Scrum of scrums/2017-08-02

2017-08-02

contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Callouts

• Android App: We are investigating user reports of reading list pages saved for offline not functioning correctly; trying to reproduce issues.
• German Technical Wishlist: Wikidiff2 patches about moved paragraphs need review: https://phabricator.wikimedia.org/T146781
• Tech Ops: Still ongoing issues with pdfrender getting stuck https://phabricator.wikimedia.org/T159922
• Scoring Platform: Large file support in git: subscribe to this task if you might have similar requirements! https://phabricator.wikimedia.org/T171758

Audiences

Readers

Web

Starting work on new page summary API Desktop print styles

iOS native app

• Blocked by: none
• Blocking: none
• Updates: 5.6.0 (Reading themes, on this day) final bug fixes & polish, submit to App Store on Friday 8/4

Android native app

• Blocked by: n/a
• Blocking: n/a
• Updates:
  • Cookie release work is all in QA/design review – https://phabricator.wikimedia.org/project/view/2763/
    • We are investigating user reports of reading list pages saved for offline not functioning correctly; trying to reproduce issues. Want to nail this down before the release.
  • Offline compilations MVP client-side work is nearly complete – https://phabricator.wikimedia.org/project/view/2833/
    • Work on file generation and storage is underway (https://phabricator.wikimedia.org/T170843 )
  • One engineer is newly hired, one more offer still to be made; PM search is in progress

Reading Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • Extracting structured reference lists (JSON).
  • Fixing pronunciation parsing.
  • Gergo on vacation until Wikimania

Discovery (maps)

• Blocked by: none
• Blocking: none
• Deploying mapframe/maplink to four more wikis that the community has requested
• Progressing with reloading test server

Community tech

Updates:

• Human-readable sections merged, wikitech-l announcement today
• CodeMirror and LoginNotify hopefully deploying soon
• Started work on GlobalPreferences and ArticleCreationWorkflow

Not blocking and not blocked

Contributors

Global Collaboration

Language

• No blockers.
• Niklas looking at, T170591. See: https://phabricator.wikimedia.org/T170591#3492148
• Update:
  • cxserver's adaption changes merged; deploy pending.
  • CX-VE work continue.

Collaboration

• Updates
  • RCFilters
    • Filter duplicates when filtering for multiple tags
  • RCFilters: Improve loading animation
    • Make 'related links' collapsible
    • Create a sticky preference for days/limit groups
    • Allow setting a new query as default
    • Ability to page through the results in the new UI
    • Some bug fixes
• Blocking
  • Flow dumps - https://phabricator.wikimedia.org/T172025

Parsing

• Language Converter support code in Parsoid was deployed y'day -- the second part of rendering a page in the desired language variant is the next part in development
• Going to be publishing weekly linter count change stats on wiki -- https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy/Linter/Stats/July31 for example
  • Weekly plug :-) if you are an editor on a wiki, please help fix these high-priority linter issues on your home wiki.

UI Standardization

• Updates:
  • OOjs UI: v0.22.4 released, among changes:
    • (continued from last week): Further aligning OOjs UI with WikimediaUI Base
      • WikimediaUI theme: Directly use the Less values from WikimediaUI Base (James D. Forrester)
    • Accessibility FieldsetLayout: Use `<legend>` now that Chrome 55 bug is less important (James D. Forrester)
    • Apex theme: Introduced focus states on all widgets as accessibility/UX improvement
    • WikimediaUI theme: Work around a Firefox rendering bug for checkboxes and radios (Bartosz Dziewoński)

Wikidata

• Further improvements on the Query Service UI: https://phabricator.wikimedia.org/T170279
• Preparing for Wikimania: cleaning up Lexeme demo data, widgets, and design.

German Technical Wishlist

• Blocked by:
  • Waiting for C++ reviews of the wikidiff2 patches for changes in moved paragraphs https://phabricator.wikimedia.org/T146781
    • the plan is to get at least +1s and then poke Tim
    • https://gerrit.wikimedia.org/r/#/c/356582
    • https://gerrit.wikimedia.org/r/#/c/319866

Technology

Search Platform

• Blocked by: none
• Blocking: none
• Updates:
  • Continuing work on ML-assisted ranking
  • Working on A/B test with interleaving search results (https://phabricator.wikimedia.org/T150032 )
  • Vietnamese analyzer will be re-evaluated after upstream bugfixes (https://phabricator.wikimedia.org/T170423 )
  • Archive search enabled everywhere (https://phabricator.wikimedia.org/T163235 ), needs bugfix (https://gerrit.wikimedia.org/r/#/c/369696/ )
  • Wikidata prefix search with Elastic testing continues, some feedback received & processing (test: http://elastic-wikidata.wmflabs.org/wb.html, announcement: https://lists.wikimedia.org/pipermail/wikidata/2017-July/010964.html )
  • Trey published docs for tools used to analyze language analysers: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Analysis_Analysis_Tools

Services

• Blockers: none
• Updates:
  • Will truncate stored HTML soon to free up space for Cassandra 3 migration
    • No disruptions for VE
    • A bit elevated latencies for some time
  • Testing new data model in the RESTBase-dev cluster. Please ignore alerts from it
  • Recommendation service API going public tomorrow
  • Low team availability next week due to Debconf

Technical Operations

• Blocked by:
  • Flow dumps speedup still blocked on revision content retrieval issue, https://phabricator.wikimedia.org/T172025
  • Still ongoing issues with pdfrender getting stuck https://phabricator.wikimedia.org/T159922
• Blocking:
• Updates:
  • Wikidata and dewiki read only for 1hour+ https://wikitech.wikimedia.org/wiki/Incident_documentation/20170728-s5_(WikiData_and_dewiki)_read-only

Fundraising Tech

• CentralNotice: working on clone campaign feature, fixed a couple little bugs
• Working on generic script to clear up stranded payments
• Loading ever more mailing data into Civi from our 3rd party bulk mailer
• Continuing work on API update for our main credit card processor
• Also updating our audit parser for the same processor

Scoring Platform

• Blocked by:
  • Note git-fat is still a long-term blocker, and some solutions are being discussed.
• Blocking others:
  • Mention that we're trying to resolve our blocker to using the new ORES server cluster, by doing stress tests to estimate capacity. When we're done, the celery workers will be moved off of SCB nodes
• Updates:
  • Revscoring 2.0 is coming -- going break ORES "model_info" JSON structure & add new functionality
    • Will be deployed on labs before in prod, so code can be updated and tested
    • Announcement coming -- probably during Wikimania
    • "Thresholds" is something Roan knows about

Security

• Reviews
  • vue.js
  • Kartography extension
  • review of tables replicated to sanitarium