Scrum of scrums/2018-06-27

Callouts

• Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar :
  • 2018-07 es, 2018-07-09 to 2018-11-11 de, 2018-07-01 to 2018-11-31 en, 2018-07-10 to 2018-12-31 de, no, he, fr, nl, da, pl, ru, uk, pt, lv, ru, ro, sk, hu, en, fr, de, zh, es
• Multi-Content Revisions: revision storage / page update rewrite (T174024, T174038) goes live this week, RfC on further page update changes today (T198075)

Audiences

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:

Android native app

• Blocked by:
• Blocking:
• Updates:
  • Multi-language support now in production

Readers Web

• Blocked by:
  • Ruby to JS Cucumber refactor needs help from the RelEng team to fix our flaky Ruby tests: https://phabricator.wikimedia.org/T190710
• Blocking:
• Updates:
  • Mobile website (MinervaNeue / MobileFrontend):
    • Improvements to diff T197491 T197581
    • Improvements to page issues T197728 T191303
    • Investigating parser cache pollution T173949
    • Miscellaneous fixes and improvements T196947 T156186 T197273 T192725 T190549 T193517
    • Mobile navigation for advanced contributors is in planning and design https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
  • Desktop website (Popups):
    • Miscellaneous fixes and improvements T192928 T193792 T196952 T193519
  • PDF rendering (Proton):
    • Miscellaneous fixes and improvements to concurrency and queue management T186748 T186748 T186748
    • Investigating grave kerning and spacing issues T178665
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

• Blocked by: Ping RelEng for CI patch review: https://gerrit.wikimedia.org/r/#/c/integration/config/+/442126/
• Blocking:
• Updates:
  • Wikipedia Reading Lists extension for Safari is ready for release
  • Integration of Wikimedia Page Library in the Page Content Service is in progress — see https://gerrit.wikimedia.org/r/#/q/topic:page-lib2+(status:open+OR+status:merged)
  • Maps infrastructure handoff updates:
    • Validated loading documentation on Wikidata for new map styles (though that work is on hold)
    • TODO: Validate loading docs for existing styles on Stretch in preparation to upgrade the maps servers to Stretch (currently running Jessie); pending https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/442258/
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra
  • Increase code sharing of client apps by coalescing and moving more logic to the server
    • Reading Infra depends on Parsing, Services

Maps

• Blocked by:
• Blocking:
• Updates:
  • Planning on reimaging test servers to see if there are any issues running on stretch

Multimedia

• Updates
  • Work is progressing but tied up in administrative stuff to some extent
  • Search interface prototyping currently so users can search by Wikibase properties/values
  • Also continuing work on search backend
• Quarterly goal dependency update:
  • Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia, SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 2.1 Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia
  • Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
    • Research depends on Multimedia

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:
  • Nothing new to report

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:

Editing

• Blocked by:
• Blocking:
  • Updates:

Parsing

• Blocked by:
• Blocking:
• Updates:
  • Language variants endpoint in production -- selectively exposed for some languages by the REST API on the RESTBase end.
  • Tidy -> RemexHtml on track for July 5th completion
• Quarterly goal dependency update:
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
  • Increase code sharing of client apps by coalescing and moving more logic to the server
    • Reading Infra depends on Parsing, Services
  • Outcome 2: Objective 1: Revision storage scaling
    • Services depends on SRE, Parsing

Collaboration

• Blocked by:
• Blocking:
• Updates:

Language

• Blocked by: Editing: https://phabricator.wikimedia.org/T196136 (and T191011)
• Blocking:
• Updates:
  • Continue work on ContentTranslation v2.
  • CX draft purge dry-run this week, actual run next week (Monday)
• Quarterly goal dependency update:
  • Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
    • Language depends on Editing

Audiences Design

UI Standardization

• Blocked by:
• Blocking:
• Updates:
  • OOUI – v0.27.4 special release last Thu https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.27.4
    • 3 style, 16 code and 2 accessibility improvements. Highlights:
      • Refactor how we apply `display: none` to unused icons and indicators (Bartosz Dziewoński)
      • FieldLayout: Add `for` attribute to inline help label (Prateek Saxena)
      • PopupWidget: Listen to 'click' for 'mousedown' events in iOS (Moriel Schottlender)
      • styles: Remove proprietary IE 8 & 9 `-ms-filter` properties (Volker E.)
  • Continuing work on Design Style Guide

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • New UI work on wikistats. Bookmarks for graphs are deployed, see for example new registered users for Arabic wikipedia: https://stats.wikimedia.org/v2/#/ar.wikipedia.org/contributing/new-registered-users/normal%7Cbar%7C2-Year~2016050100~2018061900%7C~total
  • Looks like we might be able to move forward in the outstanding privacy conversation of what to do with AppInstallID (the token that identifies wikipedia app install on a phone)
  • We will be working with security to do a threat model of analytics infrastructure next quarter
  • JSONSchema vs Avro RFC submitted for Modern Event Platform program: https://phabricator.wikimedia.org/T198256

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Off-site this week with the advancement teams

MediaWiki Platform

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 1.1 Assist with deploying MultiContent Revisions on Commons

T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions

• • • SDC depends on MediaWiki Platform, WMDE

Performance

• Blocked by:
  • None
• Blocking:
  • SRE (Aaron has work to do to finish the mcrouter rollout, everyone is aware)
• Updates:
  • Offsite last week
  • Nifty blog post: https://techblog.wikimedia.org/2018/06/22/mobile-web-performance-the-importance-of-the-device/
  • Updating some dashboards to tighten down alerts
  • Perf perception survey continues
  • Continuing to split out mediawiki base to push jQuery load back, expect that to land this week sometime

Release Engineering

• Blocked by:
• Blocking:
  • readers web
  • will review https://gerrit.wikimedia.org/r/c/integration/config/+/442126
• Updates:
  • FYI: Release Engineering will start including Europeans in our train rotation meaning that the MW Train will now include European appropriate windows for those weeks. Exact schedule TBA to wikitech-l@, ops@, engineering@, and @wikitech-ambassadors@
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Research

• Blocked by:
• Blocking:
• Updates:
  • Added Arabic and RLT support to the Gapfinder tools project.: http://gapfinder-tools.wmflabs.org/
  • Done with training models for translation recommendation: https://github.com/wikimedia/research-translation-recommendation-models/
  • Collecting data for Schema:CitationUsage starting tomorrow.
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
    • Research depends on Multimedia

Scoring Platform

• Blocked by:
• Blocking:
• Updates:

Search Platform

• Blocked by:
• Blocking:
• Updates:
  • Added analysis chain for Mirandese: https://phabricator.wikimedia.org/T197890
  • Finished analysis chain for Esperanto: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Esperanto_Stemmer_Analysis
  • Added Lexeme to instant indexing setup: https://phabricator.wikimedia.org/T196896
  • Fixed a number of bugs in WDQS MWAPI: https://phabricator.wikimedia.org/T197495 https://phabricator.wikimedia.org/T197496
  • Started preparation to upgrade to ElasticSearch 6.3: https://phabricator.wikimedia.org/T198067
  • Working on Lexeme fulltext search: https://phabricator.wikimedia.org/T196188
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • *Objective 2.1 Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia

Security

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services

Services

Not attending in person today

• Blocked by: none
• Blocking: none as we know
• Updates:
  • JobQueue migration completed. No need for Redis queue any more, so far so good
  • Language variants support in REST API is coming soon, working with clients to
• Quarterly goal dependency update:
  • Increase code sharing of client apps by coalescing and moving more logic to the server.
    • Reading Infra/Parsing, Services
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services

Outcome 2: Objective 1: Revision storage scaling

• • • Services depends on SRE, Parsing

Site Reliability Engineering

• Blocked by:
  • None
• Blocking:
  • Readers web on proton. Should be unblocked this week.
• Updates:
  • Back from SRE offsite, no updates
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra
    • The service is after some changes done this and last week seems in a better shape to withstand the monitoring load. Next step is to pool it in LVS and make it available.
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Outcome 2: Objective 1: Revision storage scaling
    • Services depends on SRE, Parsing

Wikidata

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 1.1 Assist with deploying MultiContent Revisions on Commons
    • T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions
    • SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

Multi-Content Revisions

• Blocked by:
• Blocking:
• Updates:
  • page update / revision storage refactoring goes live this week:
    • https://gerrit.wikimedia.org/r/c/mediawiki/core/+/405015
    • https://gerrit.wikimedia.org/r/c/mediawiki/core/+/406595
    • https://gerrit.wikimedia.org/r/c/mediawiki/core/+/416465
  • RfC on future steps of page update refactoring today: https://phabricator.wikimedia.org/T198075
  • new revision schema will be enabled on beta soon (this week or next): https://phabricator.wikimedia.org/T197818

SoS Meeting Bookkeeping

• Updates: