Scrum of scrums/2019-06-26

2019-06-26

Callouts

• Release Engineering
  • All: Input greatly wished for on the "Future of CI" planning document: https://lists.wikimedia.org/pipermail/wikitech-l/2019-June/092227.html
  • Unknown team (?): wikimania-scholarships hosting needs to move to PHP7 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224906
• Research
  • Readers Web and Performance: just a heads up that QuickSurveys is running on a handful of Wikipedias starting today: https://phabricator.wikimedia.org/T226273
• SRE
  • DBAs point out that X1 primary db master failover scheduled for 3rd July: https://phabricator.wikimedia.org/T226358

Audiences

Contributors

Editing

• Blocking:
  • Performance: [12 Mar 2019] CR for Graph extension multi-dc caching. – https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Graph/+/493628/
• Updates:
  • Section editing live on mobile for all wikis
  • Mobile edit cards: Mobile Edit Cards
    • v1.0: Thursday, 20 June, Edit Cards v1.0 went live for all contributors to Bengali, Hebrew and Persian wikis using the mobile visual editor.
    • v2.0: In process

Growth

• Updates:
  • Backporting patch for wmf.10 for https://phabricator.wikimedia.org/T223142
  • Will release first iteration of Mobile Homepage Thursday https://phabricator.wikimedia.org/T225676

Language

• Updates:
  • cxserver is updated to use nodejs 10 now.
  • MT support for Italian added for ContentTranslation.

Readers

iOS native app

• Updates:
  • Finishing up 6.3 work (talk pages) (https://phabricator.wikimedia.org/tag/ios-app-v6.3-lobster-on-a-motorcycle/)
  • Preparing for a bug fix release 6.3.1 (https://phabricator.wikimedia.org/tag/ios-app-v6.3.1_lobster-on-an-orv/)

Android native app

• Updates:
  • Finishing up testing of suggested edits of structured image captions
  • https://phabricator.wikimedia.org/project/board/3959/

Readers Web

• Updates:
  • Summary: continuing ongoing development for the advanced mobile contributions project.
  • Responsive website (MinervaNeue / MobileFrontend / Portals):
    • Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
      • Add wikidata item link to AMC overflow menu
      • Allow AMC to load user contributions page from core
      • PageActions Menu should use Builder pattern and reuse existing Menu elements
      • [EPIC] AMC Navigation - user menu
      • [AMC] Updates to user pages
    • Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
      • Tasking for next year
    • Miscellaneous:
      • Decide whether we want the package-lock.json to commit or ignore
  • Planning
    • Desktop refresh design and planning

Readers Infrastructure

• Updates:
  • New PCS endpoints coming soon:
    • /page/talk
    • /page/media-list (simpler version of /page/media)

Parsing

• Updates:
  • Bulk of the porting work complete. Some odds and ends left to complete. Parsoid REST API will be layered on top of the core REST API framework. Work in progress.
  • We can now run both wt -> html and html -> wt entirely in PHP. We can also parse some large pages like enwiki:Berlin without crashers and run wt2wt with some minor bugs. But, lots of QA and testing to do
  • Next focus is on getting parsertests runner ported and get all parser tests green.

Technology

Fundraising Tech

• Updates:
  • Fixing a bug that got a bunch of contacts on our email unsubscribe list by mistake: https://phabricator.wikimedia.org/T223935
  • Core CiviCRM search performance improvements: https://phabricator.wikimedia.org/T226560
  • Reviewing code written by external contractor for CentralNotice features: https://phabricator.wikimedia.org/T225101, https://phabricator.wikimedia.org/T226344,
  • Getting forms ready for India fundraising: https://phabricator.wikimedia.org/T224514
  • Forms to ask one-time donors to upgrade to recurring: https://phabricator.wikimedia.org/T216562
  • Off-site meeting last week

Core Platform

• Blocking:
  • Performance
    • CR for ExternalStorageAccess refactor. – https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/414968/
  • Release Engineering
    • MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
    • (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
  • Performance: [17 Apr 2019] CR for ExternalStorage Access refactor. – https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/414968/ is was blocking https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/505468/ for easier maintenance.
• Updates:
  • Off-site meeting last week

Performance

• Blocked by:
  • CPT: [17 Apr 2019] CR for ExternalStorageAccess refactor. – https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/414968/
  • Search Platform: [20 June 2019] CR for core SearchEngineFactory refactor. – https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/502939/
  • Editing: [12 Mar 2019] CR for Graph extension multi-dc caching. – https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Graph/+/493628/
    • Note sure which sub-team maintains this

Release Engineering

• Blocked by:
  • Security team (already acknowledged): Make phan-taint-check-plugin work on PHP > 7.0 so we can move CI to PHP72 https://phabricator.wikimedia.org/T207344
  • Core Platform Team:
    • MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
    • (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
  • SRE:
    • ServiceOps Team:
      • Thanks to DC Ops, contint1001 now has extra drives; how do we get them mounted? https://phabricator.wikimedia.org/T207707
      • Phabricator tweak for allowing "silenced" job runs by more RelEngers https://gerrit.wikimedia.org/r/c/operations/puppet/+/517140
    • Traffic Team (low priority): https://phabricator.wikimedia.org/T213769 is blocking undeployment of Wikipedia Zero.
  • Unknown team (?): wikimania-scholarships hosting needs to move to PHP7 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224906
• Updates:
  • Train Health
    • Last week: 1.34.0-wmf.10 - https://phabricator.wikimedia.org/T220735 (derailed due to blockers)
    • This week: 1.34.0-wmf.11 - https://phabricator.wikimedia.org/T220736
    • Next week: 1.34.0-wmf.12 - NO TRAIN, WMF HOLIDAY (4 July)
  • All: Input greatly wished for on the "Future of CI" planning document: https://lists.wikimedia.org/pipermail/wikitech-l/2019-June/092227.html

Research

• Updates:
  • Reader demographics survey is running: https://phabricator.wikimedia.org/T226273
  • GSoC and Outreachy are happening.
  • Hiring.

Search Platform

• Blocked by:
  • SRE: https://phabricator.wikimedia.org/T224324
  • WMDE: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/489447 and review for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseMediaInfo/+/507627 and https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/515327
  • WMDE: WDQS UI test broken: https://phabricator.wikimedia.org/T226329
• Blocking:
  • Performance: [20 June 2019] CR for core SearchEngineFactory refactor. – https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/502939/
• Updates:
  • haslabel:* enabled: https://phabricator.wikimedia.org/T224611 though some problems on Commons
    • Try: entities without labels: https://w.wiki/5Jr
  • Report on folding diacritics in Slovak: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Folding_Diacritics_in_Slovak
  • Fixed suggested article breakage: https://phabricator.wikimedia.org/T224879
  • Deployed WDQS Sesame upgrade (https://phabricator.wikimedia.org/T200612 ), brief response format change, now restored to original order
  • WDQS now allows variable endpoint in MWAPI query: https://phabricator.wikimedia.org/T171303
  • Created WDQS reboot cookbook: https://phabricator.wikimedia.org/T224385
  • Added filtering in WDQS strings for some weird characters: https://phabricator.wikimedia.org/T225523
  • Going to remove BETA from Wikidata entity dump names: https://phabricator.wikimedia.org/T226153
  • Working on creating RDF export for SDC/MediaInfo: https://phabricator.wikimedia.org/T221917
  • Working on CirrusSearch configuration for cloudelastic: https://phabricator.wikimedia.org/T220625
  • Working on CirrusSearch query dispatcher: https://phabricator.wikimedia.org/T216429

Security

• Blocking:
  • Release Engineering (already acknowledged): Make phan-taint-check-plugin work on PHP > 7.0 so we can move CI to PHP72 https://phabricator.wikimedia.org/T207344
• Updates:
  • Backlog
    • Brian to probably hand off to Sam not started - https://phabricator.wikimedia.org/T223307
    • Exploring outsourced reviews for OIT things, rewrites, JB to follow up after new vendor budgets set stalled - https://phabricator.wikimedia.org/T155537, https://phabricator.wikimedia.org/T156960, https://phabricator.wikimedia.org/T148246, https://phabricator.wikimedia.org/T187846
    • DoubleWiki, Brian to deploy as sec release, then push through gerrit, stalled - https://phabricator.wikimedia.org/T131199
    • Audiences user-testing concept review, stalled - https://phabricator.wikimedia.org/T220043
    • Audiences growth team emails concept review, stalled - https://phabricator.wikimedia.org/T220242
  • Active
    • Waiting on update from Yurik/Vega folks (upstream) to proceed stalled - https://phabricator.wikimedia.org/T222806
    • Planet wikimedia - assigned to Michal Anna, stalled - https://phabricator.wikimedia.org/T207246
    • Wikisource ext, starting - https://phabricator.wikimedia.org/T217289
  • Waiting
    • Wikibase Termbox, completed for now, John to follow up with Raz re: risk ownership, in-progress - https://phabricator.wikimedia.org/T216419
    • Labs db/sanitarium and maintain-views.yaml audits - transition to James F for review, in-progress - https://phabricator.wikimedia.org/T169097, https://phabricator.wikimedia.org/T103011

Site Reliability Engineering

• Blocking:
  • Search platform on https://phabricator.wikimedia.org/T224324
  • Release engineering on
    • Thanks to DC Ops, contint1001 now has extra drives; how do we get them mounted? https://phabricator.wikimedia.org/T207707
    • Phabricator tweak for allowing "silenced" job runs by more RelEngers https://gerrit.wikimedia.org/r/c/operations/puppet/+/517140
    • Traffic Team (low priority): https://phabricator.wikimedia.org/T213769 is blocking undeployment of Wikipedia Zero.
• Updates:
  • DBAs point out that X1 primary db master failover scheduled for 3rd July: https://phabricator.wikimedia.org/T226358

Wikidata

• Blocking:
  • Search Platform
    • WMDE: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/489447 and review for https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikibaseMediaInfo/+/507627 and https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/515327
    • WMDE: WDQS UI test broken: https://phabricator.wikimedia.org/T226329