Scrum of scrums/2019-02-13

2019-02-13

Callouts

• Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar
• Release Engineering: Beta Cluster and CI issues https://lists.wikimedia.org/pipermail/cloud/2019-February/000538.html
• SRE: Sunsetting Wikipedia Zero stuff (https://phabricator.wikimedia.org/T187716) is blocked by https://phabricator.wikimedia.org/T213769 (and possibly others); not urgent, but we want this done this quarter if possible.
• From Analytics: The old staging database in dbstore1002 will be set to read-only on Feb 18th. Please, use the new one in dbstore1005, thanks!
• TechCom: RFC: Re-establish the development policies https://phabricator.wikimedia.org/T190379

Audiences

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:

Editing

• Blocked by:
• Blocking:
  • Updates:

Growth

• Blocked by:
• Blocking:
• Updates:

Language

• Blocked by:
• Blocking:
• Updates:

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • In a code freeze phase for 6.2 - testing https://phabricator.wikimedia.org/tag/ios-app-v6.2-beluga-on-a-pogo-stick/
  • Preapring for 6.2.1 - bug fixes, editing tools enhancements and mobile html prototype https://phabricator.wikimedia.org/tag/ios-app-v6.2.1-beluga-on-stilts/

Android native app

• Blocked by:
• Blocking:
• Updates:

Readers Web

• Blocked by:
• Blocking:
• Updates:
  • Summary: we've transitioned the Proton PDF renderer to Readers Infrastructure for final deployment, we're continuing the Advanced Mobile Contributions project and have enabled ES6 support in MobileFrontend as part of the Architecture investment effort.

• • Responsive website (MinervaNeue / MobileFrontend):

• • • Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
      • Talk tabs disabled on main page T214724
      • Page/talk toggle v1 T212216
      • Design updates to Settings page & opt-in toggle T214195
      • Create AMC edit tag T212959

• • • Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
      • Enable Babel transpiling in MobileFrontend T202746
      • Separate lazy loading from Skin T214658
      • Migrate deprecated calls T208915
      • Group web client error reports T212970

• • • Page issues https://www.mediawiki.org/wiki/Reading/Web/Projects/Mobile_Page_Issues
      • Miscellaneous bug fixes and maintenance T212376 T212371 T214550

• • • ExternalGuidance extension review and support

• • • Miscellaneous bug fixes and maintenance T215648 T215849 T213336 T202374

• • Desktop website (Vector, Popups)

• • • Popups https://www.mediawiki.org/wiki/Page_Previews
      • WMDE reference previews review and support T67114 https://meta.wikimedia.org/wiki/WMDE_Technical_Wishes/ReferencePreviews

• • PDF rendering (Proton) https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality
    • Transitioned to Readers Infrastructure

Readers Infrastructure

• Blocked by:
  • SRE: Sunsetting Wikipedia Zero stuff (https://phabricator.wikimedia.org/T187716) is blocked by https://phabricator.wikimedia.org/T213769 (and possibly others); not urgent, but we want this done this quarter if possible.
• Blocking:
• Updates:
  • Maps: codfw cluster OS upgrade to stretch started this week with maps2004 T215521
  • App Editor Tasks infrastructure work ongoing

Multimedia

• Blocked by:
  • RelEng: Adding WikibaseMediaInfo to the gate; patch is https://gerrit.wikimedia.org/r/c/integration/config/+/480463 and needs deployment
• Blocking:
• Updates
  • working towards first release of structured data statements (depicts)
  • onboarding for 2 new hires

Parsing

• Blocked by:
• Blocking:
• Updates:

UI Standardization

• Blocked by:
• Blocking:
• Updates:

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • The replacement for dbstore1002 is in place now. Contains a queryable replica of the wiki databases distributed in 3 nodes (dbstore100[345]).
  • Up-to-date docs at: https://wikitech.wikimedia.org/wiki/Analytics/Data_access#MariaDB_replicas
  • The staging database is in dbstore1005. The old one in dbstore1002 will be set to read-only on Feb 18th. And we plan to decomission dbstore1002 in the upcoming weeks.
  • Superset can connect to the new MySQL hosts, including the staging database.

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Still testing PHP7 / MediaWiki 1.31 payments-wiki upgrade, has morphed into testing our backup cluster as well https://phabricator.wikimedia.org/T184460
  • Fixing bugs in latest CiviCRM point upgrade https://phabricator.wikimedia.org/T215802, https://phabricator.wikimedia.org/T215513
  • Updating employer matching gift import https://phabricator.wikimedia.org/T215196
  • Donor data deletion tool updates https://phabricator.wikimedia.org/T199747
  • Determining viability of ways to ask for a recurring donation after getting a one-time donation https://phabricator.wikimedia.org/T215340
  • Reducing number of emails sent to recurring donors https://phabricator.wikimedia.org/T213209
  • Creating batch fraud lookup tool https://phabricator.wikimedia.org/T199268

MediaWiki Core Platform

• Blocked by:
• Blocking:
• Updates:
  • Marko taking over coordination of Multi-DC work
  • Overview doc for Q3 code cleanup work: Q3 cleanup work: https://www.mediawiki.org/wiki/User:BPirkle_(WMF)/Code_Cleanup_FY2019_Q3
  • Publishing of Platform Evolution Goals and an Update
    • https://www.mediawiki.org/wiki/Platform_Evolution/Goals
    • https://www.mediawiki.org/wiki/Platform_Evolution/Updates/Feb_2019
  • Session Service work continues (added http metrics, syslog messages, CI tests and began documentation) https://phabricator.wikimedia.org/T206016
  • ObjectCache/Stash analysis: https://www.mediawiki.org/wiki/User:EvanProdromou/ObjectCache_use

Performance

• Blocked by:
• Blocking:
• Updates:
  • Switched from c4.large to c5.xlarge for the WebPageTest agent https://phabricator.wikimedia.org/T215167 - This means metrics id decreased since the machine is faster
  • RFC: Re-establish the development policies https://phabricator.wikimedia.org/T190379 (hoping to be on Last Call soon)
  • Reviewed ExternalGuidance Extension for Language Team https://phabricator.wikimedia.org/T214170

Release Engineering

• Blocked by:
• Blocking:
  • Multimedia: Adding WikibaseMediaInfo to the gate; patch is https://gerrit.wikimedia.org/r/c/integration/config/+/480463 and needs deployment
  • Scoring Platform: sort of because we have a work-around. https://phabricator.wikimedia.org/T212818 (LFS not mirroring to gerrit)
• Updates:
  • Beta Cluster and CI issues https://lists.wikimedia.org/pipermail/cloud/2019-February/000538.html
  • Train Health:
    • Last week: 1.33.0-wmf.16 - https://phabricator.wikimedia.org/T206670
    • This week: 1.33.0-wmf.17 - https://phabricator.wikimedia.org/T206671
    • Next week: 1.33.0-wmf.18 - https://phabricator.wikimedia.org/T206672
  • Log Health:
  • Code Health:

Research

• Blocked by: None
• Blocking: None
• Updates:
  • Links event stream is going live soon (end of week or next week):
    • https://phabricator.wikimedia.org/T214706
  • Continuing work on productionizing article recommender systems:
    • https://phabricator.wikimedia.org/T211981
  • Experimental section alignment and recommendation API:
    • https://meta.wikimedia.org/wiki/Research:Expanding_Wikipedia_articles_across_languages/Inter_language_approach#Section_Recommendation
    • https://secrec.wmflabs.org/API/alignment/es/en/Historia
    • https://secrec.wmflabs.org/API/recommendation/en/Quilombo?verbose=False&blind=False

Scoring Platform

• Blocked by:

   * Releng -- sort of because we have a work-around. https://phabricator.wikimedia.org/T212818 (LFS not mirroring to gerrit)

• Blocking:

   * Growth -- Fixing an issue with itwiki's goodfaith model (thank you Roan!) https://phabricator.wikimedia.org/T211032

• Updates:

   * Damagaing/goodfaith support for Korean Wikipedia coming soon https://phabricator.wikimedia.org/T161629
   * New ORES deployment on the way out 
* Increased fitness for English Wikipedia Draft Quality and Article Quality (T214091)
* Increased fitness for Wikidata Item Quality model (T158430)
* Reduced potential security issues (pyyaml T214159 & pickle-->json T206333) 
* New models for Spanish Wikiquote (T209784)

Search Platform

• Blocked by:
• Blocking:
• Updates:
  • Finished A/B tests for wbsearchentities profiles for FR, DE and ES: https://phabricator.wikimedia.org/T214515 - results positive
  • Removed “archive” type indexes in preparation for Elastic 6 migration: https://phabricator.wikimedia.org/T213851
  • Re-built Hebmorph analysis plugin: https://phabricator.wikimedia.org/T214439
  • Finished setting up work environment for NLP contractor: https://phabricator.wikimedia.org/T212885
  • Fixed WDQS issues where some triples had duplicated normalized value: https://phabricator.wikimedia.org/T213213
  • Working on ES 6 upgrade: https://phabricator.wikimedia.org/T183282
  • Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654
  • Working on “wrong keyboard” detection: https://phabricator.wikimedia.org/T138958
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
  • Working on moving CirrusSearch code out of Wikibase to a separate extension: https://phabricator.wikimedia.org/T190022

Security

• Blocked by:None
• Blocking:None
• Updates:T215048: waiting on code to review
  • T155537 and T156960: to be submitted for consideration for outsourcing
  • T207246: either to review in next two weeks or moved to frozen
  • T214152: review to be finished today
  • T201492: to be completed end of next week
  • T163827: to be completed end of week
  • T163827: tbd
  • T207990: tbd

Services

• Blocked by:
• Blocking:
• Updates:

Site Reliability Engineering

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • Goal work ongoing
  • eventgate being deployed this week

Wikidata

• Blocked by:
• Blocking:
• Updates:

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

Multi-Content Revisions

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: