Scrum of scrums/2021-03-24

2021-03-24

(meeting conflict with Product Platform Strategy overview)

Callouts

• RelEng: All extensions will have a buster variant of their main CI job added as voting next week. This shouldn't break anything (it's been running in production for months now), but be aware if your extension suddenly stops passing tests. https://phabricator.wikimedia.org/T252432
• SRE Service Ops:
  • Eqiad kubernetes cluster upgraded, reinitialized and fully repooled. Some Job backlog was created, it's being served though.
  • Many thanks to all the teams for having worked on https://phabricator.wikimedia.org/T274262
• RelEng: Developer satisfaction survey extended until until 2021-03-31
• RelEng: When to use train vs backports quick guide: https://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport

Gerrit patches or GitHub Pull Requests for reviews or feedback

No updates

iOS

No notes provided

Editing, Parsing, Inuka, Cloud Services, Platform, Performance, Security,

SoS Meeting Bookkeeping

• Updates:

Product

Community Tech

• Blocked by:
• Blocking:
• Thank yous:
  • Subbu and other parsoid team members for their help and support with several tasks
• Updates:
  • We'll be wrapping up WS-Export work this week and move on full-time onto the OCR Improvements wish

https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2020/Wikisource/New_OCR_tool

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Thank yous:
  • Huge thanks to David Lynch for excellent work on SecurePoll, and helping mentor our new engineers
  • Thanks to everyone who has helped with onboarding the engineers
• Updates:
  • No updates

Growth

• Blocked by:
• Blocking:
• Thank yous:
  • SRE with their continued support with the link recommendation service
  • Search for their help with indexing pages with recommendations
• Updates:
  • Continuing work on Add Link https://wikitech.wikimedia.org/wiki/Add_Link
    • Available (in its current unfinished form) via Special:Homepage on testwiki and beta cswiki now
  • Continuing to work on on-wiki configuration
  • Continuing design of mentor dashboard https://www.mediawiki.org/wiki/Growth/Mentor_dashboard
  • Deploying Growth features in opt-in mode this week to tewiki, jawiki, eowiki, nbwiki, sqwiki, hiwiki

Android native app

• Blocked by:
• Blocking:
• Thank yous:
• Updates: No big updates. Continuing our work w/ Platform Engineering Team on image recommendations - we're getting near the MVP launch date and cooperatively pruning the remaining desired API features.

Web

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • No updates. We're continuing our work on the language switcher instrumentation and A/B test

Product Infrastructure

• Blocked by:
• Blocking:
• Thank yous: From SRE Serviceops for work on https://phabricator.wikimedia.org/T274262
• Updates:

Structured Data

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • Wrapping up final work before MediaSearch goes default on Commons
  • Continuing to work on improved search profile
  • Continued discussions across teams regarding Structured Data Across Wikimedia (image recommendations API and structured content)

Abstract Wikipedia

• Blocked by:
  • None.
• Blocking:
  • None.
• Thank yous:
  • Scott B. from Security for running a great threat modelling exercise with us.
• Updates:
  • Closing on end of Phase γ: https://meta.wikimedia.org/wiki/Abstract_Wikipedia/Phases

Language

• Blocked by: None.
• Blocking: None.
• Thank yous:
  • Alexandros Kosiaris for cluster upgrades and for T278141 help.
• Updates:
  • No major updates deployed in Section Translation this week.
  • MassMessage remote wiki delivery was briefly broken. Now fixed.
  • Working on new translation variable syntax for better Parsoid support.
  • There is now a limit how big translatable pages can be moved. Working on a script to move manually pages that are too big.
  • Improving ULS language selector dialog positioning (for Web team).
  • Translatable templates are usable on translatable pages with the normal syntax for transclusion. (https://phabricator.wikimedia.org/T47096)

Library

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • Started work on making library partner's descriptions translatable
  • Getting first mock-ups of the Library redesign. They look great and we look forward to implementing them!

Vue.js

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • Onboarding our new program manager!
  • Planning for the experimental shared internal component library, both on the design front and the development side

Technology

Analytics

• Blocked by:
• Blocking:
  • SRE Service Ops on https://phabricator.wikimedia.org/T274262
• Thank yous:
• Updates:
  • mw server replacements in codfw proceeding
  • Eqiad kubernetes cluster upgraded, reinitialized and fully repooled. Some Job backlog was created, it's being served though.

Fundraising Tech

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • More work on email prefs page https://phabricator.wikimedia.org/T268510
  • Enhancements to optional employer autocomplete field (used for matching gifts)
  • CiviCRM contribution import enhancements https://phabricator.wikimedia.org/T271416, https://phabricator.wikimedia.org/T275445
  • Investigating software libraries that handle multiple payment providers https://phabricator.wikimedia.org/T277246, https://phabricator.wikimedia.org/T277245
  • Better error handling for CentralNotice invalid banner name: https://phabricator.wikimedia.org/T173782
  • Audit / reconciliation file processing improvements: https://phabricator.wikimedia.org/T277244, https://phabricator.wikimedia.org/T265545

Engineering Productivity

Quality and Test Engineering

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • "Outreachy, December 2020-March 2021" blog post by Željko Filipin https://phabricator.wikimedia.org/phame/post/view/233/outreachy_december_2020-march_2021/

Release Engineering

• Blocked by:
• Blocking:
• Thank yous:
  • Daniel Zahn on ServiceOps for Gerrit apache help!
• Updates:
  • Deployments/Covid-19 https://wikitech.wikimedia.org/wiki/Deployments/Covid-19
  • Train Health
    • Last week: 1.36.0-wmf.35 phab:T274939
    • This week: 1.36.0-wmf.36 phab:T274940
    • Next week: 1.36.0-wmf.37 phab:T278343
  • All extensions will have a buster variant of their main CI job added as voting next week. This shouldn't break anything (it's been running in production for months now), but be aware in case your extension suddenly stops passing tests. https://phabricator.wikimedia.org/T252432
  • (MediaWiki core, vendor, and skins all are already running the buster-based PHP72 job as voting in CI.)
  • Backport / config deploys vs. train patch guidance; see https://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport

Search Platform

• Blocked by:
• Blocking:
• Thank yous:
• Updates:
  • Fix Glent M2 CJK suggestion tokenization - https://phabricator.wikimedia.org/T265081
  • Add hasrecommendation: search keyword - https://phabricator.wikimedia.org/T269493
  • [Log noise] "Prefix search request was longer than the maximum allowed length." - https://phabricator.wikimedia.org/T276385
  • Create new elasticsearch cookbook that combines a plugin upgrade with a full reboot - https://phabricator.wikimedia.org/T277792
  • Update TextCat / Language ID documentation - https://phabricator.wikimedia.org/T271249
  • Unsustainable increases in Elasticsearch cluster disk IO - https://phabricator.wikimedia.org/T264053
  • selenium-daily-beta-CirrusSearch is failing - https://phabricator.wikimedia.org/T276571
  • Fix Flink Serialization Bug - https://phabricator.wikimedia.org/T276131
  • Investigate Resource Needs for Commons and Wikidata Elasticsearch indices - https://phabricator.wikimedia.org/T265914
  • Uncaught Error: Widget not found / Call to a member function getNsIndex() on null on CirrusSearch result page with internal error - https://phabricator.wikimedia.org/T277332

Site Reliability Engineering

• Blocked by:
  • Analytics on https://phabricator.wikimedia.org/T274262
• Blocking:
• Thank yous:
• Updates:

WMDE Technical Wishes

• Blocked by:
• Blocking:
• Thank yous: To WMF Analytics, especially MForns and AOtto for the code review, feedback, and many deployments on our behalf.
• Updates:
  • Currently working on the Kartographer map extension throughout prototyping week, in order to enable it on dewiki we will need to fix a bug with how map overlay content is linked to page revision.
  • Two successful deployments today: enabling bracket matching for group0 wikis and wikitech, and an update to syntax highlighting colors everywhere.

Cross-cutting

• Blocked by:
  • [long term] Search Platform: PHP 8.0 work is long-term blocked on the migration to ElasticSearch 7.0 https://phabricator.wikimedia.org/T263142 (or at least 6.7)
• Blocking:
  • None?
• Thank yous:
  • Daimona for their continued work on phan tooling.
  • Antoine from RelEng for support on the stretch -> buster CI migration.
• Updates:
  • PHP 8.0 work is focussed on helping upstream provide forwards and backwards compatibility in Elastica-related PHP code; this is theoretically the last upstream blocker to PHP 8.0.
  • CI tools' upgrade status: https://libraryupgrader2.wmcloud.org/status?branch=master