Scrum of scrums/2019-09-04

2019-09-04

Callouts

• SRE DBAs call your attention to:
  • Several MW master failover (s2, s3, s4, s8) scheduled, with read only windows, check the days and affected wikis at https://phabricator.wikimedia.org/T230788
  • M1 (etherpad) primary master failover scheduled for 10th Sept at 16:00 UTC: few seconds of read-only expected https://phabricator.wikimedia.org/T231403
• WMDE continues to ask for help in figuring out the responsible party for the graphoid service (see Stewardship request https://phabricator.wikimedia.org/T211881). The graphs linking to Wikidata query are still not working: https://phabricator.wikimedia.org/T226250
• Release Engineering - REMINDER: We're at 1.34.0-wmf.21 this week. The last branch for this release will be wmf.25 on 30 September. Teams who want to ship things for MW 1.34 should land them now.

Product

Contributors

Editing

• Updates:
  • Summary: Wrapping up our work on improving mobile VE, so that we can pivot towards improving talk pages. Improvements include:
    • First version of improved toolbar deployed to all wikis (T211789)
    • Newest version of edit cards deployed on all wikis (T221247)
    • Refactored VE save error handling in a way that can also be used in other tools that currently have poor messaging (e.g. mobile wikitext editor) (T229532)
    • Improved the transitions on mobile when loading wikitext editor or switching between editors (T228159)

Growth

• Blocked by:
  • Search Platform, we need https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CirrusSearch/+/533528 resolved for our feature work https://phabricator.wikimedia.org/T231506
• Updates:
  • Summary: Next up for the team is to work on newcomer task recommendations. We plan to use maintenance templates to find tasks, and then to match them to newcomers' topics of interest. We'll use the welcome survey to understand what the user is trying to accomplish, to tailor the call-to-action on the homepage to their needs.
  • Deployments this week:
    • git #3a0738e5 - Homepage: Transit mobile overlay HTML as HTML, not JSON
    • git #05b3aefe - Mobile homepage: Lazy-load RL modules with only one request
    • git #4aca04d7 - Homepage: Restructure mobile overlay handling (task T229271)
    • git #b0142ef - [MW core] Special:Contributions: Drop 'newbies' feature (task T220447)

Readers

iOS native app

• Blocking:
  • CorePlatform for wikidiff PR
• Updates:
  • Development on 6.4 release https://phabricator.wikimedia.org/tag/ios-app-v6.4-seamonkey-on-a-hoverboard/
    • iOS13/iPadOS updates
    • New loading screen
    • Bug fixes
  • 6.5 release history & diffs API discussions with CorePlatform (https://phabricator.wikimedia.org/tag/ios-app-v6.5/)
    • Diff engine PR soon (https://phabricator.wikimedia.org/T228794)
  • Engineers out at conference beginning of next week (Sept 8 - 10)

Android native app

• Updates:
  • Development of Suggested Edits v3 (updates to the user contributions screen) https://phabricator.wikimedia.org/T228845
  • Solidifying our requirements for mobile-html endpoint(s), and researching optimizations.

Product Infrastructure

• Updates:
  • Maps: Security fix on OSM DB info leak T231842
  • Machine Vision: Will request DBA and security readiness reviews once T230811 is resolved
  • PCS/MCS: working on first paint performance before full release of mobile-html endpoint
  • Client Event Logging - BUOD: to complete event library MVPs for browser, iOS, Android this week

Structured Data

• Blocking:
  • Search Platform: RecentChange support for SDC: https://phabricator.wikimedia.org/T230862
• Updates:
  • working on suggestions for statements based on machine vision (with PI)
  • working on supporting new datatype for statements

Parsing

• Updates:
  • Parsoid/PHP parser tests green
  • Running wt->html->wt roundtrip tests on scandium and fixing bugs and crashers
  • Work in progress to get Parsoid/PHP deployed to beta cluster

Technology

Analytics

• Blocking:
  • Search Platform: Point discovery dashboards at SearchSatisfaction eventlogging table https://phabricator.wikimedia.org/T229882

Fundraising Tech

• Blocked by:
  • Release Engineering? failure on https://gerrit.wikimedia.org/r/534222 seems spurious: Quibble says 'Dependencies that do not exist' for ext.eventLogging
• Updates:
  • CiviCRM upgrade prep & upstreaming of local performance hacks https://phabricator.wikimedia.org/T228826
  • Payments form tweaks
    • backup card processor for Ireland https://phabricator.wikimedia.org/T230621
    • labels instead of placeholder text https://phabricator.wikimedia.org/T169795
    • another bank transfer method for India https://phabricator.wikimedia.org/T230170
    • CSS cleanup https://phabricator.wikimedia.org/T231391
  • Confirmation email for one-time to recurring conversion https://phabricator.wikimedia.org/T228162
  • CentralNotice
    • Looking into latest CN <-> Translate Extension mal-interaction: https://phabricator.wikimedia.org/T231703
    • One more round of review & fixes for campaign fallback https://phabricator.wikimedia.org/T226344
    • Fixing EventLogging based banner stats (blocked on CI?): https://phabricator.wikimedia.org/T231404

Core Platform

• Blocked by:
  • iOS native app - wikidiff PR
• Blocking
  • Search Platform: RecentChange support for SDC: https://phabricator.wikimedia.org/T230862
  • Release Engineering: MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
  • Wikidata - Not really certain by who exactly (Core Platform): not a critical blocker at this point, but we'd appreciate some input/triaging on the issue with authentication (CentralAuth) on Wikideta when switching between desktop and mobile views: https://phabricator.wikimedia.org/T225814
• Updates:
  • History REST API https://phabricator.wikimedia.org/T231338
  • THANKS to SRE for unblocking Kask https://phabricator.wikimedia.org/T229697
  • Continued development of API integration tests

Engineering Productivity

Performance

• Updates:
  • resourceloader: New Grafana dashboard providing insight into JS startup cost for extensions. – https://grafana.wikimedia.org/d/BvWJlaDWk/startup-module-size

Release Engineering

• Blocked by:
  • Core Platform Team: MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
• Blocking:
  • Fundraising: failure on https://gerrit.wikimedia.org/r/534222 seems spurious: Quibble says 'Dependencies that do not exist' for ext.eventLogging
• Updates:
  • REMINDER: We're at 1.34.0-wmf.21 this week. The last branch for this release will be wmf.25 on 30 September. Teams who want to ship things for MW 1.34 should land them now.
  • Train Health
    • Last week: 1.34.0-wmf.20 - https://phabricator.wikimedia.org/T220745
    • This week: 1.34.0-wmf.21 - https://phabricator.wikimedia.org/T220746
    • Next week: 1.34.0-wmf.22 - https://phabricator.wikimedia.org/T220747

Search Platform

• Blocked by:
  • Core Platform (or Structured Data?): RecentChange support for SDC: https://phabricator.wikimedia.org/T230862
  • Site Reliability Engineering: dumpRDF for MediaInfo entities loads each page individually: https://phabricator.wikimedia.org/T222497
  • Analytics: Point discovery dashboards at SearchSatisfaction eventlogging table

https://phabricator.wikimedia.org/T229882

• Blocking:
  • Growth - we need https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CirrusSearch/+/533528 resolved for our feature work https://phabricator.wikimedia.org/T231506
• Updates:
  • Reenabled sanity checks on production elasticsearch servers to finalize the import of production to cloudelastic (https://phabricator.wikimedia.org/T231194 )
  • Investigated GC issues on cloudelastic machines (https://phabricator.wikimedia.org/T231517), found a workaroung for now, did not clearly identify the root cause yet
  • Added a new "morelikethis" keyword: similar to morelike but combinable with other search keywords (https://phabricator.wikimedia.org/T159321 )
  • create_timestamp sort criteria in the search API is properly working on all wikis (context: https://phabricator.wikimedia.org/T195071)
  • Glent suggestions finalized and ready to be tested ("Did you mean" suggestions)

Security

• Updates:
  • Security Review For Parsoid-PHP will be actively worked on over next few weeks: https://phabricator.wikimedia.org/T227209
  • Security Review For MediaWiki REST API infrastructure will be actively worked on over next few weeks: https://phabricator.wikimedia.org/T230140
  • Currently trying to wrap up DoubleWiki: https://phabricator.wikimedia.org/T131199
  • Currently trying to wrap up PCS mobile review: https://phabricator.wikimedia.org/T227114
  • In progress: https://phabricator.wikimedia.org/T227244

Site Reliability Engineering

• Blocking:
  • Search Platform: dumpRDF for MediaInfo entities loads each page individually: https://phabricator.wikimedia.org/T222497
• Updates:
  • SRE DBAs call your attention to:
    • Several MW master failover (s2, s3, s4, s8) scheduled, with read only windows, check the days and affected wikis at https://phabricator.wikimedia.org/T230788
    • M1 (etherpad) primary master failover scheduled for 10th Sept at 16:00 UTC: few seconds of read-only expected https://phabricator.wikimedia.org/T231403

Wikimedia DE

Wikidata

• Blocked by:
  • Not really certain by who exactly (Core Platform): not a critical blocker at this point, but we'd appreciate some input/triaging on the issue with authentication (CentralAuth) on Wikideta when switching between desktop and mobile views: https://phabricator.wikimedia.org/T225814