Scrum of scrums/2019-03-13

2019-03-13

Callouts

• Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar
• Maps incident with geoshapes service: https://wikitech.wikimedia.org/wiki/Incident_documentation/20190308-maps
• (From RI) RelEng: Review needed for deploying Extension:WikimediaEditorTasks to production (https://phabricator.wikimedia.org/T218136 )

Audiences

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:

Editing

• Blocked by:
• Blocking:
  • Updates:

Growth

• Blocked by:
• Blocking:
• Updates:

Language

• Blocked by: Several CI failures but RelEng is taking care of them. Thanks!
• Blocking:
• Updates:
  • Fixed various bugs in cxserver while ContentTranslation patches were blocked due to CI issues.
  • Manually purging old unpublished drafts from ContentTranslation. This will likely to move to cronjob in 2 weeks.

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • Working on 6.2.1 (https://phabricator.wikimedia.org/tag/ios-app-v6.2.1-beluga-on-stilts/)
    • bug fixes
    • editing enhancements

Android native app

• Blocked by:
• Blocking:
• Updates:
  • Working on the design changes of enhancing reading lists search functions.
    • Bug fixes
    • Visual changes of "Suggested edits"

Readers Web

• Blocked by:
• Blocking:
• Updates:
  • Summary: adding some features to QuickSurveys, tagging and UI changes for Advanced Mobile Contributions, and continuing the MobileFrontend Architecture investment project.

• • Responsive website (MinervaNeue / MobileFrontend):

• • • Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
      • Add history link to actions menu T213352
      • Tag Thanks actions with AMC tag T215477
      • Provide mechanism to allow dynamically tag log entries T215675
      • Add X-Analytics tag for AMC webrequests T212961
      • Cannot access user contributions when following red link to user page on mobile T201339

• • • Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture

Use the Overlay.make pattern for notification feature T217296

• • • • Refactor ImageOverlay T216198
      • Refactor TalkSectionAddOverlay T217102
      • Limit mobile.startup's mw.config variables T216848

• • • QuickSurveys
      • Consultation with Research
      • Support sampling by country T213847
      • Support sampling by edits T139317
      • Remove templates T208605
      • Revise deprecated ResourceLoader API usage T216746

• • • Miscellaneous bug fixes and maintenance T218098 T207618 T217820

• • Desktop website (Popups)

• • • Popups https://www.mediawiki.org/wiki/Page_Previews
      • WMDE reference previews review and support T67114 https://meta.wikimedia.org/wiki/WMDE_Technical_Wishes/ReferencePreviews
      • Bugfix for double pokey on some page previews T204627

Readers Infrastructure

• Blocked by:
  • SRE: Sunsetting Wikipedia Zero stuff (https://phabricator.wikimedia.org/T187716) is still blocked by https://phabricator.wikimedia.org/T213769 (and possibly others); not urgent, but we want this done this quarter if possible. (Repeat from previous weeks)
  • RelEng: Review needed for deploying Extension:WikimediaEditorTasks to production (https://phabricator.wikimedia.org/T218136 )
• Blocking:
• Updates:
  • mobile-html:
    • Changing URLs from https to be protocol independent because the iOS app can handle that better when saving for offline.
    • Removing navboxes from mobile-html DOM
  • Maps: incident with the geoshapes service https://wikitech.wikimedia.org/wiki/Incident_documentation/20190308-maps

Multimedia

• Blocked by:
• Blocking:
• Updates

Parsing

• Blocked by:
• Blocking:
• Updates:
  • Working on fast and spec-compliant HTML5 parsing and filtering (querySelector) in PHP. If you are aware of code that could benefit from this (probably anything that uses DOMDocument and related classes), please add it to https://phabricator.wikimedia.org/T218183

UI Standardization

• Blocked by:
• Blocking:
• Updates:
  • OOUI release in prep, we decide if minor or patch release, depending on ongoing work by Multimedia team and Ed:
    • Bring StackLayout, MenuLayout, Tab*Layout, IndexLayout to OOUI PHP https://phabricator.wikimedia.org/T215645
    • Quicken PHP tests
    • Make mixin configs extendable
  • Unify error and system messages https://phabricator.wikimedia.org/T127405

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • db1002 is now decommissioned, so we consider the migration of the analytics mysql replicas from the old to the new hosts complete
  • the EventLogging database in Hive is now in compliance with the data retention guidelines
  • medium refactor in MediaWiki history reconstruction job to organize code, improve performance and fix some issues
  • working on Wikistats2 metrics list to bridge the gap between Wikistats1 metric definitions and Wikistats2 interface

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Upstreamed fixes for CiviCRM
  • Reviewing audit code for main card processor to make sure we're catching everything https://phabricator.wikimedia.org/T217582
  • Fixing CentralNotice sanitization over-strictness https://phabricator.wikimedia.org/T216150
  • Better fraud attempt queries for CiviCRM https://phabricator.wikimedia.org/T199268
  • Tweaks to Thank You mail https://phabricator.wikimedia.org/T207674
  • Building notification stream for changes to active CentralNotice banners and included bits https://phabricator.wikimedia.org/T208511
  • Working on recording opt-in choices even when payment attempt fails https://phabricator.wikimedia.org/T216293
  • Still trying to coordinate timing of payments-wiki upgrade to PHP7 & MW 1.31 https://phabricator.wikimedia.org/T184460

Core Platform

• Blocked by:
• Blocking:
• Updates:
  • Encapsulate MW environment in Env class for Parsoid
  • Program for EMWCon
  • Upgrade phan to 1.2.6
  • Session storage deployment prep
  • completed T216159 (stale data/caching bug in revisions). Merged.
  • completed T202352 (MultiHttpClient+Guzzle), deployed then reverted due to bug
  • Prometheus, request IDs, Helm for Kask
  • WikiPEG to npm
  • Merged "Remove unused method Title::validateFileMoveOperation" (T214316)

Performance

• Blocked by:
  • Comms: W3C replied about communication around W3C membership announcement. Waiting for Comms to tell Gilles what they plan to do.
  • Legal:
    • W3C membership pending, Gilles provided everything Stephen asked for. Now waiting for them to go ahead with it.
    • Gilles send email asking for green light on AS perf report (Security approved on 2019-03-12)
    • Gilles filed task asking for data release review of research paper dataset
  • Language: CR for patch to reduce full table SELECTs of translate_metadata https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Translate/+/494146/
  • CPT: REVISIONID Parser optimisation/deprecation for large wikis. https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/294774/
  • Traffic:
    • Be able to distinguish between wiki and non-wiki reqs in mtail from Varnish. - https://phabricator.wikimedia.org/T202479.

    "This outcome of this task should be for the mtail/varnishrls metric collector to only apply to traffic for hosts where ResourceLoader is available, 
    so as to stop the data pollution from unrelated requests for hosts where there is not meant to be an /w/load.php entry point"

• • • Error handler on mwdebug servers not working. – https://phabricator.wikimedia.org/T217846
    • Varnish thumbnail URL deduplication patch (prerequisite to Swift auto-cleanup) https://gerrit.wikimedia.org/r/#/c/mediawiki/vagrant/+/489021/
• Blocking:
• Updates:

Release Engineering

• Blocked by:
• Blocking:
  • Language: Several CI failures
  • Readers Infrastructure: Review needed for deploying Extension:WikimediaEditorTasks to production (https://phabricator.wikimedia.org/T218136 )
  • Search Platform: Thanks RelEng for working on https://phabricator.wikimedia.org/T216689
• Updates:
  • Work progresses on CI tool evaluation https://phabricator.wikimedia.org/phame/post/view/149/work_progresses_on_ci_tool_evaluation/
  • Train Health:
    • Last week: 1.33.0-wmf.20 - https://phabricator.wikimedia.org/T206674
    • This week: 1.33.0-wmf.21 - https://phabricator.wikimedia.org/T206675
    • Next week: 1.33.0-wmf.22 - https://phabricator.wikimedia.org/T206676
  • Code Health:
    • SonarQube is available as an experimental job for all extensions https://gerrit.wikimedia.org/r/c/integration/config/+/490950

Research

• Blocked by:
• Blocking:
• Updates:

Scoring Platform

• Blocked by:
• Blocking:
• Updates:

Search Platform

• Blocked by: Thanks RelEng for working on https://phabricator.wikimedia.org/T216689
• Blocking:
• Updates:
  • New blog post: https://wikimediafoundation.org/2019/03/12/the-anatomy-of-search-a-place-for-my-stuff/
  • WikibaseCirrusSearch tested on beta & testwikidata, some bugs fixed, loaded on production, enabling soon https://phabricator.wikimedia.org/T190022
  • Blazegraph now can be tested on Jenkins CI: https://phabricator.wikimedia.org/T216855
  • Fixed Greek lowercasing, reindex pending: https://phabricator.wikimedia.org/T203117 https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Greek_and_Unexpected_Empty_Tokens
  • TextCat version update fully finished and deployed: https://phabricator.wikimedia.org/T216083
  • Improved icinga monitoring for OOM conditions in elastic cluster: https://phabricator.wikimedia.org/T76090
  • Working on ES 6 upgrade: https://phabricator.wikimedia.org/T183282
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
  • Working on moving CirrusSearch code out of Wikibase to a separate extension: https://phabricator.wikimedia.org/T190022

Security

• Blocked by:None
• Blocking:None
• Updates:
  • https://phabricator.wikimedia.org/T217289: TBD
  • https://phabricator.wikimedia.org/T216692: TBD
  • https://phabricator.wikimedia.org/T163827:complete by end of week
  • https://phabricator.wikimedia.org/T216419:start by end of week
  • https://phabricator.wikimedia.org/T211489:complete by end of week
  • https://phabricator.wikimedia.org/T201492: TBD
  • https://phabricator.wikimedia.org/T103011: TBD
  • https://phabricator.wikimedia.org/T207990:TBD

Services

• Blocked by:
• Blocking:
• Updates:

Site Reliability Engineering

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • Wrapping up on goals

TechComm

• Updates:
  • Updated Gerrit Privlege policy: https://www.mediawiki.org/wiki/Gerrit/Privilege_policy
  • On Last Call: The Great Namespaceization and Reorg https://phabricator.wikimedia.org/T166010 ending March 20 1pm PST (20:00 UTC, 21:00 CET)
  • On Last Call: RfC: Standards for external services in the Wikimedia infrastructure.https://phabricator.wikimedia.org/T208524 ending March 13 11pm PST (March 14 7:00 UTC, 8:00 CET)
  • IRC Meeting Scheduled: RFC: Add a frontend build step to skins/extensions to our deploy process https://phabricator.wikimedia.org/T199004 March 20 2pm PST (21:00 UTC, 22:00 CET) in #wikimedia-office
  • IRC Meeting Scheduled: RFC: Let's stop using QUnit as a mechanism for integration tests https://phabricator.wikimedia.org/T212521 March 20 2:45pm PST (21:45 UTC, 21:45 CET) in #wikimedia-office

Wikidata

• Blocked by:
  • none
• Blocking:
  • none (we are aware of)
• Updates:
  • Work continues on new responsive term view on items and property pages: https://phabricator.wikimedia.org/project/board/3620/
  • Preparing Server-Side Rendering service for use with the new Front End Architecture: https://phabricator.wikimedia.org/T212189
  • Work continues on Schema functionality (defining the "schema" Wikidata items of particular kind should follow): https://phabricator.wikimedia.org/project/board/3789/
  • Musical notation data type to be enabled on wikidata.org tomorrow March, 14th: https://phabricator.wikimedia.org/T216730
  • Investigating next steps to improvements in the storage layer

German Technical Wishlist

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • Rollback confirmation feature: it was already reviewed but put on hold until today, waiting for a +2, which would then be rolled out to Beta.
  • Finishing the Reference Previews feature of the Popups extension, planned for Beta rollout later: https://phabricator.wikimedia.org/T217139
  • Rolling out a bugfix release of Wikidiff2: https://phabricator.wikimedia.org/T203069

SoS Meeting Bookkeeping

• Updates: