Scrum of scrums/2019-07-10

2019-07-10

Product

Contributors

Editing

• Updates:
  • VE as mobile default A/B test started on July 9th, delayed from original plan due to data instrumentation issues
  • Improved transaction system in VE by more robustly handling (squashing) multiple transactions at once: https://phabricator.wikimedia.org/T188026
  • Preparing release of next version of edit cards on mobile and improved toolbar work

Readers

iOS native app

• Updates:
  • 6.3 to be released soon (talk pages, media/link flows in Editor) (https://phabricator.wikimedia.org/project/view/3890/)
  • Active development for bug fix release 6.3.1 (https://phabricator.wikimedia.org/project/view/4092/)

Android native app

• Updates:
  • Switched over suggested-edits queries to production API. Ready to release feature to Beta. (https://phabricator.wikimedia.org/project/view/3959/ )
  • Android app is ready for a new release with image caption editing feature. We are currently testing before the big release.
  • We also had a minor high-impact bug fixes release, which has helped improve the editing on the app.

Readers Web

• Updates:
  • Summary: continuing development of the advanced mobile contributions and MobileFrontend architecture projects.
  • Responsive website (MinervaNeue / MobileFrontend / Portals):
    • Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
      • Update notifications icon (AMC & non-AMC)
      • [EPIC] AMC Navigation - user menu
      • [AMC] Updates to user pages
    • Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
      • Tasking for next year
      • Remove Page's View functionality
      • [EPIC] Proposal: abandon use of template partials in MobileFrontend for components within components e.g. Button, Icon and Anchor classes
      • MFA: Create Notifications filter overlay using modern techniques
    • Miscellaneous:
      • Update MobileFrontend-npm-run-lint-modules-docker to run node10
      • BUG: Notifications tray (mobile) - margins and borders
      • [Bug] Notification counts broken on mobile
      • Regression: Download icon doesn't download images
      • Update page issues folder structure
      • Split up reset.css rules to specific element selectors only where needed and remove file altogether
      • Use a clearly intended height on MinervaNeue header
      • Not possible to configure Minerva main menu to use Special:RandomRoot instead of Special:Random
  • Browser tests:
    • Rewrite disabled MobileFrontend browser tests to phpunit tests and Node.js browser tests
  • Planning
    • Desktop refresh planning

Readers Infrastructure

• Updates:
  • The /page/mobile-html endpoint is ready to be consumed. Please give feedback, esp. if you see anything that needs to be changed.
  • Structured talk page endpoint launched in the REST API
  • SDC caption and Wikidata description edit suggestions endpoints launched in the REST API
  • Machine vision middleware project in progress: https://www.mediawiki.org/wiki/Wikimedia_Product/Machine_vision_middleware

Multimedia

• Updates:
  • preparing for release of arbitrary statements to production commons

Parsing

• Updates:
  • Heads up for Services: https://phabricator.wikimedia.org/T226931 and https://phabricator.wikimedia.org/T217540 -- Kiwix filed this about reparsing support for renames / deletions of images. But this is not necessarily Kiwix specific since presumably apps will also see stale versions without Parsoid reparses. Change Propagation support seems to be missing for these events.
  • Parsoid-PHP Port:
  • Porting parser tests infrastructure so we can run parser tests in PHP instead of relying on JS+PHP hybrid testing as we have till now.
  • Starting to port the rest of the mocha tests.
  • Setting up more CI tests to prevent regressions.

Technology

Fundraising Tech

• Updates:
  • About to start testing India donation forms
  • Updating remaining python2 tools to python3
  • CiviCRM <-> third party emailer data interchange enhancements
  • More work to tweak fraud filters
  • Recurring conversion ask still underway

Core Platform

(N/A for Scrum of Scrums, will follow up on blockers here)

• Blocking:
  • Performance
    • {{PAGEID}} optimization; https://gerrit.wikimedia.org/r/519352
    • vary-revision-sha1 patches; https://gerrit.wikimedia.org/r/520721 & https://gerrit.wikimedia.org/r/519574
  • Release Engineering
    • (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
    • MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
• Updates:
  • mod to central auth to allow separate session storage
  • Update test.wikipedia.org to use Kask

Engineering Productivity

Performance

• Blocked by:
  • SRE (Ops): mcrouter misconfigured (multi-dc broadcasts should be async, not sync) https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/492948/
  • CPT:
    • {{PAGEID}} optimization; https://gerrit.wikimedia.org/r/519352
    • vary-revision-sha1 patches; https://gerrit.wikimedia.org/r/520721 & https://gerrit.wikimedia.org/r/519574
• Updates:
  • resourceloader
    • startup size reduced by 4K, impact from "EventLogging lightweight" project with @Analaytics last quarter, now seen in production.
    • resourceloader: CR for various patches. Fomafix is awesome.
    • resourceloader: CR for multi-dc prep of module_deps database storage (migrate from db stable to stash).
  • Moving things off of $wgMainStash (T227376)
    • https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/520964, https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/520965/, https://gerrit.wikimedia.org/r/521019, https://gerrit.wikimedia.org/r/521020, https://gerrit.wikimedia.org/r/521017, https://gerrit.wikimedia.org/r/521014

Release Engineering

• Blocked by:
  • Core Platform Team:
    • (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
    • MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
• Blocking:
  • Security team: We need to fix the ast availability in CI images to allow phan-seccheck upgrades https://phabricator.wikimedia.org/T227385
• Updates:
  • Train Health
    • Last week: 1.34.0-wmf.12 - NO TRAIN, WMF HOLIDAY (4 July)
    • This week: 1.34.0-wmf.13 - https://phabricator.wikimedia.org/T220738
    • Next week: 1.34.0-wmf.14 - https://phabricator.wikimedia.org/T220739
  • All: Input greatly wished for on the "Future of CI" planning document: https://lists.wikimedia.org/pipermail/wikitech-l/2019-June/092227.html
  • bd808/Niharika: FYI, we've moved CI for wikimania-scholarships to only test in PHP72 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224906

Search Platform

• Updates:
  • Fixed errors on links with broken UTF-8 URLs: https://phabricator.wikimedia.org/T227098
  • Created data pipeline workflow for glent method 0: https://phabricator.wikimedia.org/T216783
  • Did some capacity planning for ElasticSearch: https://phabricator.wikimedia.org/T221121
  • Some troubles reindexing wikidata: https://phabricator.wikimedia.org/T227136
  • Working on creating RDF export for SDC/MediaInfo: https://phabricator.wikimedia.org/T221917
  • Working on CirrusSearch configuration for cloudelastic: https://phabricator.wikimedia.org/T220625
  • Working on CirrusSearch query dispatcher: https://phabricator.wikimedia.org/T216429

Security

• Blocked by:
  • Release Engineering: We need to fix the ast availability in CI images to allow phan-seccheck upgrades https://phabricator.wikimedia.org/T227385
• Updates:
  • Backlog
    • John to explore funding of 3rd party audits this quarter stalled - https://phabricator.wikimedia.org/T155537, https://phabricator.wikimedia.org/T156960, https://phabricator.wikimedia.org/T148246, https://phabricator.wikimedia.org/T187846** Concept Review for the machine vision, new, to be assigned - https://phabricator.wikimedia.org/T227591
    • Parsoid-PHP, new, not quite ready for review, to be assigned - https://phabricator.wikimedia.org/T227209
  • Active
    • Page Content Service route /page/mobile-html, started - https://phabricator.wikimedia.org/T227114
    • Security review of WebAuthn library dependencies, started - https://phabricator.wikimedia.org/T227244
    • Doublewiki (old), started - https://phabricator.wikimedia.org/T131199
    • Sec review of steward userJS, started - https://phabricator.wikimedia.org/T227221
    • CentralNotice Code Review request, assigned to Sam starting - https://phabricator.wikimedia.org/T226963
    • Planet wikimedia - assigned to Michal Anna, stalled - https://phabricator.wikimedia.org/T207246
  • Waiting
    • Waiting on update from Yurik/Vega folks (upstream) to proceed stalled - https://phabricator.wikimedia.org/T222806
    • John and Scott to follow up with Raz re: risk ownership in-progress - https://phabricator.wikimedia.org/T216419
    • Labs db/sanitarium and maintain-views.yaml audits - transition to James F for review in-progress - https://phabricator.wikimedia.org/T169097, https://phabricator.wikimedia.org/T103011
  • Frozen (delayed indefinitely)
    • Audiences user-testing concept review, stalled - https://phabricator.wikimedia.org/T220043
    • Audiences growth team emails concept review, stalled - https://phabricator.wikimedia.org/T220242
    • PageForms review from a long time ago, will post closure note next week, stalled - https://phabricator.wikimedia.org/T149869

Site Reliability Engineering

• Blocking:
  • Performance: mcrouter misconfigured (multi-dc broadcasts should be async, not sync) https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/492948/
• Updates:
  • Goal planning in process, reach out to us if you have requests on SREs

TechCom

• Updates:
  • IRC meeting moved to July 17 in #wikimedia-office Abstract schemas and schema changes: https://phabricator.wikimedia.org/T191231 (note new time/date: July 17 2019 14:00 UTC/16:00 CEST/06:00 PDT)