Scrum of scrums/2016-08-31

Product

Reading

Reading Web

• Current sprint:
  • Fixing lazy loaded images bugs (ex: mathml formulas)
  • Diagnosed problem with hovercards EL data. Will submit fix next sprint
  • Train blocked and unblocked on MediawikiServices introduction on MobileFrontend

• Next sprint:
  • Carry on work on footer work and lazy loaded images work
  • Related pages improvements
  • Shipping wikidata descriptions in mobile web to some wiki

Mobile Content Service (MCS)

• Plus symbol in title fix work in progress
  • blocked on issue with url fragments (e.g. /wiki/[title]#[section])
• Trending service standup ongoing, some field renaming work, probably better to move from rcstream to ChangeProp
• Likely 'On this day' service work to start in next several weeks

Android native app

Current sprint: https://phabricator.wikimedia.org/project/view/2178/

• continuing navigation overhaul; forecasting to have it complete this sprint.
• made an 'interim' release to production, with some Feed features that were most requested by users.

Next sprint:

• planning to complete design touch-ups and get ready to release

iOS native app

• Current release board: https://phabricator.wikimedia.org/project/board/1736/
  • 5.1 set to be released today or tomorrow
  • We found a late minor regression affecting citation links, but likely
• Next board (no change): https://phabricator.wikimedia.org/project/view/2150/
  • 5.2 is in developmentwith expected deployment alongside iOS 10 release in late September
    • Adding iOS 10 support (with widgets)
    • Dropping iOS 8 support

Reading Infrastructure

• nothing blocking/blocked

Community Tech

• Currently rolling out numeric collation to English Wikipedia (will take a few more days for the script to complete)
• Rolling out PageAssessments to English Wikivoyage this week (possibly English Wikipedia next week). Jamie will help us monitor.
• No blockers

Discovery

• No blockers
• Working on BM25 implementation
• Working on multi-wiki indexes
• Working on integrating Polestar (http://vega.github.io/polestar/), working on beta site (wdqs-test.wmflabs.org)
• SPARQL Workshop on September 8th: https://office.wikimedia.org/wiki/SPARQL_workshop

Maps

• Enabling <maplink> everywhere (https://phabricator.wikimedia.org/T144062 )

Editing

Collaboration

• Blocking:
  • Continuing work on Flow caching rewrite for multi-DC. We're now 1) using WanCache, 2) deleting on write and setting cache on read. Still verifying that everything is working properly.
• 'Blocked:
• Updates:
  • Finished the work to unwatch from Echo notifications.
  • Flow VE fixes
  • Added a server-side message poster. This is a way to post to a talk page without knowing whether it uses Flow or wikitext. We already have this on the client as well.
  • Issues with mw.notify. We've temporarily re-implemented locally, but want to resolve the core issues and use that. See https://gerrit.wikimedia.org/r/#/c/306560/ .

Language

• Blocking:
• Blocked:
• Updates:
  • Apertium packaging work finished (Except kaz/kaz-tat), Kartik/Alex to start work on Jessie migration for service.
  • New CXStats page: https://test.wikipedia.org/wiki/Special:ContentTranslationStats
  • Work related to template adaption continue.
  • MLEB released last week.

Parsing

• Blocked on security review of Parser Migration extension (I see now that Security is on it)
• Ongoing work to clean up parser tests infrastructure
• Resumed work on Language Variants support in Parsoid (initial work to attain rendering parity with PHP Parser output)
• Ongoing work with Linker rewrite as part of cleanup for the shadow namespaces work

Technology

Analytics

• loading of new AQS (pageview API) cluster ongoing, will switch over to it when done, scaling and load testing docs avilable here: https://wikitech.wikimedia.org/wiki/Analytics/AQS/Scaling
• new event bus logging from mw hooks merged, will start being available on event bus soon
• browser dashboards with loads of traction as of late thanks to twitter and blogpost: https://blog.wikimedia.org/2016/08/19/most-popular-browser/ (we reached 2000 unqiue visits): https://analytics.wikimedia.org/dashboards/browsers/#all-sites-by-os
• Currently evaluating druid/clickhouse as viable datastore for edit data

Security

• Security reviews this week:
  • Youdao MT
  • Catching up on overdue reviews -- comments for https://phabricator.wikimedia.org/T141591 (HTML5Depurate and ParserMigration will be posted later today)
• Darian working on hiring tasks
• Darian out next week (Sept. 6-9)
  • Substitute with Phabricator understanding needed for Data Breach Training on Sept. 9th at 11:00a.m. Pacific; just have to answer questions that may come up with regard to setting Phab tickets private

Services

• Blocking: none
• Blocked: none
• Updates
  • Parsoid move to scap3 completed
  • Change-Prop is updating summary on wikidata item change now
  • Summary endpoint includes wikidata description now
  • New sections transform API to be deployed today

Technical Operations

• Blocking
  • None
• Blocked
  • HTML (RESTBase) dumps: script does not account for deleted pages/content. - blocked by services - https://phabricator.wikimedia.org/T133547
• Updates
  • wikidiff2 upgraded to 1.4.1 across the cluster
  • got a new DBA hire (fewer work for Jcrespo)
  • TechOps offsite happening week of Sept 25 (last week of quarter), please work around this for deployments

ArchCom

• https://www.mediawiki.org/wiki/ArchComStatus
• Last week: 2016-08-24 (Wednesday, 2016W34)
  • E262: ArchCom Planning meeting (notes)
  • E263: ArchCom-RFC office hour
    • Topic: Schema change for page content language (T69223)
    • Final comment ends 2016-08-31 (Wednesday)
• This week: 2016-08-31 (Wednesday, 2016W35)
  • E265: ArchCom Planning meeting (notes)
  • E266: ArchCom-RFC office hour
    • Topic: image and oldimage tables (T589)
    • RelEng participation would be especially helpful (late breaking request)

RelEng

• Blocking
• Blocked
  • (ops) https://gerrit.wikimedia.org/r/#/c/300092/ ("contint: tidy Nodepool slaves config history")
  • (ops) Help requested: Upgrade base MW-Vagrant image to Jessie - https://phabricator.wikimedia.org/T136429
    • Outline from bd808: https://phabricator.wikimedia.org/T136429#2572195
    • Ori suggesting Ops support: https://phabricator.wikimedia.org/T136429#2572433
• Updates

Performance

• No blockers
• More ResourceLoader work (cached module load performance improvements)
• More transactions work
• mcrouter for WANCache support added
• Multi-DC ChronologyProtector improvements (masking latency)
• Thumbor fully set up on beta, a few things to improve before switching it on
• PerformanceInspector bugfixes based on beta, getting ready for community outreach
• WebPageTest traffic shaping bugfixes

Fundraising Tech

• Deploying Redis consumers, decommissioning activemq
• More dedupe work
• CentralNotice geolocation changes https://phabricator.wikimedia.org/T143271#2562534
• Large civi upgrade tonight

Wikidata

• No blockers.
• Contributing in ArchCom discussions (content languages, multi content, …).
• Refactoring our jQuery UI based code base (https://phabricator.wikimedia.org/T142694).
• Figuring out how to show usage tracking data (https://phabricator.wikimedia.org/T103091).
• Restoring "purge without confirm" user right (https://phabricator.wikimedia.org/T143435).

WMDE TCB

• Wondering if there's any update on ETA for adding watchlist IDs to the production database (<https://phabricator.wikimedia.org/T125990> for <https://phabricator.wikimedia.org/T8964>)