Scrum of scrums/2018-05-30

Callouts

• From last week, all Windows NT operating systems are under the "Windows" os family in analytics metrics
• Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875

Audiences

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • Continuing work on tech debt release, 5.8.2 ( https://phabricator.wikimedia.org/project/view/3358/ )
  • Starting work on next major release, 5.9 ( https://phabricator.wikimedia.org/project/view/3238/ )

Android native app

• Blocked by:
• Blocking:
• Updates:
  • Released maintenance update to production (improvements to reading list syncing / fix no-such-project errors)
  • Finalizing multilingual features based on user testing at Hackathon -- on track for release in ~1 week.

Readers Web

• Blocked by:
• Blocking:
• Updates:

• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

• No updates this week.

• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra
  • Increase code sharing of client apps by coalescing and moving more logic to the server
    • Reading Infra depends on Parsing, Services

Maps

• Blocked by:
• Blocking:
• Updates:

Multimedia

• Blocked by:
• Blocking:
• Updates:
  • Looking into OOUI migration for Wikibase per discussions at the hackathon/elsewhere
  • UploadWizard work for multilingual captions pretty much complete
  • Indexing wikibase statements (searchable via haswbstatement:XXXX), work continues on quantities

• Quarterly goal dependency update:
  • Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 2.1 Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia
  • Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
    • Research depends on Multimedia

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:
  • Working on PageTriage improvements

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:
  • Working on Blocking Tools

Editing

• Blocked by:
• Blocking:
• Updates:
  • None

Parsing

• Blocked by:
• Blocking:
• Updates:
  • Tidy -> RemexHtml: final switch planned for June 27th / July 11th

• Quarterly goal dependency update:
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
  • Increase code sharing of client apps by coalescing and moving more logic to the server
    • Reading Infra depends on Parsing, Services
  • Outcome 2: Objective 1: Revision storage scaling
    • Services depends on SRE, Parsing

Collaboration

• Blocked by:
• Blocking:
• Updates:
  • Patches to solve most of Echo's multi-DC incompatibilities now awaiting review https://phabricator.wikimedia.org/T164860
  • Deleted Echo's rspec tests to unbreak CI

Language

• Blocked by:
• Blocking:
• Updates:

• Quarterly goal dependency update:
  • Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
    • Language depends on Editing

Audiences Design

UI Standardization

• Blocked by:
• Blocking:
• Updates:
  • OOUI – v0.27.1 released yesterday: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.27.1
  • 1 deprecation in this release. Additionally 9 style amendments, 9 code & 2 accessibility improvement. Among those
    • Toolbar: Add a required 'name' property to toolgroup configs; deprecating change (Ed Sanders)
    • Clarify and align TabSelectWidget focus (Volker E.) https://phabricator.wikimedia.org/T194863
    • Allow dropdown menus to be larger than their handles (Ed Sanders) https://phabricator.wikimedia.org/T195257
  • Continuing work on Design Style Guide, this week starting 'Resources' page with all repo resources
  • Continuing work on a minor UI/UX issues in AdvancedSearch with WMDE team

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Updated user agent string parsing regexes in eventlogging and refinery
  • Migrated zookeeper to new hardware
  • Migrating druid to debian stretch, should be finished this week
  • Revision score now available in eventstreams

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Working on getting Ingenico Connect API campaign ready.
  • Still working on backend pipeline for CentralNotice EventLogging stats
  • Working on a Donor Deletion tool for Civi in response to GDPR

MediaWiki Platform

• Blocked by:
• Blocking:
• Updates:
• MCR:
  • ar_rev_id deduplication is merged and maintenance script has been run
  • API "templated parameters" patch was merged
• TemplateStyles:
  • Implemented a feature request.
  • An enwiki RFC about enabling it as soon as Remex is enabled there is passing.
• MediaWiki core master now requires PHP 7.0 or HHVM
• MediaWiki-CodeSniffer 19.0.0 and 20.0.0 released, to allow for safe PHP 7 features to be used
• Bug triage and fixes for MassMessage and GlobalUserPage
• Finished development of "CoverMe": https://tools.wmflabs.org/coverme/ (https://blog.legoktm.com/2018/05/29/introducing-coverme-find-the-most-called-mediawiki-code-lacking-test-coverage.html)
• Deployed postgres in CI, filed T195807 for failures
• Work towards PSR-4 in MediaWiki core, including enabling PSR-4 autoloader for more directories, and implementing a structure test to validate PSR-4 compliance
• Hackathon projects:
  • MySQL client wrapper to replace "sql" shell script: https://gerrit.wikimedia.org/r/#/c/434188/
  • Refactor API parameter validation: https://gerrit.wikimedia.org/r/q/topic:%2522bug%252FT142080-api-param-validation%2522+(status:open+OR+status:merged)
  • Script to import Phabricator task information into a wiki: https://gerrit.wikimedia.org/r/#/c/433919/
• The usual code review and bug work
• Quarterly goal dependency update:
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
    • Planning underway for next FY Platform Evolution program
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
    • MCR capabilities in active development
  • Objective 1.1 Assist with deploying MultiContent Revisions on Commons
    • T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revision
• SDC depends on MediaWiki Platform, WMDE
• MCR capabilities in active development

Performance

• Blocked by:
• Blocking: Readers Web (review of CitationUsage) - will be done this week
• Updates:
  • performance perception survey live on several wikis
  • Trialing mobile performance testing on SauceLabs device lab
  • More fixes to ChronologyProtector
  • Still pulling jQuery deps out of base javascript modules
  • Bunch of resourceloader bug fixes
  • mcrouter expected to be ready in prod this week, will test on testwiki next week

Release Engineering

• Blocking
• Blocked
• Updates
  • Train status: https://phabricator.wikimedia.org/T191051
  • 1.32.0-wmf.5 got held up last week by an incident that happened during the scheduled Thursday train deployment window.
    • https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
    • We should be back on track this week, wmf.5 is clear of blockers and wmf.6 should be rolling out as usual

• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Research

• Blocked by: Performance: https://gerrit.wikimedia.org/r/#/c/432534/
• Blocking: None
• Updates:
  • Deploying the gapfinder-tools app and gathering section mappings.
  • Have been gathering synonym mappings.
  • Analyzed the first incoming labels from WikiLabels citations campaign

• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
    • Research depends on Multimedia

Scoring Platform

• Blocked by:
• Blocking:
• Updates:

Search Platform

• Blocked by: Security: https://phabricator.wikimedia.org/T190875
• Blocking:
• Updates:
  • Wikidata reindexed and now external ID and string properties can be searched for with haswbstatement keyword
  • Deep category search enabled on all wikis except private ones: https://phabricator.wikimedia.org/T194260
  • all: keyword enabled on all wikis: https://phabricator.wikimedia.org/T165110
  • Exploring ideas for applying NLP to search: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Potential_Applications_of_Natural_Language_Processing_to_On-Wiki_Search
  • Looking into fixing regex highlighting that does not time out as expected: https://phabricator.wikimedia.org/T195491
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
  • Working on Polish analyzer: https://phabricator.wikimedia.org/T186046
  • Working on fulltext search for Lexemes

• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • *Objective 2.1 Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia

Security

• Blocked by:
• Blocking:
• Updates:

• Quarterly goal dependency update:
  • Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services

Services

• Blocked by:
  • Parsing on language variants transformation support
  • Echo on non JSON-serializable job https://phabricator.wikimedia.org/T192945
  • Who knows who's responsible for GWToolset extension? It has non-json-serializable job https://phabricator.wikimedia.org/T192946
• Blocking: none?
• Updates:
  • Kafka queue enabled for all jobs everywhere except some exceptions and cirrus search
  • revision-score event exposed via event streams

• Quarterly goal dependency update:
  • Increase code sharing of client apps by coalescing and moving more logic to the server.
    • Reading Infra/Parsing, Services
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
  • Outcome 2: Objective 1: Revision storage scaling
    • Services depends on SRE, Parsing

Site Reliability Engineering

• Blocked by:
  • Collaboration for flow, T172025
• Blocking:
  • None
• Updates:
  • Had a wikidata outage https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
  • row C move+upgrade went quite well
  • mcrouter to be deployed this week

• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Outcome 2: Objective 1: Revision storage scaling
    • Services depends on SRE, Parsing

Wikidata

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 1.1 Assist with deploying MultiContent Revisions on Commons
    • T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions
    • SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: