Scrum of scrums/2018-06-13

2018-06-13

Callouts

• SRE and Services on Readers Web: Proton times out way too often to be put into production https://phabricator.wikimedia.org/T186748#4275727
• SRE summit next week. SREs/Ops people across the organization will be unavailable. Also deployment pause because of this. https://wikitech.wikimedia.org/wiki/Deployments#Week_of_June_18th
• Wikidata/WMDE: If you use Wikidata's wb_terms database table replicas (tool, script, anything), please let us know what data you use and how, as we're considering phasing out the table: https://phabricator.wikimedia.org/T197161
• Special thanks to Performance, Analytics, and Readers Web for reviewing the CitationUsage schema instrumentation code.
• Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875
• Please take the beta cluster survey:
  • Announcement: https://lists.wikimedia.org/pipermail/wikitech-l/2018-May/090049.html
  • Survey: https://goo.gl/forms/XgIxXiSi1G5eVHbp2
• Scoring platform: Discussion about peformance impact of deploying JADE on prodcution wikis: https://phabricator.wikimedia.org/T196547 Please chime in and take a look

Audiences

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • 5.8.2 w/ event logging analytics and bug fixes in public beta, looks good so far ( https://phabricator.wikimedia.org/project/view/3358/ )
  • Continuing work on next major release, 6.0 - Feed customization and design updates ( https://phabricator.wikimedia.org/project/view/3238/ )

Android native app

• Blocked by:
• Blocking:
• Updates:

Readers Web

• Blocked by:
  • Ruby to JS Cucumber refactor needs help from the RelEng team to fix our flaky Ruby tests: https://phabricator.wikimedia.org/T190710
• Blocking:
• Updates:
  • Mobile website page issues improvements and A/B test framework continues https://phabricator.wikimedia.org/T159262
  • Mobile website gallery and table of contents bug fixes https://phabricator.wikimedia.org/T196911 https://phabricator.wikimedia.org/T193517
  • Invest in the MobileFrontend & MinervaNeue frontend architecture planning and tasking https://phabricator.wikimedia.org/T195473
  • Catching up on code review
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • Safari Reading List extension coming soon, awaiting final QA signoff.
  • Two new engineers.
  • Supporting lang variants in MCS: Passing Accept-Language header to Parsoid. Soon: sending the uselang parameter to MW API requests.

Maps

• Blocked by:
• Blocking:
• Updates:

Multimedia

• Quarterly goal dependency update
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia, SRE, WMDE, Search Platform, MediaWiki Platform, Research
    • Preparations continue - MCR and other dependencies are well tracked for this
    • OOUI work now implicates some of our fine friends in Contributors - esp. Collaboration - been talking with Moriel to get a good high-level view of what's needed
  • Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia
    • Cormac (our lead on the search work) is out until next week, but our work on search is well ahead of schedule to my knowledge
  • Assess user needs for contributors to Structured Data on Commons with interviews and surveys - T171252
    • Research depends on Multimedia
    • As far as I know, Pam has been supporting this work, but no engineering time is needed?

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:
• Working on PageTriage improvements
  • GlobalPreferences and CodeMirror are still upon us

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:
  • Start work on Partial Blocks (quarterly goal) https://phabricator.wikimedia.org/T196578
    • Special thanks to Jaime Crespo and Brad Jorsch for their help on drafting an SQL schema change
  • Fixing Bugs with the Takedown Tools https://phabricator.wikimedia.org/project/board/2949/

Editing

• Blocked by:
• Blocking:
• Updates:

Parsing

• Blocked by:
  • No blockers known
• Blocking:
  • No blocking known
• Updates:
  • Poem extension integrated into parsoid, reviewed, waiting for merge
  • Cite extension work is done and waiting for review
  • Tidy to Remex switch over nearly complete
  • We are planning to do the final switch from Tidy -> RemexHtml for all wikis on the wikimedia cluster on July 5th
  • C Scott' s work on language subsystem just beginning review

Collaboration

• Blocked by:
• Blocking:
• Updates:

Language

• Blocked by:
• Blocking:
• Updates:
  • ContentTranslation Version 2 work continue; We are inviting some users to try it out!
  • Draft purge script in progress. Thanks to suggestions from DBAs.

Audiences Design

UI Standardization

• • OOUI – v0.27.3 special release last Thu

   https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.27.3

• • • 4 style/code improvement/regression fixes.
  • v0.27.4 in preparation for next Tue
  • Continuing work on Design Style Guide

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Discussion with coms and site and measuring pageviews for new wikimediafoundation site.
  • Ops goals for quarter done. Others still in progress.
  • Working with security and legal on data map, should be done by end of quarter.
  • Old geowiki system completely shut down (removing puppet code), we put the new data in superset (dashboard being vetted).
  • Changes continue to selectively purge data in hadoop for eventlogging backend.
  • Adding "permalinks" to Wikistats2.

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • DonationInterface: working through bugs revealed in 1 hr trial of main CC processor's new API

MediaWiki Platform

• Blocked by:
• Blocking:
• Updates:

Performance

• Blocked by:
• Blocking:
• Updates:

Release Engineering

• Blocked by:
• Blocking:
  • Ruby to JS Cucumber refactor needs help from the RelEng team to fix our flaky Ruby tests: https://phabricator.wikimedia.org/T190710
• Updates
  • Please take the Beta Cluster survey:
    • https://lists.wikimedia.org/pipermail/wikitech-l/2018-May/090049.html
      • Survey: https://goo.gl/forms/XgIxXiSi1G5eVHbp2
  • Heads up: There will be more people in the normal MW Train deployment rotation (namely: Antoine, Zeljko, and Dan to start) and we'll be doing some Train deployments during EU hours some weeks. Exact timing TBA (soon).
• Quarterly cross-dependencies

Research

• Blocked by: None
• Blocking: None
• Updates:
  • Adding UI translations to the Gapfinder tools project: http://gapfinder-tools.wmflabs.org/
  • Training models for recommending translation suggestions: https://github.com/wikimedia/research-translation-recommendation-models/

Scoring Platform

• Blocked by:
• Blocking:
• Updates:
  • Draft topic is deployed!
    • Deployed drafttopic in production, try it out like: https://ores.wikimedia.org/v3/scores/enwiki/123456?models=drafttopic
  • bswiki & srwiki have advanced support --> Collab
  • Fixed ORES extension bugs for services and analytics
  • Discussion about peformance impact of deploying JADE on prodcution wikis: https://phabricator.wikimedia.org/T196547 Please chime in and take a look

Search Platform

• Blocked by:
  • Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875
• Blocking:
• Updates:
  • Fixed prefix: to not override chosen namespaces: https://phabricator.wikimedia.org/T195815
  • Created analysis chains for Croatian, Serbo-Croatian, and Bosnian, reindex next: https://phabricator.wikimedia.org/T192395
  • Reindexed Slovak and Serbian wikis for new analyzers: https://phabricator.wikimedia.org/T191545
  • Added Lexeme terms to source text: https://phabricator.wikimedia.org/T195912
  • Added RDF export for Wikibase constraints: https://phabricator.wikimedia.org/T194762
  • Working on Lexeme fulltext search: https://phabricator.wikimedia.org/T196188
  • Working on fixing Geodata issues: https://phabricator.wikimedia.org/T196526
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
  • Working on fixing namespace/redirect mixup in search: https://phabricator.wikimedia.org/T115756

Security

• Blocked by:
• Blocking:
• Updates:

Services

• Blocked by:
  • Readers web on Proton times out way too often to be put into production https://phabricator.wikimedia.org/T186748#4275727 (from SRE)
  • EchoNotificationJob being non JSON serializable https://phabricator.wikimedia.org/T192945#4278916
  • Parsing on deploying the language conversion API at least t deployment-prep
• Blocking:
• Updates:
  • Groundwork in RESTBase to prepare for language variants support
  • Tweaking the kafka job queue for cirrus search jobs

Site Reliability Engineering

• Blocked by:
  • No longer blocked by collaboration on Flow dumps. The move to php7 made it faster, it's not an issue currently, it can be put on the back burner
  • Readers web on Proton times out way too often to be put into production https://phabricator.wikimedia.org/T186748#4275727
• Blocking:
  • None
• Updates:
  • An outbound email outage was experienced on June 6th, https://wikitech.wikimedia.org/wiki/Incident_documentation/20180606-mx
  • videoscalers/jobrunners clusters merged increasing available videoscaling capacity
  • tin has been replaced (but you should anyway use deployment.eqiad.wmnet
  • Upgrade to 3.24 HHVM started
  • Proton (chromium-render) has been deployed and is timeouting way too often even on basic monitoring traffic. https://phabricator.wikimedia.org/T186748#4275727

Wikidata

• Blocked by:
  • No longer blocked on hard-to-track browser failures: https://phabricator.wikimedia.org/T191537 Thanks Hashar, Anomie and Zeljko!
• Blocking:
  • None (that we know of)
• Updates:
  • Investigating ways of migrating away from the unmaintainable wb_terms database table
  • Improving editor experience of the recently launched lexemes on Wikidata
  • Prototyping a mobile user interface for editing labels, descriptions, etc of items and properties

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: