Scrum of scrums/2018-10-10

2018-10-10

Callouts

• Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar
• SRE:
  • Switchover week, no train. Up to now traffic and mediawiki switchovers have succeeded

• Release Engineering
  • Blocked by: need review from SRE/services Support a literal body for POST requests in `fetch_url`
  • Train Health: no train due to DC switchover - T191071 1.32.0-wmf.25 deployment blockers
  • Log Health: T204871 Deployments of MediaWiki with scap cause a spam of "web request took longer than 60 seconds and timed out"

• Research
  • Services please help with "Setting up a connection from the recommendation API service to MySQL": https://phabricator.wikimedia.org/T205452

• Parsoid

Audiences

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:

Editing

• Blocked by: Partially blocked by Performance on T176262. We want to preload code in the visual editor to improve loading times (T202720) and we need to understand the priority and timeline for T176262 to plan accordingly.
• Blocking:
  • Updates:

Growth

• Blocked by:
• Blocking:
• Updates:
  • We've released PageTriage/ORES integration.
  • Will release PageTriage/Copyvio integration in about a week.
    • We are working on interventions for Understanding first day (https://phabricator.wikimedia.org/T205754) and Personalized first day (https://phabricator.wikimedia.org/T206365)

Language

• Blocked by: None
• Blocking: None
• Updates:
  • Work on polishing ContentTranslation v2 continue. Received positive feedback so far.

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • Working on closing out 6.1 for beta (https://phabricator.wikimedia.org/tag/ios-app-v6.1-narwhal-on-a-bumper-car/), changes to cookie handling in progress

Android native app

• Blocked by:
• Blocking:
• Updates:
  • Offsite last week; focusing on releasing navigation updates.

Readers Web

• Blocked by:
• Blocking:
• Updates:
  • Mobile website (MinervaNeue / MobileFrontend):

• • • Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
      • Transition Gruntfile tasks to NPM scripts T206069
      • Follow-ups from last week

• • • Page issues https://www.mediawiki.org/wiki/Reading/Web/Projects/Mobile_Page_Issues
      • A/B test rollout increased on Farsi, Japanese, Russian, and English wikis T200792

• • • Enable Dynamic Type in iOS 9+ browsers T204807
    • Maintenance and bug fixes T206274 T206174 T204835 T206337 T205582

• • • Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
      • Design continuing special pages work in Minerva

• • PDF rendering (Proton) https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality
    • Remaining work tracked in T186748
    • Testing concurrency
    • chromium-render naming is being updated to proton

• • SEO: add Schema sameAs property pointing to Wikidata entries T198946

• • Management supporting Multimedia hiring processes

• • Design continuing work on reference previews https://reference-previews.firebaseapp.com/.

• • Product continuing 3-5 year planning.

Readers Infrastructure

• Blocked by:
  • none
• Blocking:
  • none known
• Updates:
  • RI offsite next week, very limited availability
  • Maps:
    • Load OSM data into maps1004 continues this week, we expected to start generating tiles next week

Multimedia

• Updates
  • Working on hiring, interviewing candidate this week
  • All of the SDoC multi-lingual file captions work is merged - some small security fixes and we can deploy to beta (crosses fingers)
  • lots of discussion/design on prototypes for adding 'depicts' to files containing artworks

Parsing

• Blocked by:
• Blocking:
• Updates:

UI Standardization

• Blocked by:
• Blocking:
• Updates:
  • OOUI v0.29.2 released with a hotfix on consistent document listeners from breaking change in v0.29.0 https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.29.2
  • Design Style Guide “Resources” section inclusion – preparing patches
  • wikimediafoundation.org priority accessibility issues successfully resolved https://phabricator.wikimedia.org/T201682

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Putting finishing touches on new metrics on wikistats, see for example “top editors” in italian wikipedia. We just added ability to split by bots/anonymous: https://stats.wikimedia.org/v2/#/it.wikipedia.org/contributing/top-editors

(as always all metrics are available programmatically via APIs)

• • Working with security in prioritizing items to work on as part of security’s review of analytics’ stack.
  • Ingesting data from eventlogging for easy visualization into Druid, see, for example, NavigationTiming data collected by performance team, see DOMComplete time buckets:
  • Working on ingesting xml dumps to enable easier content processing on cluster, this would give us the ability , for example, to identify content that needs citations

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Little fixes and enhancements to main CC processor's new API (which is now getting almost all CC traffic)
  • Scripts to compare data between old and new impression data pipelines
  • Following progress on MessageCache work
  • Still interviewing candidates for job

MediaWiki Core Platform

• Blocked by:
• Blocking:
• Updates:

Performance

• Blocked by:
• Blocking:
• Updates:
  • Attended welovespeed conference
  • Published https://phabricator.wikimedia.org/phame/post/view/122/best_friends_forever/
  • Tons of CRs for MW RDBMS and cache layer (
  • Helping with preparation of TechConf agenda
  • Making progress on Fresnel (performance testing as part of the build pipeline)
  • Security incident

Release Engineering

• Blocked by:
  • need review from SRE/services Support a literal body for POST requests in `fetch_url`
• Blocking:
• Updates:
  • Hired Lars Wirzenius, senior engineer
  • Interviewing on-going for our Developer Productivity position: https://boards.greenhouse.io/wikimedia/jobs/1225258?gh_src=f15731e11
  • Train Health:
    • Last week: a few blockers, resolved in time, no problems - T191070 1.32.0-wmf.24 deployment blockers
    • This week: No train this week due to DC switchover - T191071 1.32.0-wmf.25 deployment blockers
    • Next week: the last 1.32 release, 1.33 starts the next week - T191072 1.32.0-wmf.26 deployment blockers
  • Log Health:
    • T204871 Deployments of MediaWiki with scap cause a spam of "web request took longer than 60 seconds and timed out"
  • Code Health:

Research

• Blocked by:
  • [Services]: Setting up a connection from the recommendation API service to MySQL: https://phabricator.wikimedia.org/T205452
• Blocking: None
• Updates:
  • Continued working on finding missing articles for the recommendation API: https://phabricator.wikimedia.org/T203041
  • Starting to collect data for the references event stream: https://phabricator.wikimedia.org/T199189

Scoring Platform

• Blocked by: None
• Blocking: None
• Updates:
  • JADE tables is waiting for TechCom review now
  • Working to improve our job queue robustness has started, part of upgrading to celery 4

Search Platform

• Blocked by:
• Blocking:
• Updates:
  • Dropped support for caching interwiki queries that hadn’t worked properly since 2017: https://phabricator.wikimedia.org/T191961
  • Enable lexeme dumps for Wikidata: https://phabricator.wikimedia.org/T202830
  • Working on calculating examination probabilities for completion queries: https://phabricator.wikimedia.org/T205348
  • Working on improving data and creating models from autocompletion click data: https://phabricator.wikimedia.org/T205111
  • Working on improving Korean analyzers: https://phabricator.wikimedia.org/T178925
  • Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108

Security

• Blocked by:
• Blocking:
• Updates: https://phabricator.wikimedia.org/T200279 is awaiting remediation

Services

• Blocked by:
• Blocking:
• Updates:

Site Reliability Engineering

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • Datacenter Switchback week. No train. Traffic + Mediawiki have been switched over successfully, tomorrow is swift+services

Wikidata

• Blocked by:
• Blocking:
• Updates:

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

Multi-Content Revisions

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: