Scrum of scrums/2018-08-08

2018-08-08

Callouts

• Need help reviewing https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/WikimediaEvents/+/450021/ Anyone? (I added Timo as a reviewer - Ian)

• Release Engineering: feedback needed from various teams on two recent MediaWiki train related incident reports. Specifically, how problems could have been prevented.
  • • 1.32.0-wmf.13, 9 blockers, feedback needed for all of them (Audiences Design, Contributors, MediaWiki Platform, Performance, Scoring Platform, Wikidata): https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train
    • 1.32.0-wmf.14, 6 blockers, feedback needed for 2 of them (Performance, Readers, Wikidata): https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train

Audiences

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • 6.0 in beta (https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/) til 8/20
  • We'll begin working on 6.0.1 soon (https://phabricator.wikimedia.org/tag/ios-app-v6.0.1-walrus-on-a-golf-cart/)

Android native app

• Blocked by:
• Blocking:
• Updates:
  • Maintenance update released to production.
  • Beginning work on Notifications support: https://phabricator.wikimedia.org/project/view/3505/

Readers Web

• Blocked by:
• Blocking:
• Updates:
  • Mobile website (MinervaNeue / MobileFrontend):
    • Page issues UI and instrumentation: T191532 T197932 T191528
    • Invest in the MobileFrontend & MinervaNeue frontend architecture: T188261 T197133
    • Other fixes and hygiene: T199282 T193172 T201131 T197110 T197931 T200867 T200518

Readers Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • MCS patch to prepare for Parsoid <audio> tags in code review: https://gerrit.wikimedia.org/r/c/mediawiki/services/mobileapps/+/450896, hope to deploy today
  • MCS preparing announcement for Android app multi-language features: T191640
  • Continuing work on mobile-html endpoint improvements (see open subtasks of T177433)
  • Maps (*ping Gehel*):
    • deployment-maps04 is up and running for testing Maps on Stretch in the BC
    • we're ready for the maps cluster switchover to Stretch
    • maps-test cluster can be decom'd (perhaps, but not necessarily, after the maps cluster switchover to Stretch)

Multimedia

• Updates
  • Engineering spinning back up
  • Search work is progressing and getting merged - the Search team has promised to do some re-indexing on our behalf
  • Fixed an UploadWizard bug for WLM that needs review - https://phabricator.wikimedia.org/T183075
  • Filed a task for security review of MediaInfo (but it's not urgent) - https://phabricator.wikimedia.org/T200279
  • Upcoming work on MediaInfo, MCR

Contributors

Community Tech

• Blocked by:
  • Security for TemplateWizard review https://phabricator.wikimedia.org/T198666
• Blocking:
• Updates:

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:
  • IRC meeting today about Partial Blocks RFC: https://phabricator.wikimedia.org/T199917

Editing

• Blocked by:
• Blocking:
  • Updates:

Parsing

• Blocked by:
• Blocking:
• Updates:
  • Post-Tidy replacement: Added new lint detection for pages that might have been affected by Tidy removal: https://www.mediawiki.org/wiki/Help:Extension:Linter/misc-tidy-replacement-issues

Growth

• Blocked by:
• Blocking:
• Updates:

Language

• Blocked by:
• Blocking:
• Updates:
  • ContentTranslation merge blocker is resolved!
  • Niklas responded to Community Tech to inquiry about TranslateSVG: https://phabricator.wikimedia.org/T201207#4488381

Audiences Design

UI Standardization

• Blocked by:
• Blocking:
• Updates:
  • OOUI next minor release v0.28 in preparation.
    • Supporting GSOC student Hagar Shilo in finishing up new OOUI “Tutorials” section, thanks also to Moriel for initiative
    • Preparation of some UI fine-tuning for frameless buttons
  • Finishing up SVG optimization in Popups (last product resolved) https://phabricator.wikimedia.org/T185596

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • “Total article count metric” vetted, available on API now and Wikistats UI soon
  • Eventlogging outage due to attack using very long user agents solved with “band aid” patch, working on a timeout-for-long-regexes defense: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180728-eventlogging
  • Data available in wikistats for July, this was the shortest reconstruction, it took less than 48hrs. Edits split by editor types for all wikis: https://stats.wikimedia.org/v2/#/all-projects/contributing/edits/normal
  • Took decision of using Json schema (rather than avro) for the Modern Event Data Platform. Take a look: https://tools.wmflabs.org/meetbot/wikimedia-office/2018/wikimedia-office.2018-08-01-21.00.log.html

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • More work on new API integration for main card processor
  • More work on email opt-in
  • More work on CiviCRM donor data deletion requests
  • Ready to start publishing exchange rates to internal Google Doc
  • Work almost done on pipeline for EventLogging banner & landiing page data
  • Prepping for Monday maintenance window
    • upgrade payments-wiki to new Mediawiki LTS
    • add new columns and indexes to Civi log tables, update db replication mode

MediaWiki Core Platform

• Blocked by:
• Blocking:
• Updates:
  • Pingback flood issue (T200864)
    • Fixed and filtered erroneous data from graphs
  • While investigating pingback, noticed an issue with SQLite upgrade, fixed (T200861)
  • Investigated reports of events lost from Logstash. Created Grafana dashboard https://grafana.wikimedia.org/dashboard/db/logstash and task T200960.
  • Investigated PHP notice from RemexHtml (T200827)
  • Followup change on logging detail globals, complete and merged (T16576)
    • Pushed 3 changesets for unregistered options on maintenance scripts. 1 merged, following up on other 2 (T110209)
  • HTTP library discussion Guzzle/Requests, localization (T110022)
  • Platform Evolution stakeholder meetings

Performance

• Blocked by:
  • Need access to labstore servers, Cloud Services is already aware
• Blocking:
• Updates:
  • All wikis are now using mcrouter for memcache reads, instead of nutcracker
  • ResourceLoader changes to defer jQuery dependency and to remove a roundtrip are in final review, will likely be on the train next week
  • Collecting data on how people understand outage response. Survey has gone out to Technology, will go out to Audiences later on (next week-ish)
  • Working on sitemaps generation in order to address https://phabricator.wikimedia.org/T199252 (and quite a few additional tickets as well)

Release Engineering

• Blocked by:
  • Feedback needed from various teams (too many to name each one) on two recent MediaWiki train related incident reports. Specifically, how problems could have been prevented.
    • 1.32.0-wmf.13, 9 blockers, feedback needed for all of them (Audiences Design, Contributors, MediaWiki Platform, Performance, Scoring Platform, Wikidata): https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train
    • 1.32.0-wmf.14, 6 blockers, feedback needed for 2 of them (Performance, Readers, Wikidata): https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train
• Blocking:
• Updates:

Research

• Blocked by:
  • Code review of https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/WikimediaEvents/+/450021/
• Blocking: None
• Updates:
  • Carrying out an online experiment as part of "Research:Voice and exit in a voluntary work environment/Elicit new editor interests"

https://meta.wikimedia.org/wiki/Research:Voice_and_exit_in_a_voluntary_work_environment/Elicit_new_editor_interests

• • Participating in a Platform Evolution survey.

Scoring Platform

• Blocked by:
• Blocking:
• Updates:

Search Platform

• Blocked by:
• Blocking:
• Updates:

Security

• Blocked by:
• Blocking:
• Updates:

Site Reliability Engineering

• Blocked by:
• Blocking:
• Updates:
  • Network issues with switches - T201039 T201145
  • Logstash packet loss much much better now - T200960

Wikidata

• Blocked by:
• Blocking:
  • We're aware of RelEng waiting for us following up on recent incident reports. We'll finally do it soon (tm)
• Updates:
  • Unblocked Content Translation: https://phabricator.wikimedia.org/T200693
  • Work in Lexicographical data continues:
    • adding senses
    • improving the editor workflow
    • https://phabricator.wikimedia.org/project/view/2292/
  • Experiment without not using secondary SQL table for formatting item links coming live soon
    • https://phabricator.wikimedia.org/T196882

German Technical Wishlist

• Blocked by:
  • Nothing

• Blocking:
  • No one

• Updates:
  • Working on:
    • TwoColConflict
    • Wikidiff2
    • AdvancedSearch
    • FileImporter

Multi-Content Revisions

• Blocked by:
• Blocking:
• Updates:
  • Switched all wikis to the "write both, read old" migration stage (T197816)
  • Fixed resulting breakage of wikitech.wikimedia.org (T200963)
  • Ran populateContentTables.php on four wikis (T183488)

SoS Meeting Bookkeeping

• Updates: