Scrum of scrums/2020-11-18

Scrum of scrums

• Update the (etherpad) before 16:00 UTC each Wednesday.
• Keep your team's notes as short as possible.
• If you're are blocking a team or blocked by a team, copy/paste the note to their team section too, so they see it.

Links

• Scrum of scrums: https://www.mediawiki.org/wiki/Scrum_of_scrums
• Archive: https://www.mediawiki.org/wiki/Scrum_of_scrums#Archive
• Template: https://www.mediawiki.org/wiki/Scrum_of_scrums/Template

2020-11-18

Callouts

• SRE
  • ICU 63 upgrade (has MediaWiki impact) - https://phabricator.wikimedia.org/T264991
    • enwiki notification up in VP already:

    https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Update_to_ICU_Unicode_library

• • Sporadic and weird issues with Italian ISPs continue. SRE is aware and working on them. contact cdanis@ if you have more debugging data to share
• RelEng
  • No Train next week
  • No deploys next week Wed-Friday

SoS Meeting Bookkeeping

• Updates:
  • This is a reboot of the synchronous Scrum of Scrums weekly meeting. We want to see if the discipline of having a regularly scheduled brief weekly meeting helps to revive the practice of all teams filling out the notes. If you have attended the meeting in the past and have ideas for ways that we could improve it, then please share them with Grace and Deb.
  • This weekly facilitated meeting will start on Wednesday 2020-11-18 through 2020-12-23 and we will evaluate if convening a meeting leads to more comprehensive notes.

TechCom

• Blocking:

Product

Community Tech

• Blocked by: -
• Blocking: -
• Updates: The Community Wishlist Survey is now live and that's gonna be our main focus for the following 6 weeks

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:

Editing

• Blocked by:
• Blocking:
• Updates:

Growth

• Blocked by:
• Blocking:
• Updates:

iOS native app

• Blocked by:
• Blocking:
• Updates:

Android native app

• Blocked by:
• Blocking:
• Updates:

Web

• Blocked by: LangEng: Finishing up some changes to make ULS compatible with desktop improvements (https://gerrit.wikimedia.org/r/c/mediawiki/extensions/UniversalLanguageSelector/+/635679 )

• Blocking: n/a

• Updates: Main focus is on finishing the work on the Vue search study. A VueTaskForce is meeting this week.

Product Infrastructure

• Blocked by:
• Blocking:
• Updates:

Structured Data

• Blocked by: -
• Blocking: -
• Updates:
  • Commons Media Search: continuing to add features and make UI improvements, exploring some potential methods for using wikidata to improve search results (e.g. traversing entity trees, using aliases)
  • Media matching: in discussions with other teams to determine how this project overlaps with others

Abstract Wikipedia

• Blocked by:
  • —
• Blocking:
  • —
• Updates:
  • The community contest for the name of the central wiki of functions has now closed, and the result is being reviewed with Legal and Comms. Our thanks to all who voted.
  • Continuing work on using ZType data to enforce structure when editing ZObjects.
  • Huge thanks to Daimona and DannyS712 for helping with a Phan issue blocking us from merging code T268055

Parsing

• Blocked by:
  • This is a followup on a SoS update from a few weeks back. We would like Parsoid clients ( VisualEditor, ContentTranslation, StructuredDiscussion, MCS/PCS ) to act on https://phabricator.wikimedia.org/T266143 sooner than later. This should likely be a minor tweak in client code. We need confirmation that clients can handle this switch before we can make progress on making that change in Parsoid. Either leave a note on that phab task once you are done, or create a subtask and resolve it.
• Blocking:
• Updates:
  • no updates

Language

• Blocked by:
• Blocking:
  • Web. Should be unblocked this week.
• Updates:
  • T264756 Working on technical implementation plan for translatable modules. Will make it public for feedback soon.
  • T254481 Doing final tests on "Support sending TechNews using Special:MassMessage"
  • T182433 Developing "Strong synchonization" for translatewiki.net which is a prerequisite for fully automated translation exports
  • We fixed a bunch of production JavaScript errors in ULS. Fixes are waiting to be deployed.
  • Polishing section translation MVP

Inuka

• Blocked by: -
• Blocking: -
• Updates:
  • KaiOS app
    • Submitted to KaiStore
    • Addressing usability study feedback (colours, icons, copy, ...)
    • Production errors
  • Wikipedia Preview
    • Oozie job for data analysis
    • Image focus mode
    • Multilines caption

UI Standardization

• Blocked by:
• Blocking:
• Updates:

Library

• Blocked by: Waiting to hear back from Cloud Services on question about IDS/IPS for Cloud infrastructure
• Blocking: -
• Updates: Fixed a bug in Wikipedia Library that denied some users access to the library bundle when they should've had it. Refactoring of Wikilinks UI underway to improve performance.

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Adjustments to allow migration of legacy EventLogging schemas to Event Platform.
  • Fleshed out plan to migrate cluster to Apache BigTop and Hadoop coord failover.
  • Performance improvements of webrequest job, reduce CPU time and data relocation.
  • Fix bug in pageview_complete dumps (replacement of pagecounts).

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • SRE deployed a change to stop iOS app launching for thankyou.wikipedia.org, we need to test
  • Quieting down noisy logs in preparation for end of year fundraiser
  • Switching dev environment from vagrant to docker

Platform

• Blocked by:
• Blocking:
  • Code review on https://gerrit.wikimedia.org/r/c/mediawiki/core/+/587494
• Updates:
  • Parser cache for Parsoid code riding out this week
  • Design work for Sockpuppet Detection API
  • Design work for IP Masking

Engineering Productivity

Performance

• Blocked by:
  • Code review on https://gerrit.wikimedia.org/r/c/mediawiki/core/+/587494
• Blocking:
• Updates:
  • Perf monitoring services migrated to Python 3

Quality and Test Engineering

• Blocked by:
• Blocking:
• Updates:

Release Engineering

• Blocked by:
• Blocking:
  • Trainsient reports of Gerrit: remote unpack failed: Missing tree / blob (https://phabricator.wikimedia.org/T268119 ) -- hope to fix today
• Updates:
  • [All] Deployments/Covid-19 https://wikitech.wikimedia.org/wiki/Deployments/Covid-19
  • Train Health
    • Last week: No Train
    • This week: 1.36.0-wmf.18 phab:T263184
    • Next week: No Train
    • Rest of the year: https://wikitech.wikimedia.org/wiki/Deployments#Upcoming_Release_Train_disruptions (two trains in December and that's it for 2020)

Machine Learning Platform

• Blocked by:
• Blocking:
• Updates:

Research

• Blocked by:
• Blocking:
• Updates:

Security

• Blocked by:
• Blocking:
• Updates:

Site Reliability Engineering

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • Had a networking issue in codfw on Sunday, minimal impact, but keep in mind https://phabricator.wikimedia.org/T267865
  • Sporadic and weird issues with Italian ISPs continue. SRE is aware and working on them.
  • Grafana SSO is live on https://grafana-rw.wikimedia.org. Quality of life improvement(s) being worked on https://phabricator.wikimedia.org/T267645

Search Platform

• Blocked by:
  • Growth: Consume new event from the AddLink feature - https://phabricator.wikimedia.org/T262226
• Updates:
  • "ElasticSearch shard size check" icinga warnings on cloudelastic servers -https://phabricator.wikimedia.org/T265908
  • Redirect loop in pages results in infinite loop in API query - https://phabricator.wikimedia.org/T264534
  • Build integration envirionment for search platform airflow + hadoop + spark integration -https://phabricator.wikimedia.org/T265641

Security

• Blocked by:
• Blocking:
• Updates:

Site Reliability Engineering

• Blocked by:
• Blocking:
• Updates:

Wikimedia DE

Wikidata

• Blocked by:
• Blocking:
• Updates:

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates: