Scrum of scrums/2018-01-17

2018-01-17

Callouts

• Grafana will be migrated to support native LDAP on Feb 12 2018. This means the eventual demise for grafana-admin.wikimedia.org. Announcement to be posted to engineering@ and wikitech@. https://phabricator.wikimedia.org/T170150

Audiences

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • Continuing work on 5.8 - synced reading lists

Android native app

• Blocked by: weird RESTBase cache behavior: https://phabricator.wikimedia.org/T184833
• Blocking:
• Updates:
  • On track to release update with performance enhancements for Reading Lists (and "default" list, for feature parity with iOS)
  • Continuing testing of reading list syncing.

Reading Web

• Blocked by:
  • Release engineering - need to setup some CI on pdf service https://phabricator.wikimedia.org/T179552
  • Services - soon we will be looking at how to apply different styles to pdf service (https://phabricator.wikimedia.org/T181680) and how to use firejail to limit resources used by chromium render service? (https://phabricator.wikimedia.org/T180626) - we may need some guidance.

• Blocking:
• Updates:
  • We will be releasing a revamp of the mobile settings page. It also brings structure to the mobile beta meaning it will inform the user what features are in beta at any given time. (see https://phabricator.wikimedia.org/T182217)
  • Added instrumentation to print to pdf button to understand our users better (https://phabricator.wikimedia.org/T181297)

Reading Infrastructure

• Blocked by:
  • Services on code review for https://github.com/wikimedia/restbase/pull/944
• Blocking:
• Updates:
  • Switchover to MCS summary implementation is delayed until after Dev Summit week.

Maps

• Updates: None

Multimedia

• Updates: None

Discovery

• Blocked by:
• Blocking:
• Updates:

Community Tech

• Blocked by: Security for GlobalPreferences review
• Blocking:
• Updates: analysing top 10 proposals

Contributors

Editing

• Blocked by:
• Blocking:
• Updates:

Parsing

• Blocked by: None
• Blocking: None
• Updates:
  • https://gerrit.wikimedia.org/r/#/c/402455/ has some changes to how Parsoid handles the interaction between templates and responsive wrappers. Heads up to Parsoid clients to take a look at that patch and +1 if it doesn't affect you
  • We will roll out changes this week to replace <span> with <sup> for ref linkbacks ( https://phabricator.wikimedia.org/T45094)

Global Collaboration

• Blocked by: Security on 5, but waiting for all-hands to talk
• Blocking: Ops on Flow dumps probably; haven't checked in with Matt/Ariel about this recently
• Updates:
  • Flow respects robot policies (noindex) now

UI Standardization

• • OOUI v0.25.1 released https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
    • Renaming to unified “OOUI” in code documentation and comments
    • Remove buggy `translateZ` hack on scrollable PanelLayouts – keep an eye on scrolling perf in Blink/Webkit if you use PanelLayout
• Ongoing:
  • OOUI & based products:
    • icons: Unify, refine and align to WikimediaUI Style Guide https://phabricator.wikimedia.org/T177432 – first patches in: https://gerrit.wikimedia.org/r/#/c/402757/

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Found some Event data missing for January 3 through January 7. If your reports/dashboards look weird, rerun them: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Reportupdater#Re-runs
  • Clickstream blogpost: https://blog.wikimedia.org/2018/01/16/wikipedia-rabbit-hole-clickstream/
  • working on new APIs to report pageviews per project per country (sorting out ISO codes and data shape)
  • testing our java 1.8 upgrade in labs
  • Working with Brandon on TLS
  • Meltdown reboots continue

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Various CiviCRM improvements
  • Making our Amazon Pay SDK fork support TCP proxy
  • Re-starting work on new API for our main credit card processor
  • Stats projects:
    • Andrew Green's druid banner impressions lib: https://github.com/AndrewGreen/centralnotice_analytics
    • talked with Analytics, planning to use EventLogging for banner and donatewiki stats

MediaWiki Platform

• Blocked by:
• Blocking:
• Updates:
• Triaged/updated RFCs
• Multi-Content Revisions:
  • Patches under review:
    • https://gerrit.wikimedia.org/r/#/c/380669/
    • https://gerrit.wikimedia.org/r/#/c/402932/
    • https://gerrit.wikimedia.org/r/#/c/393929/
• cleanupUsersWithNoId: Wikibase blocker has movement.
• Comment table: Schema change looks even closer to done.
• A decision has been reached on ExternalStore de-PHP-serialization; patch still needs review
• Third-party developer support Phab tasks coordinated with Tech Collaboration:
  • T184606: Evaluate and set up a test instance of FOSS persistent chat software as a companion to Q&A system for communication with third-party developers
  • T184648: Create and publish a multi-tiered support level system for MediaWiki extensions frequently used by third parties
• Dev Summit planning
• Audiences Technology Working Group participation

Performance

• Blocked by: N/A
• Blocking: N/A
• Updates:
  • Team offsite this week, will not be attending
  • Prep for monitoring/evaluating Singapore at go-live
  • Fixes for database "Domain ID" logic - https://gerrit.wikimedia.org/r/404060 and https://gerrit.wikimedia.org/r/#/c/404056/
  • Docs on running performance testing on an Android phone - https://wikitech.wikimedia.org/wiki/Measure_Performance#Testing_performance_on_your_Android_phone
  • Added alerts for NavigationTiming report rates - https://phabricator.wikimedia.org/T179555#3887559

Release Engineering

• Blocking
  • None?
• Blocked
  • "Stack overflow when Redis is down" - https://phabricator.wikimedia.org/T185055
    • Need help from Operations and/or Performance
• Updates
  • Catching up the train this week and rolling out the last version before DevSummit/All Hands and RelEng team offsite weeks. [wiki[email]]
    • https://phabricator.wikimedia.org/T180749#3897321
  • We moved Wednesday morning’s SWAT window 1 hour earlier (to 10am) to give us an hour break before the new MW version rolls to second set of wikis (all non-wikipedias) which was a follow-up from a recent post-mortem. [wiki][email]
    • https://lists.wikimedia.org/pipermail/wikitech-l/2018-January/089404.html
    • https://phabricator.wikimedia.org/T182733
  • We broke git-fat deploy repos in scap (old config no longer valid), workaround/fix available in all relevant repos.
    • https://phabricator.wikimedia.org/T184882#3899710
    • (Yes, we’re re-doing how the CI for scap is done, see: https://phabricator.wikimedia.org/T184628 )
  • Updated the Debian packaging for Zuul (CI task scheduler) and released 2.5.0-8-gcbc7f62-wmf6, unblocking an upgrade of Gerrit.
    • https://phabricator.wikimedia.org/T158243
  • Converted our home-grown docker image builder to `docker-pkg` from Giuseppe
    • https://phabricator.wikimedia.org/T177276
  • Getting started with the basics of planning our team offsite pre Barcelona Hackathon. Submitted travel request form and let eng-admin@ know.
  • Working on browser tests with Search (“selenium-CirrusSearch-jessie daily Jenkins job”).

Research

• Blocked by:
• Blocking:
• Updates:

Scoring Platform

• Blocked by:
• Blocking:
• Updates:

Search Platform

• Blocked by:
• Blocking:
• Updates:
• Improving LTR training mechanisms https://phabricator.wikimedia.org/T184547
• Working on fixes for completion suggester & redirects namespaces https://phabricator.wikimedia.org/T115756
• Investigating ElasticSearch phonetic search https://phabricator.wikimedia.org/T182708
• Working on Serbian analysis plugins for ES https://phabricator.wikimedia.org/T183015
• Working on refactoring search profiles to make them more config-like https://phabricator.wikimedia.org/T183279
• Finished test for machine-learning ranking on Hebrew wiki https://phabricator.wikimedia.org/T182616, result analysis next
• Working on enabling WDQS-driven deep category search https://phabricator.wikimedia.org/T181549

Security

• Blocked by:
• Blocking:
• Updates:

Services

• Blocked by: none
• Blocking: none
• Updates:
  • All REST traffic is served from Cassandra 3 cluster
  • Remaining Cassandra 2 nodes are being moved to Cassandra 3 cluster
  • 50% of htmlCacheUpdate jobs are processed on kafka
    • All except enwiki, commons and wikidata

Technical Operations

• Blocked by:
  • Global collaboration on the flow dumps. https://phabricator.wikimedia.org/T164262
• Blocking:
  • None
• Updates:
  • Team restructuring happening. Don't expect much fallout, but we are SREs these days.
  • Grafana will be migrated to support native LDAP on Feb 12 2018. This means the eventual demise for grafana-admin.wikimedia.org. Announcement to be posted to engineering@ and wikitech@. https://phabricator.wikimedia.org/T170150

Wikidata

• Blocked by:
• Blocking:
• Updates:

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: