Scrum of scrums/2016-02-17

2016-02-17

Technology

Analytics

• Blocking:
  • Discovery with a pageview API bug: T127034, Dan is working on it right now
  • Multimedia with dumps parsing asks: T126808, T126809, Analytics will triage hopefully soon (within one or two weeks, but backlog is huge)
• Blocked
  • Services (known) because we need to refactor / move AQS (Analytics Query Service) out of the restbase repo
• Updates:
  • Same as last time, nothing new is ongoing

Architecture

[No update.]

Performance

[No update.]

Release Engineering

• Blocking:
  • Nothing new
• Blocked:
  • Looking for review on Phabricator ops/puppet role cleanup. See https://phabricator.wikimedia.org/T125851
  • Looking for a merge from Ops on scap3 provider changes. See https://phabricator.wikimedia.org/T127215
• Updates:
  • See wmf.14 group1 deployment blockers https://phabricator.wikimedia.org/T125597
    • Save latency regression
  • Progress on JS-based end-to-end (browser) tests in core. See https://gerrit.wikimedia.org/r/#/c/256404/

Research

• Blocking:
  • Nothing
• Blocked:
  • ORES still blocked on Ops. See https://phabricator.wikimedia.org/T106867
• Updates:
  • Reader survey test went live 16 Feb in 16:00-17:00 PST SWAT time (5:100K sampling): for QA purposes
  • Reader survey at full rate will go out 17 Feb 8:00-9:00 PST, for less than 2 weeks, at a 1:500 sampling rate: https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Behaviour

Security

• Blocking:
  • Nice to have: https://phabricator.wikimedia.org/T125382 (Maps)
• Blocked:
  • None.
• Updates:
  • 2FA for wikis progressing
  • Security patches

Services

• Blocking:
  • Nobody
• Blocked:
  • Separate AQS off of RESTBase - https://phabricator.wikimedia.org/T126294
    • need to schedule a time with Analytics Ops for the move
  • Mathoid - SVG to PNG support
    • librsvg(-dev) for Jessie
• Updates:
  • RESTBase: dropping listing URIs (/pagr/html/ , ...)
  • Cassandra multi-instance work _still_ undergoing

Technical Operations

• Blocking:
  • ORES moving into production, finally hardware is in place
• Blocked:
  • Nothing
• Updates:
  • Ongoing discussions/work about the switchover goal
  • Moved with LE cxserver to jessie and node 4.2

Product

Community Tech

• Blocking:
  • Nothing
• Blocked:
  • Gadgets 2.0 - blocked on ResourceLoader cache invalidation issue (Performance team) - https://gerrit.wikimedia.org/r/#/c/269901/
• Updates:
  • PageAssessments

Discovery

Blocking

• • none

Blocked

• • none

Updates

• • Building more analytics about user satisfaction in completion
  • TextCat merged, A/B tests to follow
  • WDQS Blazegraph 2.0 work still in progress, getting there
  • Discussing adding caching layer, for ops attention: https://phabricator.wikimedia.org/T126730
  • Discussing QuickSurvey with ops

Maps & Graphs

Updates

• Kartographer (maps) launched on beta cluster, getting ready to enable it on Wikivoyage
  • VE has been helping, thanks Ed Sanders
• Graphs can support WDQS, but might need caching (N.B. Operations)
• Created a page-views graph - can be placed on a talk page to show corresponding view for the past N days. https://en.wikipedia.org/wiki/Template:Graph:PageViews

Blockers

• Security: need SVG sanitization lib review (Security) - https://phabricator.wikimedia.org/T125382
  • Note that Performance were thinking of shipping sanitised user-provided SVGs to clients (instead of server-rendered PNGs), which would also need this functionality.
    • Are we sanitizing SVG on upload/download? Or do we always convert them in a sanbox env to PNG?
      • RIght now in production we always convert in a sandbox to PNG for normal page views, and (?) don't sanitise at all for download of the original SVG (on file pages).
      • We sanitize on upload, mostly show PNG's in articles. Raw svg's are served from upload.wm.o (untrusted domain)

Editing

Collaboration

• Blocking:
  • Dry run patch for external store migration is merged. Now we need to set External Store up on Beta, then test the dry run patch there: https://phabricator.wikimedia.org/T119567
• Blocked:
  • Flow dump generation on dumps.wikimedia.org: https://phabricator.wikimedia.org/T119511
• Updates:
  • Human-readable name patch is almost done: https://phabricator.wikimedia.org/T121936
  • Will be enabling cross-wiki notifications on first set of wikis soon (https://gerrit.wikimedia.org/r/#/c/265413/)

Language

• Blocking:
  • Apertium packages?
• Blocked:
  • None.
• Updates:
  • cxserver migrated to Jessie with help of Alex

Multimedia

• Blocking:
  • None
• Blocked:
  • Thumbor deployment blocks ImageTweaks deployment. Currently not a problem, as ImageTweaks is still rough.
  • Security review of ImageTweaks pending, not currently ready to go, would like it to happen sometime this quarter ideally - more updates coming. https://phabricator.wikimedia.org/T126492
  • Illustration metrics "blocked" but not urgent. https://phabricator.wikimedia.org/T126809 https://phabricator.wikimedia.org/T126808
• Updates:
  • Labs instance with ImageTweaks and Thumbor currently up and running, a bit of a demo as to what's coming to the cluster. See http://multimedia-alpha.wmflabs.org/wiki/index.php/Main_Page
  • OOUI performance issues being worked on by MatmaRex, as part of UploadWizard performance improvements.

Parsing

• Blocking:
  • None
• Blocked:
  • None
• Updates:
  • Work ongoing setting up mass visualdiff testing of rendering between 2 different mediawiki versions -- will appreciate help / feedback setting up mediawiki VMs (one per wiki) that closely reflects production config (extensions, skins, etc.). Currently considering vagrant, as well as manual setup (via scripts).
  • Awaiting additional reviews / merge on the path to serialize HTML while using TemplateData settings (hopefully this week) -- first round of reviewing and edits done.

VisualEditor

• Blocking:
  • None.
• Blocked:
  • Waiting on Design Research availability for user testing of Single Edit Tab integration
• Updates:
  • Will release the Single Edit Tab integration to a single wiki next Tuesday (huwiki) and assess impact
  • Working with Performance on assessing the performance impact of OOUI on all read pages https://gerrit.wikimedia.org/r/#/c/271144/ – will update next week on results.
  • Otherwise, we're working on performance issues, bugs, and language support, as normal.

Fundraising Tech

No blockers, most work is continued from last week

• Implemented updates for new CiviCRM financial tracking, filling in the last missing pieces
• fixes and enhancements for backup credit card processor
• prep for Latin America fundraising expansion
• beefing up fraud filters

Reading

Android

• Updates:
  • v2.1.141 published. Includes A/B test of readmore results.

Web

• Updates:
  • Exploring surfacing references via API / lazy loading in web (see https://phabricator.wikimedia.org/T123328) - making headway

Reading Infrastructure

• Nothing of note this week.