Scrum of scrums/2015-09-30

2015-09-30

Reading

Android

• Beta release (v2.1.131-beta-2015-09-28) published September 28th. This is the first release with _maps_ and the first without legacy support. Lots of UI improvements too.

Web

Quick Surveys version 0.3.0 released Team focusing attention on Popups extension and other extensions inherited e.g. multimedia viewer (old maintainers please keep an eye out for pings on bugs/old patches) Team working on a "read more" feature

Reading Infrastructure

• Siebrand asked Language people for opinions on one of the possible issues on https://phabricator.wikimedia.org/T91148, which might help get things moving.
• Stuff from last time:
  • https://phabricator.wikimedia.org/T91148 is still blocked on whoever owns oojs-ui
  • Not blocked on https://phabricator.wikimedia.org/T95864 (Ops?) or https://phabricator.wikimedia.org/T110274 (CI) yet, but it's on the horizon

Infrastructure

Security

• Working on Analytics assessment, results soon
• Packaging openvas for PCI scanning
• QA: Thanks for T114241! let me know if I can help..

Performance

• Edit save time regression investigation
• Excessive module invalidation investigation
• Multi-DC meetings started, lots of new tasks :)
• A lot of WAN cache and slave lag detection improvements
• Blockers:
  • T94028: DB master connections requested by Flow on GET/HEAD requests
  • T94029: Spike: Avoid use of merge() in Flow caches
  • pt heartbeat table permissions

Release Engineering

• Blocking: T92871 (as of just now ;) )
• Blocked by: (none)
• Updates:
  • Deployment tooling implementation continues
    • https://phabricator.wikimedia.org/project/view/1449/
    • Config deployment should be merged this week
    • Pre/post stage check system being implemented this week (hooking into Icinga/Nagios checks)
  • First branch for 1.27 cut yesterday
  • Released MW-Selenium 1.6.1 (includes major fix to user factory)
  • Read [Engineering] Fix or delete failing browser tests Jenkins jobs

Technical Operations

• Blocking: none
• Blocked by: none
• Updates:
  • Ops will be having an offsite on the week Oct 12 - Oct 16
  • Jaime Crespo is requesting assistance on the compression of ES hosts and would like to speak with a dev. Anyone interested please talk to him
  • TLS for email since a couple of days ago.
  • Cassandra is replicating to codfw

Services

• RESTBase

• various security improvements (save API, post storage endpoints) and bug fixes
• purging code ready, talk to Ops tomorrow about caching endpoints for the Mobile Content Service

• Helping Analytics around the deployment of their RESTBase instance - any day now, yay!

Analytics

• The IP Hashing bug has been fixed, we're sharing configs via etcd now, so Event Logging is parallel again. This means we can handle more throughput, come talk to us if you need that.
• Andrew Otto is in San Francisco to talk about the Event Bus with all interested parties
• Pageview API code is about to be merged on all fronts (puppet / code / deploy) and we'll be deploying it as we can over the next week or so. Shooting for October 9th but may slip if our access ticket is stuck. Ops, if you wouldn't mind taking a look at my last question on: https://phabricator.wikimedia.org/T113416

Research

• Blocking: none
• Blocked by: none
• Updates:
  • New diff/content persistence run starting on altiscales (external) hadoop cluster -- no effect on analytics cluster
  • Productionization of ORES continues
    • Moving debs to gerrit -- https://phabricator.wikimedia.org/T108556
    • Reviewing ORES scored revisions extension https://gerrit.wikimedia.org/r/#/c/229423

Community Tech

• Citation Bot fixes are finished
• UploadWizard update going out today
• Preparing for Community Wishlist survey

Editing

Collaboration

Blocked on two Parsoid issues:

• https://phabricator.wikimedia.org/T111249 (Parsoid)
• https://phabricator.wikimedia.org/T112350 / https://phabricator.wikimedia.org/T113044 (Parsoid)
  • T113044 is the relevant ticket and it is being worked on by Arlo (1 of 3 pieces are done) -- currently stalled since he is on vacation. How critical is this?
    • I don't think super-critical. Obviously, we would like it fixed, but I haven't heard user feedback about it and it shouldn't affect most Flow posts. After vacation should be okay.

• Finished converting Swedish Wikimedia chapter wiki from LQT to Flow
• Will soon be converting ptwikibooks from LQT to Flow
• Released Flow user talk opt in on MediaWiki.org, a few other wikis to come soon
• Continued work on Echo (followup to notification split) and a couple Flow backend issues

Parsing

• Not necessarily blockers, but just old stalled tickets.
  • Any word from RelEng about https://phabricator.wikimedia.org/T92871 ? -- have a workaround for when we need an immediate update to the beta labs cluster, but seems like an unnecessary step.
  • Any word from ops about https://phabricator.wikimedia.org/T102039 ? -- we continue to have a workaround that mostly works

• Nothing significant to report that is relevant to this audience (deploys and bug fixes ongoing).

Language

• No blocker/blocking.
• Work on improving suggestions continue.

Advancement

Fundraising Tech

• Running 1-hr full tests of both new payment processor integrations this week
• Deployed more CN features to improve performance and rely on less on-wiki Javascript
  • https://phabricator.wikimedia.org/T111385
  • https://phabricator.wikimedia.org/T90918
• Preparing to upgrade CiviCRM from 4.2 to 4.6, trying to upstream or discard as many of our core changes as possible.