Scrum of scrums/2015-01-07

Facilitating: Grace Gellerman

Wikidata

• First Wikidata Sprint 2015 starts tomorrow
• Not planning to do any harm to others
• Currently no obvious blockers

Parsoid

• Had a fun Saturday (Jan 3rd) afternoon with https://wikitech.wikimedia.org/wiki/Incident_documentation/20150103-Parsoid
• Deployments back on track after holiday - https://www.mediawiki.org/wiki/Parsoid/Deployments
  • Parsoid v2 api needed by RESTBase is now in production
• Working to get cite css customization solution get to a first deploy so it can be experimented with further

Language

• Apology for absense.
• No dependency on any other team blocking team.
• Work on 'must fix bugs' for Content Translation by team to prepare for deployment in production.
• Ongoing security review of Content Translation by Chris S (T85686)
• Kartik is co-ordinating with Alex K for cxserver/apertium Production setup.
• Deployment is moved to 12th January (https://wikitech.wikimedia.org/wiki/Deployments#Upcoming) due to dependency on security review.

MediaWiki Core

• Monolog for group0/group1 waiting on 1.25wmf14
• TitleBlacklist failures (https://phabricator.wikimedia.org/T85428) tracked to memcached errors, Tim debugging for now
• Deploy of https://phabricator.wikimedia.org/T76497 awaiting (poolcounter changes for elastic search per-user concurrency limiting)
• Plan to just use xenon for profiling (xhprof just for forceprofile=1...some DOS discussion for the later) (ori deployed this already) (see https://phabricator.wikimedia.org/T759)

Services

• Dependencies on ops:
  • HW delayed, likely end of month: https://phabricator.wikimedia.org/T76986
  • Should set up public entry point before then: https://phabricator.wikimedia.org/T78194
• Continuing some work on wikidata query service, you might be interested in discussion on public API: https://phabricator.wikimedia.org/T85181
• First version of Virtual REST Service (interface to services) landed in core yesterday:
  • supports parallel requests to backends
  • abstracts away low-level details
  • currently used by VE, to be used by Flow & mobile
  • some clean-up still to be done

Security

• Several bugs from isec audit, working with ops on a few
  • Status of next hhvm upgrade?
• Reviews: ContentTranslation in progress, then lightncandy for core

Release Engineering/QA

• Nothing burning down the house
• Mediawiki unit tests now run under HHVM and Zend
• Working on some browser test refactoring for Flow
• Working on some infrastructure support for browser tests
• Trying to improve the poor DNS for beta labs
• Maintenance

Operations

• Getting ready to procure lots of new hardware for CODFW
• Jobrunner servers to get HHVM by early next week
• Titan being chosen as wikidata graph platform
• T76986 RESTBase production hardware
  • Order waiting for management approval
• T70751 Update wikitech wiki with deployment train
  • ¿not sure of status?

Fundraising Tech

• Regrouping from big English campaign, planning for next few months
• Want to get as much DonationInterface refactoring as possible into January
  • https://www.mediawiki.org/wiki/Extension:DonationInterface/Refactor_2015
• Starting to test new processor for China, will start integrating a new processor for South America soon
• Working on internal dashboard customization and persistence
• Lots of general code and comment cleanup in anticipation of refactor

Analytics

• Event Logging was broken in a deploy last night. Fix is merged and deployed. Events did not get into the database for about 12 hours, but backfill is harder than usual. This is because the schema was not being sent, so we'd have to guess based on the signature. We're leaning towards not backfilling but are happy to be convinced otherwise. Impact visualized here.
• Would love to know what if anything is the status of the MobileFrontEnd changes that made it play nice with the X-Analytics header and specifically the proposed X-Analytics extension. We are pinging Ori but if someone knows something, please ping us :)
• Wikimetrics work - deleting cohort users, privacy policy, read-only research user has access to do analysis on cohort and report data
• Dashiki work - annotations and style fixes
• Refinery work: producing the sampled, mobile, and zero TSVs from the Hadoop cluster instead of udp2log is very close to being done; pageview definition is being tested.

Multimedia

• Krinkle responded to our Sentry-related tickets, so that's great
• Could use some help for tgr on Sentry puppetization (bd808? ori?)
• UW browser and qunit tests progressing
• Some work on performance investigations, gi11es should have some numbers for us soon

Collaboration

• Collaboration team is working on two main things:
  • TOC for Flow - Almost done, probably this week.
  • Integrating Flow with ElasticSearch
• Also following the work to retire Mantle ( https://phabricator.wikimedia.org/T85890 ), since Flow uses that