Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140218

who: Chad, Brad, Bryan, Ori, Aaron, RobLa, Greg out today: Tim, Chris S, Antoine

Liaisons with other teams

e.g. Flow, Wikidata, etc

HHVM

• (Re)-Kick off on Monday - if you want an invite and didn’t get one just ask.
• Use Phabricator’s kanban board?
• Need to triage/assign/estimate: 1) intl extension (facebook is working full steam ahead on this, I’ve made specific requests for things we’re missing), 2) igbinary (aaron?), 3) luasandbox (tim), 4) wmferrors (brad?), 5) puppetization/packaging (ori), 7) fast string search (might be able to live without?)

Performance

• Eliminate /geoiplookup requests! Gerrit #Ic4d2fc Gerrit #I26af69
• VE perf graphs! http://gdash.wikimedia.org/dashboards/ve/
• Moar frontend perf graphs! http://gdash.wikimedia.org/dashboards/frontend/
• mwgrep tool to grep site JS/CSS code on MediaWiki: NS, using elastic. (wooo! thanks nik & chad)
• Escalation: gitblit performance: https://code.google.com/p/gitblit/issues/detail?id=274#c9 (comments 9 & 10)
• Requirement in a nutshell: Gerrit plug-in that runs on merge and PURGEs affected views
• Would allow us to serve vast majority of reqs out of Varnish
• Chad will look & get back to Ori this week
• In progress: analysis of impact of ULSFO rollout on page load time (w/Nuria / analytics)
• Swift auth and container stat caching fixes (aaron)
• External links API query improvement suggestions

Search

• We’ve almost entirely cleared the backlog of Lucene bugs, either closing them or moving into Cirrus.
• We need more hardware -- mostly disk space (4 promised boxes in row D won’t be enough)
  • Looking to possibly rebalance some lsearchd and steal stuff: https://wikitech.wikimedia.org/wiki/Search/lsearchd_inventory
• Will probably start poking Elasticsearch 1.0.0 later this week or early next week
  • See ops-l post about this for more timeline
• Want more traffic as primary
  • Should we do this before 1.0.0?
• Nik is descending into Lucene land, trying to find ways to save us space without sacrificing features

Deploy Tooling

• Chipping away at scap refactor/python port
  • Gerrit change 113652 add detailed duration timing for scap & scap-1
  • Gerrit change 113996 remove external script dependencies from scap-1
  • Add bootstrap initialization for l10n update in new branches https://gerrit.wikimedia.org/r/#/c/113260/
  • Working on using ssh directly (bypasing dsh) to get better reporting/logging
    • Will be used for Bug 59922
• Requests:
  • Change wikiversions.dat to wikiversions.json (that is, update the PHP multiversion code to work with a JSON file rather than a custom .dat file format)
  • Drop now-unused ext: field from CDB

Beta/CI

Antoine (not here, copy/paste from RelEng/QA weekly):

• Status:    In progress Complete integration of browsertests for VisualEditor
  • One build worked and triggered two successful scenario!!
• Status:    In progress Train Zeljkof on Jenkins Job Builder script
  • Zeljkof started on it. Will pair with him to finish up.
• Status:    In progress Help migrating Cloudbees Jenkins template to JJB YAML templates
  • Zeljkof started on it. Will pair with him to finish up.

See also: Bug escalation below.

Security

• Password hashing and expiry patch review (aaron)
• Review token timing attack fix (aaron) (https://bugzilla.wikimedia.org/show_bug.cgi?id=61346)
• https://bugzilla.wikimedia.org/show_bug.cgi?id=61362

Bug escalation

• https://bugzilla.wikimedia.org/show_bug.cgi?id=61491 - “no WikiEditor edit controls on any page in beta labs”
• https://bugzilla.wikimedia.org/show_bug.cgi?id=54193 - “Recursion detected in RequestContext::getLanguage” still out there waiting for an awesome fix (51422 times in the last 7 days)