Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140218

who: Chad, Brad, Bryan, Ori, Aaron, RobLa, Greg out today: Tim, Chris S, Antoine

e.g. Flow, Wikidata, etc

(Re)-Kick off on Monday - if you want an invite and didn’t get one just ask.
Use Phabricator’s kanban board?
Need to triage/assign/estimate: 1) intl extension (facebook is working full steam ahead on this, I’ve made specific requests for things we’re missing), 2) igbinary (aaron?), 3) luasandbox (tim), 4) wmferrors (brad?), 5) puppetization/packaging (ori), 7) fast string search (might be able to live without?)

Eliminate /geoiplookup requests! Gerrit #Ic4d2fc Gerrit #I26af69
VE perf graphs! http://gdash.wikimedia.org/dashboards/ve/
Moar frontend perf graphs! http://gdash.wikimedia.org/dashboards/frontend/
mwgrep tool to grep site JS/CSS code on MediaWiki: NS, using elastic. (wooo! thanks nik & chad)
Escalation: gitblit performance: https://code.google.com/p/gitblit/issues/detail?id=274#c9 (comments 9 & 10)
Requirement in a nutshell: Gerrit plug-in that runs on merge and PURGEs affected views
Would allow us to serve vast majority of reqs out of Varnish
Chad will look & get back to Ori this week
In progress: analysis of impact of ULSFO rollout on page load time (w/Nuria / analytics)
Swift auth and container stat caching fixes (aaron)
External links API query improvement suggestions

We’ve almost entirely cleared the backlog of Lucene bugs, either closing them or moving into Cirrus.
We need more hardware -- mostly disk space (4 promised boxes in row D won’t be enough)
- Looking to possibly rebalance some lsearchd and steal stuff: https://wikitech.wikimedia.org/wiki/Search/lsearchd_inventory
Will probably start poking Elasticsearch 1.0.0 later this week or early next week
- See ops-l post about this for more timeline
Want more traffic as primary
- Should we do this before 1.0.0?
Nik is descending into Lucene land, trying to find ways to save us space without sacrificing features

Chipping away at scap refactor/python port
- Gerrit change 113652 add detailed duration timing for scap & scap-1
- Gerrit change 113996 remove external script dependencies from scap-1
- Add bootstrap initialization for l10n update in new branches https://gerrit.wikimedia.org/r/#/c/113260/
- Working on using ssh directly (bypasing dsh) to get better reporting/logging
  - Will be used for Bug 59922
Requests:
- Change wikiversions.dat to wikiversions.json (that is, update the PHP multiversion code to work with a JSON file rather than a custom .dat file format)
- Drop now-unused ext: field from CDB

Antoine (not here, copy/paste from RelEng/QA weekly):

Status: In progress Complete integration of browsertests for VisualEditor
- One build worked and triggered two successful scenario!!
Status: In progress Train Zeljkof on Jenkins Job Builder script
- Zeljkof started on it. Will pair with him to finish up.
Status: In progress Help migrating Cloudbees Jenkins template to JJB YAML templates
- Zeljkof started on it. Will pair with him to finish up.

https://bugzilla.wikimedia.org/show_bug.cgi?id=61491 - “no WikiEditor edit controls on any page in beta labs”
https://bugzilla.wikimedia.org/show_bug.cgi?id=54193 - “Recursion detected in RequestContext::getLanguage” still out there waiting for an awesome fix (51422 times in the last 7 days)