Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140407

who: Nik!, Greg!, Bryan!!, Brad?!, RobLa, Ori, Chris, Aaron, Dan, Tim regrets: Antoine

l10nupdate
- add snapshotting to the l10nupdate script for today’s
- run scap again today, see if it changes things? (but that’d be weird…)
- Bryan to check in with Tim/Greg at end of day, hand off to Tim if needed

Revision storage:

Sean doesn’t think the revision table is currently a performance bottleneck. “The true pain is in special page queries, mainly anything under IndexPager: they could all use a rethink.” He is interested in a design stage comparing TokuDB with Cassandra: “Tokudb engine is almost as exciting as cassandra. revision, logging, the *links tables, anything with more than a couple indexes, could all be candidates for tokudb”

Deployed to most of the wikis last week. Performance just fine, but none of them were big.
Upgrading to Elasticsearch 1.1.0 Tuesday.
- We’ll use this opportunity to test out the new git-fat based fat artifact deployment for Elasticsearch plugins. We’re the guinea pigs here.
- Going to do another round of performance testing after the Elasticsearch cluster has stabilized after the upgrade. Should be better than last time but will definitely find more to improve.
- We have tons (5ish) waiting on this release so we’ll get started on those as soon as it is in production
Highlighter
- Deployed to beta but not in use (waiting on the review from Chad)
- Released to the public (on maven central)
- Moved to Gerrit
- Still waiting on a review from Elasticsearch folk

Migrate profiler report to <http://performance.wikimedia.org/profiler/report>
Update HHVM on Beta to 3.0; various fixes to get it to work. Still WIP.
- Extensions that shouldn’t be loading are cited in tracebacks. Not sure why. (example)
(w/bblack) Pushing for gzip compression for SVGs on upload varnishes <https://gerrit.wikimedia.org/r/#/c/108484/>
Added per-wiki job queue stats information <https://gerrit.wikimedia.org/r/#/c/123493/>
Made BagOStuff fail fast in CAS / lock on certain errors, to avoid wasting time waiting on servers that are down. <https://gerrit.wikimedia.org/r/#/c/123041/>
Working on Zurich performance workshop and Wikimania talk