Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140203

Mehmet GÜRBÜZ

Monthly Report

• https://www.mediawiki.org/wiki/Site_performance_and_architecture
• https://www.mediawiki.org/wiki/Wikimedia_Release_and_QA_Team
  • https://www.mediawiki.org/wiki/Deployment_Tooling
    • Should we say something about logstash here? Like “w00t! Logstash.wikimedia.org!”  Done
• https://www.mediawiki.org/wiki/Admin_tools_development
• https://www.mediawiki.org/wiki/Search
• https://www.mediawiki.org/wiki/Auth_systems

Search

• enwiki and huwiki a BetaFeature today
• More performance and accuracy fixes
• elastic1007 came back for a while today, then crashed again
  • Thought it was fixed, but it’s not. Gonna fix for reals next time.

Deploy Tooling

• (ori on plane) scap to python : https://gerrit.wikimedia.org/r/110904
  • Bryan’s notes on scap: https://www.mediawiki.org/wiki/Deployment_Tooling/What_does_scap_do
  • Script should have a link to that wiki page :-D Tip: we can later use sphinx to generate documentation for the scap script.
• fatalmonitor as logstash dashboard: https://logstash.wikimedia.org/index.html#/dashboard/elasticsearch/fatalmonitor
  • Needs a LDAP account in the wmf group (can be asked via RT/Chad).

Performance

• (Tim) Began design work for HHVM Lua extension
• (Aaron) ActiveUsers rewrite (pre-computed results)
• (Aaron) AbuseFilter throttler DB query tweak (hopefully should avoid incidents like the last one on enwiki)
• (Aaron) Job queue and parser cache usage tweaks
• (Aaron) Fixed broken query group handling in LoadBalancer
• (Chad/Nik) Not loading revision objects (+db hit) for every search result (for Cirrus. Lucene doesn’t do this)

Beta / CI

• experimented gating repositories sharing dependencies no plan yet
• catched up with VisualEditor browsertests. Got to polish this up this week
• started investigating using Vagrant to sandbox tests (basically reading doc)
• Icinga back on labs thanks to PetrB. http://icinga.wmflabs.org/icinga/ , page for beta

Gerrit

• Started playing with Phabricator because I hate Gerrit.
  • http://fab.wmflabs.org/
    • Make sure to ping Shahyar and Gilles about it !:)

Security

• Starting on Kafka / Hadoop review this month
• Training sometime this month

Bug escalation

• All the bugs are fixed

Architecture Summit

Followups

• (Aaron) Virtual REST stuff as a draft in gerrit
• (Nik) TitleValue, brainstorm ways to break everything apart?
• (Chad/Ori/Tyler/etc) Config classes - first implementation merged, cleanup in Gerrit now
• (CSteipp) Template engine working group
• (Bryan) Working on POC for using monolog to add structured logging. Changeset not committed yet.
• On your interested RFC: Move meeting minutes from etherpad to wiki
  • include action items/summary
  • mark any accepted RFCs as such