Wikimedia Release Engineering Team/Checkin archive/20151013

2015-10-13

Vacations/Confs/etc

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Oct 12-16: Ops team offsite
• Oct 16: Željko - EuRuKo (European Ruby Conference), Salzburg, Austria
• Oct 16: Dan - Vacation in Denver
• Oct 16 - 20: Andrew - Vacation
• Oct 23 Friday: Antoine -
• Nov 11: US HOLIDAY - Veterans Day
• Nov 26: US HOLIDAY - Thanksgiving
• Nov 27: US HOLIDAY - Day after Thanksgiving
• Dec 25: US HOLIDAY - Christmas Day - December 25
• Jan 01: US HOLIDAY - New Year's Day
• Jan 16-18: Chad - another music festival
• Jan 18: US HOLIDAY - Martin Luther King Day
• Feb 15: US HOLIDAY - President's Day
• May 30: US HOLIDAY - Memorial Day
• June-ish: Chad - EDC
• August: France holiday - because french. :)

Team Business

Deploy+database create

• https://phabricator.wikimedia.org/T110619#1714416
• "Enable EducationProgram extension on Serbian Wikipedia (srwiki)"

• https://phabricator.wikimedia.org/T111630 for enwikiversity, on hold still.

WIkiDev16

Ours

• Sessions that made first deadline:
  • Code-review migration status/discussion (aka Differential migration RFC) - https://phabricator.wikimedia.org/T114320
  • Scap3: updates, upgrades, and challenges - https://phabricator.wikimedia.org/T114045
• What we need to do:
  • By 6 Nov 2015 (one month), all Summit proposals must have active discussions and a Summit plan documented in the description.

New vs Maint time spent

• https://docs.google.com/spreadsheets/d/1FI90AefwdLHGzVVdrLS6AxcTcJtLFyX0aQTQfyc88s4/edit#gid=0
• Enter your time spent for *last* week

#together

• Team workboard triage https://phabricator.wikimedia.org/project/board/20/query/open/

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

• Parsoid runs / self deploy from source now. Task kept open until confirmed to be done.
• https://phabricator.wikimedia.org/T115302#1721963 (Just FYI)

• Will announce:
  • Deployment tooling progress (feature completion and usage in Beta Cluster)
  • Recent use of Diff
  • CI scaling updates (job migration)
  • MW release 1.26 Nov 20-ish

Project Updates

Deployment Cabal

Main: https://phabricator.wikimedia.org/project/board/349/

Scap3: https://phabricator.wikimedia.org/project/board/1449/

Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926

• Plan: "feature complete" by Friday (knock on wood)
• Use scap to deploy AQS on Beta Cluster
• Security blah

CI Scaling

https://phabricator.wikimedia.org/project/board/1010/

Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106

• Paladox Whitelisted!

• Bitrotting extensions :-/
  • https://phabricator.wikimedia.org/T115262 (created, never used)
  • Let's send an email to wikitech-l?
  • cognitive and technical overhead
  • If it is still working keep it!
  • Challenge is finding broken extensions, that we should archives

Nodepool migration status:

• Python jobs almost all migrated to Nodepool
• Ruby / Bundler:
  • Nodepool instances ready
  • Agreed on using rake. Test target is mediawiki/vagrant
• JavaScript / Npm:
  • Puppetization ongoing. Nodepool instance to be ready this week
  • Jobs to follow
• PHP / Composer and rest of MediaWiki
  • On hold

• Splitting Zuul gate queues.
  • Probably want to hack Zuul. Kunal has a patch pending
  • Gotta upgrade Zuul
  • Deploy it (for zuul-cloner) within a venv on Nodepool instances

Phabricator/Diff[usion|erential] migration

Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/

Quarterly Goal: https://phabricator.wikimedia.org/T111465

Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

• scap usage
  • Chad has picked up odd behaviors from Gerrit :)

arc land seems to be rewriting the commit's author field. Apparently this alternative method of landing a patch preserves the author:

arc patch --nobranch D9 git push arc close-revision D9

Release MediaWiki 1.26

https://phabricator.wikimedia.org/project/board/1177/

• Should we get all bundled extensions to be migrated to extension.json ?
  • Chad: Good idea :)
  • need a task? add to a checklist?
  • + test entry point npm/composer
  • + banana l10n lint
  • Chad: working on release stuff this week

• Watch out as @master are switched to use composer test / npm test. Might be missing from REL branches.
  • Some doc at https://www.mediawiki.org/wiki/Continuous_integration/Entry_points or mediawiki/extensions/BoilerPlate.git

• Date?
  • November 20ish

Developer Tooling (MW-Vagrant, MW-Selenium, etc.)

• Selenium user uploading files to production Commons: https://lists.wikimedia.org/pipermail/qa/2015-October/002410.html

Beta Cluster

https://phabricator.wikimedia.org/project/board/497/?order=priority

• nothing significant. Stuff got handled.