Wikimedia Release Engineering Team/Checkin archive/20151116

2015-11-16

Vacations/Confs/etc

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Nov 25: Greg - Half day (working that morning)
• Nov 26: US HOLIDAY - Thanksgiving
• Nov 27: US HOLIDAY - Day after Thanksgiving
• Dec 2?-Jan 0x - Antoine, no clue yet
• Dec 4th: Greg - disconnected, leaving Thursday evening, returning Sunday :)
• Dec 21-Jan 1: Greg - vacation, at least (maybe part of the week before)
• Dec 22-29: Chad - Christmas
• Dec 23–25: Tyler — Hopeful, probable, Christmas in Kansas!
• Dec 24-Jan 3: Dan - Holidays (probably)
• Dec 25: US HOLIDAY - Christmas Day - December 25
• Jan 1: US HOLIDAY - New Year's Day
• Jan 4 - 8: WikiDev16 + All Hands
• Jan 16-18: Chad - another music festival
• Jan 18: US HOLIDAY - Martin Luther King Day
• Feb 15: US HOLIDAY - President's Day
• May 30: US HOLIDAY - Memorial Day
• June-ish: Chad - EDC
• August: France holiday - because french. :)

Team Business

Actions from last meeting

• IN PROGRESS - Chad: re 1.26 release: "Going to push on all the assigned ones and find assignees for the remainder this week."
  • Dan to continue to bring up in SoS
  • Release is next week, the 25th of Nov. before thanksgiving (US Nov 26th).
• TODO - Greg: re KPIs, do mw core gate-processing time for this quarter, reassess for next quarter if needed
• TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
  • ACTION: Antoine to create a task

WIkiDev16

• Code Review RFC - https://phabricator.wikimedia.org/T114320
• Scap3 - https://phabricator.wikimedia.org/T114045

Other

• Just FYI, deployment: https://wikitech.wikimedia.org/wiki/Deployments#End_of_year.2Fbeginning_of_new_year_.27code_freezes.27

• Hate to say it: time to talk Q3 ;)
  • https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q3

Staging

• Let's not do this
• Explore the idea: https://phabricator.wikimedia.org/T115497 Survey on needs related to Beta Cluster/Staging
• Roll the ideas from staging into beta? Auto-provisioning, recent distros, puppet cleanup, etc?
• End goal: make sure problems in production are reproducible

• Moving target trying to keep up with ops
  • ACTION: schedule time with ops to discuss dedicated opsen to help plan/review/merge
    • Promote shared ownership of ops/puppet related to BC/Prod
    • Talk about practices around puppet manifests (improvements in envirinment neutrality, taking care of existing debt)

• • Why?
    • reduce tech debt
    • fewer times bugging ops for help :)
    • making production errors (more) reproducible on Beta Cluster
    • helps find the gross corner cases in prod puppet (eg: tin, you can't just apply the deployment:: role on it and have it work)

• Differential
  • Rfc on track for end of Q2/Dev Summit
  • Q3 will likely be spent responding to concerns, defining workflows, planning for migration
  • Will not be rolling out or performing any substantial migration
  • find more standalone/early adopter projects
  • End of Q3/early Q4 for MW and extensions moving over

• QA Health Dashboard
  • What is the scope/purpose of this project?
    • One possibility is to show (us?) which projects are using which libraries/versions, data on unit/integration tests, coverage, etc.
    • API for querying this data would allow for ad hoc, more team specific dashboards

Example: https://www.mediawiki.org/wiki/User:Legoktm/ci http://raita.wmflabs.org/ ?

New vs Maint time spent

• https://docs.google.com/a/wikimedia.org/spreadsheets/d/1FI90AefwdLHGzVVdrLS6AxcTcJtLFyX0aQTQfyc88s4/edit

#together

• Team workboard: to triage: https://phabricator.wikimedia.org/project/board/20/query/TRiVy4zOMdR./
• Team workboard: only-in-#releng(ish): https://phabricator.wikimedia.org/project/sprint/board/20/query/g2T5.QSLJVRQ/

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

• Scream about MW release 1.26

Project Updates

CI Scaling

https://phabricator.wikimedia.org/project/board/1010/

Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106

• Additional zuul-merger on labs host (Tomorrow 3pm UTC with Andrew B.)
• Tyler/Mukunda got rid of ZUUL_UID for the publish jobs, let us push doc from Differential.
• random reviews and infra related stuff (Zuul/Nodepool package updates)
• zuul-cloner ready to clone from local mirrors
• rake entry point being generalized

Deployment Cabal

Main: https://phabricator.wikimedia.org/project/board/349/

Scap3: https://phabricator.wikimedia.org/project/board/1449/

Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926

• Chad/bd808/Mukunda: Lots of work on Scap Dual Masters
• Dan Initial Debian packaging work
• Mukunda: Service checks documentation, restructuring of docs
• Documentation autogeneration merged Friday
• patch for mirroring masters
  • ops/puppet change: https://gerrit.wikimedia.org/r/#/c/253040/
  • scap change: https://phabricator.wikimedia.org/D48
• docs: https://doc.wikimedia.org/mw-tools-scap/index.html

Diff[usion|erential] migration

https://etherpad.wikimedia.org/p/diffuerential-weekly

Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/

Quarterly Goal: https://phabricator.wikimedia.org/T111465

Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

(Greg can create some tasks for these if/as needed)

• Antoine + Mukunda should sit down and talk CI/Harbormaster/Nodepool
  • Mukunda just needs to find time to finally test out harbormaster triggering jenkins jobs.
• Find some Differential Ambassadors for each vertical
  • bd808 for Reading

Release MediaWiki 1.26

https://phabricator.wikimedia.org/project/board/1177/

Release date 11/25

Beta Cluster

https://phabricator.wikimedia.org/project/board/497/?order=priority