Wikimedia Release Engineering Team/Checkin archive/20160711

2016-07-11

Vacations/Important dates

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• July 14th Antoine (bank holiday but got meeting :p)
• July 14t+15th: Tyler (friends coming to town)
• July 15th: Mukunda's Birthday on the 16th .. taking day off
• July 15th: Chad
• July 25 - August 15: Željko vacation
• July 30 - August 21: Antoine vacation. At home 1st week.
• August 1st - 5th: Mukunda - vacation: Concert & relaxation

...

• January 2017: Dev Summit + All Hands (presumably)

Team Business

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

weeks of June 27 and July 4

• Train: Mukunda
  • wmf.8
  • wmf.9
• SoS: Tyler
  • https://phabricator.wikimedia.org/E155/14
  • https://phabricator.wikimedia.org/E155/15
• Out:
  • Zeljko - June 20-18 (Wikimania)
  • Mukunda - July 1
  • All US - July 4th (Monday)
  • Tyler - July 8

weeks of July 11 and 18

• Train: Chad
  • wmf.10
  • wmf.11
• SoS: Tyler
  • https://phabricator.wikimedia.org/E155/16
  • https://phabricator.wikimedia.org/E155/17
• Out:
  • Tyler - July 14+15 (Thur+Fri)
  • Mukunda - July 15
  • Chad - July 15

weeks of July 25 and Aug 1

• Train: Tyler
  • wmf.12
  • wmf.13
• SoS: Mukunda
  • https://phabricator.wikimedia.org/E155/18
  • https://phabricator.wikimedia.org/E155/19
• Out:
  • Zeljko: July 25 - Aug 15
  • Antoine: July 30 - Aug 21
  • Mukunda: Aug 1-5

Time spent spreadsheet

• FYQ1 (July-Sept 2016): https://docs.google.com/spreadsheets/d/1IrwGPdTDZ6H8x9Mf5dmCYlkK4hZ8sbUSLODEM4cFc4g/edit#gid=0

Actions from last meeting

• none?

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

Last week

• Blocking
  • None?
• Blocked
  • Gallium phase out questions: https://phabricator.wikimedia.org/T133300
    • Pasted some IRC talk from chase
    • Other input welcome
• Update July 11th:
  • Chase/Tyler/Antoine had meeting on Thursday clarified lot of questions
  • scandium kind of old, might want a new host afterall (maybe contint1001?)

• • CI Documentation publication: https://phabricator.wikimedia.org/T137890
    • Mostly needs some network expertise
  • Scandium disk space: https://phabricator.wikimedia.org/T138955
• Updates
  • Train is back on track, wmf.8 to group1 today
  • 1.27 release is out (yay!)
  • Scap3 migrations continue (if you have questions, ask us! :))

This week

• Blocking
• Blocked
• Updates
  • Call out Gerrit upgrade/downtime if that's still relevant (no $DATETIME yet, but remind everyone that it *WILL* be happening *VERY* soon, so be aware)

Other Team Business

• Quaterly Review slide deck (April-June 2016): https://docs.google.com/presentation/d/1Q_p-CRv3flBuG2MxgY3mSDNJ1D0Mo0H83DQgNFTvFqw/edit#slide=id.ga4ecc5878_2_0
  • Please review, add any Successes or Misses that I, er, missed

• Upgrade mariadb in deployment-prep from Precise/MariaDB 5.5 to Jessie/MariaDB 5.10 https://phabricator.wikimedia.org/T138778
  • Blocking a wild range of feature requests
  • Need an owner and/or a pairing
  • What is the priority? Check with Jaime. TODO: Greg. We have other priorities.

• SWAT deploys next steps:
  • "Update new SWAT member process and deploying documentation in prep for adding European SWAT window" - https://phabricator.wikimedia.org/T139545
  • "Identify inaugural SWAT members for the European SWAT window" - https://phabricator.wikimedia.org/T139544
    • volunteers so far: Dereckson, JanZ, Antoine
  • Hold a couple official training runs? Just for EU timezones (eg: just Antoine) or something Mukunda/Tyler/Chad could do as well?
• Ideas
  • "see one, do one, revert one, teach one"
  • pair review documentation
  • TODO: Zeljko do an 8am Pacific SWAT deploy with Tyler
  • TODO: After that, update docs, after that, doit

• Team Offsite Planning:
  • Parent task: task T134830
  • Decision spreadsheets
    • Timing https://docs.google.com/spreadsheets/d/1slYNnWJOAoNGK0Hn7wtvvShD2_ORO07I0fWNokuMry8/edit#gid=0
      • Looks like Nov 14-18th
    • Location https://docs.google.com/spreadsheets/d/1_8KXdObI8tw033n4L245KoE1izgsdxp3h0BnZwGqk4s/edit#gid=0
      • See also: https://teleport.org/flock/#!/131a3d128f18418d
      • Chicago?
  • I have secured support :)

• TechDebt Analysis
  • https://docs.google.com/spreadsheets/d/1Kxj9p4fKVNo2h23yAQVoOGg77dZ4FLxeXuYrH-1CrPA/edit#gid=0
  • Please dedicated a couple hours this week to filling out the spreadsheet.

• Gerrit upgrade
  • what's left? Rumblings of Zuul issues?
  • potential Zuul issues need more testing

Q1 goal/project check-in

Phase out Ubuntu Precise

keyresult tasks:

• Replace primary production Continuous Integration host (gallium) - task T95757
• Upgrade Phabricator database servers to Maria10/Jessie - task T138460
• Upgrade Beta Cluster database servers to Maria10/Jessie - task T138778

Reduce Technical Debt

Perform a technical debt analysis of software and services maintained by WMF Release Engineering - task T138225

Streamline deployments

keyresult task:

• Convert our production deployment strategy to use long-lived branches - task T89945

Non-Quarterly goal work

CI Scaling/Nodepool

• CI Outage last week: https://wikitech.wikimedia.org/wiki/Incident_documentation/20160706-CI-Outage
  • Follow-ups:
    • https://phabricator.wikimedia.org/T139771 - "Identify metric (or metrics) that gives a useful indication of user-perceived (Wikimedia developer) service of CI"

Differential migration

Differential weekly (https://etherpad.wikimedia.org/p/diffuerential-weekly ) TODOs:

• Mukunda had questiosn for antione re puppet (keys into the private store, production or other? for CI image builder)
  • see: https://cloudbees.zendesk.com/hc/en-us/articles/203802500-Injecting-Secrets-into-Jenkins-Build-Jobs

• Update documentation on creating/renaming of repos in Diffusion
  • https://phabricator.wikimedia.org/T139688

• Update task with discussion about ACLs?
  • https://phabricator.wikimedia.org/T130786

• Announce plan to migrate MW-Vagrant to Differential
  • https://phabricator.wikimedia.org/T131419#2439362

Other

• Figure out how to help Jaime with the DB schema inconsistencies issue:
  • https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )
  • What can we do in CI to help prevent, mostly?

People status updates

Antoine

Last week

• track 1.28.0-wmf.8 blocking status (DONE)
• Look at labs overloading (DONE)
• Loop back with ops about scandium/network with Tyler (DONE)
• Paper work (DONE)
• European SWAT stuff (nop)

This week

• Gerrit upgrade / Zuul upgrade
• Target host to replace gallium
• Sync up with Tyler for CI / gallium phase out
• Moaar maintenance
• Offsite site/date

Chad

Last week

• Gerrit. Gerrit. Gerrit.

This week

• Gerrit. Gerrit. Gerrit.

Dan

Last week

• Getting back

This week

• Getting back

Mukunda

Last week

• Differential documentation
• migrating Bryan's repos

This week

• Phabricator upgrade on wednesday
• Figure out where to start on the long lived branches project

Tyler

Last week

• Scap packaing/features/stewarding
• WQDS deployment move
• Hopefully see some scandium movement!

This week

• contint1001 movement (hopefully)
• SWAT training
• Deployment tooling puppet work(?) possible.

Željko

Last week

• getting back
• survey

This week

• finishing migration of browsertests* Jenkins jobs to selenium* jobs https://phabricator.wikimedia.org/T128190
• Analyze (and share analysis of) the browser testing feedback survey https://phabricator.wikimedia.org/T139247
• Run language screenshots script for VisualEditor in Jenkins https://phabricator.wikimedia.org/T139613
• Figure out what to do with Firefox + Selenium https://phabricator.wikimedia.org/T137561
• SWAT training