Wikimedia Release Engineering Team/Checkin archive/20170501

2017-05-01

Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List

How to do it

• May 1: Željko local holiday (Labor Day / May Day)
• May 3: Greg going beach
• May 5: Mukunda day off?
• May 15-18: Team Offsite in Vienna
• May 16-18: Mukunda vacation time?
• May 19-21: EU Hackathon
• July 10-14th: Tyler adventure time

Team Business

Time spent spreadsheet

• week: 17: https://docs.google.com/spreadsheets/d/1I9VraCrlQLK3KjbS4yi3K8XgLQ2SgyADMNH1dh1ky1A/edit#gid=1805132183

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

April 17 and Apr 24

• Train: Mukunda
  • week of 17th: no deploys (dc switchover)
  • wmf.21
• SoS: Tyler
• Out:
  • April 17th: Antoine travel
  • April 19-21: Željko vacation
  • April 27-29th: Antoine in Amsterdam (unreacheable)

May 1 and May 8

• Train: Mukunda
  • week of the 1st: no deploys (dc switchover)
  • wmf.1
• SoS: Tyler
• Out:
  • May 3: Greg going beach

May 15 and May 22

• Train: Tyler
  • week of 15th: team offsite, no train
  • [ wmf.2]
• SoS: Mukunda
• Out:
  • May 16-18: Mukunda vacation time?

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
• Updates

Last week

• Blocking
• Blocked
  • symlink scap sync thing with Jon Robson
    • in team meeting discussion about how we might address this
• Updates

Logspam

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

• Most interesting thing is that there's not much that's interesting.
• Anything that shows up is really new and gets addressed pretty quickly
  • modulo redis timeouts....

Offsite

• Brainstorm etherpad: https://etherpad.wikimedia.org/p/RelEng-Offsite-2017-05-Topics-brainstorm
• Logistics: https://docs.google.com/document/d/1yq4y9srT0bW1ZWT8Kt5zpaQscQcw3uWFHsOb9Hfre30/edit#heading=h.p27l44qc76kn
  • Just FYI at this point, but our dinner reservations are already made if you care

Q4 goal/project check-in

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q4

Streamlined Services Delivery

Build a runnable image from tested and confirmed code that is suitable for promotion.

define 'tested and confirmed' / determine the entry-point for building a container

generate or consume a docker file for building

build image, upload and tag it in docker registry

• Dan met with Marko re: Blubber and Service Builder to reconcile and deduplication work
  • Marko asked: Why Go? Response: err, duurrr, iono. Thoughts? Rewrite in Node? *Let's get more feedback in the weekly Pipeline meeting.*
  • Service Builder has been broken out into its own tool
  • K8s parts have not been shared/committed yet but curious to see them

• Working on ranking the stuff from JR's document async and will talk about it

Train 2.0

Move MW+Extension deploys to scap3 - task T114313 (part 3)

Integrate scap with etcd/pybal to automatically depool and repool servers - task T104352

• discussing conftool on deployment hosts, stil in progress

Release MediaWiki 1.29

A quality MediaWiki 1.29 is successfully released - task T153271

• Chad did a branch

Non-Quarterly goal work

Quality

Quality improvements

(aka JR's work, I just thought of a quick/basic name, feel free to change :) )

• posted to engineering@
• probably talk about at hackathon

Browser tests

• zeljko not here

Phabricator

• phab1001 is ready
  • we now have: phab2001, phab1001, and iridium (need to decom iridium)
• DOS issue to look into
• Task types

People status updates

Antoine

Last week

• Travel

Chad

Last week

• MW 1.29
• Gerrit security thing (again)

This week

• Scap
• mw release pipeline stuff
  • Got server last week, starting puppetiziation

Dan

Last week

• Work more on proofing Blubber

This week

• Assess Service Builder and reconciling features with Blubber

JR

Last week

• Test data wrangling improvements
• Bug data wrangling improvements
  • engaged with analytics team to discuss

This week

• Test data wrangling improvements
• Bug data wrangling improvements

Mukunda

Last week

• Train MW-1.29.0-wmf.21
  • Lesson learned: when branching goes wrong, start over, don't try to fix things. It's not worth it - too many things to go wrong.
• Further investigate Phabricator outages
  • No progress, need feedback from ops
• Phabricator update (pull from upstream)
  • done
• SCAP3 stuffs
  • No progress

This week

• Several small phabricator things for this week
  • phab1001 is now ready
  • I want to get task types merged soon if I can get ops attention
    • https://gerrit.wikimedia.org/r/#/c/345618/
  • Still need to investigate the outages (need ops input on this as well)
• Requested friday off (in namely and at the top of etherpad)

Tyler

Last week

• Build image with blubber to push to ci-staging
• scap canary work:
  • https://gerrit.wikimedia.org/r/#/c/348475/
  • https://phabricator.wikimedia.org/T136839

Željko

Last week

• T162966 Figure out why browser tests can't create suggestion box
• T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done() callback is being called in this test.`