Wikimedia Release Engineering Team/Checkin archive/20191211
Appearance
2019-12-11
[edit]Vacations/Important dates
[edit]- December 1–2: Jeena
- December 6: Lars (Finnish Independence Day)
- December 23: James, Brennen, Greg (need to put it in Namely)
- December 23–January 2: Lars
- December 24–31 (Christmas): Staff with reqs (everyone? (yes))
- 1 January (New Year's Day): Staff with reqs, Lars
- 2–3 January: James
- 20 January (Martin Luther King Jr. Day): Staff with reqs
- 17 February (Presidents' Day): Staff with reqs
- 9 March (DST+1 day): Staff with reqs
- 24 April (Not-Easter): Staff with reqs
- 25 May (Memorial Day): Staff with reqs
Rotating positions
[edit]Train
[edit]- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)
- 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan
- 9 Dec - wmf.10 - Dan + James
- 16 Dec - wmf.11 - James + Jeena
- 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
- 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
- 6 Jan - wmf.14 - Jeena + Lars
- 13 Jan - wmf.15 - Lars + Antoine
SoS
[edit]- Aug 14 onward: Zeljko 🎸 🎷 \o/
Team Business
[edit]Incoming/Needs attention
[edit]- New skill matrix: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
- New workboard for December: https://phabricator.wikimedia.org/project/view/4401/ -- make sure your tasks look right
- Create and maintain somehow a list of repos mastered in GitHub (and in Differential) https://phabricator.wikimedia.org/T237470
- Support MarcoAurelio and make it semi-automated? Halp.
- SoS: Site Reliability Engineering - Requesting follow-up from Releng team regarding Gerrit/Zuul Prometheus metrics gerrit:479139
- TODO thcipriani: to reply/try to unstick
Offsite Actions
[edit]- 🏂 In progress [thcipriani] figure out what part of team meeting to move to phab
- 🏂 In progress (T240483) [James + Antoine] draft runbooks listing
- Very initial page at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Runbooks; more coming.
- brennen+antoine: jenkins upgrade runbook
- gerrit: runbook thcipriani
- Very initial page at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Runbooks; more coming.
- [dan + brennen] explore tools for pairing
- https://phabricator.wikimedia.org/T240484
- Ž: stumbled upon this recently https://pragprog.com/book/jkrp/remote-pairing
- [Dan + Jeena] add Blubber to local dev
- -> Q3 goals?
- [Mukunda] Phab to local dev
- -> Q3 goals?
- [thcipriani] lunch and learns
- [thcipriani/greg] Program/Project managers
- [JDF] highlighted this to Grace, so she expects outreach to understand the role.
Q3 (Jan–Mar 2020) Goal Planning is upon us!
[edit]Reduce Complexity of Platform Maintain and evolve developer tooling, testing infrastructure, validation environments, deployment infrastructure, and supporting processes
- Localdev mw/core (Brennen + Jeena)
- Gerrit 2.15 -> 2.16 (con't) (Thcipriani + Dan + Antoine)
- Phabricator: eliminate elasticsearch for phabricator search (Mukunda + Brennen) https://phabricator.wikimedia.org/T230787
Maintain and improve the Continuous Integration and Testing services
- Quibble extension.json parsing + migration (James + Antoine + Jeena)
- Pipelinelib documentation (Dan + Lars)
- Migrate zuul deployment to scap3 (Antoine + Mukunda)
- "integration" Cloud VPS project jessie deprecation (Antoine + James + Jeena)
- Unnamed "New CI work" TBD after meeting with SRE (Dan + Lars)
Developers have a consistent and dependable deployment service
- Scap: Use static php array files for l10n cache instead of CDB (Dan + Lars)
- Pipeline migrations (con't) (Dan + Lars + James)
thcipriani: bold future james: I prefer task heierarchy, things get ignored in a project workboard, project tags theoretically are for extended period rather than a 1-off project mukunda: we could use milestones instead antoine: I have been using subprojects for short-term projects -- I like looking at a workboard
Timespent spreadsheet
[edit]- For the avoidance of doubt: fill out the sheet week number for the previous week
- reminder: your time spent doesn't need to total to 100%
Book club
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Tuesday notes: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/How_to_do_a_code_review
- Summary
- generally liked the article
- had some concerns
- read the wikimedia page
- Add suggestions/remove suggestions: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club#Future_Recommendations
Monthly reflection on accomplishments - December '19 edition
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
- PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.
- Revived "This week in logspam" email
- Auto DBLists
- PGP Key repo
- Production config now has pre-merge diff reports, e.g.: https://integration.wikimedia.org/ci/job/operations-mw-config-php72-composer-diffConfig-docker/86/console
Scrum of Scrums for next week
[edit]Internal team notes, not for pasting into the SoS notes
[edit]Incoming from last week (aka this morning)
[edit]- Blocked by:
- Blocking:
- Site Reliability Engineering - Requesting follow-up from Releng team regarding Gerrit/Zuul Prometheus metrics gerrit:479139
- Updates:
- Train Health
- Last week: 1.35.0-wmf.8 - phab:T233856 - group1 + group2
- This week: 1.35.0-wmf.10 - phab:T233858
- Next week: 1.35.0-wmf.11 - phab:T233859
- Train Health
Callouts
[edit]- Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break
Outgoing next week
[edit]- Blocked by:
- Blocking:
- Updates:
- Train Health
- Last week: 1.35.0-wmf.10 - phab:T233858
- This week: 1.35.0-wmf.11 - phab:T233859
- Next week: No Train - 2 weeks!
- Train Health
Callouts
[edit]- Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break
Train status and happenings
[edit]Standup!
[edit]- Make sure your tasks are correct on our kanban board!
Antoine
[edit]Last week
[edit]- Best thing
- Debian glue moved to Buster (less Jessie, newer versions of pristine-tar / git-buildpackage etc). \o/
- Worst thing
- Gotta get Doxygen 1.8.16 packaging reviewed and published to apt.wm.o.
- What I planned vs did
- Phase out Jessie draft doc
- filed some tasks for its workboard https://phabricator.wikimedia.org/project/view/4080/
- Unplannned
- Github replication transiently broken! :-)
- A bit of cleanup for Zuul package
- Storybook for MobileFrontend https://phabricator.wikimedia.org/T239246
- Brennen and I will upgrade Jenkins instances Monday 12/16 16:00UTC
This week
[edit]- What I plan to do
- Blockers
Other
[edit]
Brennen
[edit]Last week
[edit]- Best things
- https://squiggle.city/~brennen/tree_rex.mp4
- (We won the marching division in the town holiday parade.)
- https://squiggle.city/~brennen/tree_rex.mp4
- Worst thing
- What I planned vs did
- Done Finish deploying 1.35.0-wmf.8
- Not done Update skill matrix
- Done Read for book club
- Done Fill out offsite survey
- Not done Keysigning!
- Not done Hack on T238224 Provide docker-compose based development enviornment in mediawiki core
- Unplannned
This week
[edit]- What I plan to do
- Keysigning
- Skill matrix
- Pair with Antoine on T239985 Upgrade Jenkins to 2.190.3
- Give more useful input on:
- 555750: Add missing runuser for Apache and make directory for php-fpm
- 555914: Add php-fpm/apache image for use with MediaWiki Dev Env
- 550708: (DNM) Proof-of-concept Docker development environment
- Pay attention to Mukunda's input in betterworks, figure out when to pair on phab
- Deal with open enrollment
- Blockers
Other
[edit]- Shifting some time around this / next week for end-of-year medical appointments and such
Dan
[edit]Last week
[edit]- Best thing
- Learning how to document more effectively
- Used branch.py to cut the wmf branch yesterday \o/
- Thanks to Mukunda for his work on that script!
- Noemie (daughter) got to sleep on her own and slept for 12 hours straight last night
- Worst thing
- What I planned vs did
- Done Come up with questions for SRE re: third-party vs. WMF K8s platform
- In progress Reaquaint myself with scap codebase and look at ways to support PHP-based l10n
- Not done Talk to Brennen about pairing tooling research and experimentation
- In progress PipelineLib/Blubber user documentation
- Done (not needed) PipelineLib git clone improvements (depth and parallel clone support)
- Not done Tooling to simplify easier taskification of daily work
- Not done Taskify the above
- Unplannned
This week
[edit]- What I plan to do
- Train
- Continue improving Pipelinelib + Blubber documentation
- Establish a collaborative RelEng/SRE process for refining Seakeeper proposal
- Blockers
Other
[edit]
Greg
[edit]Last week
[edit]- Best thing
- Lost power for an hour, got to talk to some neighbors for a bit
- Worst thing
- I'm trying to be positive, yo
- What I planned vs did
- MTP/OKR metrics working group - going well
- leveling/job codes - done for now
- Unplannned
- NewCI discussion with Erika
This week
[edit]- What I plan to do
- TechConf review, but that will most likely slip to next week, given my week is 4 days long in December
- NewCI discussion with SRE (done)
- MTP/OKR conversation with Birgit re renaming/titling the "Reduce Complexity" Key Deliverable
- TechConf retro tomorrow morning with the ProgramCommittee
- oh right, US Benefits confirmation
- Blockers
- time, self inflicted (taking off Fridays)
- Rowan's 8th bday today
Other
[edit]James
[edit]Last week
[edit]- Best thing
- Worst thing
- Oy veh, the future of the containerisation project.
- What I planned vs did
- Done JDI for CI diff reports of MW config changes.
- Not done ? static config in production.
- In progress CI/CR metrics doc fiddles.
- In progress Runbooks documentation collation/writing.
- Unplannned
- Train UBNs.
This week
[edit]- What I plan to do
- Train support & other UBNs.
- CI metrics work.
- Removal of Ruby daily selenium jobs, as part of contint1001 jessie->buster work.
- Liaison between teams re. competing deployment thoughts.
- More runbooks documentation.
- Blockers
- —
Other
[edit]- Next week I'll be working from London, not San Francisco.
Jeena
[edit]Last week
[edit]- Best thing
- judo :D :D :D
- Worst thing
- The dark days are here
- sick again
- What I planned vs did
- Done Get caught up
- Not done key signing
- Unplannned
- Code Reviews
- Updating patchsets
- Book club
- Reading
- interview planning
- all hands registration
- benefits registration
- local dev meeting
This week
[edit]- What I plan to do
- review kosta's parchset for local dev
- train (https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Pairing_on_the_Train )
- make tasks for local dev
- interview
- keysigning
- Blockers
Other
[edit]
Lars
[edit]Last week
[edit]- Best thing
- Saw the Sun one day, for a whole half hour.
- Worst thing
- Only saw the Sun for half an hour.
- What I planned vs did
- Done Write and send out howto for signing PGP keys. phab:T239829
- Read TechConf and offsite notes, extract any useful bits.
- Done Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
- Do an Argo test deployment.
- Done Start work on documenting pipelinelib so it can be re-implemented for new CI.
- Book club.
- Unplanned
- n/a
This week
[edit]- What I plan to do
- Do a first draft of a threat model for CI
- Read TechConf and offsite notes, extract any useful bits.
- Do an Argo test deployment.
- Meeting before this one remove my mental block and gave me hope
- Blockers
Other
[edit]- Less than two weeks until solstice! Days will be getting longer again!
Mukunda
[edit]Last week
[edit]- Best thing
- Phabricator is on phab1001, Debian 10, failover very is well tested (monthly accomplishment!)
- Worst thing
- Phabricator notification server is (still) broken and will likely remain that way until DZahn returns from vacation
- What I planned vs did
- Done Finish my phabricator redundancy OKRs
- Not done Look into open-sourcing phabricator-antivandalism as I finally have the OK from our security team.
- Unplannned
- Added a "Backup train conductor" custom field to Maniphest (monthly accomplishment! -- also, awesome!)
This week
[edit]- What I plan to do
- Talk to brennen about phabricator pairing
- Work on code review working group stuff: patch triage / code review office hours
- Task grooming
- Blockers
- Need DZahn to be back from travel / vacation.
Other
[edit]
Tyler
[edit]Last week
[edit]- Best thing
- team is awesome
- Worst thing
- end of year brain dissolving
- What I planned vs did
- Done Wrangle hiring loop
- Done ish Build SPoF program
- Done ish Q3 planning kickoff
- Not done Do keysigning!
- Done Register for all-hands (everyone!)
- Unplannned
This week
[edit]- What I plan to do
- benefits in namely
- Q3 planning/SPoF/Changes to this meeting
- Blockers
Other
[edit]
Zeljko
[edit]Last week
[edit]- Best thing
- talked at a local tech meetup abot software testing anti-patterns 🎸
- Worst thing
- safeguard 🤦♂️
- What I planned vs did
- ❌ work on testing related questions for interviews with developers ❓
- ✅ expense report (Coupa)
- ✅ prepare to close my company: paperwork, meet with accountant... 👔
- ❌ read article for book club (can not attend book club) 📖
- ✅ prepare talk about software testing anti patterns for local tech meetup 🎤
- ✅ use more emoji 🤠
- Unplannned
This week
[edit]- What I plan to do
- read article for book club 📖
- follow up on various tasks from techconf 👨💻
- Blockers
Other
[edit]- I'm buying a Synology NAS for months now, hopefully I'll actually buy it this week 💾