2023-10-25

Last time

🏆 Wins

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments

Oct '23 edition

https://phabricator.wikimedia.org/T347577 digging into diffusion hosting sorting
Bitergia user data is now a webapp and we can use it
Project Catalyst is underway -- https://wikitech.wikimedia.org/wiki/Catalyst
RelEngers can downtime things for phabricator deploys without SRE (although cookbooks are less fiddly)
Ran train with Andre!
Phab deploy!
libs/metrics-platform moved over
Clarified language on backports: https://phabricator.wikimedia.org/T344409
Investigated hidden repositories in GitLab
Prettified puppet compiler output
fresnel updates for dependencies
Jaime working on project catalyst
Gerritlab revised branch naming landed

OKR update

Last week

The six questions I answer week-by-week about our work. This is pretty much all CTPO/VP/Director-types see for what we're doing. If there are specific things to call out here, let's do.

🚧 At risk (for the past two week)

Progress update on the hypothesis for the week
- T349214 Began spike investigating Zuul for CI in GitLab
  - This provides cross-repo dependencies, needed for MediaWiki + extensions + skins and operations/puppet
  - Goal is to have a proof of concept and design doc
- T342317 – Documentation improvements (Tech Docs Team)
  - Planned user research questions, scheduled meetings, and started interviews
  - Started review of existing deployment pipeline docs
- T344733 – mediawiki/libs/metrics-platform is fully migrated to GitLab
Any new metrics related to the hypothesis
- Repositories on Gerrit increased (2001 last week → 2003 this week) (making this "at-risk")
- Projects on GitLab increased (1437 last week → 1459 this week)
Any emerging blockers or risks
- Workflow for creating merge requests sometimes results in changes that the repository owner can't merge. Commented on the Upstream issue #23308 about why this is a problem and how it's handled in GitHub. Upstream has not engaged. Will flag with our with contacts at GitLab.
Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now?
- No
Have there been any new learnings from the hypothesis?
- Reached out to Ben Cooksly from KDE to ask about how they handle group webhooks (see last week's "risks"). They're handled in the same way we currently handle disabling issues and wikis: scripts that call out to the GitLab API to manage each project.
- We'll likely copy this model and expand our current api scripting to manage more projects.
Are you working on anything else outside of this hypothesis? If so, what?
- Train/Backport deployments
  - Mediawiki 1.42.0-wmf.1
    - 311 Patches ▁█▅▁▂ in 70 repos by 69 authors
    - 0 Rollbacks ▁▁██▁
    - 0 Days of delay ▁▁█▁▁
    - 2 Blockers █▂▁▄▁
- Phabricator deployment
  - T325239 – When a task has patches that resolve it, we show them at the top of the task. Now each patch has a status indicator to show the state of the task.
  - Uninstalled phabricator's CI system, dry dock (because we don't use it and don't want to)
  - Fixed a few exceptions that were in the error logs

This week

Progress update on the hypothesis for the week

Any new metrics related to the hypothesis

Any emerging blockers or risks

Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need?

Are you on the hook to give another team something you aren’t able to give right now?

Have there been any new learnings from the hypothesis?

Are you working on anything else outside of this hypothesis? If so, what?

🌻 Open source/Upstream contributions

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream

Small doc update for Bazel https://github.com/bazelbuild/bazel/pull/19676
Zuul GitLab driver improvement https://review.opendev.org/c/zuul/zuul/+/899425

😶 Let's keep these empty

📅 Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

October 2023

2-16 Oct: Jaime
02-03 Mon-Tue Oct: Dan
9 Oct: Indigenous people's day
19/20 Oct: Andre partially off (2x half-day)
26, 27: Antoine
27 Oct: Jaime

Nov 2023

1 Nov: Antoine, Jaime (all-saints holiday)
16 Nov: Jaime
20–24: dancy taking thanksgiving week off
23, 24: US holiday staff with reqs

Dec 2023

a few days after December offsite: Andre
25–Jan 1: End of year global holiday

Future

15Jan - 15Mar: Andre

🔥🚂 Train

https://tools.wmflabs.org/versions/

https://train-blockers.toolforge.org/

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

2 Jan - wmf.17 - Dan + Antoine (Jaime out)
9 Jan - wmf.18 - Jeena + Dan (Jaime out)
16 Jan - wmf.19 - Jaime + Jeena
23 Jan - wmf.20 - Brennen + Jaime
30 Jan - wmf.21 - Ahmon + Brennen
6 Feb - wmf.22 - Chad + Ahmon
13 Feb - wmf.23 – Dan + Chad
20 Feb - wmf.24 – Antoine + Dan
27 Feb - wmf.25 – Jaime + Antoine
6 Mar – wmf.26 – Jeena + Jaime
13 Mar – wmf.27 – Brennen + Jeena
20 Mar – wmf.1 – Ahmon + Brennen
27 Mar – wmf.2 – Chad Dan + Ahmon
3 Apr – wmf.3 – Antoine + Dan
10 Apr – wmf.4 – Chad + Antoine
17 Apr – wmf.5 – Jaime + Chad
24 Apr – wmf.6 – Jeena + Jaime
1 May – wmf.7 – Brennen + Jeena
8 May – wmf.8 – Antoine + Brennen (Ahmon out + Antoine Out 8th)
15 May – wmf.9 – Ahmon + Antoine (Dan out + Chad out)
22 May – wmf.10 – Chad + Ahmon (Dan out + Jeena out 26th)
29 May – wmf.11 – Dan + Chad (Memorial Day 29th)
5 Jun – wmf.12 – Jeena + Dan (Brennen out, Jaime out)
12 Jun – wmf.13 – Jaime + Jeena
19 Jun – wmf.15 – Cancelled for offsite
26 Jun – wmf.16 – Brennen + Jaime (Jeena out)
3 Jul – wmf.17 – Antoine + Brennen (3rd + 4th holidays)
10 Jul – wmf.18 – Dan + Antoine (Ahmon out)
17 Jul – wmf.19 – Ahmon+Dan (Brennen out Friday)
24 Jul – wmf.20 – Jaime+Ahmon
31 Jul – wmf.21 – Ahmon+Jaime (Jeena out, Antoine out) (Ahmon volunteered)
7 Aug – wmf. 22 – No train
14 Aug - wmf.23 – Ahmon+Jaime (Jeena out, Antoine out)
21 Aug - wmf.24 – Dan(brennen out, Jeena out, Antoine out)
28 Aug – wmf.25 – Jeena+Dan
04 Sep – wmf.26 – Antoine+Jeena
11 Sep – wmf.27 – Jaime+Antoine+Andre as lurker!
18 Sep – wmf.28 – Brennen+Jaime
- Logspam-watch needs some attention
- Every deploy is rebuilding l10n
25 Sep – 1.42.0-wmf.1 – Dan + Brennen
2 Oct – 1.42.0-wmf.2 – Jeena + Dan (Jaime Out)
9 Oct – 1.42.0-wmf.3 – Antoine + Jeena (Jaime Out)
- Vector skin issue, backport this morning!
16 Oct – 1.42.0-wmf.4 – Brennen + Antoine
23 Oct – 1.42.0-wmf.5 – Ahmon + Brennen
30 Oct – 1.42.0-wmf.6 – Dan + Ahmon
06 Nov – 1.42.0-wmf.7 – Jaime + Dan
13 Nov – 1.42.0-wmf.8 – Jeena + Jaime
20 Nov – 1.42.0-wmf.9 – No Train

Team discussions

We hired a backfill!
Reminder: next week is Daylight Confusion Time between CET and US-timezones
Post-mortem with security re: 1.41.0-wmf.28 is Monday
ITCs starting Soon™
Fill out travel info for offsite