Wikimedia Release Engineering Team/Checkin archive/2023-11-01
2023-11-01
[edit]🏆 Wins
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Nov 23
- PoC for zuul delegating to GitLab pipelines works better than expected, surfacing in the UI works better than expected
- More catalyst changes: https://gitlab.wikimedia.org/repos/qte/catalyst
- Diffusion repository exploration is done!
Team Discussions
[edit]- Train 2024-01-02?
- Tentatively yes, schedule for the next couple months and recheck
- Investigation sprint Social Piranhas
Done, where did we land?
- Prepare for a Gerrit cleanup
Get an understanding of what repos are where (Gerrit, Phab, GitLab, GitHub(?)) Find repos that have no tests, haven't been touched, are in production Plan for how to clean up those repos
- Updates as of now
- Gerrit repos, GitHub, and GitLab in the database
- Need to put what phab is doing in the mix
- Phabricator
- Explicit Read/Write and "Default"
- releng/secrets
- WMDE: delete it
- Third one with one commit to delete
- After that, no canonically hosted repos in diffustion
- Open question how to avoid that in the future
- Mostly observing, some repos where we're mirroring
- Have not found a way to query via the api
- Missing:
- Last touch time
- What's in production—no idea!
- projects-cleanup
- Some call to engineering teams could make sense
- Toolhub has a maintainer.json—WMCS may have thoughts
- Updates as of now
- Prepare Zuul migration plan
- We've identified a continued need to use Zuul, but the version we're using it out-of-date
- Proof-of-concept for using the latest Zuul
- Get Quibble/Other MediaWiki tests working with latest Zuul
- Determine what we're exposing to end-users from Zuuls Ansible files
- Verify test with existing Zuul
- (stretch) work on migration plan
- Quibble works as-is pass the --skip-zuul command line arguments and rearrange the repos
- Haven't tested in the merge-gate scenario
- rearrange is a mv currently
- Antoine filed a ticket to make quibble handle new-zuul layout: https://phabricator.wikimedia.org/T349741
- There's quibble + apache config in container
- https://phabricator.wikimedia.org/T350288 Experiment with Zuul to GitLab CI pipeline delegation
- Prepare Zuul migration plan
- Next up
- https://phabricator.wikimedia.org/T350070 T350070 Ensure no security patches is an error condition for MediaWiki deploys
- https://phabricator.wikimedia.org/T350065 T350065 Notify MediaWiki security tasks as soon as an uploaded patch fails to apply
- Integrating Zuul with GitLab for users
- What is the .gitlab-ci.yml? How does it work?
- Run all the same jobs we run in Gerrit in GitLab
- Work to port GitLab-ci.yml files
- Already have a script that extracts a job's builders
- Gerrit clean-up-a-thon
- Ideal: Getting teams a list of repos we think are theirs, confirm it's a mirror (or not), keep or delete?
- How do we figure out the who...
- You touched it "most"
- Message managers: hey, trying to do some gerrit cleanup
- Figure out heuristics for "abandoned-looking" gerrit repos, figure out who touched it most, ask about it
- Gerrit clean-up-a-thon
🌻 Open source/Upstream contributions
[edit]- Zuul GitLab driver improvement https://review.opendev.org/c/zuul/zuul/+/899425
😶 Let's keep these empty
[edit]Code review
[edit]Gerrit Access requests
[edit]Private repo requests
[edit]https://phabricator.wikimedia.org/search/query/E7t2_WXX01bB/#R
Gerrit repo requests
[edit]GitLab Access requests
[edit]- Account Approval
- Accounts and auth
- GitLab access requests
- Look up username in LDAP ( https://ldap.toolforge.org/ )
- Look for contributions on Gerrit or Phab
High priority tasks
[edit]- UBN! + High: https://phabricator.wikimedia.org/maniphest/query/PkxR1BXrbbU4/#R
- New in inbox: https://phabricator.wikimedia.org/maniphest/query/7vRDrcVnt8OI/#R
📅 Vacations/Important dates
[edit]- https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023
- https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
October 2023
[edit]- 2-16 Oct: Jaime
- 02-03 Mon-Tue Oct: Dan
- 9 Oct: Indigenous people's day
- 19/20 Oct: Andre partially off (2x half-day)
- 26, 27: Antoine
- 27 Oct: Jaime
Nov 2023
[edit]- 1 Nov: Antoine, Jaime (all-saints holiday)
- 16 Nov: Jaime
- 17 Nov: Andre (public CZ holiday)
- 20–24: dancy taking thanksgiving week off
- 23, 24: US holiday staff with reqs
- some week in November, random Mondays or Fridays: andre
Dec 2023
[edit]- Dec11-15; Dec22: Andre
- 25–Jan 1: End of year global holiday
- 11 Dec - 14 Jan: Jaime (Vacation + Home move)
Future
[edit]- 15Jan - 15Mar: Andre
🔥🚂 Train
[edit]- https://tools.wmflabs.org/versions/
- https://train-blockers.toolforge.org/
- https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
- 2 Jan - wmf.17 - Dan + Antoine (Jaime out)
- 9 Jan - wmf.18 - Jeena + Dan (Jaime out)
- 16 Jan - wmf.19 - Jaime + Jeena
- 23 Jan - wmf.20 - Brennen + Jaime
- 30 Jan - wmf.21 - Ahmon + Brennen
- 6 Feb - wmf.22 - Chad + Ahmon
- 13 Feb - wmf.23 – Dan + Chad
- 20 Feb - wmf.24 – Antoine + Dan
- 27 Feb - wmf.25 – Jaime + Antoine
- 6 Mar – wmf.26 – Jeena + Jaime
- 13 Mar – wmf.27 – Brennen + Jeena
- 20 Mar – wmf.1 – Ahmon + Brennen
- 27 Mar – wmf.2 – Chad Dan + Ahmon
- 3 Apr – wmf.3 – Antoine + Dan
- 10 Apr – wmf.4 – Chad + Antoine
- 17 Apr – wmf.5 – Jaime + Chad
- 24 Apr – wmf.6 – Jeena + Jaime
- 1 May – wmf.7 – Brennen + Jeena
- 8 May – wmf.8 – Antoine + Brennen (Ahmon out + Antoine Out 8th)
- 15 May – wmf.9 – Ahmon + Antoine (Dan out + Chad out)
- 22 May – wmf.10 – Chad + Ahmon (Dan out + Jeena out 26th)
- 29 May – wmf.11 – Dan + Chad (Memorial Day 29th)
- 5 Jun – wmf.12 – Jeena + Dan (Brennen out, Jaime out)
- 12 Jun – wmf.13 – Jaime + Jeena
- 19 Jun – wmf.15 – Cancelled for offsite
- 26 Jun – wmf.16 – Brennen + Jaime (Jeena out)
- 3 Jul – wmf.17 – Antoine + Brennen (3rd + 4th holidays)
- 10 Jul – wmf.18 – Dan + Antoine (Ahmon out)
- 17 Jul – wmf.19 – Ahmon+Dan (Brennen out Friday)
- 24 Jul – wmf.20 – Jaime+Ahmon
- 31 Jul – wmf.21 – Ahmon+Jaime (Jeena out, Antoine out) (Ahmon volunteered)
- 7 Aug – wmf. 22 – No train
- 14 Aug - wmf.23 – Ahmon+Jaime (Jeena out, Antoine out)
- 21 Aug - wmf.24 – Dan(brennen out, Jeena out, Antoine out)
- 28 Aug – wmf.25 – Jeena+Dan
- 04 Sep – wmf.26 – Antoine+Jeena
- 11 Sep – wmf.27 – Jaime+Antoine+Andre as lurker!
- 18 Sep – wmf.28 – Brennen+Jaime
- Logspam-watch needs some attention
- Every deploy is rebuilding l10n
- 25 Sep – 1.42.0-wmf.1 – Dan + Brennen
- 2 Oct – 1.42.0-wmf.2 – Jeena + Dan (Jaime Out)
- 9 Oct – 1.42.0-wmf.3 – Antoine + Jeena (Jaime Out)
- Vector skin issue, backport this morning!
- 16 Oct – 1.42.0-wmf.4 – Brennen + Antoine
- 23 Oct – 1.42.0-wmf.5 – Ahmon + Brennen
- 30 Oct – 1.42.0-wmf.6 – Dan + Ahmon
- 06 Nov – 1.42.0-wmf.7 – Jaime + Dan
- 13 Nov – 1.42.0-wmf.8 – Jeena + Jaime
- 20 Nov – 1.42.0-wmf.9 – No Train