Wikimedia Release Engineering Team/Checkin archive/2024-07-03
2024-07-03
[edit]🏆 Wins/winterrogation
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- July 2024
- "[WE6.2.1] Publish pre-train single version containers" is now on Phab <https://phabricator.wikimedia.org/T369115>
- Submitted a WMCS themed talk proposal for WikiCon North America (<https://wikiconference.org/wiki/Submissions:2024/What%27s_new_with_Wikimedia_Cloud_Services>)
- https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/367 kubernetes: Make k8s deployment failures fatal
- https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/101 Allow empty requirements list to enable Python builder
- Cleaned up scap, kokkuri and mediawiki/services/machinetranslation
- https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/368 Prompt for log message if not supplied on command line
- Deployed gitlab-runner v17.0.0. on gitlab-cloud-runners.
- https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1047158 mw-web: Add traindev environment — testing canary deployments should work!
- https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/76 enable mw-web canary / main k8s deployment
- Fixed train-dev for 1.43.0-wmf.11
- Blubber v1.0.0 has been published
- Native BuildKit LLB (Low-Level Build) instructions (no more reliance on Dockerfile)
- Refactored to support all `docker build` and `docker buildx build` options
- Supports attestations stored alongside images in the registry, provenance and SBOM
- Looks like phorge 2024.19 stable release merges cleanly, as does phorge/master
- Settled on a squash commit template: https://gitlab.wikimedia.org/repos/releng/gitlab-settings/-/merge_requests/64
- Enabled image diff in Gerrit: https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/902211/1/static/images/project-logos/dkwikimedia.png
- Further refinement in upstream code would allow some more tuning, screenshots at https://phabricator.wikimedia.org/T341291#9939660
- Diff is based on Resemble.js library, demo at http://rsmbl.github.io/Resemble.js/
- MediaWiki train!!!! Win win!
Stuff from last time
[edit]📅 Vacations/Important dates
[edit]- https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2024
- https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
- July 1-9: Jaime
- July 4-5: US staff holiday
- July 4-5: Andre (festival; CZ Holiday)
- July 12: Bryan
- July 12–15: Ahmon
- July 12-22: Dan
- July 19: Bryan
- July 25-31: Ahmon
- July 26: Bryan
- Aug 02: Bryan
- Aug 05-09: Dan (I haven't told Tyler yet, shhh)
- Fri 09 Aug – Global holiday: International Day of the World’s Indigenous Peoples
- Mon 12 Aug-16: Ahmon out
- Aug 16: Bryan
- Aug 23: Bryan
- Sun 25 Aug - 03 Sep: Brennen
- Aug 30: Bryan
- Sept 06: Bryan
- Sept 13: Bryan
- Sept 18-19: Brennen Winfield
- Sept 19-20, 23: Bryan Riot Fest in Chicago!
- Sept 27: Bryan
- Sept??? Jeena
- Oct 03-06: WikiCon North America (Indianapolis)
Future
[edit]🔥🚂 Train
[edit]- https://versions.toolforge.org/
- https://train-blockers.toolforge.org/
- https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
Rotation
[edit]- 13 May (13-17) - 1.43.0-wmf.5 – Antoine + Andre (Jeena as backup)
- 20 May (20-24) - 1.43.0-wmf.6 – Andre + Antoine (you can do it Andre!) (Antoine out Mon, Ahmon out Fri)
- 27 May (27-31) - 1.43.0-wmf.7 – Ahmon + Andre (Memorial day Monday)
- 03 Jun (03-07) - 1.43.0-wmf.8 – Dduvall + Ahmon (Brennen out)
- 10 Jun (10-14) - 1.43.0-wmf.9 – Brennen + Ahmon
- 17 Jun (17-21) – 1.43.0-wmf.10 – Jaime + Brennen
- 24 Jun (24-28) – 1.43.0-wmf.11 – Jeena + Jaime
- 01 Jul (02–04) – 1.43.0-wmf.12 – Antoine + Jeena
- 08 Jul (08-12) – 1.43.0-wmf.13 – Andre + Antoine (Ahmon + Dan out Friday)
- 15 Jul (15-19) – 1.43.0-wmf.14 – Ahmon + Andre (Dan Out)
- 22 Jul (22-26) – 1.43.0-wmf.15 – Dan + Ahmon (Ahmon out Thurs)
- 29 Jul (19-Aug 02) – 1.43.0-wmf.16 – Brennen + Dan (Ahmon out)
Team Discussions
[edit]- A very blubber demo
- https://slsa.dev/spec/v1.0/threats-overview
- Current status: we trust the systems, not the process
- https://slsa.dev/spec/v1.0/provenance
- https://in-toto.io/ -- everything in the image file system -- https://in-toto.io/examples/debian/
- https://tools.spdx.org/app/about/
- browsing a docker hub sbom: `docker buildx imagetools inspect mysql:8.0.37-debian --format "Template:Json .SBOM"`
- here's how docker hub exposes this: https://hub.docker.com/layers/library/mysql/8.0.37-debian/images/sha256-d255f59008e43c69924f94ab33126d102b77eb745aac888eaf3bd5c48ccc6640?context=explore
Let's do some inbox triage: https://phabricator.wikimedia.org/maniphest/query/7vRDrcVnt8OI/#R
🌻 Open source/Upstream contributions
[edit]