Wikimedia Release Engineering Team/Checkin archive/20190401
Appearance
2019-04-01
[edit]Vacations/Important dates
[edit]- March 29–April 1: James out (New Hampshire)
- March 31: DST switchover in .eu, elsewhere ish.
- April 9-12: Greg at tech-mgt F2F in Portland
- April 11: Dan out
- April 17-19 (Wednesday - Friday) - Željko vacation
- April 18-19 (Thursday, Friday) - Lars on vacation in Chicago
- April 22 (WMF Holiday) - US Staff
- April 22-27: Team offsite in Chicago
- April 29: Moved WMF Holiday for US staff at offsite
- May 1st - Lars, Antoine and Željko, Labor Day / May Day
- May 8th - Antoine, 1945 victory
- May 15 (Wednesday) - Željko vacation
- May 16-20 - Wikimedia Hackathon 2019 (Prague, Czechia)
- Attending: Greg, JR, Zeljko, James, and Jeena
- May 30th-31th - Antoine, Feast of the Ascension
- June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
- May 27 (Memorial Day) - US Staff
- June 6-7 - Brennen, Apogaea
- June 19 (Juneteenth) - US Staff
- July 22 - August 9 - Željko vacation
- August 25 - September 4 - Brennen vacation
Rotating positions
[edit]Train
[edit]- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- Jan 07 - wmf.12 - Dan
- Jan 14 - wmf.13 - Dan
- Jan 21 - wmf.14 - Mukunda
- Jan 28 - wmf.15 - No Train (All Hands)
- Feb 04 - wmf.16 - Mukunda
- Feb 11 - wmf.17 - Tyler
- Feb 18 - wmf.18 - Tyler
- Feb 25 - wmf.19 - Antoine
- Mar 04 - wmf.20 - Antoine
- Mar 11 - wmf.21 - Zeljko 🐌
- Mar 18 - wmf.22 - Zeljko 💣
- Mar 25 - wmf.23 - Dan
- Apr 01 - wmf.24 - Dan
- Apr 08 - wmf.25 - Mukunda
- Apr 15 - 1.34.0-wmf.1 - Mukunda
- Apr 22 - wmf.2 - NO TRAIN, team offsite
- Apr 29 - wmf.3 - Tyler
- May 06 - wmf.4 - Tyler
- May 13 - wmf.5 - Antoine
- May 20 - wmf.6 - Antoine
- May 27 - wmf.7 - Zeljko
- June 03 - wmf.8 - Zeljko
SoS
[edit]- Zeljko 4eva! :)
Team Business
[edit]Book club
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Notes: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/Continuous_Delivery
- Next:
- April 5th at the "same" time (9am Pacific/16:00 UTC)
- Chapters 7-9, inclusive
Spring Offsite
[edit]- Location: Chicago, IL (Central timezone, UTC-5 while we're there)
- Dates: Arrive Monday 4/22, Depart Saturday 4/27.
- Activity day
- Fill out the spreadsheet: https://docs.google.com/spreadsheets/d/1zqO8Mk1wUU2ZtyAM9xU68CQTpJFEOPALfDKCj7aMNo4/edit
- POLLING BOOTHS CLOSE FRIDAY EOD (iow: that's when I make a final choice/email Megan N to buy our tickets).
- See email from Deb re Cubs game on Tuesday night.
- Program:
- start listing your topics! https://etherpad.wikimedia.org/p/releng-offsite-201904-topics
- I think we're winding down. Will start agenda bashing.
Monthly reflection on accomplishments - April '19 edition
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
Annual Planning
[edit]- https://etherpad.wikimedia.org/p/releng-fy1920ap-tec1
- https://etherpad.wikimedia.org/p/releng-fy1920ap-tec3
- https://etherpad.wikimedia.org/p/releng-fy1920ap-tec12
- https://etherpad.wikimedia.org/p/releng-fy1920ap-tec13
- https://etherpad.wikimedia.org/p/releng-fy1920ap-new
Incoming/Needs attention
[edit][Task] Add Scribunto to extension-gate in CI
[edit]- https://phabricator.wikimedia.org/T125050
- https://gerrit.wikimedia.org/r/#/c/integration/config/+/497574/
- calling into question time spent on unit tests in pre-merge tests.
- yes to having better guidelines
Scrum of Scrums
[edit]Incoming from last week
[edit]- Blocking:
Outgoing this week (wrong section heading is on purpose for copy/pasting into Scrum of Scrums etherpad
[edit]Release Engineering
[edit]- Blocked by:
- Blocking:
- Updates:
- Train Health
- Last week: 1.33.0-wmf.23 - https://phabricator.wikimedia.org/T206677
- This week: 1.33.0-wmf.24 - https://phabricator.wikimedia.org/T206678
- Next week: 1.33.0-wmf.25 - https://phabricator.wikimedia.org/T206679
- Code Health
- Log Health
- Train Health
Callouts
[edit]- Release Engineering
Train status and happenings
[edit]
Quarterly Goals for Q4
[edit]https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q4
TEC1 (Maint): Outcome 1 / Output 1.1
[edit]- GOAL: Undeploy the CodeReview extension.
- WHO: James, need help from CPT
TEC1 (Maint): Outcome 1 / Output 1.1
[edit]- GOAL: Setup 1-3 of the CI WG options (Zuul v3, Argo, GitLab)
- WHO:
- Focus on a couple noteworthy repos: e.g.,
- core
- extensions
- ops/puppet
- Maybe setup in serial, i.e., a week per evaluation
- Questions:
- RelEng/Extended working group?
- At least in the WG eval it was good to have non-familiar people
- But maybe with the setup of options it might be beneficial to have experienced with current setup people.
- Folks outside the original working group to join-in to setup options; people TBD
- Do we need a rubric before we do this prototyping? (yes)
- TODO lars to work on rubric week of 2019-04-01
- RelEng/Extended working group?
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Instrument Quibble for data collection
- WHO: Mukunda, Antoine
- Still no progress / nowhere to store this data and other tasks taking priority
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Create a graph where time is spent and make a prioritized list for improvements.
- WHO: Mukunda, Antoine
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Prepare the Deployment Pipeline for changes to our CI tooling.
- WHO: Lars, ???
- Blocked by not having new CI tooling yet
TEC3 (Pipeline): Outcome 3 / Output 3.1
[edit]- GOAL: Create a .pipeline/config.yaml standard to give users more control over how their tests are run in the pipeline and allow the easy saving of artifacts at pipeline completion. (RelEng)
- WHO: Dan, Tyler, ???
TEC3 (Pipeline): Outcome 3 / Output 3.1
[edit]- GOALS:
- Adopt more services into Deployment pipeline - task T212801
- Wikidata Termbox SSR, Kask for Session Storage Service, cpjobqueue (stretch), ORES (stretch)
- Adopt more services into Deployment pipeline - task T212801
- WHO: Dan, Tyler, Lars
- Done cxserver
- changeprop
- In progress ORES
- cf: Dan's comments
- Wikidata Termbox SSR
- Kask for Session Storage Service
- cpjobqueue (stretch)
TEC12 (DevProd): Outcome 1 / Output 1.1
[edit]- GOAL: Provide an "Official" Docker base image for local development of MediaWiki based on the production tooling.
- WHO: Jeena, Brennen
TEC13 (Code Health): Outcome 1 / Outcome 3
[edit]- GOALs: Presentation/session(s) at the Wikimedia Hackathon on the current state of Code Health projects (technical debt and code stewardship)
- WHO: JR
TEC13 (Code Health): Outcome 1 / Output 1.1
[edit]- GOAL:
- Publish a re-imagination of the Review Queue process.
- Develop and implement metrics around task and code-review responsiveness
- WHO: Greg, JR (and Andre)
TEC13 (Code Health): Outcome 4 / Output 4.2
[edit]- GOALs:
- Expand SonarQube reporting into CI infrastructure
- Perform SonarQube analysis on all extensions
- Engage user communities in direct feedback solicitation
- WHO: JR, Zeljko, Code Health Metrics
Other non-goal work
[edit]Selenium
[edit]- T213268 Upgrade webdriverio to version 5
- Might fix T210506 `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11
- Blocked on T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests
Gerrit
[edit]- Back to 2.15.12 this week (see upstream discussion: https://groups.google.com/forum/#!topic/repo-discuss/pBMh09-XJsw )
- Plugin/ACL updates likely this week
Phabricator
[edit]Jenkins
[edit]QA/Code Health
[edit]- T219156 Generate baseline analysis of all extensions - script ready, will be run today/tomorrow
SCAP
[edit]Standup!
[edit]Antoine
[edit]- What I plan to do this week
- Still dealing with aftermath of Debian removing jessie-backports component. That introduced breakage all other the place due to outdated or now missing packages. Already burned 3 days on that
- Quibble upgrade for parallelism. docker-pkg was broken, quibble 0.0.30 is missing some data file due to an old setuptools (see above)
- Hopefully some Zuul repackaging :-/
- What I'm blocked on
- Change Gerrit owners from Administrators > Gerrit Managers
- Haven't looked into it E_NO_TIME
- Have a look at Zuul upgrade that Paladox worked on. E_NO_TIME :(
- Change Gerrit owners from Administrators > Gerrit Managers
- Other?
- Overall, trying to focus but the regular maintenance of Docker images is killing me.
- TLDR: do not ever use Debian *-backports component.
Brennen
[edit]- What I plan to do this week
- local-charts
- blubber.yaml / docker-pkg for MediaWiki
- Installation script tweaks
- Follow up with Eric Gardner on documentation
- Continue learning about Gerrit (thcipriani: if you want to pair on upgrade, might be...fun(?)) (ack)
- Read book
- local-charts
- What I'm blocked on
- Nothing
- Other?
- Avoid most of the internet all day today.
Dan
[edit]- What I plan to do this week
- TRAAAAINz
- Continue hacking on pipelinelib to implement pipeline config
- https://gerrit.wikimedia.org/r/c/integration/pipelinelib/+/499918
- Debugging Jenkins pipelines is a PITA
- What I'm blocked on
- Nada
- Other?
- Hacked up some nasty system tests for pipelinelib. Gross but useful
Greg
[edit]- What I plan to do this week
- Brain dumping on annual plan etherpads
- reviewing the perf team phab process, starting to write some ideas down there
- Read the book chapters
- What I'm blocked on
- MTP reveal :)
- TOO MANY EMAILS
- Other?
James
[edit]- What I plan to do this week
- What I'm blocked on
- Other?
Jean-Rene
[edit]- What I plan to do this week
- What I'm blocked on
- Other?
Jeena
[edit]- What I plan to do this week
- Add to the planning documents
- Read book
- Figure out how to use X-debug in local-charts
- Merge Mac OS install script in local-charts
- sshfs script for local-charts volume sharing
- Add goals/intentions of local-charts description to README
- What I'm blocked on
- Other?
Lars
[edit]- What I plan to do this week
- read CD book, participate in book club
- Done reinstall Debian on work laptop to fix various breakages (e.g., Docker/minikube no worky)
- improve my essay on production-like based on feedback, further thinking
- annual planning
- What I'm blocked on
- Other?
- various illnesses
Mukunda
[edit]- What I plan to do this week
- Read a book
- Fix phabricator search
- Refine the vandalism rollback tool
- Help Tyler with Gerrit upgrade and whatever else he needs
- What I'm blocked on
- Time.
- Other?
Tyler
[edit]- What I plan to do this week
- Gerrit
- Meetings
- Code review when I have time
- Read book (sooo far behind :(( )
- What I'm blocked on
- Other?
Zeljko
[edit]- What I plan to do this week
- T219156 Generate baseline analysis of all extensions
- T219437 Add MacOS installation Documentation and Install Script for local-charts repo
- T219132 European Mid-day SWAT
- What I'm blocked on
- T213268 Upgrade webdriverio to version 5
- Might fix T210506 `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11
- Blocked on T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests
- Other?
- Already read the book! (Well, chapters for book club.)
Grooming
[edit]Team Kanban Board Review and Triage
[edit]- closed and touched in the 7 days
- No update for 4 weeks
- No update for 3 weeks
- No update for 2 weeks
- No update for 1 week
- All Open
- Review To Triage column of #releng
Once / month-ish review of backlog(s)
[edit]- releng Review To Triage column of #releng
- releng-kanban Review unassigned in kanban
- releng-kanban Review 'backlog' colum of -kanban
- releng-next - Review for things we need to put on our kanban backlog
- releng-backlog - oh my, the huge backlog of things...