Wikimedia Release Engineering Team/Checkin archive/20190225
Appearance
2019-02-25
[edit]Vacations/Important dates
[edit]- February 19 - March 1 - Dan, vacation
- March 11 (WMF Holiday) - US Staff
- April 22 (WMF Holiday) - US Staff
- April 22-27: Team offsite in Chicago
- April 22nd - Antoine, Easter - we're flying to Chicago?
- May 1st - Antoine and Željko, Labor Day / May Day
- May 8th - Antoine, 1945 victory
- May 17-19 - Wikimedia Hackathon 2019 (Prague, Czechia)
- May 30th-31th - Antoine, Feast of the Ascension
- June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
- May 27 (Memorial Day) - US Staff
- June 19 (Juneteenth) - US Staff
Rotating positions
[edit]Train
[edit]- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- Jan 07 - wmf.12 - Dan
- Jan 14 - wmf.13 - Dan
- Jan 21 - wmf.14 - Mukunda
- Jan 28 - wmf.15 - No Train (All Hands)
- Feb 04 - wmf.16 - Mukunda
- Feb 11 - wmf.17 - Tyler
- Feb 18 - wmf.18 - Tyler
- Feb 25 - wmf.19 - Antoine
- Mar 04 - wmf.20 - Antoine
- Mar 11 - wmf.21 - Zeljko
- Mar 18 - wmf.22 - Zeljko
- Mar 25 - wmf.23 - Dan
- Apr 01 - wmf.24 - Dan
- Apr 08 - wmf.25 - Mukunda
SoS
[edit]- Zeljko 4eva! :)
Team Business
[edit]Book club
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- March 4th: discuss Part I plus Chapter 5.
- ONE MORE WEEKS!!!!1eleven
- Scheduled: Mar 7th, 9am Pacific
Spring Offsite
[edit]- Location: Chicago, IL (Central timezone, UTC-5 while we're there)
- Dates: Arrive Monday 4/22, Depart Saturday 4/27.
- BOOK FLIGHTS BY: March 21
- Activity day: Send your suggestions to me if you have them :) I'll make the voting spreadsheet later.
- Chicago Bulls!!!11!oneone
- April 10 -- Regular Season ends, so only if they're good this year :)
- I've heard there's good pizza :P
- I'm sure we'll have some of that for our dinners, unless you want to do a cooking class :)
- Greenfield park conservatory?
- Museum of Science and Industry - https://www.msichicago.org/
- Any American sport would be fun (basketball, football, baseball..) (Lars doesn't like watching sports, but would be happy to sit somewhere quite for the duration) (thcipriani: baseball isn't so much about watching baseball :)) (Lars: going to the baseball stadium is stressful when there's thousands of others there (I'm difficult, sorry))
- Chicago Bulls!!!11!oneone
- Program: Haven't started yet :)
Technical Advice IRC Meetings
[edit]- What: Joint WMF/WMDE lead IRC advice/q&a session. See: https://docs.google.com/document/d/1kXE2k6nM_eyIzcFHkU-d8G2asD5EpgYc64XiKLFgSAI/edit
- When: every Wednesday at 16:00 UTC (we always keep the meeting at 17:00 MEZ)
- Signup to co-host: https://docs.google.com/spreadsheets/d/1ExZWzV8vQJ6WQbQrhpzBggGia9Tr7SrpbSfNjOOeosw/edit#gid=0
Monthly reflection on accomplishments
[edit]- Let's start keeping a list of accomplishments we've had over the last month (instead of monthy or weekly)
- Purpose: helps with morale :) and can be a way of identifying good blog post/other ways of showcases
- blubber uses blubberoid.wikimedia.org in the pipeline and pipeline is almost there for end-to-end functionality (can't yet deploy to production, but nearly can)
- scap development back on gerrit -- new contributors
- local-charts repo created
- docker SIG announced/setup
- Developer satisfaction survey results https://www.mediawiki.org/wiki/Developer_Satisfaction
- Scap 3.9.0-1 released in production
- Deployed wmf.18
- Updated phabricator to 2019-02-20 release, blog posted detailing some changes: https://phabricator.wikimedia.org/phame/post/view/145/phab_phebruary/
Incoming/Needs attention
[edit]Recover from corrupted beta MySQL slave (deployment-db04)
[edit]- https://phabricator.wikimedia.org/T216067
- Mukunda will look into this more today
- We talked about if we should "simply" recreate from scratch if needed and import some sample content from production
Pywikibot CI
[edit]- https://phabricator.wikimedia.org/T132138
- Antoine to take a time boxed look into this, this week
Scrum of Scrums
[edit]- Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums
Incoming from last week
[edit]- Blocking:
Outgoing this week (wrong section heading is on purpose for copy/pasting into Scrum of Scrums etherpad
[edit]Release Engineering
[edit]- Blocked by:
- Blocking:
- Updates:
- Developer satisfaction survey results https://www.mediawiki.org/wiki/Developer_Satisfaction
- New Phabricator features, phame blog posted: https://phabricator.wikimedia.org/phame/post/view/145/phab_phebruary/
- Scap 3.9.0-1 is released, ping us if scap does anything weird :)
- Train Health:
- Last week: 1.33.0-wmf.18 - https://phabricator.wikimedia.org/T206671
- This week: 1.33.0-wmf.19 - https://phabricator.wikimedia.org/T206672
- Next week: 1.33.0-wmf.20 - https://phabricator.wikimedia.org/T206673
- Log Health:
- Code Health:
Callouts
[edit]- Release Engineering
Train status and happenings
[edit]
Quarterly Goals for Q3
[edit]https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q3
TEC1 (Maint): Outcome 1 / Output 1.1
[edit]- GOAL: Automate the generation of change log notes
- WHO: Mukunda, (Tyler on backup)
- No movement last week
- Planned update to notes task this week
TEC1 (Maint): Outcome 1 / Output 1.1
[edit]- GOAL: Investigate notification methods for developers with changes that are riding any given train
- WHO: Mukunda, Tyler
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Instrument Quibble for data collection
- WHO: Mukunda, Antoine
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Create a graph where time is spent and make a prioritized list for improvements.
- WHO: Mukunda, Antoine
TEC3 (Pipeline): Outcome 2 / Output 2.1
[edit]- GOAL: Select and integrate a code health metric solution into our tooling.
- WHO: JR, ...
dependent on Code Health Group Metrics Group work
TEC3 (Pipeline): Outcome 3 / Output 3.1
[edit]- GOALS:
- Adopt more services into Deployment pipeline - task T212801
- cxserver, ORES (partially), citoid, changeprop, cpjobqueue (stretch)
- Deploy eventgate
- Adopt more services into Deployment pipeline - task T212801
- WHO: Dan, Tyler, Lars
- "I think we're mostly on track for it"
TEC12 (DevProd): Outcome 1 / Output 1.1
[edit]- GOAL: Conduct interviews with development stakeholders and compile a report that informs future work creation of a rubric.
- WHO: Jeena, Mukunda
- Results are posted: https://www.mediawiki.org/wiki/Developer_Satisfaction
TEC13 (Code Health): Outcome 1 / Output 1.1
[edit]- GOALs:
- Develop and communicate guidelines and best practices for successful Code Stewardship.
- (Continued from Q2) Update/refresh review queue (review process for initial code deployment)
- WHO: JR
Progress last week.
TEC13 (Code Health): Outcome 2 / Output 2.2
[edit]- GOAL: 5 of the 15 prioritized repositories have at least 1 end-to-end test - task T206621
- WHO: Zeljko
TEC13 (Code Health): Outcome 2 / Output 2.3
[edit]- GOALs:
- Evolve/develop tools and processes to support the PE refactoring effort to improve code health.
- Develop common test strategy that enable teams to engage in more effective and efficient testing practices. (maybe should be output 2.4?)
- WHO: JR, Core Platform Team
Checked to see to what extent CHGM WG could help make progress in coverage metric tooling improvements.
TEC13 (Code Health): Outcome 3 / Output 3.2
[edit]- GOALs:
- Speak at All Hands on the status of Technical Debt
- Engage and coach development teams on their approach to managing technical debt.
- WHO: JR, Core Platform Team
No progress
TEC13 (Code Health): Outcome 4 / Output 4.1
[edit]- GOALs: Code Health Dashboard with 50% of repositories covered.
- WHO: JR, Core Platform Team
Minimal progress.
Other non-goal work
[edit]Selenium
[edit]- T214478 The first Selenium test for AbuseFilter
- T216424 The first Selenium test for ContentTranslation
- T214480 The first Selenium test for TimedMediaHandler
- T204068 QA: Automation Testing - port Echo Notification tests to Node.js
Gerrit
[edit]- 2.15.10 is ready
- https://gerrit.wikimedia.org/r/#/c/operations/software/gerrit/+/492025/
- need to find window to deploy
Phabricator
[edit]- Deployed almost 6 months worth of upstream changes
- Summarized some key changes in this blog post:
- Schema changes took a long time, nearly disrupting some SRE on-site datacenter work that was unfortunately timed.
- This could have been avoided with better planning, however, it highlights the need for high-availability of phabricator.
- I'm tempted to build a static cache of our public phabricator content (perhaps look into what it would take to make our existing reverse-proxy / cache infrastructure do the job.)
- There was one regression which I reported and it's now fixed upstream - I'll deploy a patch today. ( https://phabricator.wikimedia.org/T216849 )
Jenkins
[edit]QA/Code Health
[edit]** T217008 Report results from SonarCloud to Gerrit
SCAP
[edit]- 3.9.0-1 released today, changes planned
Standup!
[edit]Antoine
[edit]- What I plan to do this week
- What I'm blocked on
- Other?
Brennen
[edit]- What I plan to do this week
- Land a few minor changes to local-charts setup scripting (better Debian, known-working Ubuntu)
- Discussion with Lars, Zeljko, Antoine, et al. re: CI
- Efforts to get a better handle on state of existing CI
- First Docker SIG meeting on Thursday, want to feel more ready for that by the time it happens
- What I'm blocked on
- Other?
- Started making lots of scribbly notes on Continuous Delivery book, planning to do a chapter a day until it's defeated.
Dan
[edit]- What I plan to do this week
- What I'm blocked on
- Other?
Greg
[edit]- What I plan to do this week
- Review Queue brain dumping/sense-making
- ISOSSTWG thing, finally? (keeps being demoted in priority)
- Follow-up with Erika re Phab workflows (in relation to the above)
- Read book
- Thinking about next year's TechConf ("developer productivity"?)
- Docker SIG
- Talking about Quality with Adam/Marcella (with JR)
- Maybe https://help.github.com/en/articles/creating-a-default-community-health-file-for-your-organization for CoC?
- What I'm blocked on
- Other?
James
[edit]- What I plan to do this week
- What I'm blocked on
- Other?
Jean-Rene
[edit]- What I plan to do this week
- Continue work on stewardship
- Work on quality strategy stuff
- work on CPT Goals
- What I'm blocked on
- Other?
Jeena
[edit]- What I plan to do this week
- Figure out why hyperkit now taking up bunch of CPU
- Finish setting up restbase for local charts
- Work with Brennen on figuring out where/how to publish docker images for the local dev environment
- Read book
- What I'm blocked on
- Other?
Lars
[edit]- What I plan to do this week
- Get Quibble set up on my laptop, run the test suite to verify it works.
- Discuss with Zeljko, Brennen how to do the CI future project and tool evaluation.
- Interview people about CI requirements.
- Find possible CI tools to review.
- Docker-SIG, Tech Advice
- What I'm blocked on
- computers are complicated
- Other?
Mukunda
[edit]- What I plan to do this week
- Deploy fix for phabricator regression + upstream changes that didn't make the cut last week
- Fix beta cluster db
- Start looking into quibble instrumentation
- Figure out what is TEC3 (Pipeline): Outcome 1 / Output 1.2 all about. (thcipriani: let's pair! :))
- Try out phabricator's new subtype field customization feature
- Continue playing with docker / minikube phabricator test environment if time allows
- Probably not read the book
- What I'm blocked on
- Time in a day
- Other?
Tyler
[edit]- What I plan to do this week
- Gerrit 2.15.10
- Update pipelinelib patch with feedback (thanks all!)
- scap dev env
- Train notes automagic
- Gerrit duplicate users
- Catchup with what's happening with sonarcloud patches re:branch vs patch
- What I'm blocked on
- Other?
- Deployment pipeline book -- collecting thoughts/notes
Zeljko
[edit]- What I plan to do this week
- T217008 Report results from SonarCloud to Gerrit
- T214478 The first Selenium test for AbuseFilter
- T216424 The first Selenium test for ContentTranslation
- T214480 The first Selenium test for TimedMediaHandler
- T204068 QA: Automation Testing - port Echo Notification tests to Node.js
- What I'm blocked on
- Other?
Grooming
[edit]Team Kanban Board Review and Triage
[edit]- closed and touched in the 7 days
- No update for 4 weeks
- No update for 3 weeks
- No update for 2 weeks
- No update for 1 week
- All Open
- Review To Triage column of #releng
Once / month-ish review of backlog(s)
[edit]- releng Review To Triage column of #releng
- releng-kanban Review unassigned in kanban
- releng-kanban Review 'backlog' colum of -kanban
- releng-next - Review for things we need to put on our kanban backlog
- releng-backlog - oh my, the huge backlog of things...