Wikimedia Release Engineering Team/Checkin archive/20180219
Appearance
2018-02-19
[edit]Vacations/Important dates
[edit]- Feb 2nd: Mukunda vacation day
- Feb 19 (Mon): President's Day (All US Staff)
- Mar 30 (Fri): WMF Holiday
- April 2: Željko (Holidays in Croatia - Easter Monday)
- April 14 (Fri): WMF Holiday
- May 1: Željko (Holidays in Croatia - Labor Day / May Day)
- May 15?/16/17: Team offsite in Barcelona
- May 18-20: Wikimedia Hackathon in Barcelona
- May 21 (Mon): Tech-Mgt F2F
- May 31: Željko (Holidays in Croatia - Corpus Christi)
Rotating positions
[edit]Train
[edit]- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
- Feb 19 - wmf.22 - Mukunda
- Feb 26 - wmf.23 - Tyler
- Mar 05 - wmf.24 - Tyler
- Mar 12 - wmf.25 - Chad
- Mar 19 - wmf.26 - Chad
- Mar 26 - wmf.27 - Mukunda
- Apr 02 - wmf.28 - Mukunda
- Apr 09 - wmf.29 - Tyler
- Apr 16 - wmf.30 - Tyler
SoS
[edit]- Feb 19 - Chad
- Feb 26 - Mukunda
- Mar 05 - Mukunda
- Mar 12 - Tyler
- Mar 19 - Tyler
- Mar 26 - Chad
- Apr 02 - Chad
- Apr 09 - Mukunda
- Apr 16 - Mukunda
Team Business
[edit]Updates
[edit]Mid-year check-ins
[edit]A basic check-in: Go over what we hoped we'd do when we talked back for annual review
Then, the outline from T&C:
- Celebrate accomplishments (highs):
- What can we learn from (lows):
- What goals or projects have been completed? What went well, what could have been better?
- What goals/responsibilities are still ahead? Is any support needed to help get them done? Does any work need to be adjusted (due to departmental/organizational change)?
- Any peer feedback wanted or given? (Feel free to do this casually via email or conversation.)
- [Greg: Let me know if anyone wants to do some kind of "ask your peers for feedback", I can set something up.]
Please come prepared to talk about those items; I'll be filling out a document we can look at during the meeting, just for our records. They are not shared with T&C (they will only be checking in with managers to verify the check-ins happened, not what the content was).
Scrum of Scrums
[edit]- Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums
This week
[edit]Release Engineering
[edit]- Blocking
- None?
- Blocked
- Updates
Last week
[edit]- Blocking
- None?
- Blocked
- None
- Updates
- None
Train status and happenings
[edit]- wmf.21 was mostly uneventful, howver, there is some logspam left over from the past few weeks which still needs to get cleaned up.
- Some of the cleanup is currently in-progress and I will tackle more of it with wmf.22
Past week status updates
[edit]- All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q3
Quarterly Goals
[edit]Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack
[edit]- Due: End of this quarter
- What: Specific improvements to the now canonical framework, see: task T182421, notably:
- Upgrade webdriverIO to version 4.9
- Investigate replacing nodemw with mwbot
- Video recording for Selenium tests in Node.js
- Task: task T182421
- T186724 Trouble running selenium tests inside of mediawiki-vagrant
- fixed the problem, updated documentation
- T185315 selenium-EXTENSION-jessie Jenkins job should have e-mail notification
- created patch, waiting for review
- T185094 Update page object pattern in Selenium tests
- created patch for mediawiki-core, something is wrong - ERROR: Unexpected token import
Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure
[edit]- Goals
- Draft requirements for a Kubernetes based solution for CI - task T183513
- Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
- Unify production and CI docker image build process - task T177276
- Done 01/15
Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans
[edit]- Due: End of quarter
- task T174091
- created summary of Q3's items under review and sent to Toby and Victoria
- Scheduled review meeting with Toby and Victoria
Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation
[edit]- Due: End of quarter
- task T174095
- worked on Avoiding Technical Debt blog post, ETA 2/21
Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))
[edit]- Due: End of next quarter
- task T174096
- no progress
Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline
[edit]- Due: End of this quarter
- Keyword: SSD
- phab project: https://phabricator.wikimedia.org/project/view/2453/
- Goal:
- Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
- Functional PoC within integration in the deployment-pipeline
- Deploy to isolated k8s
- Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
- Minikube packaging still in progress
- pip/python support for blubber in review
- Implementing a better file ownership model in Blubber https://phabricator.wikimedia.org/T187372
Quaterly non-goal "Work"
[edit]Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)
[edit]
Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure
[edit]Program 1: Outcome 6: Milestone 1: Maintain Gerrit
[edit]Program 1: Outcome 6: Milestone 2: Maintain Phabricator
[edit]- Streamline logspam workflows by adding some integration with phabricator
- Store git-lfs (and other phab uploads) in swift: task T182085
- Major update released with a lot of new features.
- Announcement blog post: https://phabricator.wikimedia.org/phame/post/view/85/phabricator_updates_for_february_2018/
- Apache workers are still hanging leading to instability if we fail to restart apache on ~weekly basis.
Other work
[edit]- scheduled post mortem for non-train MediaWiki incident
- followed up with Daniel re Review Queue process, however he's out on vacation until later this week.
Standup!
[edit]Antoine
[edit]- What I plan to do this week
- Migrate more long tail of Docker jobs
- Fill tasks for jobs that I am blocked on
- Polish up a patch for Zuul with Tyler (re int != string)
- What I'm blocked on
- E_NOTIME :-(( to review Dan patch for Blubber/tox support
- Other?
- Focus on migration to Docker
- chromium-render has a CI job running tests with the Debian Stretch package (and not some randomly downloaded package) - https://phabricator.wikimedia.org/T179552
Chad
[edit]- What I plan to do this week
- More helm/MW/Docker investigations
- Some docroot/mw-config cleanup
- What I'm blocked on
- Nothing?
- Other?
- Zoran has been unblocked from Gerrit. Please be on the lookout for poor behavior.
Dan
[edit]- What I plan to do this week
- Finish implementing a more sane fs ownership model in Blubber https://phabricator.wikimedia.org/T187372
- What I'm blocked on
- Nothing
- Other?
Greg
[edit]- What I plan to do this week
- What I'm blocked on
- Other?
Jean-Rene
[edit]- What I plan to do this week
- Avoiding technical debt blog post
- updating Stewrdship Reviews process (actually did this yesterday)
- Update stewardship reviews page to include calendar of coming events/timelines
- Logstash review (carry over from last week)
- What I'm blocked on
- Other?
Mukunda
[edit]- What I plan to do this week
- Train: mediawiki 1.31.0-wmf.22
- Clean up (as much as possible) the logspam that's been accumulating up over the past few weeks
- Still dealing with apache worker leaks, https://phabricator.wikimedia.org/T182832
- Incident report is already completed: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180206-Phabricator
- Need to follow up on the actionables.
- Train: mediawiki 1.31.0-wmf.22
- What I'm blocked on
- Other?
Tyler
[edit]- What I plan to do this week
- Review pip/python support for blubber
- finish minikube packaging
- finish zuul patches
- start on some puppet work for verify pipeline step
- What I'm blocked on
- Other?
- https://phabricator.wikimedia.org/T187761 looks like a good idea
Zeljko
[edit]- What I plan to do this week
- T180144 Upgrade WebdriverIO to 4.9
- T181284 Investigate replacing nodemw with mwbot
- T182691 Selenium tests should be easier to run
- T182692 Document differences between Ruby and Node.js Selenium frameworks
- T185094 Update page object pattern in Selenium tests
- What I'm blocked on
- T183456 Continuous integration for mediawiki-vagrant
- The box 'debian/stretch64' could not be found
- T183456 Continuous integration for mediawiki-vagrant
- Other?
Grooming
[edit]Team Kanban Board Review and Triage
[edit]- closed and touched in the 7 days
- No update for 4 weeks
- No update for 3 weeks
- No update for 2 weeks
- No update for 1 week
- All Open
- Review To Triage column of #releng
Once / month-ish review of backlog(s)
[edit]- releng Review To Triage column of #releng
- releng-kanban Review unassigned in kanban
- releng-kanban Review 'backlog' colum of -kanban
- releng-next - Review for things we need to put on our kanban backlog
- releng-backlog - oh my, the huge backlog of things...