Wikimedia Release Engineering Team/Checkin archive/20170206

2017-02-06

Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List

How to do it

• February 20: President's Day
• March 13: Monthly day off
• April 14: Monthly day off
• May 15-18: Team Offsite in Vienna
• May 19-21: EU Hackathon

Team Business

Time spent spreadsheet

• week 5: https://docs.google.com/spreadsheets/d/1OZzvtlc116UIsFFbic1zX34LXgAJddPTXMGVE6uMsJw/edit#gid=1019523195

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Feb 6 and Feb 13

• Train: Tyler
  • wmf.11
  • wmf.12
• SoS: Chad
• Out:
  • ...

Actions from last meeting

• Mukunda: Logspam next steps

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
  • Ops: https://phabricator.wikimedia.org/T155856
• Updates

Last week

• Blocking
• Blocked
• Updates
  • scap 3.5 planned for this week

Other Team Business

DC switch over

• Understand the preparedness of misc services for datacenter switchover - https://phabricator.wikimedia.org/T156937

LOGSPAMMMM!!!111!!eleven

• Mukunda will write a thing
• Logspam has improved in the sense that Mukunda has filtered out a ton in the main dashboard

Annual Planning

• Now in a central Technology team-wide document: https://docs.google.com/document/d/1NwsUCAeHJAw4pyl0YWS1iGNsKnCFk1toM26acLm6JVE/edit#heading=h.eh5attm0n41
• Next:
  • Make sure that "Rationale" section is sometihng we're happy with
• Technology team themes: https://docs.google.com/document/d/1KHjxkYV1ecx8R6xtWh6Ntfh9dbxW9fr4PVyIRBPIslg/edit
  • We will modernize our infrastructure by creating a stable, elastic production platform for orchestrated containerized applications (based on Kubernetes), with integration of CI, instrumentation, monitoring and logging.

Q3 goal/project check-in

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q3

Continuous Integration Infrastructure modernization

Gather requirements for new CI system - task T153270

• unscheduled maintenance :)
  • Chase wrote a monitoring script that monitors nodepool (as a canary for WMF Labs itself)

• now will have a regularly scheduled meeting for it :)
  • bugging marko to attend
    • future of docker.js etc (how to standardize the build entrypoint)

Migrate MediaWiki deploys to scap3 (part 2 — This time, it's personal; A.K.A Scappy Strikes Back)

Build fanout support in scap3

https://phabricator.wikimedia.org/T121276

• A few bugs from 3.5 that should be resolved sooner than later

Phabricator

Re-evaluate and improve search functionality in Phabricator - task T146843

• Met with Discovery re ES cluster support: https://etherpad.wikimedia.org/p/phabricator-elastic
  • we have some action items
  • tl;dr: staying on main cluster, we're all on the same page re support

Non-Quarterly goal work

Browser tests

• T152963 Increase in failures caused by Saucelabs
  • Sauce Labs replied, TLDR failures happen :|
• No comments/reviews on Selenium and webdriver.io patches :(
  • https://gerrit.wikimedia.org/r/#/c/323401/ (Selenium)
  • https://gerrit.wikimedia.org/r/#/c/328191/ (webdriver.io)
  • Željko will ping QA and wikitech-l

People status updates

Antoine

Last week

• contint2001
  • Gotta loop back with Daniel Zahn
    • SKIPPED... :(
• finish MediaWiki (tarball) releases test job https://integration.wikimedia.org/ci/job/mediawiki-releases/
  • More patches to fix up everything
    • PEnding reviews
• get a bump of Nodepool pool
  • • Busy with maintenance work
• EasyTime line debug logging as possible
  • Revamped a bit of EasyTimeline. Patch still pending
• announce rspec for puppet.git to ops
  • Pending a serie of patches that adds syntax check via rake

This week

• puppet-lint/syntax check via rake
  • mariadb module: https://gerrit.wikimedia.org/r/#/c/331329/
  • puppet.git https://gerrit.wikimedia.org/r/#/c/331239/
• If above done, announce rspec-puppet work
• contint2001 (that is really needed now)
• Yet another tech doc for CI/Kubernetes idea
• EasyTime line debug logging as possible

Chad

Last week

• Gerrit
• Logspam
• Scap
• Phab / Elastic stuff

This week

• Moar gerrit (bane of my freaking life)
• Logspam (I may make some enemies here)
• Scap (fix puppet manifests vis a vis git-fat)

Dan

Last week

• Moar research
• Formulate first steps on container building infra PoC

JR

Last week

• Continue reviewing past "escapes". Identify first pass interviewees and schedule interviews, build knowledge re CI now and future, build knowledge of current QA/Test processes.

This week

• investigate test results reporting
• investigate coorelating escapes to test coverage
• schedule Quality 1:1s

Mukunda

Last week

• Deployment train, 1.29.0-wmf.10 / T155525
• write up thoughts on fighting logspam
  • didn't happen

This week

• write up thoughts on fighting logspam
  • https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Logspam
• Phabricator
  • Deploy phabricator updates
  • Phabricator search stuff ( https://phabricator.wikimedia.org/T157156 )

Tyler

Last week

• Docker/K8s learnings
• Try not to pay attention to the news cycle
• CI/Deployment meeting setup
• The inevitable Scap3 fallout

This week

• Train
• Scheduling and attending meetings
• Writing things on phab in a vain attempt to curtail the ineluctable onslaught of logspam

Željko

Last week

• T156558 Selenium user: Auth issues on beta wikidata?
• T152963 Increase in failures caused by Saucelabs
• T151442 Research webdriver.io
• T156837 Release mediawiki_api 0.7.1

This week

• T152963 Increase in failures caused by Saucelabs
• T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster