Wikimedia Release Engineering Team/Checkin archive/20161212

2016-12-12

Vacations/Important dates

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Dec 23: Greg, I need an extra day to prepare....
• Dec ~23 - ~ Jan 03: Antoine (yearly trip around the country for familly events)
• December 26: Željko Holiday (St Stephen's Day)
• December 26-30: XMas Holiday
• January 2nd: New Year's Day (observed)
• January 6: Željko Holiday (Epiphany)
• January 9-11: Dev Summit
• January 12-13: All Hands
• January 16: MLK Jr Day
• February 20: President's Day
• March 13: New day off for some reason
• April 14: New day off for some reason

Team Business

Time spent spreadsheet

• week 49: https://docs.google.com/spreadsheets/d/1YMflnOBggixLV-Ra0L6P7vxgUkR6sFik6Aas1y3Zsxg/edit#gid=442167963

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Dec 12 and Dec 19

• Train: Mukunda
  • wmf.6
  • no train/deploys week of Dec 19
• SoS: Chad
  • https://phabricator.wikimedia.org/E155/35
  • https://phabricator.wikimedia.org/E155/36
• Out:
  • none?

Dec 26 and Jan 2

• Train: Tyler
  • No train/deploys week of Dec 26
  • [ wmf.7]
• SoS: Dan
  • https://phabricator.wikimedia.org/E155/37
  • https://phabricator.wikimedia.org/E155/38
• Out:
  • Week of Dec 26th: Everyone
  • Jan 2nd: New Year's Day observed

Actions from last meeting

• Greg: write the Q3 CI goal
  • DONE
• Greg: Start conversation re Beta in prod and per-server rollouts

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
• Updates
  • Reminder last week for deployments is this week until Jan 3rd: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html

Last week

• Blocking
• Blocked
• Updates
  • Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html

Other Team Business

Volunteer deployers ?

Add more Volunteers? Is there any specific policy. Directed one at Greg.

• https://wikitech.wikimedia.org/wiki/SWAT_deploys#New_SWAT_Team_member_check-list
  • Need trust, technical endorsement (eg approve kabal of deployers). Directed to Greg for questions.

QA Hire

• Doing reference checks on one candidate today/tomorrow
• circle up tomorrow with interview loop (probably a short meeting)

Q2 goal/project check-in

Future of CI plan

Determine future composition of the CI infrastructure with a plan on how to get there without disrupting expected services and performance.

• Good meeting with Ops on Thursday (!!!)
  • see: https://etherpad.wikimedia.org/p/releng-ops-ci-sync
  • next steps:
    • Chase + Dan talking re Kubernetes this week
    • Explore Beta in production
    • Explore per server/percentage based rollouts
    • others?
• What do we put as our goals for Q3 and... beyond!...?
• Curious what Gabriel is working on...https://phabricator.wikimedia.org/T152684#2860452

Off meeting: need a reference disk/image

Migrate MediaWiki deploys to scap3 (part 1)

Use a unified git repo for MW deploys

• On beta
  • Needs some cleanup -- lots of space used
    • git gc/repack/pack-refs etc

Assess new directory structure and how it will interplay with MW

see above

Stretch goal: Replace rsync with git syncing

nope. still nope :)

Release MediaWiki 1.28

•  Done

Non-Quarterly goal work

Browser tests

• T152683 Set up Selenium tests for Kartographer extension
• T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster

Phabricator

• Phabricator is getting 'compare branches' functionality
• Deploying this week: https://phabricator.wikimedia.org/rPHDEPcf34cf262ed5a07adfe5643c315e94a8f6f9d825

DB Inconsistencies

https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )

People status updates

Antoine

Last week

• EasyTimeline fix for Chinese wikipedia
  • OK
• Nodepool/Permanent slaves doc
  • ????
• Dig in migrating jobrunner deployment to scap3
  • skip
• Speed up boot of Nodepool instances (DHCP related issues delayed boot by ~ 30 seconds)
• Played with Docker on scap repo

This week

• EasyTimeline fix deployed. Have to double check then close task
• CI: inject skins as dependencies of MW extensions for selenium jobs
• Look Docker/k8s as time allow

Chad

Last week

• Train + gerrit upgrade (and login snafu)

This week

• Sorting a few last gerrit things (submodules)
• Scap3 stuff

Dan

This week

• Scap3 rollback refactoring
• K8s meeting with Chase and follow up experiments for CI PoC

Mukunda

Last week

• Phabricator Phabricator Phabricator Phabricator
  • Continue experimenting with elasticsearch
    • Come up with a way to a/b test queries on both mysql and elasticsearch
      • Done - append ?elastic=1 to your query url
  • https://phabricator.wikimedia.org/rSCAPEXT1908191626ddc143556422071e18e1eedfaef511

This week

• Deploying:
  • https://phabricator.wikimedia.org/rPHDEPcf34cf262ed5a07adfe5643c315e94a8f6f9d825
  • Mediawiki Train
• Maybe this week (if deployments don't eat up all the time)
  • fail over to phab2001
  • reimage iridium to jessie, renamed to phab1001

Tyler

Last week

• moar scap code review
• Some puppet patches incoming, likely for ci-staging stuff

This week

• Finish up scap mw quarterly goal things
• May actually get to ci-staging this week :)

Željko

Last week

• T152422 Release new version of mediawiki_selenium
• T146916 RSpec tests for Echo Mention notification
• T117418 Ensure ChromeDriver is installed for jobs that run Selenium tests
• T139740 Port Selenium tests from Ruby to Node.js
• T151442 Research webdriver.io
• T151443 Research nightwatchjs
• T152683 Set up Selenium tests for Kartographer extension
• T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster
• QA hire
• SWAT deploy

This week

• SWAT deploy
• T151443 Research nightwatchjs
• T152683 Set up Selenium tests for Kartographer extension
• T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster