Wikimedia Release Engineering Team/Checkin archive/20150728

2015-07-28

Team Business

Standard

• Root access email from Mark
  • TODO: Greg expand, start etherpad
• Vacations
• GitHub

30 (ish) day checkin on Q1 goals

https://phabricator.wikimedia.org/tag/releng-201516-q1/

[Quarterly Success Metric] Jenkins: Run jobs in disposable VMs

https://phabricator.wikimedia.org/T47499

• boot instances from OpenStack API
  • labnodepool is pretty much done. Going to be reimaged from scratch. https://phabricator.wikimedia.org/T107158
  • still missing the image to boot from (goal: end of week-ish?)
• subset of jobs run in disposable VM (not isolated)
  • after Antoine's vacation
• Bug 1/Task 2001
  • For now just some notes at: https://wikitech.wikimedia.org/wiki/Nodepool

Gerrit Migration stage 1

• Prototype CI integration with Differential
  • https://phabricator.wikimedia.org/T103127
  • TODO: Mukunda and Antoine to pair or something this week

• Allow cloning of Phabricator hosted git repositories
  • https://phabricator.wikimedia.org/T128
  • Completely working on HTTPS.
  • SSH a WIP, Chase was working on this last week
    • Cloning of SVN requires SSH, Phab doesn't support HTTP(S) + SVN

Create or improve the RESTBase deploy method (tracking)

https://phabricator.wikimedia.org/T102667

Seemingly on track at this point Not drowning!

• A new workflow for RESTBase is deployed (task T102667 is complete)
  • Created reasonable replacement method via scap
  • Working on wrapping ansible to hide ansible :)
  • Goal to have systems to evaluate (roughly) by next week

• All items in Deployment_tooling/Future#Future_Requirements completed
  • Continually evaluating approaches
  • Fill out evaluation of tools, further refine best approach
  • https://docs.google.com/a/wikimedia.org/spreadsheets/d/1MlEsFxrLvdZdV_G82WEAIvBXr7ArO7nCEKaFClHhJEw/edit?usp=sharing

Pairing (#together) / Weekly Triages

• happenin'

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/?statuses=open%28%29&projects=PHID-PROJ-arpazvuktn2l647rb6us#R

Beta Cluster

https://phabricator.wikimedia.org/project/board/497/?order=priority

• Migrate Varnish caches from Trusty to Jessie https://phabricator.wikimedia.org/T98758
  • Shouldn't be hard, we can clean this up.
  • Chad took the task, started looking at it last week anyway
• FYI: Might want to deploy MediaWiki services using scap/git-deploy/whatever...

Deployment Cabal

• Already discussed above in quarterly.

Isolated CI instances

https://phabricator.wikimedia.org/tag/continuous-integration/board/?order=priority

Quarterly Priority: Disposable VMs - https://phabricator.wikimedia.org/T47499

• Zuul upgraded, fixed regression
• Antoine to write doc about building the Zuul .deb package and bumping from an upstream version.

Phabricator

• Already discussed above in quarterly.

Developer Tooling (MW-Vagrant, MW-Selenium, etc.)

• Working on video recording for headless browser test sessions
  • Done, just needs a couple merges (mw-selenium 1.5.0 release and support in jenkins slave script)
  • https://gerrit.wikimedia.org/r/#/c/226653/
  • https://gerrit.wikimedia.org/r/#/c/226651/
    • Antoine: seen them, that is all good. The ruby video stuff looked legit though I haven't tested them. Only concern was disk space consumption on slaves, but that has been dealt with by limiting the number of artifacts we keep.
      • next step offloading the videos to swift? :) :) :)

Other Work

• Hosted Testing: Where does it hurt? session yesterday
  • Seemed like a successful first step in addressing teams' testing pain points
  • Grace and Dan will be reviewing notes and formulating next steps this Wednesday
• start using semantic versioning for wmf branches:: https://phabricator.wikimedia.org/T67306
  • I am going to attempt to implement this asap, maybe today if I don't hit too many roadblocks with make-wmf-branch, etc.
  • I am curious...if we automated the release process...what if we actually did weekly point releases that coincide with deployment?
    • It needs freaking automation.

Vacations/Confs/etc

Please add your time off to your gcal and ADP, as appropriate

• Dan: July 30-31 (reachable by gchat/phone/email)
• Zeljko: July 27th - Aug 16th (3 weeks!)
• Antoine: Aug 1st - 23rd (3 weeks!)