Wikimedia Release Engineering Team/Checkin archive/20151006

2015-10-06

Vacations/Confs/etc

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Oct 12: US HOLIDAY - Indigenous People's Day (Columbus Day)
• Oct 12-16: Ops team offsite
• Oct 16: Dan -
• Oct 16 - 20: Andrew - Vacation
• Oct 23 Friday: Antoine -
• Nov 11: US HOLIDAY - Veterans Day
• Nov 26: US HOLIDAY - Thanksgiving
• Nov 27: US HOLIDAY - Day after Thanksgiving
• Dec 25: US HOLIDAY - Christmas Day - December 25
• Jan 01: US HOLIDAY - New Year's Day
• Jan 16-18: Chad - another music festival
• Jan 18: US HOLIDAY - Martin Luther King Day
• Feb 15: US HOLIDAY - President's Day
• May 30: US HOLIDAY - Memorial Day
• June-ish: Chad - EDC

Team Business

Skill matrix update (2 min)

• https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
  • please update by EOD (used in our QR)
    • Antoine {done}

Quarterly Review (2 min)

• Last chance review of our Quarterly Review slides
  • https://docs.google.com/presentation/d/11GDxDi0OzZ70pJk5AVoKRu2wjPWYh-CU6dbYWYWQGtQ/edit#slide=id.ga4ecc5878_2_0

WIkiDev16 (5 min)

Ours

• Sessions that made first deadline:
  • Code-review migration status/discussion (aka Differential migration RFC) - https://phabricator.wikimedia.org/T114320
  • Scap3: updates, upgrades, and challenges - https://phabricator.wikimedia.org/T114045
• What we need to do:
  • By 6 Nov 2015 (one month), all Summit proposals must have active discussions and a Summit plan documented in the description.

Discussions that are interesting to us

• RFC: Streamlining Composer usage - https://phabricator.wikimedia.org/T105638 - https://www.mediawiki.org/wiki/Requests_for_comment/Streamlining_Composer_usage
  • implications on deployments
• Identify and prioritize architectural challenges - https://phabricator.wikimedia.org/T96903
  • See the "Process" section; implications on deployments, shared infrastructure and development processes
• The end of shared hosting support? - https://phabricator.wikimedia.org/T113210
  • oh boy :)

Q2 KPIs (5 min)

• We should get these 2 done sooner than later
  • Log errors: https://phabricator.wikimedia.org/T108749
    • Owner: Chad (with Mukunda) :)
  • CI wait time: https://phabricator.wikimedia.org/T108750
    • Owners: Antoine and Dan
    • https://phabricator.wikimedia.org/T70114
    • https://grafana.wikimedia.org/#/dashboard/db/releng-zuul

New vs Maint time spent (10 min)

• Discuss how to "track" time spent on goals and maintenance
• Why? See our title slide in the Quarterly Review: https://docs.google.com/presentation/d/1UYK_IKndaubzIRGqw2-YWK_cVXUiZXLagMDf9QdHs1o/edit#slide=id.g6f90f15c0_10_0
  • One suggestion: weekly breakdown on Monday/Tuesday ("What did I do last week? Where does that fall?") Still just using percentages of time, rough estimate.
    • see eg what Ops is doing: https://office.wikimedia.org/wiki/Operations/Operations_Meeting_Notes/TechOps-2015-09-28#Individual_updates_.2820_mins.29
    • example for us:

   === greg ===
   QuarterlyGoal1: 10%
   QuartelryGoal2: 30%
   Maint/Reactive: 60%

Will let management gauge load of teams.

#together (10 min)

• Team workboard triage https://phabricator.wikimedia.org/project/board/20/query/open/

• CI Scaling needs from Ops for Q2
  • Antoine? :)
    • Antoine gotta identify ops related projects and figure out what we reasonably can do. Backlog in mind: network isolate nodepool instances, move zuul to labs, phase out gallium

Scrum of Scrums (5 min)

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

• Pinged from Subbu re: "Parsoid patches don't update Beta Cluster automatically -- only deploy repo patches seem to update that code"
  • https://phabricator.wikimedia.org/T92871

• Pinged from Chris re: "Update all repositories that use mediawiki_selenium Ruby gem to version 1.6.x"
  • https://phabricator.wikimedia.org/T114241

Project Updates

CI Scaling

https://phabricator.wikimedia.org/project/board/1010/

Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106

• LOT of changes in integration/config to add entry points to mw ext and phase out old jobs
• Most python jobs migrated
• Ruby/gem added to Nodepool instance
• Talked extensively about caching package managers tarballs

Deployment Cabal

Main: https://phabricator.wikimedia.org/project/board/349/

Scap3: https://phabricator.wikimedia.org/project/board/1449/

Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926

• using Differential for code-review for scap :)
• post-friday for restbase via scap on Beta

Phabricator/Diff[usion|erential] migration

Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/

Quarterly Goal: https://phabricator.wikimedia.org/T111465

Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

• reminder to start RFC drafting before Nov 6th when it's due

Release MediaWiki 1.26

https://phabricator.wikimedia.org/project/board/1177/

Beta Cluster

https://phabricator.wikimedia.org/project/board/497/?order=priority

Other Work

I haven't upgraded phabricator for a full month. This is happening tomorrow, hopefully using scap3 to do the deployment.

https://phabricator.wikimedia.org/T110443