Wikimedia Release Engineering Team/Checkin archive/20170417

2017-04-17

Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List

How to do it

• April 13 and April 17th: Antoine travel - work on Friday 14th
• April 17: Željko local holiday (Easter Monday)
• April 19-21: Željko vacation
• April 27-29th: Antoine in Amsterdam (unreacheable)
• May 15-18: Team Offsite in Vienna
• May 19-21: EU Hackathon
• July 10-14th: Tyler adventure time

Team Business

Time spent spreadsheet

• week: 15: https://docs.google.com/spreadsheets/d/1I9VraCrlQLK3KjbS4yi3K8XgLQ2SgyADMNH1dh1ky1A/edit#gid=653023378

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Mar 20 and Mar 27

• Train: Tyler (plus Chad for goup2 on March 30th)
  • wmf.17
  • wmf.18
• SoS: Chad
• Out:
  • March 23-28: Chad in Miami
  • March 30, 31: Tyler in Wichita
  • Thu March 30 - Mon Apr 3: Greg in Berlin (Wikimedia Conference)

Apr 3 and Apr 10

• Train: Chad
  • wmf.19
  • wmf.20
• SoS: JR
• Out:
  • April 10-17: Dan
  • April 13 and April 16th: Antoine travel
  • April 14 (Friday): US Staff holiday

April 17 and Apr 24

• Train: Mukunda
  • week of 17th: no deploys (dc switchover)
  • wmf.21
• SoS: Tyler
• Out:
  • April 17th: Antoine travel
  • April 19-21: Željko vacation
  • April 27-29th: Antoine in Amsterdam (unreacheable)

May 1 and May 8

• Train: Mukunda
  • week of the 1st: no deploys (dc switchover)
  • wmf.22
• SoS:
• Out:

May 15 and May 22

• Train:
  • week of 15th: team offsite, no train
  • [ wmf.23]
• SoS:
• Out:

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
• Updates

Last week

• Blocking
• Blocked
  • scap deploy patches...
• Updates

Other Team Business

Annual Planning

https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Technology

Logspam

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Other

• Generate compiled assets from continuous integration - https://phabricator.wikimedia.org/T158980
  • See also: Developer happiness - https://phabricator.wikimedia.org/T162936

Q4 goal/project check-in

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q4

Streamlined Services Delivery

Build a runnable image from tested and confirmed code that is suitable for promotion.

define 'tested and confirmed' / determine the entry-point for building a container

generate or consume a docker file for building

build image, upload and tag it in docker registry

• Still working on pushing to docker registry
• JR finishing work on spreadsheet
  • gave faidon access

sub-point: quality interview summary/writeup

• JR has it 99% done, wants to present to team, probably next week

Train 2.0

Move MW+Extension deploys to scap3 - task T114313 (part 3)

Integrate scap with etcd/pybal to automatically depool and repool servers - task T104352

• Mukunda and Chad making a date

Release MediaWiki 1.29

A quality MediaWiki 1.29 is successfully released - task T153271

• not yet...

Non-Quarterly goal work

Phabricator

• There was a pretty major XSS issue with the search highlighter thanks to elasticsearch being dumb.
  • https://phabricator.wikimedia.org/T118206
  • I responded quickly and deployed the fix on friday, it is now unpossible to xss the search results.

People status updates

Antoine

Last week

• Redis "could not connect" log spam with Elukey
• POC for caching npm install
• hide chocolates in garden

Chad

Last week

• Train
• Scap

This week

• Scap
• MW 1.29 work
• Gerrit security thingie

Dan

Last week

• Time off

This week

• Catch up on last week's email and progress on CI quarterly goal

JR

Last week

• quality interview
  • complete write up
• CI Pipeline requirements
  • roll in Ops req
  • start review with team
• bug/defect data wrangling

This week

• CI Pipeline requirements
• Test data wrangling improvements
• Bug data wrangling improvements

Mukunda

Last week

• Fix bugs
• Help chad with pybal stuff?
• From last week
  • Evaluate the contributed "Release" app for phabricator (this is a thing that might replace Releeph, for cutting release branches in phabricator...)
• Maybe work on more custom search results UI... maybe
• ????
• Profit
• Spent almost the entire week working on scap config diffs (+ fixing phabricator XSS issue)
  • https://phabricator.wikimedia.org/T118206
  • Finally have a good scap dev environment locally in KVM. Vagrant:fail

This week

• Finish config diffs https://phabricator.wikimedia.org/T118206
• Logspam cleanup
• catch up with chad about pybal/conftool

Tyler

Last week

• Datacenter switchover scap deployment host -- need to make sure it's global only
• Push built images to ci-staging
• php55 lint -> docker (maybe)

This week

• Push image to ci-staging
• Push forward https://gerrit.wikimedia.org/r/#/c/347130/
• Couple of scap bug things: canaries, all patches for individual repos

Željko

Last week

• T139740 Port Selenium tests from Ruby to Node.js
• T162256 Port Selenium tests from Ruby to Node.js on Reading Web extensions
• T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done() callback is being called in this test.`