Wikimedia Release Engineering Team/Deployment pipeline/2020-08-05

2020-08-05

Always

• [1]
• Archive
• Task tree: https://phabricator.wikimedia.org/T198901

General

Any high-bandwidth commentsfor: https://docs.google.com/document/d/1nGv5N1_PYM5Wl5TTPlkFI8TZTSokuJcmdIZD-dKZdEA/edit#

RelEng

• Multi-level "copies" now a thing in Blubber
  • Copy artifacts from multiple base containers
  • https://phabricator.wikimedia.org/T254629
  • Example use: compile typescript -> js use js to build

• Injection of credentials + environment variables in Pipelinelib for docker run
  • Example: sonar code health tests as part of the pipeline

• Jeena working on Kask tests
  • https://phabricator.wikimedia.org/T224041
  • Hung up on old dockerd version there
  • Some things noticed while deploying new kask chart, maybe not important
    • Lots of TLS handshake error warnings (pre-existing new deployment)
      • http: TLS handshake error from 10.2.2.16:36374: EOF
      • Alex: known and expected (see https://phabricator.wikimedia.org/T209110#5544017 )
      • Liveness probes don't do TLS and kask complains
    • https://phabricator.wikimedia.org/T259686 service checker failing
      • Alex will try to have a look -- weird that doesn't return a spec -- may be missing some configuration -- openapi yaml path may need passing

• Build step: how does this fit in
  • Vue.JS build step in very early alpha
  • Want to produce artifacts, have suggested targeting git for the built assets
  • Dan: I cringe at using git for built assets: we should target containers as soon as possible even if that means unpacking images as part of deployment to bare metal servers
  • TODO: we should have more followup there.

Serviceops

• Mediawiki on k8s doc ongoing
• Move apertium to the pipeline https://phabricator.wikimedia.org/T255672.
  • Continuing to maintain debian packages
  • Then utilize the rest of the pipeline -- emptyish repo + .pipeline but no code
  • Q: Can we have an "emptyish" repo that is more or less a ".pipeline" structure?
    • This should work

CPT

• Tim, Bill and Cindy going to comment on Giuseppe's doc
• Naïké following up with Tyler, Wolfgang about coordination
• Will out, Mandy taking over CPT side
• CPT is now called Platform Engineering Team

Reminder: date for k8s w/Fandom is now Aug. 18th -- a week earlier than originally planned! \o/

As Always

• Release Pipeline Workboard
• Meeting notes