Wikimedia Release Engineering Team/SSD Sync Up/2019-05-28

Last Time: 2019-05-21

Deployment Pipeline

Workboard

• CI arch doc
  • Processing Antoine's feedback
  • Seeking feedback from Krinkle
  • on team's Google Docs now, will reach out to outsiders this week: who?
    • SRE?
    • MediaWiki devs?
    • everyone?

• SRE asked about a "secure CI" to build Docker images, Debian packages
  • separate from current Jenkins, which seems to not be sufficiently secure for them (understandable)
  • should we do something or have Greg decide if we should take this on?
  • Consensus: We probably shouldn't have lots of CIs, at least without talking to Greg first.
  • There are many security aspects that need to be thought through carefully
  • Also K8s maintenance questions.

• integration/config changes for .pipeline/config.yaml
  • Dan: Trying to get blubber's pipeline/config.yaml working, surfacing bugs that weren't covered in unit tests (hard to test integration with k8s). Almost working.
    • A high degree of duplication in blubber's pipeline config already. Maybe we need an `includes:` under each pipeline ala blubber variant includes?
    • e.g. https://gerrit.wikimedia.org/r/c/blubber/+/511784/6/.pipeline/config.yaml

Local Development

Still in-flight / pending work:

• Looking to start running `helm lint` in CI for local-charts.
• Various tasks created during Hackathon.
  • Ubuntu: https://phabricator.wikimedia.org/T223715
  • Windows: https://phabricator.wikimedia.org/T223659
  • EventLogging: https://phabricator.wikimedia.org/T223643
  • Redis: https://phabricator.wikimedia.org/T223642
  • Xdebug: https://phabricator.wikimedia.org/T223641
  • xhgui: https://phabricator.wikimedia.org/T223670