Wikimedia Release Engineering Team/SSD Sync Up/2019-02-05
Appearance
- Notes posted for All-Hands meeting https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Deployment_pipeline/2019-01-29
- Good talk
- Came up with 2-month MVP
- Main thing from our-side is jenkins pipeline should comment on gerrit
- demo of/talk about https://github.com/vapor-ware/ksync -- looks neat
- Jeena: tried mounting a volume in k8s and it was slow, so this syncs your workspace by setting up a svc in k8s, then you use ksync create on the commandline to create a spec with selector for the target deployment and local disk and space on the pod then run `ksync watch` on the pod
- When you setup minikube, vbox mounts your local user directory to the vm, so when you try to mount a volume to your pod you
- Minikube mounts your entire `Users` directory (which is like `home` for the mac)
- Following the directions on the github repo, it was slow and terrible
- Jeena: tried mounting a volume in k8s and it was slow, so this syncs your workspace by setting up a svc in k8s, then you use ksync create on the commandline to create a spec with selector for the target deployment and local disk and space on the pod then run `ksync watch` on the pod
- Dan: shared volume has been problematic for mw-vagrant since its shared filesystem is super slow
- Jeena: minikube constantly uses 30-40% of my CPU (actually VBox used by minikube), ksync adds an additional 10% of cpu
- Dan: neither setup seems perfect, I'm wondering if we should experiment further
- shared filesystem to expose host project files to VM so they can be mounted by VM into container
- creates a weird non-native virtual filesystem within the contianer, which introduces complexity
- periodic image rebuild or sync model
- shared filesystem to expose host project files to VM so they can be mounted by VM into container
- Minikube for mac driver gist: https://gist.github.com/inadarei/7c4f4340d65b0cc90d42d6382fb63130
- Mikikube for linux driver: https://github.com/kubernetes/minikube/blob/master/docs/drivers.md#kvm2-driver
- maybe ask davidwbarratt if he has experience with various drivers
- David Barratt had issues with Docker on mac and hinted that Docker uses Hyperkit and mounts volume with :cached. Reach out to him? He gave a presentation on Friday at all-hands.
- Blubber policyfile
- Task on Workboard to be filed
- repo to store the policyfile?
- enforced for which variants?
- V4 of Blubber parser?
- There's a public https://blubberoid.wikimedia.org now
- Work on https://phabricator.wikimedia.org/T212247 can continue
- There's a public https://blubberoid.wikimedia.org now