Continuous integration meetings/2015-09-01/Minutes

#wikimedia-office: CI weekly triage

Meeting started by hashar at 14:00:49 UTC. The full logs are available at https://tools.wmflabs.org/meetbot/wikimedia-office/2015/wikimedia-office.2015-09-01-14.00.log.html .

Meeting summary

• LINK: https://www.mediawiki.org/wiki/Continuous_integration/Meetings/2015-09-01 Agenda (hashar, 14:01:01)
• LINK: https://plus.google.com/hangouts/_/wikimedia.org/ci-weekly Google hangout (hashar, 14:01:37)
• Action restrospective (hashar, 14:01:57)
  • LINK: https://www.mediawiki.org/wiki/Continuous_integration/Meetings/2015-08-25/Minutes (hashar, 14:02:00)

• Wikidata browser test jobs (hashar, 14:02:30)
  • LINK: https://phabricator.wikimedia.org/T110510 (jzerebecki, 14:03:32)
  • LINK: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-firefox-sauce/ Failling job (hashar, 14:04:11)
  • LINK: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-firefox-sauce/jobConfigHistory/ (hashar, 14:05:28)
  • LINK: https://integration.wikimedia.org/ci/view/BrowserTests/view/Wikidata/job/browsertests-Wikidata-WikidataTests-linux-chrome-sauce/ Actually falling job is the chrome one (hashar, 14:07:20)
  • LINK: https://integration.wikimedia.org/ci/view/BrowserTests/view/Wikidata/job/browsertests-Wikidata-WikidataTests-linux-chrome-sauce/jobConfigHistory/ (hashar, 14:07:41)
  • LINK: https://integration.wikimedia.org/ci/job/browsertests-Wikidata-WikidataTests-linux-chrome-sauce/jobConfigHistory/ (zeljkof-meeting, 14:10:07)
  • Now named CI scaling project (hashar, 14:21:52)
  • ACTION: Rename project in Phabricator (hashar, 14:22:03)
  • AGREED: to rename the CI isolation project to CI scaling (hashar, 14:23:13)
  • https://phabricator.wikimedia.org/T110693 MySQL database for Nodepool (hashar, 14:23:50)
  • https://phabricator.wikimedia.org/T107268 Bump Nodepool to support statsd 0.3.0 (hashar, 14:24:30)
  • Creating images using disk-image-builder !!!!!!!!! (hashar, 14:26:24)
  • .plan : hashar to conclude nodepool install then migrate integration/config.git jobs and later pywikibot/core jobs (hashar, 14:28:12)
  • Hashar and Dan discussed about using LXC to run jobs. Potential challenge is creating the reference image and then compile a Jenkins job as a sequence of commands to run in a LXC container. Might do a POC in September (hashar, 14:30:20)

• Wikidata and composer (hashar, 14:31:18)
  • composer-merge-plugin no more blocking. Jan lacks time to convert the existing jobs though (hashar, 14:31:38)

• Jobs compatibility with old release branches (hashar, 14:32:43)
  • Conversion to generic composer/npm jobs cause jobs to fails on release branches that are not ready for it yet (hashar, 14:33:44)
  • AGREED: hashar to emit a proposal to wikitech-l to bring npm/composer support to REL branches. (hashar, 14:37:31)

• Unique entry point (make test? ) (hashar, 14:38:36)
  • Pro: offers liberty to dev, Con: does not let us ensure the proper jobs are running (such as npm/composer based) (hashar, 14:39:08)
  • Jan points npm/composer can be badly configured. legoktm dashboard shows the tools being used https://www.mediawiki.org/wiki/User:Legoktm/ci (hashar, 14:41:17)
  • LINK: https://www.mediawiki.org/wiki/User:Legoktm/ci legoktm dashboard (hashar, 14:41:22)
  • LINK: https://github.com/legoktm/tools-ci legoktm dashboard source code (hashar, 14:41:31)
  • alternative to a make file would be using a config file that says something like npm=yes, composer=no. i.e. you could enable individual entry points. (jzerebecki, 14:42:57)
  • Paladox proposed a lot of changes to mediawiki repositories and CI config. Have to test each of them individually before approval though :-/ (hashar, 14:48:40)
  • AGREED: jzerebecki to fill a task requesting to make it easier to run composer/npm on repo that are not configured yet (using Zuul experimental pipeline) (hashar, 14:51:05)
  • Already solved by legoktm ! npm / composer-tests are in experimental (hashar, 14:52:15)

• Next meeting (hashar, 14:53:16)
  • AGREED: Next meeting on Tuesday September 8th at 16:00 CET (14:00 UTC) (hashar, 14:53:33)

Meeting ended at 14:56:29 UTC.

Action items

• In Phabricator rename project CI-Integration-Isolation to CI-Integration-Scaling

People present (lines said)

• hashar (42)
• wm-labs-meetbot (3)
• jzerebecki (3)
• zeljkof-meeting (2)