Scrum of scrums/2018-04-04
Appearance
2018-04-04
[edit]Callouts
[edit]- Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01
- Language -> VE/Editing https://phabricator.wikimedia.org/T188072 and review of: https://gerrit.wikimedia.org/r/#/c/419402/
- Need help from RelEng with WDQS GUI build automation: https://phabricator.wikimedia.org/T189811
- Wikidata selenium test stability problems: https://phabricator.wikimedia.org/T189762
Audiences
[edit]Readers
[edit]iOS native app
[edit]- Blocked by:
- Blocking:
- Updates:
- Reading Lists sync in beta since 03/29, finishing up 5.8 (https://phabricator.wikimedia.org/tag/ios-app-v5.8.0-manatee-on-a-skateboard/)
Android native app
[edit]- Blocked by:
- Blocking:
- Updates:
- Reading List syncing in Beta for a couple of weeks, currently running survey to gather feedback from Beta users.
- Will begin initial rollout to production (10%) this week.
Readers Web
[edit]- Blocked by:
- Cached page previews not shown on refresh (services+Brandon Black)
https://phabricator.wikimedia.org/T184534. We'd like to fix this but it's outside the scope of projects we usually work on. How can we move this along?
- Blocking:
- Updates:
- Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
- Preparing for deploy. Deploy of VirtualPageViews is being finished today, switching focus to working out a site config deploy task. Thank you Analytics!
- Reading Web depends on SRE, RelEng, Reading Infra
Readers Infrastructure
[edit]- Blocked by:
- Blocking:
- Updates:
- TemplateStyles will be enabled on German Wikipedia on Wednesday
- Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
- Reading Web depends on SRE, RelEng, Reading Infra
- Increase code sharing of client apps by coalescing and moving more logic to the server.
- Reading Infra depends on Parsing, Services
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
Maps
[edit]- Blocked by:
- Blocking:
- Updates:
- Unblocked on ops today
- Gehel back from vacation this week
- Planning release to enwiki
Multimedia
[edit]- Updates
- File page MediaInfo display prototype: Slow progress
- Search prototype: Up on wmflabs instance, some kinks to work out
- UploadWizard multi-lingual captions: Patch up, working through review
- Quarterly goal dependency update:
- Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
- SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Most dependencies fulfilled, prototypes moving quickly through review
- Objective 2.1 Integrate structured file captions into search
- SDC depends on Search Platform, Multimedia
- Dependencies pretty much fulfilled, prototype up for perusal on wmflabs instance
- Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- https://phabricator.wikimedia.org/T171252
- Research depends on Multimedia
- Haven't heard anything, happy to help
- Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
Contributors
[edit]Community Tech
[edit]- Blocked by:
- Blocking:
- Updates:
- Still working on GlobalPreferences
- Discussing the outcome of ACTRIAL with the community
Anti-Harassment Tools
[edit]- Blocked by:
- Blocking:
- Updates:
Editing
[edit]- Blocked by:
- Blocking:
- Updates: None
- Quarterly goal dependency update:
- Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
- Editing depends on Parsing.
- Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
Parsing
[edit]- Blocked by:
- Blocking:
- Updates:
- Tidy replaced on a bunch more wikis today (all wikiquotes except frwikiquote, all wikimedia wikis). More being replaced next week (ref. announcement on wikitech-l & ambassadors-l)
- Today, at noon PT, we are going to be discussing with TTO about the <poem> extension in #mediawiki-parsoid. We are trying to figure out whether to merge <poem> into core ( https://phabricator.wikimedia.org/T54061 ) with a different tag, or make other fixes to the poem extension. If you have an interest in this extension, please show up in #mediawiki-parsoid.
- Quarterly goal dependency update:
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
- Parsing depends on MediaWiki Platform, Services
- Increase code sharing of client apps by coalescing and moving more logic to the server.
- Reading Infra depends on Parsing, Services
- Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
- Editing depends on Parsing
- Program 7, Outcome 2: Objective 1: Revision storage scaling
- Services depends on SRE, Parsing
- Outcome 2: Objective 1: Revision storage scaling
- Services depends on SRE, Parsing
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
Collaboration
[edit]- Blocked by:
- Blocking:
- Updates:
- Still dealing with fallout from the OOUI icon changes, need more follow-ups from Volker (will talk to him)
- Deployed maps i18n code to maps-test, still working out issues before prod deployment
Language
[edit]- Blocked by:
- Requesting review of https://gerrit.wikimedia.org/r/#/c/419402/ from VE/Editing.
- Blocking:
- Updates:
- ContentTranslation version 2 work continue
- apertium upgrade done except fra-cat pair
- Quarterly goal dependency update:
- Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
- Language depends on Editing
- Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
Audiences Design
[edit]- Blocked by:
- Blocking:
- Updates:
UI Standardization
[edit]- Blocked by:
- Blocking:
- Updates:
- OOUI – v0.26.2 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.26.2
- Two icon deprecations: 'userActive'/'userInactive' & 'find' icon
- 10 more icon and sizing patches as follow-ups to https://phabricator.wikimedia.org/T97631 & https://phabricator.wikimedia.org/T177432 rel in 0.26.0
- Work on size unification aftermath in different products (Notifications, Flow, RevisionSlider)
- Style Guide technical and contents improvements ongoing with 4 open PRs currently
- Transparency Report: Wrapping up accessiblity measurments
- OOUI – v0.26.2 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.26.2
Technology
[edit]Analytics
[edit]- Blocked by:
- Blocking:
- Updates:
- Improved MediaWiki history reconstruction performance, less than half (7 hours now with spark 2)
- Preparing the migration of all Spark jobs to Spark2
- Lots of small-medium Wikistats2 front-end bug-fixes
- Ongoing: Aggregation of new Audiences EL events VirtualPageViews (Popups) into pageview_hourly format.
Cloud Services
[edit]- Blocked by:
- Labvirt1021/22 still having initial install issues, working with DC Ops: https://phabricator.wikimedia.org/T183937
- Labvirt1019/1020 still have RAID issues, working with DC Ops & HP ticket open: https://phabricator.wikimedia.org/T187373
- Blocking:
- Updates:
- Madhu moved Dumps content hosting to new servers managed by Cloud Services team.
- Toolforge, Cloud VPS, Analytics NFS moved Monday 2018-04-02 with no incident and minimal outage
- dumps.wikimedia.org web interface & rsync moving on Wednesday 2018-04-04
- More details at <https://etherpad.wikimedia.org/p/dumps-migration>.
- Tool catalog project led by James Hare has been branded "Toolhub" and initial use cases published on meta <https://meta.wikimedia.org/wiki/Toolhub>
- Chase got a functioning high availability OpenStack Neutron layer 3 network up in labtestn! There is more work to do, but this is a big Neutron project milestone.
- Q4 goals posted on mediawiki.org
- Madhu moved Dumps content hosting to new servers managed by Cloud Services team.
Fundraising Tech
[edit]- Blocked by:
- Blocking:
- Updates:
- EventLogging for fundraising landing page views: https://gerrit.wikimedia.org/r/423952
- Short-term response to banner that loaded 3rd party script: add CSP only on forced banner previews: https://gerrit.wikimedia.org/r/420754
- Looking at new bitcoin payment processor, as our current one is stopping USD cashouts at the end of the month
- More work on new API for main CC processor
- CiviCRM custom data enhancements
MediaWiki Platform
[edit]- Blocked by:
- Blocking:
- Updates:
- MW 1.31 release planning
- considering additional bundled extensions (https://phabricator.wikimedia.org/T178349 )
- Pingback heartbeat patch merged
- MCR:
- API updates for query modules are in Gerrit: https://gerrit.wikimedia.org/r/#/c/413223/
- Code review
- Actor table:
- Further deployment is waiting on the schema change (https://phabricator.wikimedia.org/T188299 )
- 17 extension updates still need review: https://gerrit.wikimedia.org/r/#/q/status:open+topic:bug/T167246-actor-migration
- Comment table:
- Follow up schema change is still in progress https://gerrit.wikimedia.org/r/#/c/417039/
- Toolforge view updating patch is merged and pending updates
- The image_comment_temp merging patches are in Gerrit
- All except one are blocked on the schema change
- Improving API test coverage:
- 6 changes merged and 6 changes outstanding
- Code review and bug fixes
- MW 1.31 release planning
- Quarterly goal dependency update:
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
- Parsing depends on MediaWiki Platform, Services
- MWPT working on relevant planning for Platform Evolution CDP to prepare for next FY and will coordinate with Parsing as this progresses
- Parsing depends on MediaWiki Platform, Services
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
- SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- MWPT meets weekly with SDC and WMDE
- SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Objective 1.1 Assist with deploying MultiContent Revisions on Commons
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer,T174043 Deploy Multi-Content Revisions
- SDC depends on MediaWiki Platform, WMDE
- MWPT meets weekly with SDC and WMDE
Performance
[edit]- Blocked by:
- Blocking:
- The train :-(
- Updates:
- Continuing to monitor SG datacenter rollout, looking great. Working on a blog post.
- Thumbor patches, adding WebP support
- Safemode support for Visual Editor is out for review
- Coal has been updated to use Kafka
- Waiting on SRE for a rebuild of the mcrouter package (they're aware, just haven't had time yet)
- Tons of ongoing CR
Release Engineering
[edit]- Blocked by:
- Blocking:
- Updates:
- Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
- Reading Web depends on SRE, RelEng, Reading Infra
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
Research
[edit]- Blocked by:
- Blocking:
- Updates:
- Quarterly goal dependency update:
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
- SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
- Research depends on Multimedia
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
Scoring Platform
[edit]- Blocked by:
- git-lfs support, we've tried deploying a git-lfs submodule and it doesn't work. git-lfs is still lacking on the deployment node, but that shouldn't affect the deployment itself. See task https://phabricator.wikimedia.org/T180627
- Blocking:
- Updates:
Search Platform
[edit]- Blocked by:
- Blocking: https://phabricator.wikimedia.org/T190958 needs re-deploy
- Updates:
- Wikidata fulltext search is fully enabled, so there should be improvements there
- Slovak stemmer analysis done: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Slovak_Stemmer_Analysis
- Next step - creating proper analysis plugin: https://phabricator.wikimedia.org/T190815
- Fixed an issue with Wikidata RDF dumps: https://phabricator.wikimedia.org/T185589
- Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148
- Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
- Working on Lexeme completion search: https://phabricator.wikimedia.org/T189745
- Need help with WDQS GUI build automation: https://phabricator.wikimedia.org/T189811
- Wikidata selenium test stability problems: https://phabricator.wikimedia.org/T189762
- Quarterly goal dependency update:
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
- SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Objective 2.1 Integrate structured file captions into search
- SDC depends on Search Platform, Multimedia
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
Security
[edit]- Blocked by:
- Blocking:
- Updates:
- Quarterly goal dependency update:
- Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
- Parsing depends on MediaWiki Platform, Services
- Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
Services
[edit]- Blocked by: search on updating CirrusSearch jobs
- Blocking: none
- Updates:
- Moved a big bulk of jobs to kafka
- Resetting the restbase-dev environment
- Quarterly goal dependency update:
- *Increase code sharing of client apps by coalescing and moving more logic to the server.
- Reading Infra/Parsing, Services
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
- Parsing depends on MediaWiki Platform, Services
- Outcome 2: Objective 1: Revision storage scaling
- Services depends on SRE, Parsing
- *Increase code sharing of client apps by coalescing and moving more logic to the server.
Site Reliability Engineering
[edit]- Blocked by:
- None
- Blocking:
- None
- Updates:
- Holiday week, really slow stuff not much to report
- HHVM CVE-2018-6334 patch rolled out this week
- Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
- Reading Web depends on SRE, RelEng, Reading Infra
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
- SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Outcome 2: Objective 1: Revision storage scaling
- Services depends on SRE, Parsing
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
Wikidata
[edit]- Blocked by:
- Blocking:
- Updates:
- Quarterly goal dependency update:
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
- SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Objective 1.1 Assist with deploying MultiContent Revisions on Commons
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer,T174043 Deploy Multi-Content Revisions
- SDC depends on MediaWiki Platform, WMDE
German Technical Wishlist
[edit]- Blocked by:
- Blocking:
- Updates:
- Following up on OOUI changes influencing AdvancedSearch
- Going to focus on FileImporter (a.k.a. MoveToCommons) again
SoS Meeting Bookkeeping
[edit]- Updates: