Scrum of scrums/2016-07-06

2016-07-06

Product

Reading

iOS

• 5.0.5 has been delayed for 2 more weeks due to new regressions.
  • We are restarting the entire beta process because the 5.0.5 release diverged significan;ty from the trunk
  • A new 5.0.5 with changes more recent bugfixes from the main trunk is being redeployed to beta this week
  • 5.0.5 will re-enter regression next week
• 5.1 features are being re-evaluated due to the long development time of 5.0.5
  • Some 5.1 features will likely be moved to 5.2
• Discovery is helping us improe the map UI first developed on Android by implementing some Geodata API enhancements (https://phabricator.wikimedia.org/T139378)

Android

Finishing touches on the feed.

Mobile Content Service

• Experienced more than a dozen Nagios checker failures (timeouts) due to increased memory usage by ORES last weekend. Got fixed on Monday. https://phabricator.wikimedia.org/T139177
• Feed endpoint improvements:
• redirect to summary endpoint for random and TFA if possible. https://phabricator.wikimedia.org/T139424 + https://phabricator.wikimedia.org/T136960
• adding date input validation for feed endpoints which accept dates

Blocked on Services team:

• We need the public feed endpoints (aggregated feed + random page) to enable the feed functionality for a beta Android app release. This is blocking the Android teams quarterly goal.

Reading Web

• Wikidata descriptions to mobile web stable in ca.wiki and pl.wiki
• Deployed lazy references and images to mobile web tl.wiki
• Fixing some bugs with hovercards to improve data analysis from A/B test
• Started working in improvements to language switcher in mobile web

Community Tech

• Deploying PageAssessments extension to test.wikipedia (https://www.mediawiki.org/wiki/Extension:PageAssessments)
• Finishing work on CopyPatrol Tool (https://tools.wmflabs.org/copypatrol)
  • Replication lag on Tool Labs has been a major problem. We are migrating from local DB queries to API requests to avoid the problem.
• Figuring the out the best implementation plan for switching to UCA collation + numerical sorting for categories
• No blockers

Editing

Multimedia

• https://phabricator.wikimedia.org/T138273#2410743 MatmaRex needs review from anomie, tgr, and AaronSchulz.
• Still waiting for Thumbor deployment to carry ImageTweaks forward, Gilles says he's working on Debian packaging
• Continuing work on FileAnnotations
• Continuing work on getting rid of fatal errors in UploadWizard

Collaboration

• Blocking - No change
• Blocked - None
• Updates
  • Deployed to group 0 new enhanced Echo bunding (with the ability to expand and collapse bundles of notifications and act on individual notifications), changed sorting of Alerts and Messages
  • Deployed new version of Special:Notifications with per-page notification lists

Parsing

• Co-ordinating with Services to resume work on Parsoid migration to use service-runner utility. This blocks upgrade of parsoid production cluster to node 4.x (from 0.10) and deployment process to scap3 (from trebuchet)
• Continuing to work on a bunch of bug fixes in Parsoid.
• Work ongoing (Tim & Scott) to land a PHP HTML5 parser in core which can serve as a default Tidy replacement solution for mediawiki.

Discovery

• Blocking: none
• Blocked: none
• Hired new data analyst, she starts end of July (give or take)
• TextCat A/B finished, analyzing results
• Working on enabling boxed search by coordinates with near: and neartitle: - https://gerrit.wikimedia.org/r/#/c/297524/
• Logstash elasticsearch upgrade planned for July 7th (https://phabricator.wikimedia.org/T136001). This also includes upgrade to Kibana 4.
• Portal stats updated on June 30th
• Portal survey on why people come to Portal are published: https://phabricator.wikimedia.org/T136874#2418095

Maps/Graphs

• Geoshapes service is integrated with WDQS and can provide both wikidata data and shapes: http://data.wmflabs.org/wiki/Regional_maps

Wikidata

• Focus on refactoring the Sites mess in core, starting with: https://phabricator.wikimedia.org/T137537, tracked in: https://phabricator.wikimedia.org/T113034
• Core support for multilingual wikis: https://phabricator.wikimedia.org/T114640
• Ongoing communication about Multi Content Revision support in core: https://phabricator.wikimedia.org/T107595

Technology

Analytics

• Will start working on migrating refinery to SCAP 3 tomorrow (cc: release team)
• Ongoing work on Event Bus, scaling AQS and the Pageview API, reconstructing mediawiki history, and loading Druid with pageview data

Research

• ores.wikimedia.org online (woo ops). ores.wmflabs.org will remain online and a deprecation plan will be announced "soon"
• Major ORES downtime was exacerbated by icinga config failure (301 is a good response and not followed by default) https://wikitech.wikimedia.org/wiki/Incident_documentation/20160610-ORES
• ORES extension deployed to fawiki and wikidatawiki. Large wikis coming soon.

Security

• Other security reviews are being schedule; if you have need, please submit your request: https://www.mediawiki.org/wiki/Wikimedia_Security_Team/Security_reviews
• A security release will be prepared soon
• Reviews: 3d2png (cont.), Tool Labs Console

Services

• out for two weeks - Wikimania + Offsite
  • lots of interesting discussions
• Auth / session storage service
  • discussed the plan with Darian
  • will draft an Arch RfC soon
• Nodejs migration to 4.4.6
  • https://phabricator.wikimedia.org/T138561
  • scheduled for next wednesday
  • test your services and update your package.json to use node v4.4.6
  • especially important for SCB services

Fundraising tech

• Building and deploying new payments servers to get off precise and php 5.3
• Also upgrading mediawiki and CiviCRM, planning how we'll more closely follow mw master
• More work towards de-duplicating donor database
• CentralNotice: don't load anything on Special: or action=edit
• Still investigating what looks like missing log entries (delivered via Kafkatee): https://phabricator.wikimedia.org/T132500

RelEng

• Blocking: none?
• Blocked:
  • Target architecture without gallium (email followup) https://phabricator.wikimedia.org/T133300
• Updates
  • Browser Testing survey still open (phab task for info: https://phabricator.wikimedia.org/T131123)
  • CI reduced yesterday, should be good now
  • Scap3 migration - new guide posted on wikitech https://wikitech.wikimedia.org/wiki/Scap3/Migration_Guide

Technical Operations

• Blocking
  • None
• Blocked
  • By noone
• Updates
  • All image scalers are now on jessie with updated librsvg, fixes plenty of bugs (also related to changes to fonts while at it)
  • Enabled TCP Fast Open on some caching clusters
  • gitblit is finally dead
  • Working with LE to get apertium packages reviewed/uploaded on apt.wikimedia.org. Some 20% done