Scrum of scrums/2015-11-04

2015-11-04

Reading

Web

• Need help security reviewing Cards extension
• Parsoid team: We will be contacting you with findings from research around slimming down Parsoid output for reading
• Looking to deploy Relatedarticles extension and QuickSurveys before end of month

Android

• Transitioning to Marshmallow target API.
• Fixing crashes identified in HockeyApp from the last release.
• Identifying testing weaknesses and making improvements.

iOS

• 5.0 Alpha released!
• Should be getting ball rolling on API usage & Universal Links soon

Content Services

• Removing mobile-html route
• Renaming mobile-html-sections* routes to mobile-sections* (dropping the "html-" part since it's really JSON output)
• Offloading transformations from client to service (except the ones that depend on the client width, a client setting or a click handler on the client)
• potential blocker: Parsoid does not mark red links https://phabricator.wikimedia.org/T117519 -> https://phabricator.wikimedia.org/T39902

Reading Infrastructure

• Block: Need security review for php-session-serializer and SessionManager, see https://phabricator.wikimedia.org/T116413 for details
• Block: ApiSandbox is still ultimately blocked on whoever owns oojs-ui for https://phabricator.wikimedia.org/T91148

Community Tech

• No blockers
• We may also need an additional security review before the end of the quarter: https://phabricator.wikimedia.org/T117142
  • Open a #secruity-review ticket, and we can negotiate Got it!
• Community Wishlist Survey starts next week

Editing

Language

• No Blocker/Blocking.
• Unblocked: Comment on Datetime widget: https://gerrit.wikimedia.org/r/#/c/216909/
• Unblocked: T86385: Translate extension makes huge batch INSERTS
• Work on CX suggestions continue.
• service-runner patch in review, Puppet config for it in progress.

Parsing

• Need input form Language engineering and VE teams on https://phabricator.wikimedia.org/T113331
• Note to Content Services: srcset support will probably be live on Monday after we test it this week

Collaboration

• External store patch is ready to merge, but needs review from Jaime : https://gerrit.wikimedia.org/r/#/c/226544/
• Same applies for artificial primary key for Flow reference tables : https://gerrit.wikimedia.org/r/#/c/238393/ . I'll create the needed followup tickets today.
• Dump work continuing
• Just converted ptwikibooks from LQT to Flow
• Cross-DC preparation work in progress. https://gerrit.wikimedia.org/r/#/c/247575/ just rolled out, which will deliberately cause much of our cache to gradually expire and not re-fill. This will give us info on how Flow behaves without its Memcached Index cache layer
• We're continuing preparatory and design work for cross-wiki Echo notifications.
• We'll be resuming work on Flow anti-spam soon

Infrastructure

Technical Operations

• Blocking: none
• Blocked: none
• Updates:
  • OpenDJ LDAP server for labs migration ongoing
  • Mostly in maintainance mode this week.
  • Will try and migrate ops meeting to bluejeans next week.

Services

• Cassandra

• use Date-Tiered Compaction Strategy - https://phabricator.wikimedia.org/T117115
• hickups resolved
• multi-instance work under way

• QG EventBus

• finalising event schemas - https://github.com/wikimedia/restevent/pull/5/
• about to start work on change propagation (to replace our RestbaseUpdateJobs extension)

• QG High-volume API end-points

• discussions ongoing for imageinfo - https://phabricator.wikimedia.org/T116840
• need to talk to Reading Web for extracts - https://phabricator.wikimedia.org/T117082

Security

• Reviews for Sessions in progress
• patches on the cluster
• Secure code training Dec 3rd, email will go out to wikitech-l soon
• We are probably going to allow "Access-Control-Allow-Origin: *" with "Access-Control-Allow-Credentials: false" across wikis (T62835)
• Static analysis tools, PCI scanning still in progress

Release Engineering

• Blocking:
  • T87036 Convert work machines (tin, terbium) to Trusty and hhvm usage
    • Waiting on ops/puppet patch https://gerrit.wikimedia.org/r/#/c/224829/
• Blocked by: (none)
• Updates:
  • Deployment tooling implementation continues
    • https://phabricator.wikimedia.org/project/view/1449/
    • Documentation (for user centric docs) sprint last week
  • Still investigating caching options for dependencies on isolated CI instances
  • MW release 1.26 Nov 20-ish
    • Please take a look at https://phabricator.wikimedia.org/tag/mw-1.26-release/ for tasks/bugs related to your projects
  • Continuing to dogfood arc/Differential

Discovery

• Working on language improvement, A/B test started
• Working on setting up Relevance Lab
• Portal improvement work continues, posted public document about reasoning & plans
• New GUI for WDQS with completion, bells & whistles
• Considering deployment freeze in December
• Maps: working with Wikivoyage RU/EN on adoption
• Graphoid has been moving forward - now supports both Vega 1 and Vega 2 on the service side. Working with services team on restructuring its storage.
• Zero had a number of issues last week, Yuri still resolving them.

Advancement

Fundraising Tech

• Lots of post-upgrade fixes for CiviCRM modules
• Fixing email list generation and success tracking for November appeals
• Troubleshooting Worldpay issues
• Testing backup CC processors for December

Research

• article translation recommendations to be surfaced in ContentTranslation in the sprint starting Wednesday
• deployed WikiData vandalism predictor in ORES ('reverted' model)
• working through notes from security review for ORES service