Scrum of scrums/2016-12-07

2016-12-07

Product

Reading

iOS native app

• Last Week
  • Shipped 5.3.1 with bug fixes
  • Continued work on 5.3.2 - Dynamic text size, data layer update, performance enhancements
• This week
  • Finish work on 5.3.2, fix bugs from beta feedback
  • Feature complete on 5.3.2 Friday 12/9

Android native app

• Last week:
  • Continuing Q2 goals for Wikidata descriptions
  • New beta v2.4.182
    • Fundraising and survey cards now configurable remotely (beta)
• Next week (https://phabricator.wikimedia.org/project/view/2352/):
  • More Q2 goals for Wikidata descriptions (tutorial and polish)

Mobile Content Service (MCS)

• Remove obsolete mobile-summary endpoint (handled by RESTBase directly)
• Moved to node template version 0.5.0, moved to ES2015 and eslint

Reading Web

• Current sprint: https://phabricator.wikimedia.org/project/view/2362/
• So far:
  • ReadMore has been enabled on Japanese and Spanish wikis (mobile site)
  • Wikidata Page banner has been enabled on Finnish Wikivoyage
  • Wikidata page descriptions has been enabled on French and German wikipedias (mobile site)
  • Lead image has been disabled from the mobile site, beta mode.
• Until we meet the next time:
  • Create importable test pages that can be used to test various Reading Web related changes
  • Hovercards rewrite finish up
  • Continue working on returning page images from the lead section only

Reading Infrastructure

• API i18n changes going out with next train: https://lists.wikimedia.org/pipermail/mediawiki-api-announce/2016-December/000121.html
  • you can use the new errorformat, errorlang, errorsuselocal paramers to get localized, parsed errors; if you don't, most API modules will behave the same as before. Exceptions:
    • for query modules the error codes won't be prefixed anymore the way parameter names are;
    • for a few modules (see announcement) which put errors in some non-default location in the response data, that location might change and/or the contents might change from a single error to an array of errors.
• could use some advice from Performance or Language on dealing with huge JS data blobs: https://phabricator.wikimedia.org/T32574#2836570
• MediaViewer tests failing, mw.language tests seem to be the cause: https://phabricator.wikimedia.org/T152476

Editing

Collaboration

• Working on new filter UI for Special:Recentchanges; a bunch of backend patches for this landed in MW core recently, more will land soon. Will be behind a hidden preference for the time being.
• Converted Flow and Echo to extension.json. This has caused a few minor issues for Flow and may cause some for Echo as well. Also, if you have open patches, they'll probably conflict now.
• Going to convert PageTriage next; and FlaggedRevs after we clear out the CR backlog a bit there

Parsing

• Blocked: Tim asked ops for someone to assist him with puppetizing HTML5Depurate for a pilot deployment to the production cluster for our Q2 goal. No response yet.
  • See "[Ops] Need Html5Depurate playmate" mail from Tim dated 11/24
• Ongoing investigation of https://phabricator.wikimedia.org/T151702 and followups with Ops and Services
• Parsoid deploy today after almost a month (https://www.mediawiki.org/wiki/Parsoid/Deployments will be updated later today)
  • Parsoid-native <gallery> rendering + a bunch of other changes going out today (Most interesting for MCS: heading ids now assigned that match core output).
  • HTML version bump to 1.3.0; See https://www.mediawiki.org/wiki/Specs/HTML/1.3.0#Changes_since_Specs.2FHTML.2F1.2.1 for changes since 1.2.1
• Tim is close to finishing the first version of remex-html ( https://github.com/tstarling/remex-html ) -- a HTML5 parser in PHP

Discovery

• No blockers
• Started discussion on how to combine various models of user query enhancements/transformations to improve search results: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/So_Many_Search_Options
• Continuing work on crosswiki searches, load test successful
• Published analysis of WDQS traffic to detect parallel connections: https://phabricator.wikimedia.org/T149963
• WDQS now limits parallel connections to 5 per IP. Working fine so far.

Technology

Analytics

• Blocker -- None
• Ongoing
  • Wikistats 2.0 UI has kicked off with new contractor designer.
  • RecentChanges via EventBus is on its way, we will soon have events flowing in Kafka. Purpose is later to turn off Redis based producer.
  • Mediawiki history reconstruction is at final review stage (will be long, heavy code) -- Plans to communicate early next quarter
  • Old logs on stat1002 have been deleted. More at https://phabricator.wikimedia.org/T84618. Now working on removing some old generation processes in the cluster.
  • Cross team collaboration in migrating limn editor-engagement dashboards to dashiki

Release Engineering

• Blocking:
  • None?
• Blocked
  • None
• Updates
  • Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html
  • Gerrit is updating, pretty much right now

Security

• Security Reviews
  • Recommendations API continues from last week
• Continuing work on CSRF protection for anonymous users (https://phabricator.wikimedia.org/T40417)
• Question for Parsing: Can we limit the amount of nesting in lists?
  • https://phabricator.wikimedia.org/T151834
• Question for Reading: Should page requests containing invalid characters in title still result in 200 OK if curid is valid?
  • https://phabricator.wikimedia.org/T144100

Services

• Blockers: none
• Updates:
  • PDF render service and API endpoint deployed and completely operational:
    • https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_pdf_title
  • Working on followups for the API cluster outage
    • https://phabricator.wikimedia.org/T152074

Technical Operations

• Blocked:
  • Community Tech
    • https://phabricator.wikimedia.org/T152080 page_assessments creating duplicate key errors
• Blocking:
  • None
• Updates:
  • Still working on API cluster failure. https://phabricator.wikimedia.org/T151702
  • new labsdbs are almost ready to start being used
  • AB testing design still under discussion https://phabricator.wikimedia.org/T143694
  • Goals for next quarter being drafted, if you have any dependencies on Ops contact us

Wikidata

• I still can not join the Hangout when not being a WMF employee. I know multiple people already looked into this. Please forgive me when I'm not trying any more. I still find the information given in this Etherpad very helpful, and love sharing relevant bits via a WMDE mailing list.
  • Grace to look into this ^
• Blocked on security reviews of:
  • Cognate extension: https://phabricator.wikimedia.org/T149082
  • InterwikiSorting Extension: https://phabricator.wikimedia.org/T149083

Fundraising Tech

• Investigating banner impression drop from 08:00-09:00 UTC on 12/1 and 12/2: https://phabricator.wikimedia.org/T152122
• Fixing CiviCRM reports & internal dashboard
• Tweaking mailing list export
• Planning for next year
  • Estimating effort for next year's required payment processor integrations
  • Potential extra-curricular work supporting ORES: https://www.mediawiki.org/wiki/User:Adamw/Study_abroad_proposal