Scrum of scrums/2017-04-12

contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Call outs

• Datacenter switchover is happening next week: https://wikitech.wikimedia.org/wiki/Switch_Datacenter
• Consultation about new wikistats started (http://stats.wikimedia.org is been phased out). This is the prototype: https://analytics-prototype.wmflabs.org/#/ you can leave feedback here: https://www.mediawiki.org/wiki/Wikistats_2.0_Design_Project/RequestforFeedback/Round2
• safemode=1 URL parameter to not load user scripts and gadgets. Often these cause interference with extension JS, so this can greatly simplify troubleshooting.

Analytics

• Added 12 new machines to hadoop cluster, we had one casualty so we have 40 new nodes, once cluster rebalances we expect our metrics when it comes to resources used to change. Cluster is on debian now, all machines updated.
• Consultation about new wikistats started (http://stats.wikimedia.org is been phased out). This is the prototype: https://analytics-prototype.wmflabs.org/#/ you can leave feedback here: https://www.mediawiki.org/wiki/Wikistats_2.0_Design_Project/RequestforFeedback/Round2
• Pagecounts (Legacy pageviews) available programatically: https://wikitech.wikimedia.org/wiki/Analytics/AQS/Legacy_Pagecounts
• Limn is deprecated (for those of you that know what that is) and reportcard migrated: https://analytics.wikimedia.org/dashboards/reportcard/#pageviews-july-2015-now

Services

• Blockers: none
• Updates:
  • RESTBase code and config deploy moved to scap3
    • https://phabricator.wikimedia.org/T116335
  • REST API Version 1.0
    • http://en.wikipedia.org/api/rest_v1/
    • Announced in the blog post: https://blog.wikimedia.org/2017/04/06/wikimedia-rest-api/
  • Deployed a new upstream version of PDF render service
    • https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_pdf_title
  • Truncating Parsoid HTML tables for commons and Wikidata
    • https://phabricator.wikimedia.org/T161243
    • Possible disruption of ongoing VE edits, but VE is almost not used on these wikis, so the probability is very low

Tech Ops

• Blockers: none
• Blocking: none
• Updates:
  • Ongoing issues related to swift [resolved] user-facing error report https://phabricator.wikimedia.org/T162035 root cause https://phabricator.wikimedia.org/T162348
  • Saturday 8th April, labsdb on read only for a few minutes due to fix a heavy querying issue – https://phabricator.wikimedia.org/T162519

Product

Reading

Web

• Current Sprint: https://phabricator.wikimedia.org/tag/reading-web-sprint-95/
• Last Week:
  • Deploy PagePreviews to Hungarian and Hebrew wikipedias.
  • PagePreviews instrumentation related bugfixes.
  • Improved print styles for MobileFrontend
• This Week:
• Remove RelatedArticles beta feature from desktop
• PagePreviews bugfixes
• Improved print styles for MobileFrontend

Android

• Last week/this week:
  • Further improvements to offline functionality and surrounding UX polish
  • Continuing work on cross-platform consolidation of CSS & JS
• This week (pending community liaison approval): a new release to beta, including the following:
  • A substantially better offline experience! (our Q3 goal: https://phabricator.wikimedia.org/tag/android-app-goals-2017-jan-mar-q3/)
  • Wikidata description editing expanded from three languages to all except the top 10 by page views as measured in the app.
• Current release board: https://phabricator.wikimedia.org/project/view/2352/

iOS

• Last Week
  • Continued work on 5.4.1 – https://phabricator.wikimedia.org/project/view/2600/
    • Image caching fixes (moved up from 5.5)
    • Crash fixes
  • 5.5 – https://phabricator.wikimedia.org/project/view/2602/
    • Places
    • JavaScript consolidation with Android
• This Week
  • Testing 5.4.1
  • Continue work on 5.5 (Places, JS consolidation)

Reading Infrastructure

• MCS: Deployed fix for external links. Working on splitting off DOM transformations into separate endpoint.
• TemplateStyles work in the final stretch before beta cluster

Multimedia

• Continuing work on deploying 3D to beta cluster, working through dependencies

Community Tech

• Special:AutoblockList has been merged https://phabricator.wikimedia.org/T146414
• Should deploy cookie blocks to all wikis soon
• XTools "Pages created" and "Adminstats" nearly complete
  • Trying to fix a mysterious Symfony caching issue on Tool Labs https://phabricator.wikimedia.org/T162753
  • Working on an API that the frontend (and other consumers) can use
• LoginNotify
  • Various small tweaks, bundling notifications, deciding on sensible default config settings
  • only blocker is privacy check-in https://phabricator.wikimedia.org/T161362

Fundraising Tech

• Meeting conflict (brainstorming recurring donations ideas), sorry to miss this one!
• More features for cron wrapper script
• Updating branding: https://phabricator.wikimedia.org/T141921
• Central Notice: Banner sequence feature with OOJS admin UI: https://phabricator.wikimedia.org/T144453
• Deploying fixes for Paypal Express Checkout
• Fixed regression on donate wiki

Editing

UI Standardization

• This week:
  • Provide WikimediaUI Base variables in core https://phabricator.wikimedia.org/T123359
  • Apply unified icon/indicator padding/position to toolbars as well
    • Generalizing padding/position to save some extra bytes and multi-dozen lines of code through cascade
  • Align the style for lists of pages https://phabricator.wikimedia.org/T153417
  • Show preview and Review your changes more directly accessible in the New Wikitext Editor https://phabricator.wikimedia.org/T153306
• Updates:
  • OOjs UI:
    • Release of v0.21.0 (our 100th release!) with 11 UI improvements https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md – among those:
      • Unify padding/position of labels/icons/indicators across OOjs UI widgets in a generalized manner https://phabricator.wikimedia.org/T161177
      • MediaWiki theme: Replace arrows with chevrons and increase contrast (unified approach for all web products)
      • MediaWiki theme: Fix toolbar `:hover` state
      • PopupWidget: Center the anchor for vertical (above/below) popups too

Language

• ContentTranslation migration to OOjs UI continue.
• Work on new CX API end point started with Service team (T107914)

Parsing

• Linter extension being deployed to all wikis this week.
• Added a new Linter category ( https://www.mediawiki.org/wiki/Help:Extension:Linter/deletable-table-tag ) to assist editors with fixing up broken tables ( https://phabricator.wikimedia.org/T161341 ) which need to fixed to ensure those affected pages render properly when Tidy is replaced. You can see an example of broken rendering via the ParserMigration extension: https://sv.wikipedia.org/w/index.php?title=Kugelstein&action=parsermigration-edit
• Considering adding one more Linter category to help work around https://phabricator.wikimedia.org/T134469 that will render differently when Tidy is replaced.
• https://www.mediawiki.org/wiki/Parsoid/Language_conversion/Preprocessor_fixups lists pages that need fixup as part of fixing edge cases in the preprocessor. Will reach out to editors via TechNews and other mediums soon.
• Poke for Wikidata folks: C.Scott ran into https://phabricator.wikimedia.org/T156280 while working on language variants -- affects installation of wikidata on his laptop. He will look at whether using mw-vagrant helps him, but would appreciate wikidata folks taking a look at that.
• Planning to pick up redlinks support in Parsoid soon (within next couple of weeks) -- heads up MCS.

Collaboration

• Blocked
• Blocking
• Updates
  • Working on ORES threshold standardization for RC page
  • Spam stuff
    • Nuke fix deployed
  • Roan wrote safemode=1 URL parameter to not load user scripts and gadgets. This should be really useful. A lot of times user scripts and gadgets interfere with extension JS, so this allows tracking this down right away.

Wikidata

• Preparing/contributing to Wikimania submissions.
• Deploying Cognate on Wiktionaries (again): https://phabricator.wikimedia.org/T150182
• Deploying geo-shape property type on Wikidata: https://phabricator.wikimedia.org/T161543
• Working on Lexeme entity type for Wiktionary, adding Forms and Senses: https://www.mediawiki.org/wiki/Extension:WikibaseLexeme/Data_Model
• Making more ArticlePlaceholder pages indexable by search engines: https://phabricator.wikimedia.org/T162244

German Technical Wishlist

• Blocked on feedback from James Forester for <ref refines="..."> wish: https://phabricator.wikimedia.org/T151308 and related. Mail is out. Looking forward to the Hackaton.

Discovery

• No blockers
• Preparing to deploy sister wiki search results display – posted notice at multiple wiki's village pumps (https://phabricator.wikimedia.org/T162064#3161941)
• Special:Undelete search code merged, reindexing underway, next step – asking admins for feedback on displaying search results
• Building infrastructure for machine learning assisted ranking (aka MjoLniR)
• Working on Wikidata search improvement
• Working on improving noop detection plugins for Elasticsearch (needed for indexing complex data like wikidata has)
• WDQS now service traffic from both DCs
• More edpoints added to WDQS SPARQL federation
• New maps style has been put up for testing & feeback: https://lists.wikimedia.org/pipermail/maps-l/2017-April/001565.html