Reading/Web/Release timeline/Visual Changes
This page is a companion page to the Release timeline, which documents visual changes (both expected and unexpected) that went out in each release as caught by https://pixel.wmcloud.org/. If a release has no heading, this means there were no visual changes in that release. We began tracking visual changes for the wmf10 branch (comparing master against wmf.9).
2024
[edit]Comparing origin/wmf/1.44.0-wmf.4 against master.
[edit]- 6 "errors" in mobile relating to Growth team features. Followed up with Growth team to check these are expected
- 11 errors in desktop relating to tags in history page. Followed up with editing team to check these are expected.
- 5 on web-maintained - known flakey test QuickSurveys issue
- No issues on other jobs.
Comparing origin/wmf/1.44.0-wmf.3 against master.
[edit]- Desktop 43 Issues due to https://phabricator.wikimedia.org/T378771 and Codex release (input border color)
- 2 QuickSurveys issue - known flakey test
- 52 issues on web-maintained due to Codex release (input border color)
- 10 failures on https://pixel.wmcloud.org/reports/mobile/index.html due to T375287
No issues on other jobs.
Comparing origin/wmf/1.43.0-wmf.28
[edit](only cases with errors shown)
- echo - 10 failures also due to donate linke changes
- desktop - 75 failures, expected changes to the user links and logo from the donate link changes.
Comparing origin/wmf/1.43.0-wmf.25
[edit](only cases with errors shown)
- web-maintained - 3 failures due to Pixel. I proposed a pull request to improve.
- echo - 3 failures. Expected. Fixes T376414
- desktop - 2 failures - https://phabricator.wikimedia.org/T376675 tracks one, the other seems to be a false positive.
Comparing origin/wmf/1.43.0-wmf.24 (with custom branches: design/codex:v1.13.0) against master.)
[edit]- mobile - 3 failures due to blue link in button issue. Conversation here.
- desktop - ~7 failures but all due to expected changes like with the code box that is now black in night mode as well as subtle color shifts that seem expected.
Comparing origin/wmf/1.43.0-wmf.22 (with custom branches: design/codex:v1.12.0)
[edit]- web-maintained - 2 failures due to long-standing vertical shift issue
- desktop-dev - empty due to no feature in active development: https://wikimedia.slack.com/archives/C06L1RZC222/p1725651005439399
- desktop - 2 failures due to TOC and appearance menu moving up/down the page slightly on massive screen length, doesn't seem like a big deal
Comparing origin/wmf/1.43.0-wmf.21
[edit]- Login - 30 failures - Addition of the donate button causes visual diff, 1px shift down of warning button and info button in the reauth message
- web-maintained - 26 failures - Addition of the donate button causes visual diff, 1px shift down of the nearby-pages-error message
- desktop - 46 failures - Donate button addition causes visual diff
Comparing origin/wmf/1.43.0-wmf.20
[edit]- desktop - 40 failures due to https://phabricator.wikimedia.org/T363920 which changes the color of icons.
Comparing origin/wmf/1.43.0-wmf.19 (with custom branches: design/codex:v1.11.1) against master.
[edit]Last updated: Jdlrobson (talk) 20:05, 26 August 2024 (UTC)
- desktop - 5 failures due to https://phabricator.wikimedia.org/T371654
Comparing origin/wmf/1.43.0-wmf.15 (with custom branches: design/codex:v1.10.0)
[edit]Last updated: Steph 3:45 pm 29 July 2024 (pacific)
- web-maintained - 2 failures due to the mysterious horizontal shifting. Not worried
- mobile - 5 failures due to what looks like intentional temporary accounts work
Comparing origin/wmf/1.43.0-wmf.11 (with custom branches: design/codex:v1.8.0) against master.
[edit]Last updated: Jdlrobson (talk) 15:49, 27 June 2024 (UTC)
- Login - 28 failures due to T256190(expected)
- desktop - 66 failures. Many due to T256190 and T366358 (expected). Seems like the edit bracket color changed slightly, as color subtle in dark mode seems to have shifted from #eaecf0 to #a2a9b1. A few glitchy renderings in long screenshots to do with article text that seem like false positives.
- mobile - 1 failure. Color subtle in dark mode seems to have shifted from #eaecf0 to #a2a9b1
- web maintained - 4 UI regressions in Timeless- looks unexpected but minor.
- echo GREEN
Comparing origin/wmf/1.43.0-wmf.9 (with custom branches: design/codex:v1.7.0) against master.
[edit]- all green except desktop-dev, which is failing 107/148 tests - posting in #pixel-development to see what's up
Comparing origin/wmf/1.43.0-wmf.6 against master.
[edit]Last updated: Jdlrobson (talk) 18:04, 24 May 2024 (UTC)
- Login - 4 failures due to dropping of IE11 support and T361573 (previously 8 failed)
- desktop - 26 due to T361573 (see T365631), other failures due to IE11 support being dropped; and tables - investigating (Previously 22, previously 40 due to https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/1034556)
- mobile - 5 changes due to dropping of IE11 support.
- web maintained - 5 failures due to T361573
- echo 5 failures due to T361573
Comparing origin/wmf/1.43.0-wmf.5 (with custom branches: design/codex:v1.6.0) against master.
[edit]Last updated: Jdlrobson (talk) 20:39, 21 May 2024 (UTC) (manually ran locally)
- Login - 0 (previously 40 failed due to Pixelissue)
- desktop - 1 failure due to main page becoming full width (previously: 5 failed - bullet points size and positioning which seem expected)
- mobile - 5 failed (expected) due to https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MobileFrontend/+/1032039?usp=search
- web maintained - 0 at time of deployment (previously: 4 failed - line spacing only which is expected.)
- Echo - 0 (previously 2 failures due to UBN https://phabricator.wikimedia.org/T365409
Comparing origin/wmf/1.43.0-wmf.4 (with custom branches: design/codex:v1.5.0) against master.
[edit]- Login - 20 failed - Created ticket here.
- desktop - 16 failed - Created ticket here.
- mobile - 0 failed
- web maintained - 10 failed - Created ticket here.
Comparing origin/wmf/1.43.0-wmf.3 (with custom branches: design/codex:v1.5.0) against master.
[edit](May 6 2024)
- Login - 0
- desktop - 0
- mobile - 36 - The only visual change in these is a shadow box, which seems expected
- web maintained - 1 - repeat issue
Comparing origin/wmf/1.43.0-wmf.3 (with custom branches: design/codex:v1.5.0) against master.
[edit](May 2 2024)
- Login - 0
- desktop - 0
- mobile - 35 - The only visual change in these is a shadow box, which seems expected
- web maintained - 1 - repeat issue
Comparing origin/wmf/1.43.0-wmf.2 (with custom branches: design/codex:v1.4.0) against master.
[edit]All flagged issues in desktop-dev (21) are related to the text change from day to light and from night to dark in the night/dark mode accessibility menu https://phabricator.wikimedia.org/T361157. These will make their way to the next release and are to be expected.
(April 29 2024)
- Login - 0
- desktop - 0
- mobile - 5 - These tests did not run all related to `MediaWiki_Page_issues`
- web maintained - 1 - repeat issue
Comparing origin/wmf/1.43.0-wmf.2 (with custom branches: design/codex:v1.4.0) against master.
[edit](April 24 2024)
Some problems with tests (multiple message boxes due to https://phabricator.wikimedia.org/T361906 reduce confidence in these reports)
- Login - 0
- desktop - 0
- mobile - 0
- web maintained - 1 - repeat issue
Comparing origin/wmf/1.42.0-wmf.26 (with custom branches: design/codex:v1.3.6) against master.
[edit](April 10, 2024) Unexpected
- Login - 0
- desktop - 0
- mobile - 0
- web maintained - 2 - repeat issue with slight vertical alignment adjustment. I believe this was due to the viewport and not a real issue, but I am investigating
Comparing origin/wmf/1.42.0-wmf.25 against master.
[edit](April 5, 2024) Unexpected
- Login - 0
- desktop - 10 - slight margin change to show/hide pinning buttons. Not a big deal. Discussion
- mobile -3 issues relating to last modified bar - all look like improvements to me.
- web maintained - outdated. Likely not working correctly. Discussion.
Comparing origin/wmf/1.42.0-wmf.24 against master.
[edit](April 1, 2024) Unexpected
- Login - 26 failed - DST have been working on this login form. This appears to be the fix for https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1014144
- desktop - 0
- mobile - 0
- web maintained - 1 - the usually flakey QuickSurveys test.
Comparing origin/wmf/1.42.0-wmf.23 against master
[edit](March 25, 2024)
Unexpected
- Login - 38 failed - New style rule caused regression. Ticket in the works.
- desktop - 2 failed - MathML PHP Errors
- mobile - 60 failed - I believe these are all pixel issues. I can't replicate the difference in vertical alignment between beta and prod nor in test and prod. Will double check with team.
- codex - 1 fail - Progress bar issue. Roan is working on a ticket.
Comparing origin/wmf/1.42.0-wmf.20 against master
[edit](March 5, 2024)
- 5 on web-maintained - 4 relating to cologneblue skin and 1 suspected codex issue
- 8 on desktop-dev related to removal of language links notice
- 48 on codex, investigating now
- 45 on wikilambda, seem unrelated to our work
Expected: Language links notice removal due to https://phabricator.wikimedia.org/T353619
Unexpected: box shadow issues (resolved) and codex issues. I (Steph) am not personally worried about wikilambda failures
Comparing origin/wmf/1.42.0-wmf.19 (Includes 989911) against master.
[edit](Feb 23, 2024 )
- 94 on Vector 2022
- 79 on Minerva due to restoration of old line height. https://phabricator.wikimedia.org/T358498
Expected changes: Slight alignment differences between icons and their labels due to latest Codex release.
Unexpected: Footer margin seems to have changed on desktop, doesn't seem like a significant regression.
Echo:
- on Friday there were 23 failures due to Night mode being enabled unintentionally on day mode. Suspect this to be less when checked again on Monday.
Comparing origin/wmf/1.42.0-wmf.17 against master.
[edit](Feb 12, 2024 Re-Run)
Same as previous, except:
web-maintained (previous: 20) 31
mobile (previous: 4) 72
Reasons same as previous.
Comparing origin/wmf/1.42.0-wmf.17 against master.
[edit]- Test group: login - 56 regressions due to:
- improvements to input text alignment in Codex release. (Gerrit change 992533)
- web-maintained = 20 regressions due to:
- improvements to input text alignment in Codex release (Gerrit change 992533)
- phab:T356900
- QuickSurvey flakiness.
- Desktop = 98 regressions
- improvements to input text alignment in Codex release. (Gerrit change 992533)
- https://phabricator.wikimedia.org/T352875
- mobile: 4 regressions due to
- improvements due to use of normalize CSS phab:T205341
phab:T356900- https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/998537
Others: No regressions
Comparing origin/wmf/1.42.0-wmf.16 against master.
[edit]No regressions.
2023
[edit]Comparing origin/wmf/1.42.0-wmf.14 against master.
[edit]- Extensions and skins maintained by web team (web-maintained) - 0
- Echo badges (echo) -0
- Vector 2022 skin (desktop) - 98 expected changes from https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/989911
- Minerva and MobileFrontend (mobile) - 0
Comparing origin/wmf/1.42.0-wmf.9 against master.
[edit]- Extensions and skins maintained by web team (web-maintained) - 0
- Echo badges (echo) -0
- Vector 2022 skin (desktop) - 0 errors
- Minerva and MobileFrontend (mobile) - <problem with build>
Comparing origin/wmf/1.42.0-wmf.7 against master.
[edit]- mobile - 2 failures due to T351946
- web-maintained 1 false positive
- desktop-dev 5 false positive due to change on paragraph spacing.
- desktop 16 false positive due to text change of alert in the right side/ main menu --- this relates to loading the full codex library T353071
- wikilambda 1 vertical scroll on header, 1 false positive
Comparing origin/wmf/1.42.0-wmf.4 against master.
[edit]- web-maintained - 3 failures (Survey false flags)
- desktop-dev - 3 failures (Text change false flags)
Comparing origin/wmf/1.42.0-wmf.3 against master.
[edit]- Mobile - 22 failures due to T350627
- Web maintained - 2 false positives. Will see if I can mute those.
Comparing origin/wmf/1.42.0-wmf.2 against master.
[edit]- Login and sign up pages (login) - 20 failed - Pixel shift it is expected and very minor.
- Extensions and skins maintained by web team (web-maintained) - 21 failed - 20 of them are expected Pixel shifts. The Nearby the WMF office (#nearby #minerva) have 1 Error that indicate a different size of media query activated.
- Echo badges (echo) - 4 failed - Seems there was a change related to alerts which make them mostly expected changes if not fore having a div size different between child and parent.
- Zebra Vector 2022 skin (desktop-dev) - 0
- codex (codex) - 49 failed - Cause: Inconsistent page width between reference and test.
- Vector 2022 skin (desktop) - 0 failed
- Minerva and MobileFrontend (mobile) - 0 failed
Comparing origin/wmf/1.41.0-wmf.30 against master.
[edit]Comparing origin/wmf/1.41.0-wmf.30 against master.
- Login and sign up pages (login) - 0 failed
- Extensions and skins maintained by web team (web-maintained) - 1 failed - Cause: Pixel shift down. Minor.
- Echo badges (echo) - 0 failed
- Zebra Vector 2022 skin (desktop-dev) - 1 failed - Cause: 1px shift down on TOC border-bottom/hr. Very minor.
- codex (codex) - 51 failed - Cause: Inconsistent page width between reference and test.
- Vector 2022 skin (desktop) - 0 failed
- Minerva and MobileFrontend (mobile) - 0 failed
Comparing origin/wmf/1.41.0-wmf.29 against master.
[edit]Comparing origin/wmf/1.41.0-wmf.29 against master.
- Login and sign up pages (login) - 0
- Extensions and skins maintained by web team (web-maintained) 6 fail - Cause: Cologne blue is now showing 2 edit links when preference is enabled. Issues related to QuickSurveys can be safely ignored.
- Echo badges (echo) 18 fail (T348530)
- Zebra Vector 2022 skin (desktop-dev)36 fails - Cause: Content width shrunk,
- codex (codex) 38 failed - Minor <1-2px vertical shift
- Vector 2022 skin (desktop) 9 fails. All expected improvements to history page which is now using codex.
- Minerva and MobileFrontend (mobile) - 10 fails. The edit label is now "Create" on mobile and "History" is "View history".
Comparing origin/wmf/1.41.0-wmf.26 against master.
[edit]Test ran on Sun Sep 17 2023 23:06:07 GMT+0000 (Coordinated Universal Time)
- Login and sign up pages (login) - 0
- Extensions and skins maintained by web team (web-maintained) 1 fail - Cause: Echo error (see below) - Ticket
- Echo badges (echo) 5 fail - Cause: Slider broken. UBN filed.
- Zebra Vector 2022 skin (desktop-dev) 52 fails - Cause: Main menu + TOC collapsed in test - Ticket
- Vector 2022 skin (desktop) 17 failed - Cause: Main menu + TOC collapsed in test - Ticket
- Minerva and MobileFrontend (mobile) - 0
- campaign-events (campaign-events) 26 failed - Minor diff in error message numbers
- codex (codex) 52 failed - Minor <1-2px vertical shift
Comparing origin/wmf/1.41.0-wmf.25 against master.
[edit]Test ran on Thu Aug 10 2023 18:08:02 GMT+0000 (Coordinated Universal Time)
mobile - 0 failures
desktop - 1 failures, false alarm
Echo - 6 failures relating to Codex switchover.
login - 2 failures. Flakiness.
QuickSurveys - 2 failures. Codex?
Comparing origin/wmf/1.41.0-wmf.20 against master.
[edit]Page was last generated on: Fri Aug 11 2023 19:07:48 GMT+0000 (Coordinated Universal Time)
- Test group: Login - 2 failures. Cause: Flakiness. **
- Test group: web-maintained - 2 failures. Cause: Likely similar issue to last week with Codex changes. Mostly 1-2px differences in font size and an overall <body> vertical shift-downward of 1-2px.
- Echo - 6 failures - Cause: https://phabricator.wikimedia.org/T342907
- Desktop - 1 failures - Cause: Flakiness
- Mobile - 67 failures - Cause: https://phabricator.wikimedia.org/T342908 Mostly icon related (alignment/size). Issues of concern relating to default editor will hopefully be fixed in next run. **
- Desktop-dev - 2 failures - Cause: Nothing important.
**Need further investigation
Comparing origin/wmf/1.41.0-wmf.20 against master.
[edit]Page was last generated on: Fri Aug 04 2023 17:07:23 GMT+0000 (Coordinated Universal Time)
- Test group: login: 5 failures the button for login/create account has no margin between it and bottom input. I was unable to replicate this in the beta cluster and this also happened in previous deploys. Unclear why.
- Test group: web-maintained - 2 failures in QuickSurvey due to Codex update. Not a problem.
- Echo - 4 failures, also manually checked and not a problem, due to https://phabricator.wikimedia.org/T342907
- Desktop - 0 failures.
- Mobile - 1 failures due to reference drawer icon change (expected)
- Desktop-dev - 1 failure
Comparing origin/wmf/1.41.0-wmf.19 against master.
[edit]Test ran on Tue Aug 01 2023 00:36:33 GMT+0000 (Coordinated Universal Time)
- Mobile - 48 visual changes, relating to the switch to Codex (https://phabricator.wikimedia.org/T340262). All have been manually checked.
Comparing origin/wmf/1.41.0-wmf.18 (Includes 937187) against master.
[edit]Test ran on Mon Jul 24 2023 20:04:12 GMT+0000 (Coordinated Universal Time)
- Desktop - 1 failure, seems fine just subpixel change to the limited width popup notification
Comparing origin/wmf/1.41.0-wmf.18 against master.
[edit]Test ran on Thu Jul 20 2023 11:08:10 GMT+0000 (Coordinated Universal Time)
- Codex - (4 failures) captured in https://phabricator.wikimedia.org/T342190
Comparing origin/wmf/1.41.0-wmf.15 against master.
[edit]Test ran on Mon Jul 03 2023 17:05:23 GMT+0000 (Coordinated Universal Time)
- All green except campaign-events test group (27 failures due to text change from `Add username` to `Add more` and error warnings have different numbers). No blockers.
Comparing origin/wmf/1.41.0-wmf.13 against master.
[edit]16 failures due to language button missing on main page. Some issues around language button missing related to T315036
- /web-maintained - some errors in NearbyPages due to change in defaults. Some z-index issues in Timeless. Not blockers.
Comparing origin/wmf/1.41.0-wmf.12 against master.
[edit]Test ran on Fri Jun 09 2023 23:41:34 GMT+0000 (Coordinated Universal Time)
- Mobile has 5 errors due to https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/923383/
- 4 failures in CologneBlue due to sub title padding (won't fix)
Comparing origin/wmf/1.41.0-wmf.10 against master.
[edit]Test ran on Mon May 29 2023 14:34:30 GMT+0000 (Coordinated Universal Time)
- Notification Overlay error in MinervaNeue due to Codex z-index update.
- 2 pixel border pushes content down by 1px.
Comparing origin/wmf/1.41.0-wmf.8 against master.
[edit]Last checked: Jdlrobson (talk) 18:48, 2 May 2023 (UTC)
- Desktop: 8 failures due to https://gerrit.wikimedia.org/r/c/mediawiki/core/+/918598
- Monobook: TOC text color looks slightly darker
Comparing origin/wmf/1.41.0-wmf.7 against master.
[edit]Last checked: Jdlrobson (talk) 18:48, 2 May 2023 (UTC)
- Desktop: 0 failures
Comparing origin/wmf/1.41.0-wmf.6 against master.
[edit]Last checked: Jdlrobson (talk) 23:09, 1 May 2023 (UTC)
- Desktop: 3 failures
- 91 failures - all accounted for https://gerrit.wikimedia.org/r/c/mediawiki/core/+/908524
- 3 failures presumably because of gerrit:c/mediawiki/skins/Vector/+/914023.
- web-maintained: 15 failures
- 15 failures presumably due to subtle color change in message box component. https://gerrit.wikimedia.org/r/c/mediawiki/core/+/908524
Comparing origin/wmf/1.41.0-wmf.1 (Includes 884918) against master.
[edit]Jdlrobson (talk) 21:12, 24 March 2023 (UTC)
All green.
Comparing origin/wmf/1.40.0-wmf.26 against master.
[edit]NRay (WMF) (talk) 19:26, 10 March 2023 (UTC)
- web-maintained: 5 visual changes involving the bottom of the footer chanigng position, but I couldn't replicate this locally so I'm assuming the test is somehow flaky.
Comparing origin/wmf/1.40.0-wmf.24 against master.
[edit]BWang (WMF) (talk) 20:07, 23 February 2023 (UTC), Jdlrobson (talk) 23:25, 27 February 2023 (UTC)
- Desktop: 28 expected visual changes from 889828 and 889859 and 884907
Comparing origin/wmf/1.40.0-wmf.23 against master.
[edit]NRay (WMF) (talk) 19:31, 17 February 2023 (UTC)
- Desktop: 831143 makes the TOC appear in new places (expected).
- Echo: 0
- Mobile: 0
- Web-maintained: 0
Comparing origin/wmf/1.40.0-wmf.22 against master.
[edit]Jdlrobson (talk) 00:32, 9 February 2023 (UTC)
- Desktop: There will be many visual changes to the TOC as a result of https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/886437, 2 relating to Growth team changes to newcomer homepage; 6 relating to a shift in the "search for pages containing" (T329287), 7 relating to https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/888109
Comparing origin/wmf/1.40.0-wmf.21 against master.
[edit]Jdlrobson (talk) 23:29, 6 February 2023 (UTC)
- Desktop: 6 failures because the thumbnails on typeahead are slightly larger in size (more info), rises to 17 with T325020 and up to 66 with moving login link (updated Pixel so these do not show)
- Web-maintained: 60 failures due to very slight difference in text alignment (text looks more vertically centered in master) as well as slightly larger thumbnail sizes in Nearby page (due to change in Codex, more info).
- Echo: 3 failures due to expected change (updated Pixel so these do not show)
- Mobile: 0 failures
Comparing origin/wmf/1.40.0-wmf.21 against master.
[edit]Jdlrobson (talk) 23:29, 6 February 2023 (UTC)
- Desktop: 6 failures because the thumbnails on typeahead are slightly larger in size (more info), rises to 17 with T325020 and up to 66 with moving login link (updated Pixel so these do not show)
- Web-maintained: 60 failures due to very slight difference in text alignment (text looks more vertically centered in master) as well as slightly larger thumbnail sizes in Nearby page (due to change in Codex, more info).
- Echo: 3 failures due to expected change (updated Pixel so these do not show)
- Mobile: 0 failures
2022
[edit]Comparing origin/wmf/1.40.0-wmf.20 against master.
[edit]Jdlrobson (talk) 23:01, 26 January 2023 (UTC)
- Echo: Green
- Desktop: 38 intentional failures involving the expanded TOC from T328045
- Mobile: Green
- Web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.19 against master.
[edit]Jdlrobson (talk) 21:46, 18 January 2023 (UTC)
- Echo: Green
- Desktop: Green
- Mobile: Green
- web-maintained: Green
- Desktop-dev: Green = Stability?!!
Comparing origin/wmf/1.40.0-wmf.18 against master
[edit]- Desktop: https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/877255 will cause 4 minor changes to the dimensions of the collapsed TOC https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/877243/ will cause 16 progressions to the spacing of the TOC button in the page title and sticky header
Comparing origin/wmf/1.40.0-wmf.17 (Includes 861946,866657) against master
[edit]Jdlrobson (talk) 19:28, 9 January 2023 (UTC)
- Echo: Green
- Desktop: 40 failures due 852139, 861946 ((phab:T316559). Caught T326538
- Mobile: Green
- web-maintained: 39 failures (expected)
Comparing origin/wmf/1.40.0-wmf.14 against master.
[edit]Jdlrobson (talk) 00:25, 15 December 2022 (UTC)
- Echo: Green
- Desktop: 9 failures due 861946
- Mobile: 33 failures due to 866657
- web-maintained: Green
- Desktop-dev: (Failures to be expected) 84 failures
Jdlrobson (talk) 22:30, 9 December 2022 (UTC)
- Echo: Green
- Desktop: Green Green [6 failures (improvements) relating to Codex release]
- Mobile: 33 failures due to https://phabricator.wikimedia.org/T324876
- web-maintained: Green
- Desktop-dev: (Failures to be expected) 6 failures
Comparing origin/wmf/1.40.0-wmf.12 (Includes 859135) against master.
[edit]Last updated Jdlrobson (talk) 21:50, 5 December 2022 (UTC)
- Echo: Green
- Desktop: 58 failures relating to expected visual changes in https://phabricator.wikimedia.org/T318013 (gerrit) and phab:T323172 (26, gerrit).
- Mobile: Green
- web-maintained: Green
- Desktop-dev: (Failures to be expected) 3 failures due to https://phabricator.wikimedia.org/T318013
Comparing origin/wmf/1.40.0-wmf.10 against master.
[edit]Last updated Jdlrobson (talk) 17:03, 16 November 2022 (UTC)
- Echo: Green
- Desktop: 4 failures but all should be fixed by https://github.com/wikimedia/pixel/commit/6958c771ffa0226caca3f531b63878f048fe2697, 5 caused by the Codex update
- Mobile: Green
- web-maintained: Green
- Desktop-dev: (Failures to be expected) We have a tools menu!
Comparing origin/wmf/1.40.0-wmf.9 (Includes 838818) against master.
[edit]- N/A (no train this week)
Comparing origin/wmf/1.40.0-wmf.8 (Includes 838818) against master.
[edit]Last updated Jdlrobson (talk) 23:56, 9 November 2022 (UTC)
- Echo: 20 failures. Most relating to 854129. Caught an issue in legacy Vector which was fixed.
- Desktop: 89 failures relating to 854129 and the related feature flag and 850290. Fixes: 855156, 855158
- Mobile: Green
- web-maintained: FLAGGING some issues with Nearby pages relating to i18n change.
Comparing origin/wmf/1.40.0-wmf.7 (Includes 838818) against master.
[edit]Last updated: Jdlrobson (talk) 16:13, 26 October 2022 (UTC)
- Echo: Green
- Desktop: 4 failures due to expected bug fix T317902
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.6 (Includes 838818) against master.
[edit]Last updated: Jdlrobson (talk) 18:13, 24 October 2022 (UTC)
- Echo: Green
- Desktop: Green (note several issues in this cycle relating to https://phabricator.wikimedia.org/T320449#8327604)
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.5 (Includes 838818) against master.
[edit]Last updated: 7 October 2022 11:50AM PST
- Echo: Green
- Desktop: Green
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.4 against master..
[edit]Last updated: 6 October 2022
- Echo: Green
- Desktop: Green
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.3 against master..
[edit]Last updated: 29 September 2022
- Echo: Green
- Desktop: 4 errors, regression fixed by https://gerrit.wikimedia.org/r/c/mediawiki/extensions/NearbyPages/+/836929
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.2 against master..
[edit]Last updated: 23 September 2022
- Echo: Green
- Desktop: Green (note previousl expected visual changes relating to bolding of active TOC section were shown but the bolding behaviour is not supposed to be flagged by PixelT316032)
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.40.0-wmf.1 against master..
[edit]Last updated: 15 September 2022
- Echo: Green
- Desktop: 1 unexpected visual change relating T317902, 11 expected due to Gerrit change 831126
- Mobile: 1 unexpected visual change relating to page actions color. Could not replicate on beta cluster.
- web-maintained: Green
Comparing origin/wmf/1.39.0-wmf.28 against master.
[edit]Last updated: 13 September 2022 Expected visual changes documented in https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/830955
Comparing origin/wmf/1.39.0-wmf.28 against master.
[edit]Last updated: 9 September 2022
- Echo: Green
- Desktop: 4 failures, 3 footer-related, 1 related to TOC bolding?
- Mobile: Green
- web-maintained: Green
8 September 2022:
- Desktop: 98 failures, due to T315261 and T315615, which affect the alignment of many elements including the header and page container. All changes are expected
Comparing origin/wmf/1.39.0-wmf.27 against master.
[edit]Last updated: 31 August 2022
- Echo: Green
- Desktop: 3 failures, 2 due to T314670, 1 due to pixel failure with "ENGINE ERROR: Evaluation failed: Cannot find module vue." error
- Mobile: Green
- web-maintained: 2 failures on Timeless -- maybe due to https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/819178? Logged T316789
Comparing origin/wmf/1.39.0-wmf.26 against master.
[edit]Last updated: 23 August 2022
- Echo: Green
- Desktop: 33 failures (expected: T315595), 7 due to T307715, 21 due to https://phabricator.wikimedia.org/T314670, Pixel #99 and external link icon change T261391
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.39.0-wmf.25 against master.
[edit]Last updated: 17 August 2022
- Echo: 13 failures due to font change (T213778)
- Desktop: 1 failure (MediaWiki_Main_Page_vector-2022_0_viewport_0_phone.png) may relate to T306440, Note flakiness: https://github.com/wikimedia/pixel/issues/96, 83 failures due to font color change (T213778)
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.39.0-wmf.24 against master.
[edit]Last updated: 15 August 2022
- Echo: 14 failures due to https://phabricator.wikimedia.org/T312157
- Desktop: 45 fails due to https://phabricator.wikimedia.org/T312157 and phab:T307771
- Mobile: Green
- web-maintained: Green
Comparing origin/wmf/1.39.0-wmf.23 against master.
[edit]Last updated: 9 August 2022
- Echo: Green but it hasn't run since 7/8/22 with 1.39.0-wmf.19 against master
- Desktop: 69 fails - I believe these are expected but we're having some issues with Pixel atm
- Mobile: Green
- web-maintained: 12 fails - all related to the Privacy Policy icon which shifted ever so slightly
Comparing origin/wmf/1.39.0-wmf.22 against master.
[edit]Last updated: 29 July 2022
- Echo (1.39.0-wmf.19 against master): Green
- Desktop: Green
- Mobile: Green
- web-maintained: 30 passes, 22 failures (due to external link icon change in QuickSurvey (phab:T261391). Expected change.)
Comparing origin/wmf/1.39.0-wmf.21 against master.
[edit]Last updated: 21 July 2022
- Echo: Green
- Desktop: 67 failures due:
- Search: Introduction of Codex (758961)
- Tabs: Changes to the language variant dropdown position ( 815323) and chevron (814234/)
- Link: External link icon change (phab:T261391)
- Footer, TOC: The new grid was rolled out resulting in changes to the footer and table of contents alignment (phab:T312241)
- TOC: Changes to table of contents text alignment and padding (815768)
- Mobile: Green
- web-maintained: 30 passes, 22 failures (due to external link icon change in QuickSurvey (phab:T261391). Expected change.)
Comparing origin/wmf/1.39.0-wmf.20 against master.
[edit]Last updated: 18 July 2022
- Echo: Green
- Desktop: Green
- Mobile: 8 failures due to the fix for https://phabricator.wikimedia.org/T312864
Comparing 808059 against master. (Fastforward of "origin/wmf/1.39.0-wmf.19")
[edit]Last updated: 7 July 2022
- Echo: Green
- Desktop: Green
- Mobile: Green
Comparing origin/wmf/1.39.0-wmf.19 against master.
[edit]Last updated: 5 July 2022
- Echo: Green
- Desktop:
- 11 failures were reported due to https://gerrit.wikimedia.org/r/808059. All visual changes were manually reviewed and expected. The reference point was updated.
- Mobile: Green
Comparing origin/wmf/1.39.0-wmf.18 against master.
[edit]Last updated: 28 June 2022
- Echo: Green
- Desktop: 15 failures.
- Mobile: Green
Comparing origin/wmf/1.39.0-wmf.17 against master.
[edit]Last updated: 27 June 2022
- Echo: Green
- Desktop: 6 failures.
- Expected: The table of contents icon shows on scroll (new feature) on mobile devices (phab:T308689).
- Expected (to be confirmed): The margin for the table of contents iswhen scrolling without the sticky header and main menu is open has been modified (phab:T309807).
- Mobile: Green
Regressions caught: phab:T311283, phab:T310536, phab:T311319, phab:T309807,
Comparing origin/wmf/1.39.0-wmf.16 against master.
[edit]Last updated: 15th June 2022
- Echo: 14 failures due to table of contents icon alignment (documented in phab:T307900#7999651. It seems unintentional that the table of contents in the sidebar is also moving.
- Desktop: 56 failures assumed to be intentional related to heading border and icon alignment (phab:T310533 and phab:T307900#7999651). There is also a change in the bottom border of the article heading in both legacy and vector-2022 that is intentional.
- Mobile: 0 failures
Comparing origin/wmf/1.39.0-wmf.15 against master.
[edit]Last updated: 8th June 2022
- Mobile: All green
- Desktop: [Regression] color change for bottom border of legacy Vector's h1 element. 62 failures but the rest are assumed to be intentional (phab:T310197)
- Echo: 20 failures related to the desktop layout changes
Comparing master against origin/wmf/1.39.0-wmf.14
[edit]Last updated: 6 June 2022
- Mobile: All green
- Desktop: [Regression] Spacing between sidebar and TOC has increased. Three failures relating to ULS settings cog. Seems to be a false positive.
- Echo: All green
Comparing master against origin/wmf/1.39.0-wmf.13
[edit]Last updated: 24 May 2022
All green
Comparing master against origin/wmf/1.39.0-wmf.12
[edit]Last updated: 23 May 2022
Desktop has 14 failures. 8 of these are on the history page and report the reference images having no revision history but those are false positives and is a result of a database schema change that occurred this week and that affected the revision table (Pixel should be more resilient to DB schema changes in the future).
Mobile (5 failed/15 pass): The notification and search icons will show a small shift due to https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/793114. This is expected. The settings link was restored to the main menu (https://phabricator.wikimedia.org/T307696) leading to more expected failures in minerva_mobile_mainmenu-open.
Comparing master against origin/wmf/1.39.0-wmf.11
[edit]Last updated: 12th May 2022
All desktop tests are passing.
Mobile (7 failed/13 pass): Mobile tests were introduced but are flaky due to the sidebar animation and layout shift involving the footer logo. The latter should be resolved in #Comparing master against origin/wmf/1.39.0-wmf.12.
Comparing master against origin/wmf/1.39.0-wmf.10
[edit]Last updated: 6th May 2022
22 passed | 38 failed (36% pass)
The failures here were due to expected changes:
- [Expected] Fix spacing/margins for screens between 1000 and 1200 px
- [Expected] Previously the height between the page title and the content was different on special pages vs regular pages. This was corrected in 789207
- [Expected] The introduction of the toolbar component in 787562 led to slight pixel misalignment in the article namespace and action tabs. This was expected preparation for the introduction of a grid system to Vector and moving the article tools below the title.
Comparing master against origin/wmf/1.39.0-wmf.9
[edit]Last updated: 2nd May 2022
47 passed | 13 failed (78% pass)
- [Expected] Weâre collapsing things into the more menu at lower breakpoints to make things more predictable. As a result edit icon will be hidden under more menu at lower resolutions now. There was one unexpected bug associated with this on history and Special:RecentChanges which will be fixed by 787801 so that this issue didn't got out with the release.
- [Expected] We changed the alignment of logo with table of contents and search with tabs
- [Regression] Main menu placement is off on screens 700-1000px