Selenium/Ruby/Workshops/WTA Test Plan

Weekend Testing Americas May 5 Test Plan

WTA May 5 Test Plan

Objectives
- Test MediaWiki version 1.20wmf02 using version 1.20wmf01 as an oracle
- Regression testing for 1.20wmf01
- General Exploratory Testing in various browsers

Platforms/Browsers of Interest
- IE7 and IE8/IE9 in "compatibility mode"
- IE8
- IE9
- IE10
- Firefox with and without "HTTPS-Everywhere" extension
- Chrome
- All browsers with and without "privacy/incognito" mode set

Test Environments (Note: we are testing in production environments, please be respectful, see Recommended Procedures below)
1.20wmf01: All Wikipedia sites, e.g. http://en.wikipedia.org/
1.20wmf02: All non-Wikipedia sites (Wiktionary, Wikisource, Wikinews, Wikibooks, Wikiquote, Wikiversity, and other sites)
- http://en.wikisource.org/ is of interest because ProofreadPage has many moving parts. A ProofreadPage sandbox is available here: http://en.wikisource.org/wiki/Page:The_book_of_try_and_learn.djvu/1
- http://commons.wikimedia.org/ is also of interest, particularly http://commons.wikimedia.org/wiki/Special:UploadWizard. Again, please be respectful when uploading files.

NOTE: the Sandbox page is important, use that over any regular wiki page when possible (See link to Sandbox below). Also, for those who have created an account, one's User Talk page is also useful for testing. For example, my user talk page is here: https://www.mediawiki.org/wiki/User_talk:Cmcmahon

Setup
- Create a global account on any wiki and login. This is not required, but it makes several things easier:
  - Any edits to pages preserves the identity of the editor. This is of particular interest for the Sandbox page
  - Provides a User_talk page, which is a good place to do testing
  - Allows persistent setting of various user preferences relevant to testing
- Create an account in Bugzilla https://bugzilla.wikimedia.org/
  - This is also not strictly required, but recommended strongly for reporting issues

Test Charters and Features to be Tested
Top priorities for 1.20wmf02 testing:
- Editing
- ProofreadPage
- UploadWizard
- 1.20wmf02 test charters: http://www.mediawiki.org/wiki/Mediawiki_1.20wmf2_Feature_Test_Charters
- 1.20wmf02 Features: http://www.mediawiki.org/wiki/MediaWiki_1.20/wmf2
- 1.20wmf01 test charters: http://www.mediawiki.org/wiki/Mediawiki_1.20_Feature_Test_Charters
- 1.20wmf01 Features: http://www.mediawiki.org/wiki/MediaWiki_1.20/wmf1/overview
- 1.20wmf01 Release Notes: https://gerrit.wikimedia.org/r/gitweb?p=mediawiki/core.git;a=blob;f=RELEASE-NOTES-1.20;h=0e8cdc09e6163154a6182e301a37aebdb244cc41;hb=refs/heads/master

Recommended Procedures
New feature testing
- Choose a test charter or feature from the 1.20wmf02 list
- Perform ET for that charter or feature on a non-Wikipedia site
- Optional follow up: Do ET for similar actions on a Wikipedia site with 1.20wmf01 installed
Regression testing
- Choose a test charter from 1.20wmf01 list
- Investigate both Wikipedia and non-Wikipedia sites for proper function of that feature
  - Note: if you are unsure of what version of MediaWiki is installed in your environment, most wikis have the page Special:Version in place, for example http://en.wikipedia.org/wiki/Special:Version
  - Note: instructions to use Sandbox pages are here: http://en.wikipedia.org/wiki/Wikipedia:Sandbox . An example of a User talk page is here: http://en.wikipedia.org/wiki/User_talk:Cmcmahon

Reporting issues
- When creating a bugzilla ticket, make the title "WTA <your issue>" for help in triage later (Bugzilla: https://bugzilla.wikimedia.org/)
- Discuss issues in WTA Skype channel and/or IRC channel freenode#wikimedia-dev
- optional: Edit http://www.mediawiki.org/wiki/User_talk:Cmcmahon with description of the issue
- optional: Email cmcmahon at wikimedia dot org