Jump to content

Article feedback/Public Policy Pilot/Workgroup

From mediawiki.org

The goal of this work group is to assess the Article feedback experimental tool during its trial period on Public Policy articles. See the blog post and the Frequently asked questions.

Sign-up

[edit]

Please sign up below if you'd like to join the workgroup. You don't need to be a developer, we're mostly looking for users. Thanks!

Draft action plan

[edit]

Questions

[edit]

"Users" means people who use the tool, whether they're readers or editors.

What motivates users to use the tool?
Possible sources of answers:
How useful are the ratings for readers and editors?
Possible sources of answers:
  • Data from the survey
  • Voluntary general qualitative feedback
  • Voluntary feedback qualitative provided by editors of public policy articles
  • Additional qualitative research such as interviews / UX study (deferred for now)
How understandable is the Likert scale used for the feature?
  • Voluntary general qualitative feedback
  • Data from the Phase 2 survey (deferred for now)
Does the feature have an impact on account creation and editing?
Possible sources of answers:
  • Raw data from the DB can provide the following metrics:
    • percentage of raters who create an account within a month after the rating (baseline: ?)
    • percentage of raters who edit an article within a month after the rating (baseline: ?)
How does this reader rating compares to other rating systems (existing Wikipedia article assessment system, expert opinion, Public Policy Initiative system)
Possible sources of answers:
More generally, how to improve the tool so it better helps users achieve their goals?
  • Data from the survey
  • Voluntary general qualitative feedback

Phase 2: Applying Article Feedback Tool to General English Wikipedia Pages

[edit]

I've posted on several people's user pages and so far, Fetchcomms, pjoef, and DGG indicated that they're interested in helping. It's great to have help with testing this feature on the English Wikipedia. So far, the Feedback Tool has only been applied to certain pages that are part of the public policy initiative. In this next phase, we'd like to experiment with having this feature on general English Wikipedia pages to see if these ratings are indeed a reasonable indicator of article quality. For more details, please refer to the following post.

I'd like to get some help from the workgroup on managing the list of general English Wikipedia articles the feedback tool is on and communicating status with the community:

  • Managing the list: We have a list of Additional Pages we'd like to put this feature on. We've posted to wikien-l and as a result have gotten some feedback from the enwiki community as to which pages they think would make sense. Can someone monitor this page every few days (say Monday and Thursday) and vet additional suggestions for inclusion in the test? If they seem reasonable (i.e., meet the criteria at the top of the page, or for another reason seem to be a good test article), please go ahead and add the tool to the article.
  • Communicating with the enwiki community: Can someone post to Village Pump with a message about what we're doing (i.e., testing the feedback tool on general wiki pages, process for suggesting new pages, adding the tool to the page, etc.)? I think it would be great to get more visibility for the test. If folks think someplace other than/in addition to Village Pump makes sense, go ahead!

Also, it would be great to get your feedback on designs. Jorm (WMF) has Phase 2 Design page he's posted some ideas. Please let him know what you think.

That's it for now. Maybe two people can take on managing the list and another person can take on communicating with the community?

Howief 05:23, 23 November 2010 (UTC)[reply]

I will monitor the list of additional pages. –pjoef (talk • contribs) 09:14, 23 November 2010 (UTC)[reply]
I can do either or both. Fetchcomms 13:51, 23 November 2010 (UTC)[reply]
Hey Pjoef and Fetchcomms. I wanted to check in -- it looks like there have been some additions to Additional Pages. Would you mind taking a look to make sure that the suggested pages have the tool on them (if they fit the criteria)? BTW, thanks Fetchcomms for posting to the Village Pump.
Also, I wanted to let you know that w:en:User:Sadads wants to help out, so hopefully the three of you can work together to manage this.
Finally, there have been instances of users putting the tool on random pages. Not a big deal, but just thought you might like to know. Jorm (WMF) is on top of it. Howief 00:19, 10 December 2010 (UTC)[reply]

Feedback summary

[edit]

Bugs

[edit]
  • Possible errors in calculations ([1])

Feature requests

[edit]
  • Compatibility with Lupin's pop-ups ([2])
  • Explicit reference to the Public Policy Initiative to provide context (mailarchive:foundation-l/2010-September/061058.html)
  • Charts of the evolution of ratings over time ([3])
  • Graceful degradation for users without JavaScript ([4])
  • More visible than the bottom of articles (maybe in the sidebar) but not too intrusive (smaller?) ([5])
  • More intuitive UI, current one may scare users away ([6])
  • Ability to query articles based on their ratings ([7])
  • Ability to leave comments ([8])
  • Change colors to avoid Communist stars ([9])
  • Use tags like TED's ([10])
  • Move the tool below categories to avoid disrupting the usual flow of the page ([11])
  • Box is too wide ([12])
  • Integrate statistical tools (variance, standard deviation, median absolute deviation) to calculate the ratings ([13])
  • Prevent automated/bot assessment ([14])

Project requests

[edit]
Retrieved from "https://www.mediawiki.org/w/index.php?title=Article_feedback/Public_Policy_Pilot/Workgroup&oldid=3620760"