Topic on Talk:ORES review tool

The new filtering interface demo

Hey folks,

Recently, I've been working with the mw:Collaboration/Team at the Wikimedia Foundation. They are working on improving reviewing interfaces in Wikipedia. ORES and the ORES review tool are obvious allies in this work. :)

Anyway, as a first step, they are designing and engineering an improved filtering interface for Special:RecentChanges. I'd like to invite them to incorporate this new review interface into the ORES review tool directly. That means all who have this the ORES beta feature enabled will suddenly get a new filtering interface once they are ready to deploy it (still TBD at this point). As this tool focuses on improving RecentChanges in ways that the ORES review tool does and beyond, you might think of merging these projects for some future deployment as the next major iteration on the ORES review tool.

While a change to RecentChanges filters might be a bit jarring to you, I think that integrating their work into ours as soon as possible is a good idea. My team (m:R:Revision scoring as a service) doesn't have that many resources to devote to the ongoing development and maintenance of the ORES review tool, while the Collaboration Team has designers and professional engineers working on this problem. By integrating with their work and handing off new development to them, we can spend more time focusing on making ORES predictions as good as they can be.

So, what do you think? Any concerns we should discuss? Regardless, there'll be announcements before we make any major changes.

Here's a working prototype of the new interface. Give it a try if you'd like to get a hands-on feel for the new filtering tools.

Remember, this is only a mockup. The search results are all canned, and filtering properties were applied to them semi-randomly. So this won't let you test whether the search technology is working properly.

It will, however, give you a good sense of the new look and feel. Presentation of the ORES-based filters (“Quality” and “User intent”) was a particular focus: they have to be understandable by a broad audience, but flexible enough to meet different types of reviewers' varied needs. What do you think?

Looks nice! Are the filters filtering in or out? Couldn't quite figure that bit. Thanks

Thanks @Iadmc. The new filters are all "include" instead of the old-style hide filters. Logically, the new arrangement is an "AND of ORs," meaning that within each filter grouping, the filters have an OR relationship, while different groupings are connected by ANDs—which should enable users to more accurately isolate the properties they're interested in.

We've been talking about how the Recent Changes filtering scheme demonstrated above will affect current ORES beta feature users. Here's what we're thinking: when this new filtering system rolls out as part of the beta, it will replace the current ORES display on the Recent Changes page. That means the automatic color coding, the red “r” symbol and the “hide probably good edits” filter will go away, to be replaced by the new, more nuanced set of filters and user-defined color coding.

All other pages that have ORES features, like Watchlist and Related Changes, will remain as they are now. We expect those pages could also benefit from the new filtering system. But at present we're thinking we'll wait to see how users (meaning you) react the beta test first—and make any necessary changes—before we start spreading the new UI around.

That's the plan as it currently stands. As always, please let us know if you have any thoughts.