Jump to content

Cross-wiki Search Result Improvements/pl

From mediawiki.org
This page is a translated version of the page Cross-wiki Search Result Improvements and the translation is 8% complete.

Nowy Cel

The Discovery department is looking into the ability to provide search results from other Wikimedia projects within the same language (commonly named cross-wiki or inter-wiki searches).

For example, if you were on the French Wikivoyage and searched for "milk" you would be presented with the expected matching articles from the French Wikipedia and results from other French Wikimedia projects (i.e.: fr.wiktionary and fr.wikiquote).

This page is an attempt to summarize some of our thoughts and we invite all contributors to openly discuss this potential change on the talk page.

This idea is different, but related to, a new feature that the Discovery Search team enabled in 2016. That new feature shows results from select other language Wikipedia's when it's been determined that the user might have used a different language to type in their query, because their local results are less than 2 matches. The topic of this page - a new display of search results across the same language wiki projects - will be in addition to the new feature of language detection, not replacing it.

The Rationale

The way search currently works for all Wikimedia projects is this: each language project has its own separate index to search in. This means that there is currently no way to search across all wiki projects for relevant results at the same time. However, on the backend, the language is the same for a search (regardless of project) and visitors may be interested in information that could be in a sister project in their language.

Providing search results across projects (within the same language) provides more information to visitors, easier visibility into other projects, and increases the value Wikimedia visitors receive out of searching on-wiki, which includes the potential for less zero result searches.

Displaying additional search results across projects will not only increase visibility to those other sister projects but it could also increase discovery into more articles of interest and possibly even encouraging additional contributions.

Why haven't we done this already?

existing search results page on enwiki

Why not have one giant index to search across all projects in all languages?

  • Technical complexity is one reason: the size of the resulting index would be in the hundreds of gigabytes.

For example, the English Wikipedia database index of all article pages is around 200 gigabytes. Providing search results quickly would be negatively impacted if having just one very large database index.

  • Another reason for this 'one language' search results approach is that it probably wouldn't be very useful to search for a topic across all languages.

Searching for "Paris, France" and seeing generally the same article in French, German, and English wouldn't help very much in discovering new information.

The English language wiki projects are quite large:

  • English Wikipedia index for all English article pages is approximately 200 GB
  • English Wikinews is approximately 15 GB
  • English Wikisource is approximately 6 GB

This might impact various existing wiki workflows by displaying additional search results.

  • This could possibly affect bots, contributors, researchers, readers, etc.

Plan

In the first quarter (July - September 2016) the engineering team will continue to work on the following four main steps:

Pierwszy

  • Combine indexes within the same languages.

(zadanie T139498) Incomplete Partially done

  • Ask for the help from the community - which includes the discussion on this page.

(zadanie T137312) Yes Zrobione

  • The Search and Design teams at WMF will create mockups of how these new search results might be displayed.

Yes Zrobione

Drugi

By the end of the next quarter (October - December 2016) the team will compare search satisfaction. This will be done:

  • after the cross-wiki index is ready for several pre-selected languages

(zadanie T121541) Yes Zrobione

  • after running A/B tests to collect real time data with which to analyze

(zadanie T121546) N Nie zrobione

  • and get the UI mocks finalized for front end testing here:

Cross-wiki Search Result Improvements/Testing Yes Zrobione

  • while also creating a Labs instance for early testing.

(zadanie T151344) Yes Zrobione

Trzeci

In the this quarter (January - March 2017), we will:

  • begin A/B testing for the front end of this new feature for analysis and feedback from the community.

(zadanie T145917) W trakcie W trakcie

  • continue to refine and enhance the back end for this feature

W trakcie W trakcie

  • First A/B/C test was run and found to be not very conclusive

(zadanie T149806) Yes Zrobione

  • Second A/B test will be run, after fixing a minor UI bug and adding four more Wikipedias to test on, for a total of eight.

(zadanie T160004) Incomplete Partially done

Czwarty

kwiecień - czerwiec 2017:

  • wrap up analysis of the second A/B test for the sister projects snippets in the search results page

(zadanie T160008) Incomplete Partially done

  • release translated note to Village Pumps announcing the production deployment

(zadanie T162276) W trakcie W trakcie

  • release blog post about search
  • release into production on all Wikipedias

Current Search Examples

There are already a few community-led solutions to provide additional discovery of other Wikimedia projects and articles in the same language. Here is a small collection of examples:

Current search results pages for a few language wikis:

External Search Gadget:

How could these additional search results be displayed?

The appearance of search results is open for discussion and we have some rough drafts for you to look at below with more design possibilities on Design. Here are a few examples of what a new search results page could look like based on existing solutions on other language wikis:

Help us choose the solution

Please provide your feedback now!

  • Two quarters are needed, at a minimum, to architect and design the technical implementation.
  • The team would like to have something to test and to show to the community sometime in late 2016.

Pytania

The team has many questions and this is what we'd like to request feedback on from the community:

    1. Should the results from whatever wiki you're on to be shown first and then have an option to show more from other wikis?
    1. Should the additional results be inter-mixed with the local wiki results?
    1. Should the additional results be displayed off to the side (or maybe the bottom) of the results page?
    1. Should we have the option to turn off these other relevant search results (a user and/or project opt-out)?
      • This could be a keyword search term or maybe a button for a visitor to click
      • This could also be similar to the local: keyword that will only search for images on the local wiki and not Commons files, for instance.
    1. Would the additional results be best displayed as a list or a grid design?
    1. Should we include relevant metadata (images and/or a short description) with the search results?
    1. Do the results need to have the size of the article (i.e.: 848 bytes (104 words)) and the date it was created/modified?
    1. Should we indicate that clicking on a result will take you to another wiki project?
    1. How many results from other wikis should we show - 1, 2, 3, or more?
    1. Should we limit the existing method of displaying results from the wiki that you searched on?
      • We currently show up to 10,000 results in a paginated manner, but testing shows that generally only the first 3 results are ever acted upon.
  1. Do we want these new search results to work across all Wikimedia projects?
    1. For example, if I'm on Wikiquote, do I want to also see relevant search results from Wikivoyage, Wikipedia or Wikinews?
    2. Or, if I'm on Wikipedia, just show me results from other projects?
  2. Would these other relevant search results be useful and encourage deeper exploration into various topics?
    1. Is it annoying to see the other wiki search results?
    2. Conversely, does it encourage a user to discover more knowledge?
    3. How much weight do we give results from other wiki projects in the results?
  1. Will the display of the additional search results from other wikis encourage contributions from editors?
    1. i.e.: if you search for Piazza del Duomo and don't see a Wikivoyage article about it (while I'm searching on Wikiquote), would that encourage you to start an article for it?
  1. Should we limit the amount of languages we search in?
    1. i.e.: only use the top 50 languages to implement this in?
    2. Or, only use the languages that we are detecting queries in an other language than the wiki the user is on?

See also: Explore similar, Wiktionary widget, thumbnail icons in search results

Phabricator tickets:

Discussion notes:

After taking into account community feedback and design team recommendations, we'll start A/B testing soon. View this page for more information.

This page was created to encourage users to do their own testing, via a self-guided testing page with examples for those not-so-technical and those that have a Wikipedia account and are a little more experienced.