Talk:VisualEditor/Design/Reference Dialog/Archive 1

Feedback for VisualEditor Reference Dialog

Please implement this idea

Trully amazing idea! It would be really easier and faster to add references this way. if implemented this is going to have a huge impact in long term, just keep going. Cheers from a ptwiki user. TheVulcan (talk) 02:06, 21 September 2013 (UTC)

Nothing much to add myself just yet, other than I agree! I wasn't aware until yesterday that there was going to be any reference-dialogue action other than a blank freetext field. The absence of a simple but powerful footnote-creator is my main (only?) reason for not using VisualEditor for my day-to-day editing, so I'm very pleased to see this is on the cards. Could you please reiterate in your future newsletters/announcements that this sub-section of the visual editor project is actively being worked on as I'm sure there's a lot of people out there who (like me) don't know about it but are very interested in supporting it. Wittylama (talk) 02:26, 30 January 2014 (UTC)

I'll make a note to highlight it in the next newsletter (it's been linked in the last handful), although response from such requests has been very limited, so I don't think you should count on much. What seems to produce feedback is not requests, but putting a design into VisualEditor and waiting for "spontaneous feedback" (usually in the form of loud complaints). Whatamidoing (WMF) (talk) 00:04, 31 January 2014 (UTC)

No, what produces results is going to the VE feedback page and asking for feedback. You didn't get any response about the character inserter even after you had put it into production, because no one who really uses VE uses the advanced options (much too likely to cause issues, and much too advanced for the few users that use VE in general). You got a response at the English wikipedia because you finally asked at the right place instead of in more general newsletters which aren't apparently read by the few VE editors or testers you have left (in my case, they are ignored because they are unreliable and even errors that are pointed out upfront don't get corrected).

So why not try a new approach? Come to the VE feedback page on en-wiki (and other wikis of your liking), and announce that some new tool is available on Mediawiki, and that before you release it to the world (and loud complaints), you would like some feedback on it.

Better yet: why not use a completely different approach to developing software?

• Get feedback from editors as to what they would like to have
• Look at what already exists in the normal wikitext environment (standard and oft-used gadgets)
• Analyse, develop, improve
• Get your QA team to test it and give their feedback
• Go back to the editors who provided the initial feedback and ask them to test it and give their opinion
• Eat, sleep, repeat
• And then, and only then, introduce it to the other wikis

It would reduce the chance of further utter failures like the character insertor (or the VE implementation as a whole), and the accompanying number of "loud complaints". Fram (talk) 09:12, 31 January 2014 (UTC)

Suggestions - 20 September 2013

Step 1

Step 1 can be eliminated by putting the Reference icon back on the main toolbar, rather than putting it under "More". Space can be made for the Reference icon, on the toolbar, by putting all text formatting options (bold, italic, strikethrough, superscript, subscript, computer code, etc.) under a "Format text" pull-down menu, which is more intuitive than the "More" label. See here for further discussion.

Step 2

The top-most heading ("Choose a template or enter manually"), is fine, but there then should be two parallel sections of the dialog box: "Choose a template" and "Enter reference manually". The first of these two ("Choose a template") is missing; instead, the top-most heading has been combined with the first option. The reader should be able to grasp, immediately, looking at the box, that - per the heading - he/she should use one of two subsections, and these two subsections should be separately boxed, with separate sub-headings.

There should be a minimum of blank lines (horizontal spacing) in the dialog box, so the user an quickly see what the two options are. (The version shown is hopefully just done quickly, rather than intended to show where text will actually appear.)

The sequence of templates will, hopefully, be controlled by individual projects. For example, at the English Wikipedia, Cite Web would probably be first, since it's most common.

The full name of templates should be shown ("Cite web", not "Web"). This is helpful for wikitext editors switching to VE, or VE editors who use the wikitext editor, but it's also helpful when doing a search - because the user now has a much better idea as to what other templates are likely to be named. If longer names don't fit into a five-wide list, then there is plenty of space to do a five-deep list instead. (Having the full name of the template show, in the dialog, rather than a portion of it, also means less translation work, since there wouldn't be a need for a label for each citation template.)

The number of "slots" for templates also should be project-controlled, perhaps with an upper limit of 10, rather than WMF deciding on behalf of the projects that five is the ideal number. If a five-deep list is used - see prior paragraph - then there could be a second column for templates six through ten.

There is no reason to have a "Next" button. When the user clicks on a specific template, that should invoke step 3. The user should not have to (a) select a template and then (b) click "Next". (If the "Next" button is related to the search box, it should be to the right of the search box, not below it, and it should have the search icon in it, or the word "Search", or similar. However, it's easier just to press [return], as is done, for example, in the search box at the upper right of MediaWiki pages, rather than click on a separate button to start a search.)

The words "Search more templates" should be "Find more templates".

Overall comments on steps 3 through 5

Arguably, the correct approach to adding references is to improve the template dialog so that steps 3 through 5 would be done inside that dialog, not as part of a different dialog, with a different user interface. (Or, roughly equivalently, if the reference dialog used, as a base, the template dialog code when performing steps 3 through 5.) It's true that cite templates are different than (almost?) all other templates because of autofill possibilities, but that's a relatively minor difference that could easily be factored onto the standard template dialog.

It's true that the template dialog is desperately in need of redesign, and, arguably, the reference dialog is a priority. But screens 3 through 5 are not consistent with how the template dialog is currently designed (specifically, the left side of the dialog box showing parameters selected, the right side used to select additional parameters, and to fill in parameter values), a design I believe is fundamentally correct. So the approach in these design specifications for the reference dialog - assuming the template dialog stays approximately as is - will result in users having to learn two different systems for templates - one for citation templates, and one for other types of templates. That's almost certainly a mistake.

Step 3 (3a)

The heading should be "Cite book" (the name of the template), not "Book". [And similar for subsequent screens.]

It is not at all clear that the user should press [return] after entering an ISBN, in order to invoke the autofill option. (That is, to enter a value and then do a search - why search if he/she knows the ISBN?) Rather, there is a good chance that the user will type the ISBN, then tab to the next field, enter that information, tab to the next field, etc.

What should be done is to have a button, immediately below the ISBN, labelled "Autofill other parameters". That's something that an editor obviously would want to click on. If the autofill fails, a message should be displayed below it (so there should be blank space on the screen for such a message): "Unable to autofill; ISBN may be incorrect or autofill function may not be working"). In the case of such an error message, the user should not need to acknowledge the message (click on anything, an extra step) but can simply start manually entering information.

Having a separate button is also desirable because there will certainly be cases where no autofill option is available. In such cases, the lack of an autofill button will clearly indicate to the user that he/she is going to have to manually fill in parameter fields.

The list of parameters doesn't group them by "required" versus "optional" - at least, it's not clear that it does, and the description of the dialog doesn't mention this point. (As may be obvious, but just in case: For each parameter, the TemplateData information in the template states whether the parameter is required or not.) If both required and optional parameters are in the scrollable list, there should be a heading "Required parameters", then a list of required parameters, followed by the heading "Optional parameters", and a list of those. (There could be either a single scrollable list, or two scrollable lists, if space permits). Parameters not specified as having one of these two values should be considered "Optional".

Alternatively, only "Required" parameters might be listed. That appears to be the case, looking at the "Adding Parameters" screen. If so, the developer description of the dialog should be modified to state that this is the approach being taken.

The first parameter shown (ISBN) has the description information from the TemplateData documentation for the template, which is excellent. But the other parameters should also have their descriptions. Thus, for example, "Last name" should have, directly under the space for entering that parameter, this description: "The surname of the editor; don't wikilink, use 'editor-link'; can suffix with a numeral to add additional editors". (I don't happen to think this is the best description, but WMF shouldn't worry about that - the projects will have a real incentive to improve descriptions that appear in the dialog.) (Oddly enough, in the screen showing for step 5 ("Additional Parameters"), a description for the parameter "Place" is visible, but the text is not taken from TemplateData.)

The "Result" field shows six items ("Last name, First name, ..."). In fact, there are eight required parameters for Cite book - the missing two are Publisher and Pages. Presumably the "Results" field should show all required paramters, not a subset, and this is just an oversight; if not, the developer description of the dialog should be modified to explain why not all parameters are included in this box.

Note: Regarding the Results field, for additional comments, see step 4, below.

Step 3b

It's unclear why the "Results" field doesn't show the same thing as in Step 3a, and why that field is no longer greyed out after the ISBN has been entered. Does entering even one character in a field activate the "Results" box? (If so, why?)

Step 4

The current dialog description doesn't cover the situation - as is the case with Cite book - where a parameter is required (in this case, "Pages") but is not autofilled. Nor does it cover the case where, for some reason, autofill can't fill all the fields that it normally does - for example, say, the publisher location is unavailable from the database used for autofill.

Recommendation: where one or more required fields is still blank following autofill, the dialog box should scroll the parameter window so that the first blank (and required) parameter in that window is visible, along with its description.

It would be extremely helpful if a message were displayed, near the top of the dialog box, something like "7 of 8 required parameters have been filled in". That would encourage editors to complete all required parameters. [This wouldn't be a clickable/closeable message, but rather text placed in previously blank space.]

The statement "The user may also edit the reference here [in the Result box] if they wish" needs further explanation. If the user is now able to do free-form editing, this potentially breaks the template. If editing in this box results in the equivalent of doing an "Enter reference manually" (step 1) - that is, if the wikitext added to the page becomes <ref>text</ref> rather than <ref>{{cite book |ISBN= |First_name= .... }}</ref>, this is extremely undesirable. It's extremely undesirable because preserving parameters makes it possible for bots, now or in the future, to work with structured data, but that data must be inside a template.

The alternative is to make the Result box consist of fields (ideally, with small labels) for each parameter. Then while the editor might edit a field, the structure (that is, the template) is preserved. Alternatively, if the Results box contains fields, then clicking on one could take the user to that parameter, in the scrolling list, where he/she can make any desired change.

Once at least one parameter has been added, clicking on "Back to templates" should cause a pop-up dialog box: "Are you sure you want to return to discard the information you have entered, and return to templates? [yes] [no]"

The proposed display for this step only gives the values of the parameters (e.g. "Horuki") not the name of the parameter (e.g. "first1"). This makes it difficult to properly inspect the citation to see if the search process properly classified the words that were found (Maybe Horuki was really a translator or editor, not an author). Jc3s5h (talk) 17:37, 22 October 2013 (UTC)

Adding parameters (optional step 5)

"The option to add more parameters from a template is visible after the user scrolls to the bottom of the form" is far from a complete description of how this functionality works. And the drop-down menu near the bottom of the "Adding parameters" screen looks very different than how one adds a parameter in the current template dialog, where the user can find a parameter by scrolling or by searching. Is there some reason not to use the (better) "add parameter" functionality of the current template dialog?

Comments on "Notes"

Regarding this:

"This design iteration does not include the "Use this group" feature. However, in the future a user may be able to organize groups of references within the article."

While it's fine (in my opinion) to delay this functionality, it would be highly desirable to put a placeholder into the dialog box so that users understand that (a) references added via this dialog will automatically go into the standard/default group, and (b) that in the future, they will have the ability to change this.

Specifically, it would be desirable to put this to the right of "Book" (or, as suggested above, "Cite book", on screens three through 5:

Group: [Standard]   [New]

Where ["Standard"] (or "Default") is a field with a drop-down arrow that is greyed out, and "[New]" is an button that is greyed out. Eventually a user could use the down-arrow to select an existing group, other than standard/default, and could click on "[New]" to create a new group.

The programming work here should be minimal - the "Group" field should already exist, and the "New" button would be non-functional.

John Broughton (talk) 03:35, 21 September 2013 (UTC)

I don't understand Design Iteration 1

In the Design Iteration 1 it describes entering a citation template into the reference (at English Wikipedia what we are calling reference in this case would normally be called a footnote or endnote elsewhere; the reference dialogue edits the entire "reference", which may include just a citation, or may a citation and some prose, or even a long multiple-paragraph, formatted appendix-like piece of prose with blockquotes etc). But how does an editor edit the rest of the reference, for example, if she wants to include an explanatory note along with the template citation? The example is not clear how this would be done.

Also, the template editor as it is still uses wikitext for extra formatting when the editor wants it, is that still going to be the case here for these citation templates? --Atethnekos (talk) 04:27, 21 September 2013 (UTC)

Good point. I suggest adding another, final field, "Additional information", with a parenthetical "(optional)" as part of the label. This would be placed below the "Results" box/field, and which would (ideally) accept wikitext, not just plain text. And the larger point is also relevant - the interface for reference/cite templates should be similar to that for other templates, to minimize user learning. John Broughton (talk) 18:10, 21 September 2013 (UTC)

My dad might get frightened.

Step 1 also need to show a use existing reference option.

Some cite templates can have a very large number of parameters. I think its it the region of 200, with first and last names for 9 authors and editors see en:Template:Cite_journal/doc#Template_data which is still missing some. This could make for a long scroll list.

bug 50747 might be import for this as it discusses a recommended option for parameters in TemplateData, used to give a hint as to which parameters to show to start with.

Are all parameters going to me in the list. Having to search would be tricky as if you don't know the template you don't know what to search for. Would you guess there is an {{{arxiv}}} parameter in en:Template:Cite journal.

Some beginning users just like to paste a bare URL or just type an unformatted reference. These are both better than no reference at all. My elderly dad tried adding a reference to an article and it was too complicated for him to fill in all the parameters. I can see him worrying about having and ISBN box to fill in for a book published in the 19th century. What should he put in the field, is it OK to leave it empty. The barrier to entry must be very low.--Salix alba (talk) 17:57, 21 September 2013 (UTC)

With regard to the first point, yes, Screen 1 should present three parallel options: Use a template for a new reference; Enter a reference manually; or Use an existing reference. It's not clear why the third option, which is now in the Reference dialog, was omitted.

With regard to the large number of parameters, it looks like the list presented to users will include only parameters that are specified as 'required in a template's TemplateData section. (With regard to "Recommended" parameters, it doesn't look like that suggestion has got much traction. But after this redesign, there might well be a demand for a categorization other than "required" and "optional".

For users who want to just type an unformatted reference, Screen 1 has an "Enter reference manually" field/box. I've suggested making it more clear that this option is parallel to selecting a template (and, as someone else has pointed out, to using an existing reference). But arguably the manual option should be listed first, so that absolute novices can just post a url and be done with the matter.

And I wouldn't expect novices to search for a template that they're unfamiliar with; the search is there for expert editors who use a citation template that isn't on the standard list. John Broughton (talk) 18:23, 21 September 2013 (UTC)

This of course is the other point. Look at the users and think about them. Look at the folks we meet at training courses. Salix alba dad is an important starting point. Wise, knowledgeable, a history of publications behind him having no history of wikipedia jargon. He knows this occurs in Kernigan and Ritchie- because that is part of his DNA probably around page 80.

• Page one uses the term template, enter a reference manually this is jargon- it needs to be in the users language

pet hate transclusion.

• ISBNs are relatively modern- an academic will rely on books like Naismith (1896) and later editions, The Students' Cotton Spinning. A lot of editing is needed converting 10 digit to 13 digit and (10and 13 digit) to just 13 digit. It the interface can just make it clear, that a ISBN if entered will help by filling in some of the details
• Large number of books have multiple authors, any template needs to assume this. We also have the JRRowlings problem, just how do you enter initials instead of a first name.
• In normal referencing you use sfn and efn referring to a Bibliography section. Often we don't need the user to add a full cite, just (Last,Last2, year, page) I don't see how this is done here.
• How is this template used to correct an existing reference.

I'll point out that this really isn't necessary at all because when we write a visual editor, referencing will occur in line, the mode changing when the user presses a Function Key, or the software will auto-magically detect it is a reference and help the user format it correctly. Roll on the twenty-first century! --ClemRutter (talk) 09:21, 22 September 2013 (UTC)

Regarding "The mode changing when the user presses a Function Key", this seems little different from "The Reference dialog opening when the user clicks the Reference icon."

Regarding "Jargon", two comments. First, why don't you suggest alternative language? Second, I think it's appropriate to expect a user to experiment a little. If a user sees "Book" (I prefer "Cite book") as a link that can be clicked, it's appropriate to expect them to try the link to see what happens. What isn't appropriate is (a) penalizing the user for trying a link, say, by making it difficult to go back to familiar ground - which we don't, here, or (b) dumping the user into a confusing place, which again I think we don't, here - at least we don't based on the changes I suggested, above. For example, clicking on "Book" (or "Cite book") takes the user to a screen where he/she can add an ISBN and click "Auto fill other parameters". That's pretty straightforward; there is a clear "Back to templates" option.

More than 90 percent of book cites in Wikipedia, I'm sure, are of books that do have ISBNs. Thus I don't understand why you emphasize older books as if they were critically important. Moreover, entering an ISBN isn't mandatory in the dialog box for the cite book template, as you seem to think.

Your point about multiple authors is a good one; for the cite template, there probably should be a pull-down menu to specify how many authors there are, and the parameters should change accordingly. However, this isn't trivial to program, particularly since it could easily vary across different language Wikipedias. Better yet would be to have the ISBN lookup understand how to handle a book with multiple authors, and to do an autofill accordingly.

Regarding initials versus "First name", my comments (above) recommend that TemplateData descriptions be displayed below all parameters (in the mockups, they show only for some parameters). The description for first name can say (for all I know, actually does) how to handle initials. So this isn't something to code into the template.

Eventually the reference dialog should handle both plain references and two-step references (Chicago and Harvard style; "References" only versus both "Notes" and "References" sections), but initially the dialog should handle the most common case, which is plain references (one step). We need to walk before we try to run.

Regarding 13-digit ISBNs versus 10-digit ISBNs, the description (text) under the ISBN field says to use 13-digit ISBNs "where possible". I don't know if the autofill tool works with 10-digit ISBNs (or how frequently), but again that's wording that can be tweaked in the TemplateData section of a template, to strike the right balance regarding how much we want people to look for a 13-digit ISBN (say, via an Amazon book lookup.)

As for editing an existing reference, the starting process is different (select the reference, then click the Reference icon, per the User guide. If the reference was created "manually", it can then be edited directly; if it was created by a template, clicking on the text of the reference opens the Template dialog. I don't see that this approach needs to change; it seems consistent with the proposed redesign of the dialog for creating a new reference. John Broughton (talk) 21:30, 22 September 2013 (UTC)

John, as there only seem to be two of here in this section- I will quote you and put a clarification/comment after each section

Regarding "The mode changing when the user presses a Function Key", this seems little different from "The Reference dialog opening when the user clicks the Reference icon."To a more keyboard savvy elderly user- Function keys are easily, as the hands don't leave the keyboard and you don't have to hunt the screen for an icon (visually difficult for bifocal users). The use of a separate data-entry window rather than entering the data inline breaks the intellectual focus on the text- surely this is the aim of a VE. I see it that the reference is typed in line but the area of focus is displayed in a different colour- with hints as to the possible fields.VE has a large number of function keys already, adding one more to invoke the Reference dialog isn't that big a deal. However, it's problematical to find just a two-key combination, and using a three-key combination to invoke something isn't exactly trivial. As for entering the data inline, you're absolutely wrong that this is possible. A dialog box is needed, for example, to ask the user if he/she wants to (a) use a form/template/framework, and if so, which one; or (b) just type in the reference information, or (c) use an existing reference. And no, it's not possible for the computer (VE software) to just let the user start typing away, and figure out from that what the user wants. So staying inline, when entering reference information, isn't a realistic option.

Regarding "Jargon", two comments. First, why don't you suggest alternative language? Second, I think it's appropriate to expect a user to experiment a little. If a user sees "Book" (I prefer "Cite book") as a link that can be clicked, it's appropriate to expect them to try the link to see what happens. What isn't appropriate is (a) penalizing the user for trying a link, say, by making it difficult to go back to familiar ground - which we don't, here, or (b) dumping the user into a confusing place, which again I think we don't, here - at least we don't based on the changes I suggested, above. For example, clicking on "Book" (or "Cite book") takes the user to a screen where he/she can add an ISBN and click "Auto fill other parameters". That's pretty straightforward; there is a clear "Back to templates" option. Alternative wording will vary in each language but it is really the difference between programmer focussed language, and user focussed language. There is tons of literature on the hazards of predicting user acceptable language- but we must try. Take the example of a teaching a session to a Local History Society with an average age of 395. We want you to say where we can verify the information you have just provided- we have two concepts in play. Information and a citation- lets not cloud the issue by starting to define IT terms. The task we are talking about is Adding a Reference- add that to the heading. Ask them 'would you like to type the reference in directly, or use one of the help frameworks below'. So I guess in English I would call it a Help framework, or formatting framework- though that reeks of jargon. I wouldn't try to teach, for example, auto mechanics without using "jargon", and I don't think Wikipedia can be taught without asking users to learn some new words ("jargon") and concepts. I'll repeat that I think it's reasonable to expect users to do a little experimentation; if they won't, then, quite frankly, I don't think they have what it takes to be a successful Wikipedia editor. Auto mechanics to a night school class of ladies you do remove all the jargon until they are comfortable with the concepts- and then you do at their prompting, introduce some technical terms. Yes I did help write some course material in the 1970s. But that's an aside, you work with the volunteers coming forward not the ideal student. Yes encourage them to speculate and experiment- and they will discover that wikicode is more powerful and faster to write- but if they are starting out we need to encourage each one. Yes, most won't ever become successful and dedicated WP editors.

More than 90 percent of book cites in Wikipedia, I'm sure, are of books that do have ISBNs. Thus I don't understand why you emphasize older books as if they were critically important. Moreover, entering an ISBN isn't mandatory in the dialog box for the cite book template, as you seem to think. Why older books- because I am playing devils advocate and many of the books provided for the sessions I am imagining are older books. I don't work a lot in the Triviapedia field- popstars and soap operas don't enter my wikiworld. ISBNs (10 digit) have existed since 1970. There are a lot of non-Trivipedia books that have been published since 1970. And I repeat: the ISBN is not mandatory, it's just a way to avoid typing lots of other information. True true and true- but lets remember the others

Your point about multiple authors is a good one; for the cite template, there probably should be a pull-down menu to specify how many authors there are, and the parameters should change accordingly. However, this isn't trivial to program, particularly since it could easily vary across different language Wikipedias. Better yet would be to have the ISBN lookup understand how to handle a book with multiple authors, and to do an autofill accordingly. Cheers.

Regarding initials versus "First name", my comments (above) recommend that TemplateData descriptions be displayed below all parameters (in the mockups, they show only for some parameters). The description for first name can say (for all I know, actually does) how to handle initials. So this isn't something to code into the template. Not the citation, but in the data entry template it would be helpful to say what to do, or leave it as an alternative box. I am still thinking of my Local History Society session- and the questions they will ask. We seem to be talking past each other. Every field in which data can be entered, in the template, should be accompanied by its TemplateData description, just below. That description should "say what to do". Perfect

Eventually the reference dialog should handle both plain references and two-step references (Chicago and Harvard style; "References" only versus both "Notes" and "References" sections), but initially the dialog should handle the most common case, which is plain references (one step). We need to walk before we try to run. Absolutely, from a management point of view, but from a teaching point of view "Notes" and "References" is far more useful. sfn and efn are a god send. If we have someone writing about eighteen century history, it is unlike they will have more than one source book from which they will want to put four or so references into the text they have written. Seriously, do we want them to write the same 13 digit number 4 times, before they can add the page number. Can we take a different approach and provide a Short reference option- to give the sfn template. On Save/Apply- the server identifys whether this reference (on one very close) is in the Bibliography section. If yes, it saves if not, it falls back to the cite book template, autofilling a few fields- and offering the isbn box.. etc On Save/Apply they will obviously be a little housekeeping done to set up the necessary text. It will then be trivial to allow efns and Footnote facilities. No, they don't need to enter the same 13 digit number 4 times. The first screen of the Reference dialog is where users are given the opportunity to reuse an existing citation. What we should do is, when a user reuses an existing reference, is to allow him/her to specify the page number in a separate field. Good- ideally this template should suit, the referencer volunteer, who is using a one notable book to reference un-cited text in a string of similar articles

Regarding 13-digit ISBNs versus 10-digit ISBNs, the description (text) under the ISBN field says to use 13-digit ISBNs "where possible". I don't know if the autofill tool works with 10-digit ISBNs (or how frequently), but again that's wording that can be tweaked in the TemplateData section of a template, to strike the right balance regarding how much we want people to look for a 13-digit ISBN (say, via an Amazon book lookup.) A little post processing to remove the 10 digit code would probably fix it.

As for editing an existing reference, the starting process is different (select the reference, then click the Reference icon, per the User guide. If the reference was created "manually", it can then be edited directly; if it was created by a template, clicking on the text of the reference opens the Template dialog. I don't see that this approach needs to change; it seems consistent with the proposed redesign of the dialog for creating a new reference. Fine, I was concerned that one of the class would want to make a correction. There is always the problem of someone citing the first edition, while taking page numbers from the second.

I hope that helps.--ClemRutter (talk) 22:56, 22 September 2013 (UTC)

I've added further comments with underlining, above. John Broughton (talk) 03:08, 24 September 2013 (UTC)

Much appreciated- and few responses. --ClemRutter (talk) 23:00, 28 September 2013 (UTC)

References

A couple of comments

• Making adding refs easy is key. I really like this tool as it figures out if the number I have entered is a PMID or ISBN automatically [1]
• When an ISBN is added we need to encourage people to add a page number. Jmh649 (talk) 11:29, 27 September 2013 (UTC)

Nested templates

This design iteration does not allow for templates within templates.

If you don't support the inclusion of templates within templates, then you cannot add a {{Dead link }} template inside the reference to mark a dead URL, like this:

<ref>{{cite web |title=My Home Page |url=www.example.com/deleted{{deadlink}} |date=2001}}</ref>

Does it support adding the template after the citation template? That wouldn't be perfect, but it might be good enough.

What's going to happen if someone tries to edit a template that contains a deadlink template? Whatamidoing (WMF) (talk) 17:39, 30 September 2013 (UTC)

The transclusion dialog supports (only) wikitext for the parameters of a template, so if you were adding the "Cite web" template, you'd just type in www.example.com/deleted{{deadlink}} from your example and it would work as expected (but it's not at all discoverable and is a bad user experience). Jdforrester (WMF) (talk) 01:54, 1 October 2013 (UTC)

Reference icon

The goal for the reference icon is something that anybody (in any language or culture) can look at and think "Here's how to put a reference on the page!"

The book/bookmark icon does not seem to be ideal in this regard. One suggestion has been to use the little blue numbers: as part of an icon, although we'd probably want it in black and white to avoid the fruit salad effect, and it would need to be adapted for different languages.

Does anyone have any other suggestions? Whatamidoing (WMF) (talk) 18:19, 30 September 2013 (UTC)

(You might want to see the discussion at en:Wikipedia:VisualEditor/Feedback/Toolbar#Icon for Reference if you're interested in this subject and haven't seen it before.) Whatamidoing (WMF) (talk) 18:35, 30 September 2013 (UTC)

Autofill

Is the ISBN autofill going to be a backend service hosted by Wikimedia Foundation? Will autofill also support journal DOIs? John Vandenberg (talk) 05:50, 2 October 2013 (UTC)

Yes. We need to investigate where we can get the data from, though.

That's the plan.

Jdforrester (WMF) (talk) 18:39, 2 October 2013 (UTC)

That's great news! ISBN autofill will be very cool. --Vojtech.dostal (talk) 20:27, 2 October 2013 (UTC)

WorldCat or OpenLibrary should be usable, though both have some issues with non-unique records for ISBNs. LeadSongDog (talk) 22:14, 31 October 2013 (UTC)

French Wikipedia references namespace

Does the WMF intend to support the French Wikipedia's dedicated references namespace 'w:fr:Aide:Espace référence'? e.g. w:fr:Spécial:Pages_liées/Référence:The_Disney_Middle_Ages_(Tison_Pugh_and_Susan_Aronstein). John Vandenberg (talk) 23:29, 2 October 2013 (UTC)

Wiktionary has a similar "Citations:" namespace, so it is not unique to fr.wp. I would be really surprised if they refused to support it, but I haven't heard anything about it (which probably means that it's not on the list for the next month or two). Have you filed a bug report on it yet? Whatamidoing (WMF) (talk) 16:06, 8 October 2013 (UTC)

My observation from trainings

Hi. I would decrease number of steps to max 2. If you cannot, please use Step 1/4, 2/4,... so that user knows, how much of all steps is it there. But if UI is flexible enough, I would go to only 2 steps:

1. Selecting reference source
2. immediately after selecting source, screen changes (without next) to table: Parameter / Entry or dropdown field.

Wizard is good fo non-repeating task. But citing references is regular task and moving furth and back through wizard can be much time consuming and confusing.

Also, auto fill should be combined with dropdown, since some users surely don't know what to start typing and prefer drop-downs.

Again, I am not programmer and I don't know how UI technology is limited or not. Brg --ModriDirkac (talk) 09:11, 11 October 2013 (UTC)

not completely on topic - but

I just wanted to remind the developers that some of us still prefer to format citations and references the old fashioned way: by manually formatting with

• "<ref> xxxx citation text xxxx </ref>".

I often need to create somewhat complex citations, and find that these don't work when you use Visual Editor or other citation templates. I don't object to VE as a concept... but please make sure that not using it remains an option. Blueboar (talk) 18:57, 17 October 2013 (UTC)

@Blueboar: What do you mean by "these don't work when you use Visual Editor"? Right now VisualEditor is completely built around inserting full references (rather than a simplified interface just for a few citation templates, which this discussion is about), and lets you insert anything you like into the reference. Is this not working for you somehow? Jdforrester (WMF) (talk) 19:12, 17 October 2013 (UTC)

Actually, my issue is more with citation templates in general than it is with VE specifically. I have found that on several occasions the various fields and prompts I was presented with in a template didn't actually fit what I was trying to cite. It was easier and much quicker for me just to create it manually, without having figure out how to manipulate the template into giving me the presentation I wanted. I want to make sure that the option to do things the old way remains available to us. Blueboar (talk) 01:28, 18 October 2013 (UTC)

@Blueboar: Oh, completely agreed that the templates aren't right for all uses and we should always ensure that people can write general content (rather than just a few templates) in references if they want to, easily and quickly, without adding confusion to users who won't know what to do if just presented with an empty editor box. If you look at the wireframes for iteration 2 of the design proposal (e.g. here), the "advanced dialog" would be a full empty editor in which you can put anything you like except sub-references - text, arbitrary templates, images, lists, tables, whatever is needed). We've also considered adding some quicker ways to get there than triggering a wizard and clicking advanced, possibly with a sub-menu in the reference insertion button - hopefully we can get a prototype thrown together pretty quickly to show off some possibilities soon. Jdforrester (WMF) (talk) 01:44, 18 October 2013 (UTC)

Because of a post from WhatamIdoing on WT:V on en.wiki, I just wanted to agree with Blueboar that it's very important to make sure the Visual Editor doesn't break the text interface in this or any other respect.S Marshall (talk) 23:52, 17 October 2013 (UTC)

@S Marshall: When you say "break the text interface", do you mean the wikitext editor? We've no plans to put any of the VisualEditor tools into the wikitext editor yet (though it might be worthwhile to explore doing something in this area at some point). If you meant something else, please explain! Jdforrester (WMF) (talk) 00:02, 18 October 2013 (UTC)

Design iteration 2

When was iteration 2 created? I'd like to know what comments posted to this page refer to the previous iterations, and which ones are answers to Design 2. Diego Moya (talk) 19:23, 17 October 2013 (UTC)

@Diego Moya: : 2 October. Jdforrester (WMF) (talk) 19:59, 17 October 2013 (UTC)

Some feedback

I've been informally polling some of the content editors on English about what they'd like to see supported by the VE Ref Dialog. Some interesting points to consider:

• Prompt for Reflist template: A good portion of our articles (and all our new articles) don't have the Reflist template in place. Currently, if you add ref tags in the wikitext editor when Reflist isn't there, you get that lovely red text at the bottom of the page. Having VE search for Reflist, and, if not found, prompting the editor to add it, would be a nice addition, and very helpful to new editors.
• Support for "Footnote" style cite templates. The Harv and Sfn cite templates are popular in our Good and Featured Articles. They also provide the only practical and accurate way to cite multiple pages/page ranges within the same work for multiple citations. These templates will probably also need a pop-up prompt to remind editors, and educate new editors, that they need a complementary citation template to be in place in the references section for the note to work properly. While I agree with John above that this is advanced citation skillz here, and that we should focus on simple refs first, I think it's a good idea to have note-style refs in mind when designing. Newer editors will look to our best content to see what to emulate, and many will want the notes functionality. (A new editor coming from an academic background especially will be wanting to make these type of cites)
• Have two sets of parameters for common cite templates, the "recommended" elements, and the full list. Salix alba mentions this above, templates like "Cite journal" have dozens of possible fields - seeing them all at once would scare off the rookie editor, as well as slow down the veteran. I think that's how we have it in the mockup right now - the book example has only the commonly used elements (though it should probably should include "page number" in there too.) I think Iteration number 2 handles this nicely.

Anyways, just a few points - Design Iteration 2 looks great! PEarley (WMF) (talk) 20:15, 20 October 2013 (UTC)

I don't think that you'd want to search for the reflist template, because that's not used everywhere (and where it is used, the template name often changes). But if you could find out whether the <references /> code was either present or transcluded, then that would be excellent. Whatamidoing (WMF) (talk) 19:20, 21 October 2013 (UTC)

Good point on reflist, I had forgotten about <references />. PEarley (WMF) (talk) 19:37, 21 October 2013 (UTC)

I think a prompt for <references /> will be fine, since it will only appear if there are no references yet - so the (limited) number of new references will probably not urgently need a reflist style. --Atlasowa (talk) 13:22, 22 October 2013 (UTC)

(Edit conflict) Good feedback, but a few caveats:

• Prompt for Reflist template German Wikipedia doesn't use the Reflist template (it was deleted de:Wikipedia:Löschkandidaten/26._Mai_2010#Vorlage:Reflist_.28gel.C3.B6scht.29), but <references/>, so this wouldn't be a welcome addition.
• Support for "Footnote" style cite Template:Harv and Template:Sfn Those are not used on German WP, so this wouldn't be a welcome addition.
• Have two sets of parameters for common cite templates - Good idea, "simple" and "extended" or "expert". Agree with the page number .

BTW, German WP does not even use the en:Wikipedia:refToolbar 2.0, so this Reference tool would be a huge step! --Atlasowa (talk) 19:26, 21 October 2013 (UTC)

Yeah, most of this is pretty English-centric :) I'm not sure how practical it would be to disable certain templates for different languages, James will have to weigh in on that. How do you folks survive without the RefToolbar? It's one of my favourite tools. PEarley (WMF) (talk) 19:37, 21 October 2013 (UTC)

I don't know how we survive without the RefToolbar, but I'm probably the wrong person to ask because I have advocated repeatedly ([2][3]) for activating RefToolbar on deWP ;-) I think there are basically 2 reasons, 1) users don't miss it because they don't know it and have found ways to cope, 2) the cite templates of RefToolbar bloat the source text (think of 1 sentence with 3 citations -> huge clutter). BTW, a german Wikipedian looked at references in July 2013 in a sample of 1000 random articles ([4][5]). He found a total of 2162 refs (average: 2,162 per article), 56,4 % had no refs at all, and 64,46 % of all refs were in just 10% of articles. I suspect in enWP it may be a little more, but comparable. A 2011/2012 study of enWP ((Citation needed)): The dynamics of referencing in Wikipedia found that of 11.000 en-articles (with more than 240 revisions) only 5.400 had any refs, so on enWP around half had no refs too. And the dynamics seems to be that refs lead to more refs. (But keep in mind that "unreferenced" articles may have sources given in the literature section, or in the weblinks section or in the edit comments!)

Anyway, a good, intuitive and fast reference dialog will be a big advantage of VE! --Atlasowa (talk) 13:22, 22 October 2013 (UTC)

PS: Don't forget this bug about refs and VE.

I have been pulled back into the debate by the Wikipedia Libraries newsletter and as far as I am concerned cite templates calling templates are useful when sorting out the bibliography, the real work for adding citations (wikignoming) or new articles is the {{sfn}} and his brother {{efn}}. ( I even dream of having a {{qfn|free text}} where I can write down a free text incomplete reference- that will provide a Hidden category- References that need completion. ) I don't see the logic of the fingers having to leave the keyboard- locating text input boxes and twiddling around, it breaks the work flow.

Simply-ve must recognise sfn- and check the existance of the bibliography. ref, and failing to find it stack the problem, and on save, harangue the editor to choose an existing one, or create one using a cite template as described above. efns would automatically create the notelist structure on exit to save and get the editor to confirm that this was what they wanted. Neither should interrupt the editing flow or cause the fingers to leave the keyboard during an edit. Wann es klappt könnten wir das de:wikipedia als Geschenk geben.--ClemRutter (talk) 23:07, 27 October 2013 (UTC)

Äh, danke User:ClemRutter ;-) But I'm afraid that german Wikipedians would rather lecture you about the superiority of de:Vorlage:Literatur, which tries to accomodate every possible rule about academic citations (and that i consider borderline unusable as a result). Keep in mind that in the last years several high-ranking german politicians (including our minister of defense and minister of research and education!) lost their job, their reputation and their academic titles because of plagiarism affairs? "I was using Harvard style citations" has got a terrible ring... :-P --Atlasowa (talk) 17:39, 19 November 2013 (UTC) PS: How about all the french, russian, ... citation templates too?

Unclear context with respect to end notes vs. bibliographies

The overall structure of VisualEditor/Design/Reference Dialog does not make it clear whether this dialog automatically includes the <ref> and </ref> tags (in which case the dialog can only be used to edit end notes) or if it can omit them and thus be used to edit bibliography sections such as one can see at en:Coordinated Universal Time. Jc3s5h (talk) 17:45, 22 October 2013 (UTC)

Yes. It is one thing to stuff bibliographic details into a template, thereby creating a full reference. It's quite a different question as to where that reference (citation) should go: in the text? in an "in-line" note (in <ref> .. </ref> tags)? Or in some other section? ~ J. Johnson (talk) 23:33, 4 November 2013 (UTC)

That's an excellent point, Jc3s5h. I believe that they focused on producing "little blue numbers in brackets" at the moment, but there are a lot of ==Further reading== sections, ==Publications== sections, and similar lists out there that would benefit from simple updates (e.g., listing all the important books written by the subject of the article). Whatamidoing (WMF) (talk) 19:50, 6 November 2013 (UTC)

This is a limitation to the wiki-text reference creator as well - it only creates references, not stand-alone bibliographies. But in wiki-text it's very easy to just delete the <ref> </ref> tags, while in VE - I don't know how to do this in VE.--3family6 (talk) 15:23, 20 February 2014 (UTC)

Named references

Nice work here: I think this fills one of the biggest gaps in VE. Would like to see a way to explicitly name a reference, as is currently provided on RefToolbar. The reason: there should be an easy way for references created in VE to be accessed through the source editor. Which means giving the reference a meaningful name, not just the default :0, :1... scheme. Barte1 (talk) 19:42, 27 October 2013 (UTC)

As a side note, in case anyone's interested: the :0 scheme was chosen because (1) those buttons are available on almost every computer keyboard, not just the English/Latin script ones, and (2) it was extremely unlikely that it would conflict with any ref naming scheme chosen by a human. I would also like to see meaningful names given. Whatamidoing (WMF) (talk) 19:55, 6 November 2013 (UTC)

Modifying existing references

A user on English language Wikipedia who has been doing a lot of testing notes that correcting existing references may be an impenetrable process for new editors. Expecting to find the reference text in the reference section, they will find only the references template, and they will not see the text visibly displayed anywhere higher in the article. If they use "edit source", even if they are surprised by what they find under "references" they have the potential to find the text higher in the article. Unsure if there's anything that can be done to make this easier in future editions, but it's a fair point and so bringing it up. :) --Mdennis (WMF) (talk) 13:55, 5 November 2013 (UTC)

Prompt for <references /> if not available? Even better: en:Help:List-defined references

If someone adds a first reference, there is no <references /> yet, so this should be prompted because otherwise the article is broken. OK. But why not prompt to List-defined references with named references (see de:Hilfe:Einzelnachweise#Inhalt_der_Einzelnachweise_am_Ende_des_Artikels)?

The Sun is pretty big.<ref name=Foot01/> But the Moon<ref name=Foot02/> is not so big.<ref name=Foot03/> The Sun is also quite hot.<ref name=Foot04/>
==Notes==
<references>
<ref name=Foot01>Miller, ''The Sun'', Oxford, 2005, p. 23.</ref>
<ref name=Foot02>Jones, ''The Solar System'', MacMillan, 2005, p 623.</ref>
<ref name=Foot03>Brown, ''The Moon'', 2006, Penguin, p. 46.</ref>
<ref name=Foot04>Smith, ''The Universe'', Random House, 2005, p. 334.</ref>
</references>

which produces:

The Sun is pretty big. But the Moon is not so big. The Sun is also quite hot.

Notes

The cite-templates are pretty huge and it irks experienced editors when VE-user make the wikitext unreadable. What do you think? --Atlasowa (talk) 18:10, 19 November 2013 (UTC)

Bug 50110 - VisualEditor: Provide way for local wikis to auto-prompt reference templates seems related. --Atlasowa (talk) 11:54, 4 January 2014 (UTC)

Do you work on this?

Hello, I was promised the reference dialog on VE to be deployed in December 2013. Nothing has changed until now, is anyone at least working on this? It is very irresponsible to those who devote their time eg. to working with students, it is impossible to teach them VE if you don't follow the schedule :-(. This literally makes me very unhappy. --Vojtech.dostal (talk) 20:52, 16 February 2014 (UTC)

Hello Vojtech. Very sorry I didn't update you about the Reference dialog progress. We are hoping to have a working version very soon. It has proven more difficult than we expected, but we are close. I will make sure to notify you (and the rest of the Czech editors) when we have a released version. PEarley (WMF) (talk) 00:57, 18 February 2014 (UTC)

VisualEditor.toolbar-fi

VisualEditor insert menu 16 February 2014

What exactly is the status and the roadmap for the VE Reference dialog? VE Reference dialog is unchanged on VE on enWP (beta opt-in only) and VE on test2wiki and VE on frWP (live default for IPs). BTW, apparently the spanish WP has just cut off VE default for IPs on february 13?

I see very promising new VE Reference dialog mockups:

VE add reference

VE add reference: pasting the URL

VE add reference: edit ref details

I love the URL autofill! And ISBN autofill! And googlebooks autofill! (See also en:Wikipedia:VisualEditor/Feedback/Archive_2014_1#The_new_reference_dialogue with some stats about references.) It's gonna be great!

Wikipedians use a lot of tools to insert references, the VE team doesn't need to reinvent the wheel, but to build on earlier experiences with UI design too. Please don't say that you will notify Wikipedia editors only "when you have a released version".

Where can i test this? --Atlasowa (talk) 12:32, 19 February 2014 (UTC)

Hi Atlasowa,

We can't test it until they have some more-or-less working code. (I want PMID autofill.) The critically important ISBN autofill, in particular, seems to be complicated by the diversity of databases, some of which seem to only cover certain country's or language's books. Right now, I can't get a useful estimate from them about we'll actually see it ("not very soon" and "it depends" don't count). Whatamidoing (WMF) (talk) 18:05, 19 February 2014 (UTC)

• ISBN2Wiki (Magnus Manske) "You can enter an ISBN ... This script currently searches the following databases : Google books, DDB, Amazon, Biblio, Campusi, Library of Congress, WorldCat (deactivated : BOL, Buchkatalog, Froogle, ISBNDB)
• Wikipedia template filling (Diberri?) "Enter a DrugBank ID, HGNC ID, ISBN, PubMed ID, PubMed Central ID, PubChem ID, or URL and press submit to fill out an appropriate template that can be pasted into a Wikipedia article"
• Citation template generator (user:holek)"This is a citation template generator. Using it, you can quickly fill in the citation templates in various language editions of Wikipedia. Please fill in the data (ISBN, PMID, WWW) in the fields below, and the script will try to complete the templates. Parsers for ISBN: ISBNdb.com, LoC, DNB, NUKAT"

HTH. --Atlasowa (talk) 18:36, 19 February 2014 (UTC)

Thanks. The second is indeed Diberri, and it's not working for ISBNs any longer (at least not for me/in Firefox 26). It works for PMIDs. Whatamidoing (WMF) (talk) 19:47, 19 February 2014 (UTC)

Atlasowa, if we can't get a firm estimate, I will at least talk to the development team at our next meeting about how they want to organise the testing/deployment for this tool. I should have said above "when we have a testable version .." PEarley (WMF) (talk) 04:01, 20 February 2014 (UTC)

Thank you, that sounds good! :-) --Atlasowa (talk) 16:46, 20 February 2014 (UTC)

Thank you for update. I secretly hope that it really will be a matter of weeks.--Vojtech.dostal (talk) 14:16, 24 February 2014 (UTC)

Copy-paste then edit references

In wiki-text, in order to create a new reference I often copy-paste an existing reference and then edit the content - this saves a lot of time instead of using the template generator every time. Is there a way this could be implemented into VE?--3family6 (talk) 15:26, 20 February 2014 (UTC)

I know that they're talking about this, so we may get a better solution. However, for right now, here's what worked for me: Select the old reference and open the reference dialog (click the little book icon). Select and copy the contents of that ref. Close the ref dialog. Go to the new place, and Insert>Reference to make a new one. Paste the old ref's contents into it. Then edit it to make a new one (I just changed the date in my example). Whatamidoing (WMF) (talk) 20:10, 21 February 2014 (UTC)

PMID

The interface is currently jury-rigged to automatically link things like PMID 55555 simply by typing them in. These go directly to one single site, NCBI, which has a decent set of APIs for accessing the major fields of scientific papers. I'd like people to simply be able to type PMID NNNNN and have it be automatically expanded to a full citation, at least in the new VisualEditor edits (though a case can be made for having a bot do it universally). Incidentally, I don't know why there isn't such a bot already. Wnt (talk) 02:19, 21 March 2014 (UTC)

If you've already got a ref typed out manually that just happens to include the PMID link, then you wouldn't want to end up with a duplicate. That task might be better suited to a semi-automated script than to a bot.

They are supposed to start work on autofilling for the new citation dialog soon. I hope that autofilling PMIDs will be on the list. (URLs, ISBNs, and DOIs have already been confirmed by James F.) Whatamidoing (WMF) (talk) 21:59, 25 March 2014 (UTC)

Proposal

1.- As I can see, according to images of Dialog design, is necessary that developers understand how to work citation. You should review this: http://en.wikipedia.org/wiki/Citation. That, because most of styles of citation requires about five fields, but this can change according to the kind or source that is being quoted. Current images show a cheap numbers of fields, and ISBN is not the prioritary field.

2.- You should enable to Wikis' administrators to determine the style of citation and fields provided by the Reference Dialog. This because each Wiki can determine its own standars.

3.- I understand that programming is harder than drawing but, I suggest a reference dialog like the image below.

Reference dialog must allow to recover a source already used and to insert a new source. I suggest dialog with two tabs. The first one could be a new reference dialog with fields to fill and second a tab with the list of sources already quoted. You must be able to select many sources in each reference due is common to use more than one source in a citation. Actually you could add a new reference and use a quoted source in the same step, mantaining the selection of a source quoted in the tab, and adding a new source.

References may be listed in alphabetical order and just as the foodnote format because different sources as books, blogs, films have different fields and is not possible to show it coherently in a list of rows and columns. But you can allow change some information that could change in a citation of the same source. I think in the number of page and date of retrieve. That implies to manage each reference and each source in different way.

If you can edit a reference already used, you could open a dialog that allow you to edit each field given.--SirWalter (talk) 05:43, 26 March 2014 (UTC)

Duplication instead of coordination of efforts?

VE CiteGadgetDialog. duplication?

Uh.

Looking at meta:Grants:IEG/Visual_editor-_gadgets_compatibility, this could be really useful for cooperation. How many wikipedia projects do not support citation1 templates, at all? I suspect none or very few (German WP does support all). So supporting citation1 by default might be a good idea. In the WMF Metrics Meeting, April 3, 2014 James seemed to say that all used ref templates needed to be added by each projects admins in JSON...? --Atlasowa (talk) 21:44, 6 April 2014 (UTC)

James Forrester at WMF meta:Metrics and activities meetings/2014-04-03. (~10 minutes)

What you're looking at is a community-led project to patch some popular gadgets that are in use at some mid-size and larger projects.

James F was talking about what the devs are doing, which will be available to everyone. However, to be usefully available, an admin at each project will have to decide which specific templates to include in the list (if the answer is "none", then the feature silently vanishes), and someone will have to define TemplateData for the chosen templates (if that hasn't been done already). Whatamidoing (WMF) (talk) 21:42, 7 April 2014 (UTC)

What I'm trying to say: I just hope that the VE ref tool, including autofill functionality, will be available to small Wikipedias too, even if they don't have a super talented, active admin with the appropriate programming skills. ;-) --Atlasowa (talk) 14:46, 9 April 2014 (UTC)

@Atlasowa: Definitely. We'll be happy to help communities get started with it, and we'll also have documentation here so that communities can fix things for themselves without needing us directly in most cases. Jdforrester (WMF) (talk) 17:44, 9 April 2014 (UTC)

Feedback on current release

hey folks -- I have not read this page, and am only commenting quickly because I got a notification on my talkpage that you were looking for feedback on the cite tool. So, quickly: I had the chance the other day to teach a new Wikipedian how to edit, in which I didn't try to guide her, but just watched and helped trouble-shoot when she needed it -- so, it was kind of like a mini user-test. Two points I'd make about what happened:

1) She found the editing experience overall using VE extremely user-friendly and easy, including the cite tool. The parts that were challenging for her were all social expectations / editorial policy (like "is it okay to do X" or "how would people normally phrase something like this"), not technical. That's awesome and made me really happy. It was a big change from new editors I've worked with in the past using syntax: typically people found the syntax to be the biggest hurdle, and never got far enough to have any social/editorial questions.

2) The one point where she got stuck was, in the reference dialogue, she didn't know what to put in the field labelled Work, and, she did not see the info roll-over. Because she wasn't sure what to do, she froze and almost bailed from the dialogue. It was not clear to her that the field is optional, although IMO you've followed best practices there: there is no "required" asterisk. So, I'd suggest you might want to think about changing the label from Work to something a little more self-explanatory such as Source Name. Or, maybe you will have a better idea for a fix :)

Thanks & congratulations :) Sue Gardner (talk) 00:25, 29 May 2014 (UTC)

Thanks Sue.

Good to hear about the new editor feeling welcome. Maybe we should think in longer time about using the opportunity to hint what is and is not appropriate in content terms somehow inside the editor, to answer questions like "is it okay to do X"?

The label "Work" is written by the community (in this case, those on the English Wikipedia), so we'll take this suggestion there.

Perhaps the description (currently available from the info roll-over) should be more visible – if it was shown all the time alongside the label, do you think this would have helped?

Jdforrester (WMF) (talk) 01:48, 29 May 2014 (UTC)

Looks good so far - an overview

The ability to do references in VE is a major step forward. Count me among those editors who abandoned VE, but have turned it back on. However, having said that, I am looking forward to the autofill options (because the current iteration is not yet as functional as my external tools).

One of the more discouraging actions is telling a new editor they need to work on references, and cringing that it will not be easy. I usually direct them to Referencing for beginners. (As an important aside, I see that the page has a section on VE, but it refers to an older version. Is there a more up to date discussion which could be dropped in there?)

The editing experienced will be vastly improved for new editors, as well as experienced editors, when three tasks are completed:

1. Ability to insert a reference using VE
2. Ability to autogenerate a reference from a digital identifier such as ISBN, doi, PMID or from a Google books url
3. Widespread implement of digital identifiers for sources such as newspaper and magazine articles

The good news, from the point of view of the development team, is that step 1 is largely complete, and step 3 is not your job. That's a task I want to take on, hopefully with assistance from others.

Imagine how easy referencing will be if you can identify a source, such as a New York Times article, copy and paste a digital identifier, and a fully formed reference is generated.

I have some specific observations on what I believe is the current iteration VE Reference V4. I'll post my comments in the subsequent section.--Sphilbrick (talk) 13:32, 21 June 2014 (UTC)

Hi Sphilbrick, and thanks for all of your comments here.

There's up-to-date information at Help:VisualEditor/User guide#Editing references. A link would be easy, but it's really long, and I'm not sure that it would be easy to pick out which pieces were most important. The video was created by commons:User:GorillaWarfare almost a year ago; you could ask her if you thought it would be good to produce an up-to-date one. (NB that the appearance of all the dialog boxes will be changing in about a month.)

If you're interested in autogenerating for news sources, then you might want to look at w:en:User:Ark25/RefScript, which seems to cover a dozen English-language newspapers or websites (put in the URL, get the citation back) and, in another version, 30+ Romanian ones. Whatamidoing (WMF) (talk) 18:27, 30 June 2014 (UTC)

Comments on VE Reference V4.pdf

• General—the page doesn't say, but the implication is that a data base of ISBNs and the associated values exists. I am unclear whether they come from an external source, or wikidata
• Page 4 I trust developers are aware that a canonical ISBN has four fields, separated by hyphens, so will allow editors to copy in an ISBN which may include no hyphen, a single hyphen after the first field or any hyphens in any location. I'll also guess that some places will accidentally use another character, whether a minus sign, an en-dash and possibly others. It would be nice if all options could be parsed
• Page 6,7 The ISBN identifies the name of the publisher and the location, so I am not understanding why these fields are presented. They should be auto-filled
• Page 8 The year of Publication should also be auto-filled
• Page 8 The page number cannot be auto-filled, but is so important, it should not be optionally presented, it should always be presented, although it should be allowed to leave it blank.
• General I do not see any discussion of named references. I think I saw somewhere that there will be a numbering convention, but if I want to reuse an existing reference, I do not see how.
• Page 9 This screen implies there are only two cases: Case 0—the IBSN is in the database and Case 1—the ISBN is invalid. At a minimum, I am fairly certain there can be valid ISBNs not in the database (those issued very recently). I think there are other cases as well, I will try to follow up with a list.--Sphilbrick (talk) 13:36, 21 June 2014 (UTC)

• There are multiple databases of ISBNs.
• What gets presented (e.g., page numbers) depends entirely on the Help:TemplateData for the template.
• Re-using references happens through Insert>References. They are automatically named if necessary, or re-use any pre-existing name. Whatamidoing (WMF) (talk) 18:31, 30 June 2014 (UTC)

Thanks for the comment about the existence f multiple database of ISBNs. That's a whole messy dimension I hadn't appreciated. A minor issue if they are identical in content, but that's unlikely. I'll let someone else sort that out.

I'm not fully following the TemplateData point, but it is possible I do not need to. I hope it means it is configurable by users, so, if for example, the first version doesn't have a page number field, we can add it easily. However, I am not sure if this was intended to respond to my question about page 6 and 7, or some other point. Let me see if I can make my point a different way:

In the sixth slide of the demo, a user enters an ISBN, and some filled are automatically filled out. On the next slide, the user is presented with some additional fields to fill out, such as Publisher name and location. Both of these fields should be auto-filled, so I do not know whether the develop simply did not realize this, and will implement it differently than shown, or plans not to extract those fields and insist that the user do so. Is there a more recent version to check this, or is there a way to run this by the developer? It will be quite a disappointment if the available fields are not used. I hope this is a non-issue, but as I spend my other life in software development, I've been told a number of times "I wish we knew that earlier" so I'd like to understand where we are on this step. I see from the Roadmap that autofill is in progress.--Sphilbrick (talk) 18:26, 9 August 2014 (UTC)

The pictures are not exact. The goal is to have everything filled in that's possible to fill in, and to have "possible" defined in a configurable, expandable system (so that if a newspaper starts putting its author name in a different place on the page or with a different label on it, then that can be fixed ASAP). Whatamidoing (WMF) (talk) 01:34, 11 August 2014 (UTC)

ISBN cases

Following up on a point made in the prior section, I think there are several cases relating to the status of an ISBN. While it may be that multiple cases generate the same response, it may be useful to consider the cases.

I am not yet clear on where the information on ISBN is housed, but wherever it is, I resume there must be some lag. If a publisher with a group of ISBNs decides to publish a book, it seems plausible they might refer to the ISBN, if only in a press release, on some date prior to the information being added to the data base.

That case is different than someone typing in an invalid ISBN. While most people will copy and paste, someone might type (and mistype) or the original source might have made a mistake. The check digit helps identify those errors. At a minimum, I would like to see two different messages:

1. The ISBN you supplied is not in the data base
2. The ISBN you supplied is not a valid ISBN

The reason for the difference is that in case two, the editor ought to double-check the value, as it is certainly wrong. The editor might choose to manually fill out the other fields, but should NOT leave that ISBN in the field. It is wrong However, in case one, while the editor should double-check, it is possible the value is correct, in which case the entry should remain, and the editor should manually fill out the rest of the fields. I want to ensure that the advice given to the editor is different.

Here's an example:

1. 9781234567890 is not a valid ISBN—it fails the checkdigit (Special:BookSources already knows how to calculate this). This could be flagged to the editor, but I'm not sure that we want to auto-remove it.
2. 9781234567897 is a valid ISBN—sort of. The problem is that there are a remarkable number of books with this made-up ISBN.

There are also issues with foreign languages, typos, formatting that isn't what we want to use (e.g., should it be "Candy: A Century of Panic and Pleasure" or "Candy : A Century of Panic and Pleasure" or "Candy: A century of panic and pleasure"?). It is important that editors be able to change what's autogenerated, and I understand that this is already the plan. Whatamidoing (WMF) (talk) 18:44, 30 June 2014 (UTC)

Advanced issues

There are a few non-unique ISBNs. My guess is that we do not have any way of knowing about these in advance, but an editor will notice if they enter an ISBN and it auto fills the wrong information. ASt a minimum, the editor should be allowed to override the fields, I trust this already works. As an advanced option, there might be a check box to fire off a notice to the owner of the database, so that some action can be taken. A really advanced option would present the editor with both options and the ability to choose. I think there are more important things to work on so, given the rarity of the situation, would put this low on the list. See this site for some discussion of non-unique ISBNs.--Sphilbrick (talk) 14:02, 21 June 2014 (UTC)

• There are other practical issues concerned with the use of ISBNs or other identifiers. Granted it would be nice to quote an ISBN, or a Mathematical Reviews or Zentralblatt MATH identifier or whatever and have the bibliographic data filled in automatically. But that data has to come from somewhere. Do we have any reason to believe that the owners of those databases are going to allow the unlimited free automated access needed to support this aspiration, and do so for a long time? After all, the compilation of those databases costs money and the data owners are going to look to recoup those costs by charges, especially to an enterprise such as Wikipedia which although not commercial in itself may be freely exploited for commercial purposes. Let's not spend a lot of scarce time and effort on this sort of — admittedly highly agreeable — feature, unless we are sure that it is sustainable in the long term. Deltahedron (talk) 15:58, 28 June 2014 (UTC)
  • Some of them have been doing it for several years already, so I don't think that's very likely to be a serious problem. I don't know what their funding model is, but if you ask your favorite search engine about isbn database api free I think you'll see why this isn't worrying me (but that the problem of an endless proliferation of ISBN databases, each of which has slightly different data, is worrying me). Whatamidoing (WMF) (talk) 18:44, 30 June 2014 (UTC)

Oh please. That search yields over half a million hits on Google, and I'm obviously not going to read all of them, and I don't suppose that you have either. If there are useful links in there, please have the courtesy to list them. Many services are provided free initially, to buld the market, before the charges kick in. Are you guessing, or just hoping, that someone somewhere will continue to provide for free this valuable data? Have you actually considered the sustainability question? (I note that you admit that you don't know what the funding model is for any of the providers, which suggest that the answer might well be no.) If you have then please be so kind as to let us have, or point to, a summary of your answer to my question above, preferably with a summary of the evidence and the reasoning behind it. Airily waving in the the general direction of Google is not, frankly, a satisfactory answer to a serious question. Deltahedron (talk) 20:16, 30 June 2014 (UTC)

@Deltahedron: Because you are clearly of the opinion that a minute's reading comprehension is beneath you, the answer is "yes". Jdforrester (WMF) (talk) 21:39, 30 June 2014 (UTC)

I note your answer and I shall comment on the tone elsewhere. I am glad to hear that the sustainability question has ben considered. Deltahedron (talk) 06:09, 1 July 2014 (UTC)

@Deltahedron: It wasn't necessary to figure out which link to read, the point is that the database owner has a free API, which means not only do they accept that there will be a lot of data calls, they are trying hard to make it easy. The large number of hits means this isn't some obscure point, but well known in that community. If you will still like to see a specific one, try [this], which states "Of interest to developers is the fact that there is a complete (and free) REST API." --Sphilbrick (talk) 17:50, 9 August 2014 (UTC)

That is an answer to the question I was asking, thanks you for that. I find it regrettable that one member of staff who presumably knew that answer chose to bury it in a list of half a million other links, and that another member of staff chose to be personally insulting rather than give any kind of details, useful or not. Presumably I was not the first person to raise the question, and it will have been adressed in some kind of WMF document, which might also have been a useful way of answering the question. Deltahedron (talk) 08:40, 10 August 2014 (UTC)

If you had looked over even the first page of search results, without clicking on any of them, you would have seen so many places offering free access to their databases that you would have stopped worrying about whether it was possible to get a free API. When hundreds of places offer free access, it is reasonable to assume that access is actually available. Or, as James F told you, 'the answer is "yes"': the editing team is very confident that they will be able to get this "valuable data" for free. It is in the publishers' and booksellers' best interest to make this information easily accessible to everyone in the world.

Sphilbrick, at the moment, I believe that they're focusing on WorldCat rather than Amazon as the primary. Whatamidoing (WMF) (talk) 01:32, 11 August 2014 (UTC)

And if you had read my question a little more carefully, and answered it in a less off-hand way, we would not be having to continue this conversation. I remind you that the question was Do we have any reason to believe that the owners of those databases are going to allow the unlimited free automated access needed to support this aspiration, and do so for a long time? Note that final phrase for a long time. I was asking not only about current access but also about long-term sustainability, an issue which I would expect WMF to have considered. A random Google search might show that there are multiple providers right now, but it is certainly not sufficient to give you the confidence you need that they will be around in, say, four years time. This is not how WMF staff should behave towards the community. I take it from Jdforrester's response, which was unnecessarily and deliberately rude, that WMF have addressed the sustainability issue. Why did you not just say so? Why are WMF staff reluctant to engage on collegial terms with community members by giving a straightforward answer to a well-meant and well-posed question? Deltahedron (talk) 06:37, 11 August 2014 (UTC)

@Deltahedron: Because asking such a basic question betrayed a stunning, contemptuous, ludicrous lack of respect for our professionalism, competence and judgement on your part that it didn't really bear scrutiny? Because instead of saying it in a "collegial" way, you instead insinuated that you knew all about this and how it worked, and we didn't? Re-read your question and consider the tone you used. :-) Jdforrester (WMF) (talk) 09:20, 11 August 2014 (UTC)

Firstly, this page is not a personal conversation between two individuals. It is, or at least should be, a community resource where staff and volunteers work together for the benefit of the projects. To deliberately refuse to answer questions or provide pointers to information, just because you don't think you were asked nicely enough, is to deliberately deprive the community as a whole of relevant information, and to deliberately impede fruitful collaboration. That is not what would be expected of senior staff members. Among the tens of thousands of contributors there are probably people who can help you out with almost any given topic. Why would you deprive yourself of that help?

Secondly, if you have comments to make about the tone of my question, you should make them in the proper venue, which is my user talk page. Deltahedron (talk) 17:28, 12 August 2014 (UTC)

A view from my corner of planet Wikipedia.

Work so far look wonderful- but seems to solve the wrong problem.

The standard way to work in my area of the country is with :

{{sfn|name|year|p=nn}}

and

{{efn|freetext}}

giving code that links into

== See also ==

[[similar article]]

==References==

===Footnotes=== These terms can be different- using the word cite, citation etc according to the discipline.

{{notelist}}

===Notes===

{{reflist}}

===Bibliography===

*{{cite journal|lastname=.......|year=......|title= …..........|url=......... |ref=harv}}

===Further Reading===

==External links==

Most referencing is about page numbering, from a reference already in the Bibliography.

It is also important that the resulting markup is tidy, consistent, readable and economic.

The current work looks helpful, but must now be tailored to this sort of references as well.

JUst a few thoughts as you have been kind enough to send me a newsletter.

ClemRutter (talk) 09:01, 25 June 2014 (UTC)

It strikes me that this kind of problem might better be addressed by updating the way references are handled than by updating VisualEditor. This style's core design is referring back to the bibliography, so putting it in the VisualEditor cleanly would imply a way of referring back to the other references programatically. I'm imagining something like <ref name="originalref" fromgroup="bibliography" page="42"/> offhand, though we might want to be more broad than named parameters like "page" in case people want to cite specific volumes, chapters, or other levels of content grouping. {{Nihiltres|talk|edits}} 17:20, 25 June 2014 (UTC)

Adding support for page numbers to the MediaWiki core referencing system would have the advantage that it would work everywhere, not just on the few Wikipedias (<20%) that have the sfn templates (which are used on ~25,000 pages at en.wp). Doing it well should also obviate the need for {{Rp }} (used on ~10,000 pages at en.wp), which is a hack to get around the fact that there's no easy way to specify page numbers if you're just using <ref> tags. (That will need some design work, though.) User:Jdforrester (WMF), can we do this? Please?

Clem, what you want to do should work fine right now, so long as you go to "Insert > Template" rather than "Cite" or "Insert > Reference". If you change that last plain {{Reflist }} to a plain <references /> tag, then it will even auto-update while you're editing (and be a tiny bit faster than using the template to achieve the same end). Whatamidoing (WMF) (talk) 18:52, 30 June 2014 (UTC)

@Whatamidoing (WMF): This (adding "pages=" to references for re-use) is bug 13127. It could be done, but it might be a little disruptive for the users of sfn (because it would have to say ", page 36–49" at the end of the reference instead of in the middle. What do you think? Jdforrester (WMF) (talk) 19:11, 30 June 2014 (UTC)

I think I would want this even if sfn had never existed, for use on all of the thousands of other articles. I could use this at w:en:Candy right now. ClemRutter, what do you think? WhatamIdoing (talk) 19:19, 30 June 2014 (UTC)

Actually this is the wrong way to do it. An attribute should name the global instance of the referenced source, preferably on Wikidata, and then the content of the ref-element should hold the local adaption such ac quotes, notes and page numbers. Jeblad (talk) 14:19, 10 August 2014 (UTC)

TemplateData parameter grouping

This might be an idea better suited to discussing about TemplateData more broadly than the reference use case (I can think of a lot of templates to which TemplateData parameter grouping would be helpful), but there are a number of cases where it would really be useful to group parameters that are generally or always used together, or where one is dependent on another.

For example, in references, author data can be input a number of ways. There's firstN and lastN, or authorN, and authors can optionally be wikilinked with authorNlink (with parallel versions for editors). The firstN and lastN example is a good argument for grouping: if you want to use one of those two, you almost certainly want to use the other as well. Some parameters are exclusive of one another: if you're using firstN and lastN notation, you're probably not going to use authorN. For that matter, if you don't have a name defined for author N, it doesn't make sense to define authorNlink for that N. For that matter, it doesn't really make sense to define author3 if you don't have author2 defined.

It could help make referencing in VisualEditor far easier if TemplateData could contain some (limited!) information about these sorts of dependencies, exclusions, and/or groupings. I emphasize that "limited" because a full description could become very complicated very fast. For example, in English Wikipedia's {{infobox artwork}}, I've set up wikicode for dimensional data so that both feet and inches can be described. The height_inches, and similar parameters should only be used if their parallel parameter (like height_imperial) is defined and imperial_unit is set to "ft". That's probably a more complex situation than makes sense for TemplateData to be able to handle fully… but a subset of dealing with that (e.g. requiring height_imperial to be defined as a prerequisite for height_inches) seems like it would be feasible.

Thoughts? Has this been discussed elsewhere? {{Nihiltres|talk|edits}} 17:52, 25 June 2014 (UTC)

I'm not aware of any significant discussions, but I think the idea's been mentioned before. I think this is a good idea, but I agree with you that it might end up being very complex.

One very basic thing that would be helpful to users is to remind editors that the order of the TemplateData on the doc page is the order that the parameters will be displayed in the template dialog. So if you want to "associate" |lastname= and |firstname=, then you need to put them on adjacent lines in the TemplateData. Whatamidoing (WMF) (talk) 18:57, 30 June 2014 (UTC)

Put them side by side and add a width in TemplateData. Use the labels as background in the textboxes unless there are defaults. Jeblad (talk) 14:24, 10 August 2014 (UTC)

Off topic but tangentally relevant

Here at en.Wikipedia's Village pump (technical) I'm offering a $1000 reward to any person or team who comes up with a referencing system in six months that highlights the supported text when you hover your mouse over (or press on a touch screen) a footnote marker. If a WMF person or team pulls it off and feels weird about accepting the reward, I'll be happy to donate the reward to the WMF. If you don't have time to think about it now, could those of you who think it's a worthwhile idea please just store it away for later. --Anthonyhcole (talk) 12:28, 27 June 2014 (UTC)

I think this is a worthwhile idea, but I probably wouldn't want to "Edit source" for any article that used it extensively. I suspect that any implementation is going to look a lot like w:en:Template:Citation needed span, and an article's worth of that is going to be nearly illegible. If you consider this passage from w:en:Cancer pain (with refs stripped in list-defined references style):

Objective psychological testing has found problems in memory, attention, verbal ability, mental flexibility and thinking speed.^[1] Pain is also associated with increased depression, anxiety, fear, and anger.^[2] Persistent pain reduces function and overall quality of life, and is demoralizing and debilitating for patients and those who care for them. ^[3]

It's created by this wikitext:

Objective psychological testing has found problems in memory, attention, verbal ability, mental flexibility and thinking speed.<ref name = Kreitler&Niv /> Pain is also associated with increased [[Depression (mood)|depression]], anxiety, fear, and anger.<ref name="pmid19146872" /> Persistent pain reduces function and overall quality of life, and is demoralizing and debilitating for patients and those who care for them.<ref name = Induru />

It would have to be replaced by something like this:

<ref name = Kreitler&Niv text = Objective psychological testing has found problems in memory, attention, verbal ability, mental flexibility and thinking speed. /> <ref name="pmid19146872" text = Pain is also associated with increased [[Depression (mood)|depression]], anxiety, fear, and anger. /> <ref name = Induru text= Persistent pain reduces function and overall quality of life, and is demoralizing and debilitating for patients and those who care for them./>

and when you add in the wikitext for the citations themselves, you get such a big mess—and a mess that silently blanks your sentence if you get a typo in the wrong spot—that I think normal people would give up in despair. This might be doable with VisualEditor, but I think it would be painful in wikitext. Whatamidoing (WMF) (talk) 19:12, 30 June 2014 (UTC)

@Whatamidoing (WMF): Indeed. As others have said, Anthonyhcole's suggestion would be really powerful (and has been suggested before), but the current ideas we see would be exceptionally hard for wikitext users. It's vaguely planned as part of the "future referencing system" which is on the backlog of things we'd like the Editing team to work on in the next few years, but there's nothing concrete right now, and we'd need to work out how we could make it usable first. Jdforrester (WMF) (talk) 19:40, 30 June 2014 (UTC)

When you're thinking about the design, please keep in mind that what I really want to be able to do is this:

Objective psychological testing has found problems in memory, attention, verbal ability, mental flexibility and thinking speed.^[1][2][3]

rather than the simpler case of:

Objective psychological testing has found problems in memory, attention,^[1] verbal ability,^[2] mental flexibility and thinking speed.^[2][3]

WhatamIdoing (talk) 00:21, 1 July 2014 (UTC)

@Whatamidoing (WMF): Yeah; in fact, maybe the references should show based on where you're looking right now, rather than always next to the fact or always at the end of the sentence or paragraph. Lots of possibilities. Jdforrester (WMF) (talk) 01:18, 1 July 2014 (UTC)

Wrote a proposal for a master dissertation about something similar a few years back. It is possible without messing up the refs to badly. It doesn't really work for short text fragments, but if there is a few words it is possible. General idea is to always name the refs and then keep the text you want to highlight in some other store. Main problem is what you do when the highlighted text changes, do you try to track the changes or do you simply say the reference is invalid? The original proposal was for users to mark a text fragment and say whether they trusted it, and then log that. When the highlighted text changed it would not be a valid statement anymore so it would be dropped. The proposal was never picked up by any student, I think it was to difficult. Jeblad (talk) 14:36, 10 August 2014 (UTC)

Autofill suggestions

It is great to see such strong recent improvements in VE referencing. Thank you.

Suggestion: Reftools has at least two styles of autofill (or one of the versions of it does) that are incredibly useful for referencing addicts such as myself, working from Google Books URLs and NYT links, respectively. Where an ISBN and a GB URL are both available, it is easier, at least in Reftools 1.x, to use the Google Books URL, as that contains not only the information about the book but also in many cases the page number. The code to accomplish that is clearly around for reference if not reuse, as it continues to work, so it would be my hope that the back-end portion of this would not be a lot of work. Obviously there would still be front-end work. --Joe Decker (talk) 19:46, 8 August 2014 (UTC)

@Joe Decker: Hey, thanks for the suggestion. We're in fact doing this right now – citoid will let users paste in a URL, ISBN, DOI and others. I don't believe that the Zotero translator for Google Books which citoid currently uses notes the page number, but it sounds like a simple modification we could make, yes. Jdforrester (WMF) (talk) 08:58, 9 August 2014 (UTC)

Pie in the Sky: Assistance with the references themselves

References are difficult for editors, particularly new editors, for two reasons. One, which VE aims to help, is the syntax/structure part of the problem, giant long hairy syntax replaced by an easy fill-in form. Boffo. The other more tricky, the Byzantine but necessary questions that go into determining what is and isn't a reliable source.

I know that you're not going to be able to fix that. But... there is one feature that you could add that might allow ENWIKI or whomever to help problems like it.

What if the citation tool in VE had some sort of lookup, callback,... something, that would check reference URLs (when present) against a small table of URL patterns and "responses", and display the "response", I figure in a non-modal fashion.

What's the use case? Imagine an editor attempting to add a "imdb.com" reference. ENWIKI considers that source unreliable for most purposes, we have a little policy section about it in a couple of places. Wouldn't it be great if ENWIKI could say "hey, you see someone editing IMDB, show them this note." That's it, it wouldn't be useful to try and add enforcement. A different message for sources from the various social media sites, and so on.

Why is this valuable? I do a lot of work at AfC on ENWIKI, and I have keyboard macros on my computer explaining issues with some of the most common kinds of problematic references -- those issues are just that common -- and more importantly, they are issues which go directly to the problem of new editors creating new articles and getting bitten and running away.

Anyway, just a crazy thought. I hope you enjoyed. --Joe Decker (talk) 20:05, 8 August 2014 (UTC)

@Joe Decker: This is an interesting use case. I'm not sure it's very workable, however, given that there isn't really the scope for making judgements about each source. Even if we ignore the problem that different wikis might have different views of the "reliability" of the same source, the view is a lot more nuanced than an up/down guide of "yeah, that's OK to cite" vs. "no, that's a problem, don't cite it".

For example, The Daily Mail from the UK is I believe considered for the English Wikipedia not "reliable" for the purposes of articles about medicine, but is considered fine for political matters. Similarly, blogspot.com isn't "reliable", unless it's the blog of the individual concerned (e.g. someone announcing that they are retiring).

Giving a customised note for each source, with possibly tens of thousands of sources each having their own kind of note which needs to be monitored, updated, corrected and translated into 300 languages, seems like a huge amount of work to dump on the community.

There's also the issue about validating and flagging problematic sources after the fact, not just on initial entry. An editor following-up an article that hasn't been edited for months needs some way to flag that there are issues to be resolved, but not in a way that prevents them from making some (if not complete) improvements or suggests that that's the case, lest we scare newbies doing the right thing away (letting perfect be the enemy of good).

That said, I'd say that there's definitely something that would be good work on here, I'm just not sure what the best way to flag to users potential issues might be. Jdforrester (WMF) (talk) 09:15, 9 August 2014 (UTC)

Understood and agreed, I'm not 100% sure about the right way to do it either, but I think it's worth thinking about on both sides of our respective aisle. Thanks, --Joe Decker (talk) 20:11, 11 August 2014 (UTC)

dropdown widget

We are putting a drop down widget in a titlebar ? That's a rather uncommon concept, are we sure that it's a good idea ? Have alternative ideas been explored ? TheDJ (talk) 11:02, 9 August 2014 (UTC)

Sorry, TheDJ: Can you try that again, but in English?

I'm not sure which thing is the "titlebar" in your question. Whatamidoing (WMF) (talk) 01:40, 11 August 2014 (UTC)

Lots of notes

Handling pages with Open Graph and Dublin Core

A working solution should at least handle an URL pointing to a page with metadata given as Open Graph and Dublin Core, there are also other semantic data schemes that should be used. Only scraping the title does not make much sense. It is probably equally important to be able to reference newspapers on the web as it is to reference books. Jeblad (talk) 08:51, 10 August 2014 (UTC)

News archives an paywalls/firewalls

It is important to be able to access news articles behind firewalls/paywalls if those have better or more complete metadata. In those cases the schema is often proprietary and needs special handling. In some countries (at least Norway and Sweden) there are a few major players that makes news archives available that could be approached. The Norwegian community had access to one of them in a test project a few years back. There are also international news archives, but they are mostly just providing the big newspapers and not the smaller ones.

There is also the problem with news archives often being the paper edition while the web edition is often the one referenced, and that a single article form those two editions can be diverging. Also articles from each of those editions can be available in several revisions. Jeblad (talk) 08:58, 10 August 2014 (UTC)

Overly focus on Google Books

It seems like there is some overly focus on Google Books. Even if this is a nice project it is not global and it will definitely not be complete unless they plan to break local law in a lot of countries. I would say we should try to use locally provided data where possible and link to and use national libraries. For example in Norway the National Library have a service called bokhylla.no (the book shelf) and they also provide better and more accurate data for the books. And note, they do provide country-wide free access to books still copyrighted and we can get global access to their metadata through BIBSYS (an old search interface is available [6]). Jeblad (talk) 09:09, 10 August 2014 (UTC)

Hello Jeblad, i specifically asked the WMF team for the inclusion of google.books URL autofill, because it is used really, really a lot (high in the Top 5 of ref URLs on Wikipedia = big, big impact for referencing) and because it is not that difficult to implement (there already are some tools that do this). Please read my explanation and stats at en:Wikipedia:VisualEditor/Feedback/Archive_2014_1#The_new_reference_dialogue. I am not at all a google acolyte, this is just about usability and impact...

But i really like your proposal about bokhylla.no and bibsys.no (i had no idea ;-)) - do you use a template for linking to them on no.wikipedia? If you use a template, you can make VE RefDialog use this. That would be great! Or do you have another proposal? --Atlasowa (talk) 18:54, 11 August 2014 (UTC)

I understand that Google Books are really useful for some American books, but it will not be very useful for European books if things goes as it seems to go right now. Bokhylla.no is like Google Books for Norway, but it is done "the right way" by the National Library and in cooperation with the publishers. It would be a better source for metadata I think, but I'm not sure how we will handle the access limitation to Norwegian IP addresses. We can add it to the template data, but we are more or less in the middle of changing the whole cite system. One idea could be to use the archive url and let that point to Bokhylla, or tweak it some other way. Anyhow, it is not storing the url to Bokhylla that is the problem, but to get data from there instead of Google Books or some other source. The data maintained at Bokylla cones from the National Library and is usually much better than other sources for such data. Jeblad (talk) 18:14, 12 August 2014 (UTC)

Hi Jeblad,

• "it is not storing the url to Bokhylla that is the problem, but to get data from there instead of Google Books or some other source." - That is a different use case, and not what this books.google-URL-autofill feature is about, IMHO. If an editor wants to give a book as a reference, he should provide an ISBN and then the VE Reference Dialog ISBN-feature will autofill the data (title, author etc). I'm not sure what sources the ISBN autofill will use, BIBSYS sounds like a good addition (see this BIBSYS tool!), maybe user:Whatamidoing (WMF) can point us to more details about used ISBN-sources. Norwegian WP can point those ISBN-links in refs (ISBN 9878257317607 for example) to bokhylla.no, via no:Special:BookSources or directly via noWP templates. That is a different use case from the books.google-URL-autofill feature, which is trying to make adding refs easier and is aimed at old public-domain books that very often do not have ISBN and are fully digitized and available at books.google.com/.de/.fr/.no etc.
• "Google Books are really useful for some American books, but it will not be very useful for European books" Look at the external link stats, it's not just used for english WP or only american books. Wikipedians are already, now, using a lot of books.google-URL for references, in different language WPs. The VE Reference Dialog will be able to autofill those bare books.google-URLs with metadata (title, author, year etc) - not forcing anybody to google! Look at the stats:

External links stats for deWP, 2011 (aronsson), wikipedia external links statistics for January 2011: For each database dump of Wikipedia and sister projects, a CSV (comma separated values) file was produced (Lars Aronsson) It's also available for noWP: [7] (dewiki-2011)

de.wikipedia external links statistics for January 2011
count	website domain name (25.870)
454306	toolserver.org
169167	creativecommons.org
168085	dispatch.opac.d-nb.de
146374	d-nb.info
145474	commons.wikimedia.org
81650	viaf.org
81160	errol.oclc.org
73500	portal.d-nb.de
61574	imdb.com
58704	imdb.de
41907	gnu.org
26192	books.google.de
24197	ssd.jpl.nasa.gov
22332	bundesrecht.juris.de
19762	spiegel.de
15526	dx.doi.org
14115	recensement.insee.fr
11353	bibleserver.com
11109	sports-reference.com
10935	admin.ch
10454	perseus.tufts.edu
9766	web.archive.org
9601	books.google.com
8970	youtube.com
8962	kb-law.info
8953	zeit.de
8402	weltfussball.de
8373	hls-dhs-dss.ch
8344	welt.de
8030	catholic-hierarchy.org
7788	daten.digitale-sammlungen.de
7703	allmusic.com
7284	bbkl.de
7148	hockeydb.com
7029	news.bbc.co.uk
6537	geonames.usgs.gov
6334	heise.de
6190	archive.org
6018	faz.net
5884	en.wikipedia.org
5781	secure.wikimedia.org
5640	myspace.com
5587	zeno.org
5431	dejure.org
5400	bioguide.congress.gov
5297	sueddeutsche.de
5244	demo.istat.it
4959	iucnredlist.org
4937	reichstag-abgeordnetendatenbank.de
4930	findagrave.com
4772	fis-ski.com
4699	iaaf.org
4652	rottentomatoes.com
4626	ncbi.nlm.nih.gov
4455	taz.de
4346	fussballdaten.de
4324	german.imdb.com
4315	nytimes.com
4115	tagesspiegel.de
4044	censtats.census.gov
3989	biographien.ac.at
3964	pubchem.ncbi.nlm.nih.gov
3945	berlinonline.de
3876	musicline.de
3874	ine.gob.bo
3710	factfinder.census.gov
3702	focus.de
3647	discogs.com
3576	czso.cz
3529	gesetze-im-internet.de
3450	filmportal.de
3397	statistik.at
3388	rsssf.com
3375	webcitation.org
3296	nzz.ch

E. Summers. top hosts referenced in wikipedia (part 2), inkdroid. 2010 The top 100 hosts in article name space (2010):

• See more ref / external link stats at de:Benutzer:Atlasowa/ref_stats#ref_links_stats
• http://tools.wmflabs.org/hay/exturl/index.php?site=no.wikipedia&q=books.google.com found 1680 pages with 3230 links
• http://tools.wmflabs.org/hay/exturl/index.php?site=no.wikipedia%2Cen.wikipedia&q=bokhylla.no 3 pages with 3 links
• http://tools.wmflabs.org/hay/exturl/index.php?site=no.wikipedia%2Cen.wikipedia&q=bibsys.no found 7 pages with 7 links

HTH, --Atlasowa (talk) 10:45, 19 August 2014 (UTC)

You misunderstand me. Bokhylla.no has a lot of data that isn't available in Google Books and probably never will be available there. As it is said elsewhere on this page, the information available from different sources are not exact duplicates and often books are not even available at some of the sources. I have tried to find information about old books and this is a real problem. If the autofill service shall work you must not only query several libraries, you must also handle conflicting data. Jeblad (talk) 21:39, 19 August 2014 (UTC)

Not unique digital identifiers

One known and rather irritating problem is that a lot of digital identifiers in use are not unique. To solve that the user must be able to chose among alternatives or even override what any automatic system could find. This is especially a known problem for ISBN numbers, but it is a problem for all identifiers that lacks a central vetting service (or actually a service to provide the publisher with an unique id space).

Note also that an ISBN can be correct but the actual description from the different databases can diverge. As long as this is only on which fields are available this is not a huge problem, but when the actual data available doesn't agree then it will be difficult to automate the data collection. One option would be to provide the alternatives in a dropdown list and ask the user which one to use. Jeblad (talk) 09:29, 10 August 2014 (UTC)

Update of references

How will a reference be updated? Right now we build our own snapshot of the reference, but we should not do that. What we should do is to make a tracking reference that use updated information when available. This is especially important when the referenced asset moves, like a newspaper article is moved from normal publication to a news archive. It is previously claimed that we can archive the referenced page at some of the citation archives, but that is actually not legal to do that in a lot of countries. That is, we will then violate the editor and publishers copyright. It is although legal both to link to the correct news archive and to make quotations. If we want to use a citation archive it is somewhat easy to build the link, but if we want to use the news archive we must update the reference at some point. There can be a lot of updates to a reference over time, like completion of available data or corrections.

If we chose to make tracking references then some of the data should not be changed even if the external service changes their data. This is especially important if we keep a quotation from the external source. We use a source because of some claim they made, and if they changes that claim we should know so we can mark the reference as invalid. Jeblad (talk) 09:43, 10 August 2014 (UTC)

Automatic verification of quotations, invalid references

At some point we should start making quotations from the source so we can mark references as invalid if the quoted text changes. Now a reader must manually inspect the source for changes, which is not a very efficient solution. This checking should be automated. Quoting a whole text is not very useful, so making an excerpt should be manual. Quoting the whole text is also illegal in a lot of jurisdictions. We can although process the page somehow and make a digest for the whole text, that is probably legal, but probably not very useful and it will be extremely difficult to make a stable digest for a news article. It would be much easier to check a quotation against the source.

There is a partial implementation of an extension Quote that does such checking, but there are no user interface. This extension is unpublished. Jeblad (talk) 09:51, 10 August 2014 (UTC)

Use of sets

Tracked in Phabricator
Task T52407

It seems like sets in TemplateData does not work (this is on nowiki and it could be due to some local problem). It is very important to be able to set up sets so to avoid additional clicks to find fields that belong together. If I have a reference where I already have year, then I should be provided month and day as recommended fields but I should not be required to do so. Note that if some fields are provided others should be removed. For example if there is a full date field then individual fields for year, month and day should not be provided. That is, in addition to sets there should be exclude rules for each param. If a param has an exclude then this will contain a list of other params to remove, and if those are parts of sets the complete set should be removed too.

In addition to required fields there should be recommended fields. Recommended fields should be easily available, but should not block saving if they are missing. Required fields should block saving if they are missing. There is a suggested field but it does not work properly.

Note that sets can be used to insert author2 if author1 is used, so the multiple author problem can be solved for a lot of templates. Jeblad (talk) 11:26, 10 August 2014 (UTC)

Hi Jeblad,

This idea is the second-oldest open bug for TemplateData.

"Required" is not being enforced in software, and we probably don't want it to be. I don't understand why you say that "suggested" is not working properly. It is working correctly for me, e.g., at w:en:Template:Cite book. Can you give me an example of the problems you're encountering? Whatamidoing (WMF) (talk) 01:50, 11 August 2014 (UTC)

For example a Cite web without an url is pretty silly. Seems like suggested works, not sure why I had marked it as defunc. Jeblad (talk) 18:02, 12 August 2014 (UTC)

Alternate representations

It should be possible to spin through alternate representations, like the set with first_name and last_name and the alternate fullname. Not sure how this is best visualized. It is also necessary to have some kind of transform to pass data between alternate representations. That said I don't really like the numbered fields, I would much rather have an authors field and insert templates for individual authors into that. That is nested templates. Ugly in wikitext, but this is VisualEditing. Jeblad (talk) 13:02, 10 August 2014 (UTC)

Hardcoded num of templates

Not sure if I really like the icon-text table like drop-down menu. It starts to be common, and it is easier to hit the right thing inside it, but it isn't very good if it is somehow should be dynamic.

Hardcoding the number of templates to 6 is not a good idea, and just picking some random templates to list is definitely not a good idea at all. List the most used ones and add a "More&hellip" entry to the bottom of the list. Clicking more will then turn the list into an ordinary menu listing all templates. Not sure if that should follow usage stats or be alphabetical, perhaps an entry on top should change between listing according to usage stats and alphabetical listing.

The most used citation templates should be listed down to a set fraction of usage, but at least some min number, and increased to fill all the columns. Jeblad (talk) 11:32, 10 August 2014 (UTC)

At the English Wikipedia, they've already listed the four most commonly used templates. You can add any template you want (or multiple templates) by going to Cite>Basic and then Insert>Template into Basic's free-form reference system.

IMO the biggest risk with an unbounded list is that someone might decide that the only "fair" thing to do was to list all possible citation templates. The result would be unusable, because the list would scroll off the screen. Whatamidoing (WMF) (talk) 01:57, 11 August 2014 (UTC)

Not allowing something because someone fear a worse case scenario is usually not a good idea. Said that I don't think the idea can be sold to other projects that "because enwiki chose to do it like this everybody must do it the same way". I don't think that argument will be accepted by the communities. Jeblad (talk) 18:17, 12 August 2014 (UTC)

Lookup of templates

I think I also would like to change the "Add reference" label into a text in a search box, where a user can search for a specific template if necessary. The search should be inside a category for the citation templates. If the search string is detected to be some specific type of identifier then the type can be used as a lookup for the correct template. That is the Cite web template is chosen if the type is link. It could be necessary to do some subdivision of types, for example if the link is to a specific news archive. It could also be easier to skip named types altogether and instead use a regexp defined in the templates TemplateData.

This also solves the problem of giving old books without an ISBN as a reference, just pass a reference to the record in BIBSYS for example. Jeblad (talk) 11:32, 10 August 2014 (UTC)

Bypass templates

It should be possible to bypass the templates and just insert a raw reference. This would mostly be to avoid some lengthy discussions. Jeblad (talk) 12:11, 10 August 2014 (UTC)

Do you mean "it should be possible to manually type in whatever I want" (which you can do now: Cite>Basic), or do you mean "I should be able to use autofill features, and then have the template's contents converted into plain wikitext"? Whatamidoing (WMF) (talk) 01:59, 11 August 2014 (UTC)

Cite→Basic was not listed in the examples, but it is available in the running code. Yes I do want to keep it. There are more than enough discussions about cite-templates and not everyone wants them. I think they will accept them as soon as the autofill-system works properly.

I like the second part of your question and I would really like a solution where the reference text is parsed and an attempt is made to replace the text with results from autofill. If the autofill succeed in using all string fragments except punctuation and formatting from the reference, then it can be said to replace it fully and the old reference can be removed and the new one used. I think that would be the situation in the majority of the cases. Jeblad (talk) 18:25, 12 August 2014 (UTC)

Reuse current reference

Can't see how to reuse an existing reference. Note that it should not be necessary to manually provide names for the ref-elements, and also that providing names could be very error prone. Still in some disciplines specific ways to write the names are commons, so it should be possible to override the automatic names. The user should just pick a reference. If there isn't provided a name yet for the reference, then the system can generate a random number. Provide the generated name to the user and ask if it is okey or whether the user wants to change it. Jeblad (talk) 12:33, 10 August 2014 (UTC)

To re-use a reference, go to Cite>Re-use. Whatamidoing (WMF) (talk) 02:00, 11 August 2014 (UTC)

Reuse is not part of the examples, if the plan is to keep them then update the examples. Jeblad (talk) 18:26, 12 August 2014 (UTC)

Multiple references to the same source

It is rather common that some books are used in several references, with only minor changes between the pages and quotations. If a reference is reused and new page numbers, quotations or notes are added, then the underlaying system should switch to two-step references. Jeblad (talk) 13:16, 10 August 2014 (UTC)

Subject specific data sources

Is it planned to use subject specific databases such as en:MathSciNet and en:Zentralblatt MATH in mathematics and en:DBLP in computer science? There are 174 mentioned in en::Category:Bibliographic databases, and that's just one language. Are commercial databases such as en:Science Citation Index in scope? What criteria will be applied to suggestions for inclusion? Deltahedron (talk) 18:31, 12 August 2014 (UTC)

Unified database

The comments above suggest that a unified database of references across projects, presumably through Wikidata, is a logical next step. Is that correct? Would it be open source and open format? Deltahedron (talk) 18:33, 12 August 2014 (UTC)

Stand-alone tools

Will there be stand-alone tools for converting from common data source formats such as en:BibTeX or en:MARC standards? Or will the conversion be a purely internal process?

PII and SICI

Will en:Publisher Item Identifier or en:Serial Item and Contribution Identifier be accepted as an alternative to DOI? Deltahedron (talk) 18:22, 14 August 2014 (UTC)

BICI

Will en:Book Item and Component Identifier be accepted as an alternative to ISBN? Deltahedron (talk) 18:24, 14 August 2014 (UTC)

And what's about Wikidata ?

Sorry but I think we miss an overall view about references. Wikidata is creating a data structure (see here to store data about references. I think that the new feature of VisualEditor should integrate the access to wikidata in order to select a reference and to import the data in the wikicode. The best will be to add a tag to allow an update of the data if necessary. Or to create a permanent link to wikidata which will update data each time the page is open. I think we are creating to different systems instead of creating a unique tool. Snipre (talk) 19:52, 15 August 2014 (UTC)

@Snipre: We've had extensive talks with Wikidata and others about using them to store structured shared data about references, but Wikidata's current approach to "source references" for their data claims is insufficient for our needs and we're going to wait for their next step, and in the mean time provide a better service more generally. Jdforrester (WMF) (talk) 14:04, 16 August 2014 (UTC)

That sounds very interesting. Please give, or point us to, more details. Deltahedron (talk) 11:04, 17 August 2014 (UTC)

HTML standard for newspaper articles

In order to generate references for newspapers articles automatically, we need a (HTML) standard for presenting the necessary fields. Something like:

• <span class="Article title">Elephants recognise human voices</title>
• <span class="Publication date">10 March 2014</span>
• <span class="Date style">UK</span>
• <span class="Authors names">Victoria Gill</span>
• <span class="Publication name">BBC News</title>

(the article that has those fields can be found online here: Elephants recognise human voices, 10 March 2014, Victoria Gill, BBC) Call the standard as you please. You can call it RefStandard if you want, for example.

Then the WMF board can talk with some newspapers to implement this standard. And then, for those newspapers, the references will be generated automatically. In time, more and more newspapers and online publications will adopt the standard. It will serve them for other things too, not only for generating Wikipedia references. For example Facebook will be capable to capture those fields too, when presenting a link in a user's timeline.

I detailed the standard a little bit more at w:User talk:Ark25/RefScript#Reference Standard.

I was also requesting such a standard at meta:Talk:Community Engagement (Product)/Process ideas#Make life easier for the editors - generate references in one click Ark25 (talk) 08:09, 26 September 2014 (UTC)

Hi Ark25, i just checked your BBC news article and a Spiegel news article with 3 tools that generate references:

First, Citoid via en:User:Salix_alba/Citoid (relying on en:User:Mvolz/veCiteFromURL):

• {{cite web|title=BBC News - Elephants recognise human voices|url=http://www.bbc.com/news/science-environment-26488432|website=www.bbc.com|accessdate=26 September 2014}}
• {{cite news|first1=Christoph|last1=Reuter|title=Death and Dying in Aleppo as Syria Civil War Rages On|url=http://www.spiegel.de/international/world/death-and-dying-in-aleppo-as-syria-civil-war-rages-on-a-993123.html|newspaper=Spiegel Online|date=14 undefined 24.0|accessdate=26 September 2014}}

Secondly via en:Zotero (firefox addon, + preferences -> export -> format -> Wikipedia citation templates):

• {{Cite web | last = reporter | first = Victoria Gill Science | coauthors = B. B. C. News | title = Elephants recognise human voices | work = BBC News | accessdate = 2014-09-26 | url = http://www.bbc.com/news/science-environment-26488432 }}
• {{Cite news | last = Reuter | first = Christoph | title = Death and Dying in Aleppo as Syria Civil War Rages On | work = Spiegel Online | accessdate = 2014-09-26 | date = 2014-09-24 | url = http://www.spiegel.de/international/world/death-and-dying-in-aleppo-as-syria-civil-war-rages-on-a-993123.html }}

Now, en:User:Ark25/RefScript:

• <ref name="MyUser_BBC_September_26_2014c">{{cite web |url=http://www.bbc.com/news/science-environment-26488432 |title=Elephants recognise human voices |newspaper=BBC |date= March 10, 2014 |author=Victoria Gill |accessdate=September 26, 2014}}</ref>
• <ref name="MyUser_Spiegel.de_September_26_2014c">{{cite web |url=http://www.spiegel.de/international/world/death-and-dying-in-aleppo-as-syria-civil-war-rages-on-a-993123.html |title=Death and Dying in Aleppo as Syria Civil War Rages On - SPIEGEL ONLINE |newspaper=Spiegel.de |date= |author= |accessdate=September 26, 2014}}</ref>

It's all quite impressive.

Zotero is really good. And they should be, it's a specialised tool for references and handcurated i guess. The bad thing: you need to use firefox _and_ to install zotero addon _and_ configure format. That limits its usage/adoption rate to 0-2% i'm afraid.

Citoid is good, but worse than Zotero, which may be improved (?) because citoid is heavely based on zotero. Date is bad. BBC is very basic. The good thing: Citoid can be used onwiki, no extra downloads/configuration, so everybody can use it.

Ark25/RefScript is excellent for BBC, very basic for Spiegel. A lot of effort to handcode this! The bad thing: The moment you tell users "you just have to add a javascript bookmarklet to your browser program and..." usage/adoption rate drops to zotero-like 0-2% i'm afraid.

Ark25, can you give some example URLs for romanian newspaper articles and compare the tools? --Atlasowa (talk) 10:13, 26 September 2014 (UTC)

Thanks for your answer. I just tried Zotero. Sorry I don't mean to be harsh, but using it is a mess. Right click -> Export Item -> and then save it into a text file? That's almost less productive than manually formatting the {{Cite web }}. Also it's very far from being accurate. The name of the author it can capture is "Victoria Gill Science reporter" and it doesn't capture the publication date. Ark25/RefScript works in a single click. And then you got the formatted reference, you just need to push Ctrl+C to copy it.

On the Romanian wikipedia there is another script, capable to handle tens of newspapers. It works flawlessly for most of the sites - not because I'm good, but because the Romanian newspapers don't have 10 different formatting styles on their sites. They only have one formatting style each. The script can be found at w:ro:Proiect:Cod Wikipedia/Bookmarklets/Generare referințe. Here you can inspect a few external links generated using RefScript:

• Lavrov: Extinderea NATO ar fi o mare GREŞEALĂ care va submina sistemul de securitate al Europei, 27 septembrie 2014, Anna Primac, Mediafax
• Oraşul cu cel mai curat aer din ţară. Botoşaniul este singurul municipiu din România considerat de Uniunea Europeană „oraş verde“, 26 septembrie 2014, Cosmin Zamfirache, Adevărul
• DESCOPERIRE UIMITOARE. Gaura Neagră nu există, iar teoria Big-Bang-ului este greşită, 26 septembrie 2014, Daria Andrieş, Evenimentul zilei
• SURSE DIPLOMATICE: România ar putea bloca ratificarea Acordului UE-Canada din cauza MENŢINERII vizelor, 26 septembrie 2014, Paul Filimon, România liberă
• MICROSOFTGATE, 26 septembrie 2014, Biro Attila, Gândul
• "Avem o singură FEBRĂ: America şi pretenţiile ei!". Mihail Gorbaciov, despre conflictul ucrainean şi un posibil război rece între Rusia şi SUA, 26 septembrie 2014, Jurnalul Naţional
• Yazaki angajează 4.000 de oameni în noile unităţi de producţie de la Brăila şi în Urlaţi, 26 septembrie 2014, Adelina Mihai, Ziarul financiar
• O firmă americană va deveni al treilea producător de gaze din România, 26 septembrie 2014, Capital

(the script can generate external links too). In those external links you can see that the script captured all the necessary fields: title, author, publication date, name of the publication. I can generate the references too, if you want

If you want, I can teach the script how to handle Spiegel.de - it will take me a half an hour or so.

But if there would be such a tiny tiny tiny standard, then it would not be necessary to teach it, it would work directly and without problem with any newspaper that would implement the standard.

And not only my script (I wasn't even talking about my script in my first message). Such a script would be integrated in the Visual Editor and then it won't require the editors to create any bookmarklet.

I don't believe that installing the bookmarklet can be a problem for so many Wikipedia Editors. Many of them are good with computers. They simply don't know about this script and those who know about it don't realize the advantages of using it.

Heck, WMF can work with Mozilla to design a version that has the bookmarklet included (or to include the bookmarklet in FireFox, after installing Firefox). On a second thought, I realize that until then, I should make a video for how to install it though - that's more like a decent thing to do in the first place.

Now I am also thinking that maybe there is a way to install a bookmarklet easier? Like you visit a webpage, click on a button, and it will install the bookmarklet. —  Ark25  (talk) 07:37, 27 September 2014 (UTC)

Regarding Zotero: you click once and then drag&drop the ref, done. I just randomly picked 2 romanian URL, Mediafax.ro and jurnalul.ro: Zotero:

• {{Cite web | title = Lavrov: Extinderea NATO ar fi o mare GREŞEALĂ care va submina sistemul de securitate al Europei | work = Mediafax.ro | accessdate = 2014-09-27 | url = http://www.mediafax.ro/externe/lavrov-extinderea-nato-ar-fi-o-mare-greseala-care-va-submina-sistemul-de-securitate-al-europei-13352626 }}
• {{Cite web | title = "Avem o singură FEBRĂ: America şi pretenţiile ei!". Mihail Gorbaciov, despre conflictul ucrainean şi un posibil război rece între Rusia şi SUA | accessdate = 2014-09-27 | url = http://jurnalul.ro/stiri/externe/avem-o-singura-febra-america-si-pretentiile-ei-mihail-gorbaciov-despre-conflictul-ucrainean-si-un-posibil-razboi-rece-intre-rusia-si-sua-678335.html }}

Citoid:

• {{cite web|title=Lavrov: Extinderea NATO ar fi o mare GREŞEALĂ care va submina sistemul de securitate al Europei - Mediafax|url=http://www.mediafax.ro/externe/lavrov-extinderea-nato-ar-fi-o-mare-greseala-care-va-submina-sistemul-de-securitate-al-europei-13352626|website=www.mediafax.ro|accessdate=27 September 2014}}
• {{cite web|title="Avem o singură FEBRĂ: America şi pretenţiile ei!". Mihail Gorbaciov, despre conflictul ucrainean şi un posibil război rece între Rusia şi SUA|url=http://jurnalul.ro/stiri/externe/avem-o-singura-febra-america-si-pretentiile-ei-mihail-gorbaciov-despre-conflictul-ucrainean-si-un-posibil-razboi-rece-intre-rusia-si-sua-678335.html|website=jurnalul.ro|accessdate=27 September 2014}}

RefScript:

• <ref name="MyUser_Mediafax.ro_September_27_2014c">{{cite web |url=http://www.mediafax.ro/externe/lavrov-extinderea-nato-ar-fi-o-mare-greseala-care-va-submina-sistemul-de-securitate-al-europei-13352626 |title=Lavrov: Extinderea NATO ar fi o mare GREŞEALĂ care va submina sistemul de securitate al Europei - Mediafax |newspaper=Mediafax.ro |date= |author= |accessdate=September 27, 2014}}</ref>
• <ref name="MyUser_Jurnalul.ro_September_27_2014c">{{cite web |url=http://jurnalul.ro/stiri/externe/avem-o-singura-febra-america-si-pretentiile-ei-mihail-gorbaciov-despre-conflictul-ucrainean-si-un-posibil-razboi-rece-intre-rusia-si-sua-678335.html |title="Avem o singură FEBRĂ: America şi pretenţiile ei!". Mihail Gorbaciov, despre conflictul ucrainean şi un posibil război rece între Rusia şi SUA |newspaper=Jurnalul.ro |date= |author= |accessdate=September 27, 2014}}</ref>

These results are actually quite similar. --Atlasowa (talk) 21:18, 27 September 2014 (UTC)

@Atlasowa: Wait, you were using the english RefScript, which doesn't know Romanian newspapers. Look at the Romanian RefScript please:

• <ref name="mediafax.ro_2014-09-28">{{Citation | url=http://www.mediafax.ro/externe/lavrov-extinderea-nato-ar-fi-o-mare-greseala-care-va-submina-sistemul-de-securitate-al-europei-13352626| title=Lavrov: Extinderea NATO ar fi o mare GREŞEALĂ care va submina sistemul de securitate al Europei| newspaper=Mediafax| date= 27 septembrie 2014| last=Anna Primac| accessdate=28 septembrie 2014}}</ref>
• <ref name="jurnalul2014-09-28">{{Citation | url=http://jurnalul.ro/stiri/externe/avem-o-singura-febra-america-si-pretentiile-ei-mihail-gorbaciov-despre-conflictul-ucrainean-si-un-posibil-razboi-rece-intre-rusia-si-sua-678335.html| title="Avem o singură FEBRĂ: America şi pretenţiile ei!". Mihail Gorbaciov, despre conflictul ucrainean şi un posibil război rece între Rusia şi SUA| newspaper=Jurnalul Naţional| date= 26 septembrie 2014| last=| accessdate=28 septembrie 2014}}</ref>
• <ref name="adev2014-09-28">{{Citation | url=http://adevarul.ro/locale/botosani/orasul-mai-curat-aer-tara-botosaniul-singurul-municipiu-romania-considerat-uniunea-europeana-oras-verde-1_542569660d133766a873123f/index.html| title=Oraşul cu cel mai curat aer din ţară. Botoşaniul este singurul municipiu din România considerat de Uniunea Europeană „oraş verde“| newspaper=Adevărul| date= 26 septembrie 2014| last=Cosmin Zamfirache| accessdate=28 septembrie 2014}}</ref>
• <ref name="evz2014-09-28">{{Citation | url=http://www.evz.ro/descoperire-uimitoare-a-oamenilor-de-stiinta-toti-sunt-in-soc-gaura-neagra-nu-exista-iar-teoria-big-bang-ului-este-gresita-au-dovezi-palpabile.html| title=DESCOPERIRE UIMITOARE. Gaura Neagră nu există, iar teoria Big-Bang-ului este greşită| newspaper=Evenimentul zilei| date= 26 septembrie 2014| last=Daria Andrieş| accessdate=28 septembrie 2014}}</ref>
• <ref name="romlib2014-09-28">{{Citation | url=http://www.romanialibera.ro/actualitate/international/surse-diplomatice--romania-ar-putea-bloca-ratificarea-acordului-ue-canada-din-cauza-mentinerilor-vizelor-351184| title=SURSE DIPLOMATICE: România ar putea bloca ratificarea Acordului UE-Canada din cauza MENŢINERII vizelor| newspaper=România liberă| date= 26 septembrie 2014| last=Paul Filimon| accessdate=28 septembrie 2014}}</ref>
• <ref name="gandul2014-09-28">{{Citation | url=http://www.gandul.info/stiri/microsoftgate-13351979| title=MICROSOFTGATE| newspaper=Gândul| date= 26 septembrie 2014| last=Biro Attila| accessdate=28 septembrie 2014}}</ref>
• <ref name="capital.ro_2014-09-28">{{Citation | url=http://www.capital.ro/o-firma-americana-va-deveni-al-treilea-producator-de-gaze-din-romania.html| title=O firmă americană va deveni al treilea producător de gaze din România| newspaper=Capital| date= 27 septembrie 2014| last=| accessdate=28 septembrie 2014}}</ref>

(It's a beast)

Now I have just added en:Spiegel Online to the English RefScript, I hope you'll like it:

• <ref name="MyUser_Spiegel_Online_28_September_2014c">{{cite web |url=http://www.spiegel.de/international/world/death-and-dying-in-aleppo-as-syria-civil-war-rages-on-a-993123.html |title=Death and Dying in Aleppo as Syria Civil War Rages On |newspaper=Spiegel Online |date= 24 September 2014 |author=Christoph Reuter |accessdate=28 September 2014}}</ref>
• <ref name="MyUser_Spiegel_Online_September_28_2014c">{{cite web |url=http://www.spiegel.de/politik/deutschland/nsa-spaehaffaere-opposition-verklagt-merkel-wegen-snowden-a-994029.html |title=NSA Spähaffäre: Opposition verklagt Merkel wegen Snowden |newspaper=Spiegel Online |date= September 28, 2014 |author=Annett Meiritz |accessdate=September 28, 2014}}</ref> - for http://www.spiegel.de/politik/deutschland/nsa-spaehaffaere-opposition-verklagt-merkel-wegen-snowden-a-994029.html
• <ref name="MyUser_Spiegel_Online_September_28_2014c">{{cite web |url=http://www.spiegel.de/karriere/ausland/richard-branson-bei-virgin-kann-jeder-urlaub-nehmen-wann-er-will-a-993926.html |title=Richard Branson: Bei Virgin kann jeder Urlaub nehmen wann er will |newspaper=Spiegel Online |date= September 26, 2014 |author= |accessdate=September 28, 2014}}</ref> - for http://www.spiegel.de/karriere/ausland/richard-branson-bei-virgin-kann-jeder-urlaub-nehmen-wann-er-will-a-993926.html

Once we have the tiny standard, the script works with any newspaper implementing the standard. —  Ark25  (talk) 08:47, 28 September 2014 (UTC)

I do like it! :-) You have tackled the 2 difficult parts, the author field and the date field ("date" of the article, not the easier "accessdate") and that is a challenge. But i think we need to face the harsh reality about 2 things:

1) Bookmarklets and browser addons just won't scale. Even if people knew about those (which they don't), they won't use it if they need to install something. And casual users can't use it, mobile users can't use it... We need onwiki solutions for largescale adoption and ref improvement.

2) Regarding "the WMF board can talk with some newspapers to implement this standard" and "WMF can work with Mozilla to design a version that has the bookmarklet included": don't hold your breath for that. IMHO that's just not gonna happen, and it wouldn't do to just call for yet another "tiny" HTML standard. Forget it, i'd recommend.

What we need: A reference generation feature that works onwiki, like VE reference dialog and the default wikitext "ReferenceToolbar", because that is accessiblefor everyone. And we need a way to improve its autofill ref generation for the difficult fields like "author" and "date", ideally the tool would "learn" from usage.

How about this: Let's say we had a dataset of important newspaper references, containing cite web/cite news templates with "author" and "date" fields filled out correctly, and at least 3 for every news website, and not just the top40 newspapers from Romania but also Italy, Colombia, Israel etc. Could we make a reference generation tool learn from this dataset, to find the date/author field for the same news websites in the future? I think we could build such a dataset from a) the external links datadump ([8]) and b) the templatetiger template fields ([9][10]). What do you think, Ark25? --Atlasowa (talk) 14:48, 28 September 2014 (UTC)

Yes, we can make a script that generates references and integrate it into Visual Editor. The script will fill automatically the fields: title, name of the publication, author name and publication date. I will teach the script the newspapers you tell me. I just need someone to start the script and to fill those fields with anything (spaces for example). Then I will teach the script how to handle the sites, one by one. I just don't know where to start writing.

I will also make a feature to my RefScript so the users can drag it into their bookmarks toolbar, like this one: http://quozio.com/bookmarklet/ — And then the script won't need to be installed anymore. Can I have such a page where I can write a bit of such HTML/javascript code somewhere on WMF servers? —  Ark25  (talk) 10:18, 29 September 2014 (UTC)

@Atlasowa: I'm back. Now I made the webpage to drag the script in the toolbar - for the moment it's hosted on Dropbox. Hopefully I'll be able to save it somewhere on WMF servers as a permanent solution. Here is the link: https://dl.dropboxusercontent.com/u/46152682/RefScript.htm - no more installation headaches.

Someone should show me where I should add code in the Visual Editor so it can generate references automatically. And how can I test the code. Can anyone help? —  Ark25  (talk) 02:50, 30 September 2014 (UTC)

Inactivity

I see that no-one from WMF has edited this page since mid-August. In the meantime there are over a dozen questions or suggestions from volunteers which, I venture to suggest, merit some kind of response. Would some member of the team please address the backlog, even if it's to acknowledge the question, suggestion or comment? Thanks in advance. Deltahedron (talk) 19:32, 1 October 2014 (UTC)

@Deltahedron: Hey, sorry for being slow; the conversation in the section above is misplaced, but I didn't want to tell people to go discuss it elsewhere. Jdforrester (WMF) (talk) 23:05, 1 October 2014 (UTC)

Sorry but nobody is asking you to dictate to the people where to talk. You can simply give an useful information by suggesting a better place to discuss a certain topic. Also, I don't think that the fact that a discussion is misplaced is enough of an excuse for not answering the people's questions. —  Ark25  (talk) 07:46, 2 October 2014 (UTC)

Indeed, it would have been more helpful and taken very little more time to point to the location where that discussion should have been placed.

Returning to the previous point, in the section above the "misplaced" discussion, namely Lots of notes, there appear to be eighteen unanswered questions or comments. I doubt that they are all misplaced, and even if they were, some kind of response would be much appreciated.

Curiously, the time frame within which most of those unanswered comments were made is almost exactly the same as that of this declaration by the Board chairman, endorsing the Executive Director's commitment that "We will communicate sooner, we will prioritize smarter, we will test more, and we will achieve better outcomes. Her vision is to involve the community at each step of product development, including more structured feedback stages and reviews." The ED has also declared that she is "asking the same of everyone at the Foundation as well and now providing resources for doing so". Deltahedron (talk) 21:25, 2 October 2014 (UTC)

Some of them are off-topic, e.g., everything about Wikidata, because whether or not to store bibliographic citations on an external site does not affect what one dialog box should look like inside VisualEditor. It happens that James F and I are both very interested in that subject, but it won't affect the design of the reference dialogs in VisualEditor. Some of them are questions for which the answer is not firmly settled at this time for any project and may differ between projects (e.g., all of the "Will _____ be accepted?" questions), some are interesting ideas for a much later stage, and a few have been overtaken by events. None of them have any sort of w:WP:DEADLINE associated with them. The ones for which a substantive and reasonably reliable answer could be given have already been replied to.

Also, while you say here that it's "more helpful" to tell people to go away and talk somewhere else, you have previously been unhappy about being given the run-around in very similar circumstances. Telling people to go away would be unfriendly, especially in this instance, because there is no existing place for that particular conversation and so no clear advantage to them to moving it. It's not like we can send them to another page where they could get more and better help, because there is no such other page. Nobody really minds if people want to talk about it here, and I like the direction they're taking. I'd rather that they got this work done instead of wasting time moving discussions and documentation to some "ideal" place. Whatamidoing (WMF) (talk) 17:38, 3 October 2014 (UTC)

Thank you for taking the time to reply. I would suggest that there are very few circumstances under which users would prefer to receive no response at all to their questions or comments. It surely would have taken rather little time and effort to respond to the questions which you left unanswered for the reasons you now give with a short and timely comment explaining why no more substantial or reliable response was possible at the time. While it is true that there is no deadline for the completion of the encyclopaedia, common politeness tends to suggest that six weeks is a long time to leave questions in a discussion between developers and volunteers unanswered. As to being given the run-around, at least you acknowledge that that is what I was getting. Your reason for leaving the conversation here seems to contradict the comment by James F. Deltahedron (talk) 18:10, 3 October 2014 (UTC)