The issue is more systematic than just beta features, so while my comments may be completely ignored because I'm an anonymous user and most beta features don't really work for "us" aside from the a/b tests, these comments might still offer a less biased perspective.
Some issues:
- Search - First architecturally speaking, a severe flow flaw is the fact that it isn't indexed in site search. This should really have been part of the MVP even if it required some hacks. For beta features it is important for people not to repeat the same feedback, and read related comments before submitting theirs. Funny that wikimedia itself has a similar feature request for phabricator developers (T883), highlighting its importance.
- Violates basic principles of usability design (https://www.nngroup.com/articles/ten-usability-heuristics/)
- Recognition rather than recall - the interface shouldn't ask for things it can get automatically. When someone reports an issue, the browser has access to the wiki, mediawiki version, the user agent, the user scripts installed, default gadgets, and more. Yet none of this is automatically added in structured fields.
- Error prevention - prevents errors by not requiring users to submit information that the wiki / browser already knows about
- Grouping - Lacks ways to manually group similar or near identical discussions, without leaving the interface (e.g category) .
- Ability to filter resolved discussions (with wikitext these can easily be collapsed).
-
Wikitext talk pages have even more severe flaws, yet their flexibility means that one can easily make use of headers to discuss similar topics, merge them, or even split them and move them elsewhere. It is very useful when discussing a problem to see different perspectives. Aside from user agent and ip, many user scripts aren't even private due to being added to common.js rather than being gadgets.
Finally, compare this to Wikia, who for example, is very consistent (community managers religiously ask people to submit bug reports to special:contact), and as an anonymous user I can submit feedback about any feature to them by using Special:Contact after testing the beta features activated in their testwiki. This is sent along with the browser and other info (added by a issue specific user-filled form) to wikia staff, who may eventually reply. According to them, registered users can even see progress of their report in a private issue tracker.
Wikimedia is very inconsistent about how it handles feedback, the contact interface in english wikipedia is different from ptwiki and probably many others. One way to improve this may be to improve the feedback interface, deploy the Extension:Contact and Extension:EnhanceContactForm to all wikis, and add a checkbox to submit potentially private information to either phabricator (for bugs) or flow (for other random feedback).
That being said, flow is by far more user friendly to newbies than wikitext-based talk pages (aside from the crippling lack of search functionality) that use even more arbitrary rules for indenting and posting.