Trust and Safety Product/Decision records/2024-08-16-Approach for account reputation prototype
Authors: KHarlan (WMF) (talk)
Status
[edit]- Accepted on 2024-08-02
Context
[edit]For WE4.2.2 Account reputation score, we want to develop a prototype application that outputs a best guess at a user account reputation score using publicly available data for an account. The application should have:
- A numeric score
- A set of buckets to contextualize the score (e.g. “good”, “neutral”, “suspicious”, “likely bad”; or “low”, “medium”, “high”)
- A way to view the breakdown of the component parts that went into calculating the score. E.g. if the output of the application is a JSON object, there might be a field for score and a field for components, with each component indicating how it went into the calculation of the score
Options considered
[edit]- Use the GrowthExperiments user impact score infrastructure
- A standalone Toolforge app. This is nice because it's independent of production infrastructure. OTOH, there is some boilerplate setup work to do which would be nice to avoid given the tight timelines
- build something into XTools, assuming the maintainers are open to that. That doesn't have existing boilerplate for us to setup, and presumably is easy enough to set up locally
Decision
[edit]We propose to use the GrowthExperiments user impact score infrastructure, because:
- we get several data points “for free” (e.g. number of thanks received is already there)
- we are already one step closer to a production implementation by adding the data points needed for an account reputation score into the impact score. We could probably add a hook to allow for other extensions to modify data added to the user impact score, and use CheckUser for adding these data points.
Consequences
[edit]- User impact score data can be extended by other extensions (e.g. CheckUser)
- The user impact score component in GrowthExperiments might need to be renamed to better reflect that it will now track user impact alongside account reputation