Deployment timing
TBD
Bucketing criteria
WARNING: the requirements below are borrowed directly from T384372. We'll consider these Requirements "final" once the Editing and Machine Learning Teams (in collaboration with @MNeisler) align on the above and remove this warning.
Bucketing Requirements:
- Bucketing should include both registered and unregistered users at all identified participating wikis.
- All users, who are editing a desktop or mobile main namespace page (NS:0), at any of the participating wikis should have a 50% chance of being included/bucketed into the A/B test's control or treatment group.
- Bucketing should be done on a per-Wikipedia basis. 50% of people within a given wiki should be placed within the control group; 50% should be bucketed in the treatment group
- The test group should have Tone Check experience enabled while the control group should not
- People should remain in the same test group for the duration of the test (and across sessions and pages).
NOTE: We need to specify the experiences that will be available in both the test and the control groups. For example, will all wikis in the control group have access to Multi-Check (References)?
Instrumentation-Related Requirements
- A bucket is applied to these events so we can distinguish all events logged for the control group and the test group within the A/B test.
- The bucket should be descriptive of the test in case there are overlapping AB tests.
- The anonymous_user_token field is populated for unregistered users in the test.
Participating wikis
WARNING: the wikis participating wikis will not yet be final until human reviews are completed via T388471.
| Wiki | Status | Notes |
|---|---|---|
| es.wiki | ||
| fr.wiki | ||
| ja.wiki | ||
| pt.wiki | ||
Tech/News Draft
#TODO
Edit Check Configuration
#TODO