Page MenuHomePhabricator

Nuke tool follow-up satisfaction survey
Closed, ResolvedPublic

Description

This ticket tracks work to develop and field a *follow-up* survey to the baseline nuke tools survey (T376759).

This survey will be administered to users who:

  1. are known to have used the updated nuke tool
  2. answered the baseline survey

Survey Recruitment:
Nuke users will be contacted via massmessage.

Survey Content:
Survey will be short and will reuse satisfaction items used in baseline survey to facilitate direct comparisons with baseline measurements.

Draft survey here: https://docs.google.com/document/d/1JkVYJXpMmkqN-JcULx3gLZPwF6LubbZ8LH6Cw-QEg5A/edit?tab=t.0

Translations:
Survey will be fielded in the same languages as the baseline survey:

  • English
  • Chinese (S)
  • Chinese (T)
  • French
  • German
  • Italian
  • Japanese
  • Russian
  • Spanish

Timeline:
Survey should be fielded and preliminary analysis shared by end of Q4 (end of June 2025).

Event Timeline

Okay, I checked for nuke usage in the same wikis for which we solicited baseline satisfaction responses; please find the user list here
https://docs.google.com/spreadsheets/d/1NMGOzM9_3CqyTJ-ios5GeRdTBdwpgSpHeDMiFjVdITU/edit?gid=0#gid=0

That sounds great to me, thank you for the update @YLiou_WMF!

Hi @SonjaPerry - do you know who I should connect with to get this out via mass message? For the previous survey, that was handled by the moderator tools team. Thanks!

Hi @SonjaPerry - do you know who I should connect with to get this out via mass message? For the previous survey, that was handled by the moderator tools team. Thanks!

I believe @Samwalton9-WMF sent out our previous messages. I have the access rights to send out mass messages on enwiki, but not commons. I've never done so before though, and it's kind of an interesting tool, so it would be preferable to have someone more familiar with it do the task.

@Trizek-WMF is that something you could take care of? I was hoping we could send out the message as soon as possible (ideally tomorrow) so that I can close out the KR by Tuesday next week. How long do we usually run these surveys?

@Sonja Perry <sperry@wikimedia.org> that really depends on how many
responses we get, but given that the universe of respondents isn't too big,
hopefully we can wrap it in a few days.

Update: first batch of survey links has been sent through emailuser with rest to go out tomorrow by @Quiddity.

Will post updates here as we receive responses.

@Trizek-WMF is that something you could take care of? I was hoping we could send out the message as soon as possible (ideally tomorrow) so that I can close out the KR by Tuesday next week. How long do we usually run these surveys?

I'm recording publicly that @Quiddity stepped in as I was out of office. In the future, this kind of request should go through the Movement Communication request for support request. :)

Update: We currently have collected 15 total responses (13 completes). I'll be sharing some preliminary analysis internally, but will hold off on sharing anything here until we have more responses.

I'll be deactivating this survey (based on the slack conversation here).

Please also find the analysis memo for this project here.