Wikipedia Pages Wanting Photos/Evaluation Report 2021/Key findings

WPWP Campaign 2021

Summary

Limitations

Inputs

Outputs

Outcomes

Key findings

Appendix

What are our key finding this year?
We evaluated the results in terms of participants compliance with campaign rules and stated priority goals that local organizers & participants reported.
Read this page to learn the most important takeaways and recommended next steps.

What is the level of participants' compliance with campaign rules ?	statistical result of analysis of the contributions of participants who registered an account between 0 to 6months We sampled participants based on their years of editing experiences across five (5) languages Wikipedia. The participants were randomly selected from the English, Bangla, Arabic, Swahili, and Ukraine Wikipedia. They were grouped into the following 5 categories: 0 - 6 months, 6 months - 1yr, 1yr - 2yrs, 2years and above @ p<0.05 As shown in the statistical representation below, participants who registered an account between 0 - 6 months (<p 0.05) are unlikely to comply with the campaign rules and are more likely to violate local editing policies. A significant proportion of participants in this experimental group did not meet the minimum expected competence to participate in the campaign. Participants in this experimental group may not be allowed to participate in the campaign to minimize disruption. Statistical result of analysis of the contributions of participants who registered an account between 6 month to 1 yr Participants who registered an account between 6 months - 1 yr (<p 0.05) are more likely to comply with the campaign rules and local editing policies when compared with participants who registered an account between 0 to 6months. But the error rate is significant to result in disruption. A significant proportion of participants in this experimental group did not meet the minimum expected competence to participate in the campaign. Participants in this experimental group may still be allowed to participate if they are well trained but their edits may be throttled to minimize disruption. Statistical result of analysis of the contributions of participants who registered an account between 1 yr to 2 yrs Participants who registered an account between 1yr - 2 yrs (<p 0.05) are likely to comply with the campaign rules and local editing policies. A significant proportion of participants in this experimental group met the minimum expected competence to participate in the campaign. They have the requisite skills and experiences needed to participate without training and their edits may not be throttled. The contributions of participants in this experimental group contains minimal errors that could easily be handled through local community processes and policy. Statistical result of analysis of the contributions of participants who registered an account for 2 yrs and above Participants who registered an account for 2yrs and above (<p 0.05) have the relevant experience, skills, knowledge and competent to participate in the campaign. A significant proportion of participants in this experimental group met the minimum expected competence to participate in the campaign. Based on the above findings, we we recommend that the campaign participation be restricted to only participants who have registered an account at least 1 year before the campaign. Participants who registered an account between 0 - 6 months may still be allowed to participate if they are trained and their contributions are throttled based on community consensus.
How does the campaign deliver against stated goals?	The five (5) most commonly cited priority goals for the 2021 edition of the WPWP Campaign events were: Increase contributions to Wikimedia projects project; Increasing accuracy and/or quality of contributions; Building and engaging the community; Increasing usage of Wiki Loves Photos; Increasing readers satisfaction. Increasing contributions Data available on the total number of images used during the 2021 WPWP Campaign shows Year Total number of images used on Wikipedia articles during the 2021 WPWP Campaign 2021 252,227 Data available on the total number of vides used during the 2021 WPWP Campaign shows Year Total number of videos used on Wikipedia articles during the 2021 WPWP Campaign 2021 3,794 Data available on the total number of audios used during the 2021 WPWP Campaign shows Year Total number of audios used on Wikipedia articles during the 2021 WPWP Campaign 2021 2,957 Media files used on articles during the WPWP Campaign 2021 represent 0.31% of all the media files uploaded to Commons by registered users during the reporting period. This is above the value (0.14%) recorded last year. Increasing awareness of Wikimedia projects More than 70% of the participants were existing editors. 27% of the campaign participants who took the survey reported that their participation in the #WPWP was the first time they edited Wikipedia. The campaign attracted more new editors in 2021 when compared with the data recorded in 2020. In 2020, over 85% of the participants were existing editors. Social media were used by local organizers for promotion. More than 62% of the participants reported that they learnt about the campaign through the central notice banner on Wikipedia and other Wikimedia projects. Increasing accuracy of Wikipedia or quality of Wikimedia projects The priority goal of more than 52% of the participants who took the survey was to increase the accuracy of Wikipedia or quality of Wikimedia projects. Other priority goals of the participants were increasing their contributions to Wikimedia projects, increasing readers' satisfaction, and increasing diversity represented in contributions and contents on Wikimedia projects. More than 65% of the respondent reported that the campaign meet their expectations for achieving these goals. Notes
How this information can apply to campaign planning	Planning for Program Inputs & Outputs Use the information to help you in planning for campaign inputs and outputs. The numbers evidenced by others can help you to know what the right combination of participants might be for the content outcomes you are hoping to achieve. The data presented in this report suggest that small-scale events can be as effective as larger participation events with more new editors while larger participation counts tended to have more media files used on Wikipedia articles. This information may be especially useful in budgeting and setting reasonable targets Planning campaign budgets based on the budgets presented here would be helpful if the prizes, and event lenght are reduced. Although, local costs and event style may sometimes significantly affect budgets. Reach out and connect to other leaders To avoid surprises, when using budgets presented here for planning purposes, try to find an event in a location with a similar economy to your area and consider reaching out to successful campaign leader to discuss potential resource needs (including possible budget or donated resources). Alternatively, you can find an event based on the same model in different locations and talk to the campaign leaders about the costs incurred before translating those expenses into local prices. Use the distribution statistics as guardrails against costly plans that may not produce scaled results The average cost per participant in this report may be helpful references, if, as with overall budget information, taken in the context of each event. We hope, as we continue to evaluate the WPWP Campaign and feed the results back into campaign design, that we can learn more from the campaigns achieving the most impact using the fewest resources.
How easily can the program be replicated?	The 2020 edition is the maiden edition of the WPWP Campaign. New campaigns requires adequate supports and documentation to thrive. It involves a lot of learning and evaluation to understand the best practices and effective implementation plan. About 30 Wikimedia affiliates communities joined the campaign last year. This year, the campaign were implemented in about 50 affiliate communities. This is a significant increase in the number of affiliate participation, which suggest that the WPWP Campaign could easily be replicated and might be easy for new affiliates to replicate. The WPWP Campaign has a global international team of 18 experienced community leaders which offers support for local organizers of the campaign, answers questions around promotion, prizes, and potential partners. Furthermore, the global international team is gradually becoming more sophisticated in documenting the campaign and providing the community with tools to measure the competition's results. The WPWP Campaign is one of the campaigns in the Wikimedia movement that has the most cohesive and clear set of goals, measures of success, and documentation for replication of success. Still, we are currently examining a selection of events and reaching out to learn more from local campaign leaders and the strategic team at the WMF in order to develop a program toolkit specifically for gathering the different stories, resources, and advice for how to plan, run, and evaluate this campaign.
Challenges	In a survey report by organizers of the campaign, 23 of the 50 local organizers reported the following challenges in implementing the campaign Since the campaign events were remote, it took more time to train newcomers Lack of interest due to the difficulty in understanding the process of adding photos Hostility from Wikipedia admins Dealing with infobox was sometimes tricky Tracking tool was difficult to use Understanding of how Wikipedia, Wikimedia Commons, and Meta-Wiki work Inability of campaign participants to adhere to campaign rules Participants adding images to multiple languages they do not actually speak Enough time and schedule to conduct regular edit-a-thon. COVID-19 pandemic impacted on in-person activities