Research:Slow Editing Towards Equity
Researching Wikipedian policy development and knowledge equity. This project aims to identify the skills needed by Wikipedians to move equity initiatives through the policy development process. The grantees will evaluate the paths of equity initiatives through the policy development process in five Wikipedia language editions (Arabic, Dutch, English, French, and Spanish). We will collect and analyze both successful and failed proposals that sought to increase knowledge equity. This work has the potential to increase understanding of Wikipedia’s policy landscape and how existing practices influence the likelihood of a proposal’s success. The project will produce both academic publications as well as a field guide to policy change.
Goals & Intended ImpactsEdit
The intended goal of this research is to provide a set of best practices, skills, and role descriptions that Wikipedians can mobilize in order to enact policy changes. This will be achieved by using mixed methods (content analysis, qualitative textual analysis, and interface analysis) as part of two research strategies.
- Research strategy 1: Analyze the moments when Wikipedians successfully and unsuccessfully garnered the broader acceptance of the community; such as by moving an essay or project page into a guideline or official policy within different language editions.
- Research strategy 2: Collect and analyze both successful and failed policy proposals that were designed to increase knowledge equity.
The major impact of the work will be in increasing the knowledge of how Wikipedia’s policy environment is developed and how these practices have shaped the success and failure of equity-based policy proposals. In doing so, policy reform initiatives will benefit by learning from this history and can plan their activities and mentorship accordingly. Furthermore, this research will be applicable to multiple languages of Wikipedia and therefore adds to the capacity of the re- search to address the diverse needs of different Wikipedian communities. As such, it is expected that policy workshops and taskforces will use this information to train Wikipedians and new users on how to develop and maintain equitably policies.
- RQ1. What kinds of skills and roles have Wikipedians used to move a rule from an initial project page (or essay) to established policy?
- RQ2. What are the markers of successful policy proposals and the barriers for unsuccessful policy proposals dedicated to increasing knowledge equity?
Over the past decade, there has been a significant and concerted effort to address both Wikipedia’s knowledge equity and the relative stagnation in increasing and retaining editors. This has manifested in article creation initiatives like Art+Feminism and Whose Knowledge?. However, knowledge equity is not just a question of content — it is also about process. As Amanda Menking and Jon Rosenberg argued, Wikipedia’s policy environment reinforces problematic norms about knowledge processes. Similar sentiments have been levelled against specific guidelines and policies dealing with reliable sources, and notability. As such there is a need to reconsider the foundational assumptions about knowledge that are being manifested in these community-defining documents. Given this situation, the research project proposes that in order for the 2030 Wikimedia Strategic Direction on knowledge equity to succeed, these concerns about Wikipedia’s policies must be addressed.
To understand the methods chosen for this research, it is necessary to first understand how the research object will be theorized. In this particular instance, policies and policy-making will be conceptualized according to legal scholar Cornelia Vismann’s position that legal media exist as “cultural techniques”. This means that the “making” of policy is not simply the translation of a wiki-based discussion into a document. Instead, policy development will be understood as the combination of actions and tools that connect logics (how it is argued into being on the talk page), inscription and storage (the changing composition of the policy page), and its circulation (practices of hyperlinking to policy documents). This theoretical approach falls in line with previous research about Wikipedian governance that is sensitive to the entwined relationship between social practices and technical operations. Consequently, this socio-technical approach requires a unique set of mixed methods. In particular, one that combines the quantitative benefits of content analysis, the interpretative value of textual analysis, and the media-sensitivity of interface analysis, methods that have been used in other research projects. The synthesis of these methods will provide the means for answering the following research questions.
Content analysis, textual analysis, and interface analysis will be used to analyze Wikipedia's policy environment.
|Project organization||Research Strategy 1: Policy development skills and roles||Research Strategy 2: Assessment of knowledge equity policy proposals||Project Communications|
|July 2022||Make arrangements with fiscal sponsor|
|August 2022||Hire Post-doctoral researchers and assistant researcher|
|September 2022||Team Briefing||Data Collection: English
||- Develop social media assets for communications|
|October 2022||Analysis: English|
|November 2022||Team Meeting: Data Collection Datasprint||Analysis: English
Data Collection: Arabic, Dutch, French, Spanish
|Data Collection: English|
|December 2022||Team Meeting: Coding Scheme calibration||Analysis: Spanish||Analysis: English
Data Collection: Spanish
|- [Pushed from October] Finalize social media assets for communications|
- Ongoing community awareness of the project via noticeboards and social media begins
|January 2023||Team Meeting||Analysis: Arabic, Dutch, French, Spanish||Analysis: English, Spanish
Data Collection: Arabic, Dutch, French
|February 2023||Analysis: Arabic, Dutch, French||Analysis: Arabic, Dutch, French|
|March 2023||Team Meeting||Report writing: All languages||Analysis: Arabic, Dutch, French|
|April 2023||Report writing: All languages|
|May 2023||Team Meeting||- International Communication Association Annual Conference|
- Submit research to academic journals
- Produce public-facing report and guideline for policy reform activities
|June 2023||Team Debriefing||- End of project communications of final report|
- December 2022
- Second pass of the Research Strategy 1 coding scheme through cross-coding.
- Tagging of 3 policies from each of the five languages being studied begun.
- November 2022
- Datasprint for data collection for the Arabic, English, Dutch, French, and Spanish versions. Each researcher began a pilot analysis of three policies relevant to the research.
- First pass of the Research Strategy 1 coding scheme completed.
- Data collection for Research Strategy 2 (English) begun.
- October 2022
- Meeting with fiscal sponsor to coordinate budget
- Submitted Abstract for the International Communication Association Annual Conference (Rejected, January 2023)
- September 2022
- Two post-doctoral researchers and one research assistant formally hired
- First meeting with research team
- Data collection started for Research Strategy 1 (English)
- Development of social media assets for research communications
- July-August 2022
- Administrative meetings with fiscal sponsor (University of Amsterdam) and WMF to process funding.
- June 2022
- Slow editing towards equity research project proposal accepted.
- Menking, Amanda; Rosenberg, Jon (2020). "WP: NOT, WP: NPOV, and Other Stories Wikipedia Tells Us: A Feminist Critique of Wikipedia’s Epistemology.". Science, Technology, & Human Values: 1–25.
- Berson, Amber; Sengul-Jones, Monika; Tamani, Melissa (2013). "Unreliable Guidelines: Reliable Sources and Marginalized Communities in French, English, and Spanish Wikipedias". Art+Feminism. Retrieved 2022-09-26.
- Gauthier, Maude; Sawchuk, Kim (2017). "Not notable enough: feminism and expertise in Wikipedia". Communication and critical/cultural studies (14): 385––402.
- Tripodi, Francesca (2021). "Ms. Categorized: Gender, notability, and inequality on Wikipedia". New Media & Society: 1–21.
- Maher, Katherine (2017-08-10). "Wikimedia 2030: A draft strategic direction for our movement". Diff.Wikimedia. Retrieved 2022-09-26.
- Vismann, Cornelia (2008). Files: Law and media technology. Stanford University Press.
- Vismann, Cornelia (2013). "Cultural Techniques and Sovereignty". Theory, Culture & Society (30): 83–93.
- Geiger, Stuart (2017). "Beyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture.". Big Data & Society: 1–14.
- Ford, Heather; Wajcman, Judy (2017). "`Anyone can edit’, not everyone does: Wikipedia’s infrastructure and the gender gap". Social Studies of Science: 1–17.
- Jankowski, Steve (2022). "Making Consensus Sensible: The Transition of a Democratic Ideal into Wikipedia’s Interface". Journal of Peer Production (15). Retrieved September 26, 2022.
- Jankowski, Steve. "The Trouble with Knowing: Wikipedian consensus and the political design of encyclopedic media". York University. Retrieved September 26, 2022.
- Jankowski, Steve (2015). "No consensus on consensus: A paradox within Wikipedian governance and collective action". In Torres, C.; Mateus, S. From Multitude to Crowds- Collective Action and the Media. Peter Lang. pp. 177–196.