Grants:IdeaLab/Article quality improvement rate

Red heart with heartbeat logo.svg
Article quality improvement rate
Use ORES (Wikimedia's machine learning web service) to regularly score the quality of an article to measure the improvement of the article over time. This article quality improvement rate would be useful for editing communities around single articles, but could also form the basis for a combined improvement score for WikiProjects and task forces.
countryUnited States
themeediting statistics
Hex icon with lightning white.svg
idea creator
this project needs...
Hex icon with hand black.svg
Hex icon with hexes black.svg
Hex icon with lightning black.svg
Hex icon with star black.svg
project manager
Hex icon with bee black.svg
community organizer
Hex icon with circles black.svg
Hex icon with flask black.svg
contact email
created on16:34, 26 July 2018 (UTC)

Project ideaEdit

What Wikimedia project(s) and specific areas will you be evaluating?Edit

Is this project measuring a specific space on a project (e.g. deletion discussions), or the project as a whole?
Wikipedia as a whole and WikiProjects.

Describe your idea. How might it be implemented?Edit

Provide details about the method or process of how you will evaluate your community or collect data. Does your idea involve private or personally identifying information? Take a look at the Privacy Policy for Wikimedia’s guidelines in this area.
ORES would regularly assess the quality of articles to provide a rough score that represents the rate at which an article's quality is increasing (or decreasing). This would enable a visualization of the article's improvement over time, which would motivate editors, and would provide a metric for evaluating the article's health, the best proxy for the health of a community.

This article improvement rate score could then be combined for all the pages in a WikiProject to provide an overall score for the health of the articles in that WikiProject, perhaps with weighting that accounts for the article's importance as well.

In implementing this, we would also have to work out the relationship between ORES's automatic assessments and human assessments. Human assessments should overrule the automatic assessments unless the human assessment is dated and the article has changed substantially.

Are there experienced Wikimedians who can help implement this project?Edit

If applicable, please list groups or usernames of individuals who you can work with on this project, and what kind of work they will do.
The Scoring Platform team, Wikipedia Version 1.0 Editorial Team, User:Mabeenot, User:Scott5114, User:Fredddie, User:Rschen7754, User:Hurricanehink.

How will you know if this project is successful? What are some outcomes that you can share after the project is completed?Edit

Implementation of the score and associated graphs on talk pages and WikiProjects.

How would your measurement idea help your community make better decisions?Edit

After you are finished measuring or evaluating your Wikimedia project, how do you expect that information to be used to benefit the project?
The information would provide an actionable benchmark about article health and the health of the communities attached to those articles, revealing areas where exceptional work is taking place. The practices of those high-performing communities can then be applied to low-performing communities.

Do you think you can implement this idea? What support do you need?Edit

Do you need people with specific skills to complete this idea? Are there any financial needs for this project? If you can’t implement this project, can you scale down your project so it is doable?
I don't have the technical chops to implement this by myself, so I would need the support of those more familiar with ORES, stats, bot programming, and potentially data visualization to implement this.

Get InvolvedEdit

About the idea creatorEdit



Expand your ideaEdit

Would a grant from the Wikimedia Foundation help make your idea happen? You can expand this idea into a grant proposal.

Expand into a Rapid Grant

No funding needed?Edit

Does your idea not require funding, but you're not sure about what to do next? Not sure how to start a proposal on your local project that needs consensus? Contact Chris Schilling on-wiki at I JethroBT (WMF) (talk · contribs) or via e-mail at cschilling for help!