OpenRefine
OpenRefine is a free data wrangling tool that can be used to process, manipulate and clean tabular (spreadsheet) data and connect it with knowledge bases ("spreadsheets on steroids" / "a swiss army knife for data"). It is widely used by librarians, in the cultural sector, by journalists and scientists, and is taught in many curricula and workshops around the world.
- OpenRefine is a popular tool for Wikidata batch editing since 2018.
- OpenRefine supports Wikimedia Commons batch editing and uploading, thanks to a Wikimedia grant, since 2022.
- OpenRefine can also be used to batch import and edit data items and media files in Wikibases.
OpenRefine is a community-supported open source project, licensed under the BSD license. It has a graphical user interface in more than 15 languages.
.svg){kind=logo}
- General links
- OpenRefine's website: https://www.openrefine.org/
- Download OpenRefine: https://openrefine.org/download.html
- Download and install the Wikimedia Commons extension for OpenRefine: https://github.com/OpenRefine/CommonsExtension
- General OpenRefine documentation: https://openrefine.org/docs
- Talk about OpenRefine with its community and with Wikimedia users
- Ask questions on OpenRefine's community forum: https://forum.openrefine.org
- Telegram group for Wikimedians who use OpenRefine: https://t.me/+Qc23Jlay6f4wOGQ0
- Bug reports and feature requests
- On GitHub (for OpenRefine in general): https://github.com/OpenRefine/OpenRefine/issues
- On Wikimedia Phabricator (mainly for Wikimedia Commons reconciliation): https://phabricator.wikimedia.org/tag/openrefine/
OpenRefine for Wikimedians Edit
Cloud version of OpenRefine (on PAWS) for Wikimedians Edit
Is it difficult for you to run OpenRefine on your own computer?
Run OpenRefine in PAWS on Wikimedia’s Cloud Services (you need a Wikimedia account and an internet connection): https://hub-paws.wmcloud.org/
OpenRefine for Wikidata Edit
- OpenRefine for Wikidata editing: info, tutorials... https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine
OpenRefine for Wikimedia Commons Edit
- There is a Wikimedia Commons extension for OpenRefine. It is recommended to install this (download and install) for additional helpful features to work with Wikimedia Commons (thumbnail previews of Commons files; load files from Commons categories; specific GREL scripts).
- OpenRefine for Wikimedia Commons editing: info, how-tos... https://commons.wikimedia.org/wiki/Commons:OpenRefine
- How-to: add structured data to files on Commons with OpenRefine 3.6+ https://commons.wikimedia.org/wiki/Commons:OpenRefine/Adding_structured_data_with_OpenRefine or as a video: https://www.youtube.com/watch?v=kv8bDtO4cq8
- How-to: upload files to Commons with OpenRefine 3.7+ (under construction / experimental) https://docs.google.com/document/d/19eiMeq3XssiPrT9b04E-8XyE-desBEzYNgygLDYKP4o/edit# or as a video: https://www.youtube.com/watch?v=sc6aNNmsNCI
Related tools Edit
OpenRefine edits on Wikidata and Wikimedia Commons can be undone with the EditGroups tool.
- EditGroups on Wikidata: https://editgroups.toolforge.org/
- EditGroups on Wikimedia Commons: https://editgroups-commons.toolforge.org/ (note: is not able to undo uploads; only edits to existing files)
OpenRefine for Wikibase Edit
Reconciliation Edit
- Wikidata’s reconciliation service https://wikidata.reconci.link/
- Wikimedia Commons’ reconciliation service https://commonsreconcile.toolforge.org/
- Setting up reconciliation services for Wikibases: https://openrefine-wikibase.readthedocs.io/en/latest/
- Various (other) reconciliation services via the Reconciliation Testbench: https://reconciliation-api.github.io/testbench/