Community Wishlist Survey 2017/Wikisource/Improve workflow for uploading books to Wikisource

◄ Back to Wikisource


  • Problem:
Uploading books to Wikisource is difficult.
In the current workflow you need to upload the file on Commons, then go to Wikisource and create the Index page (and you need to know the exact URL). :The files need to be DJVU, which has different layers for the scan and the text. This is important for tools like Match & Split (if the file is a PDF, this tool doesn't work).
More importantly, the current workflow (especially for library uploads) includes Internet Archive, and the famous IA-Upload tool. This tool is now fundamental for many libraries and uploaders, but it has several issues.
As Internet Archive stopped creating the DJVU files from his scans, the international community has struggled solving the issue of creating automatically a DJVU for uploading on Commons and then Wikisource.
This has created a situation where libraries love Internet Archive, want to use it, but then get stuck because they don't know how to create a DJVU for Wikisource, and the IA-Upload is bugged and fails often.
Summary
    • IA-Upload tool is bugged and fails often when creating DJVU files.
    • M&S doesn't work with PDF files.
    • Users do not expect to upload to Commons when transferring files from Internet Archive to Wikisource.
    • Upload to Internet Archive is an important feature expecially for GLAMs (ie. libraries).
  • Who would benefit:
    • all Wikisource communities, especially new users
    • new GLAMs (libraries and archives) who at the moment have an hard time coping with the Wiki ecosystem.
  • Proposed solution:
Improve the IA-Upload tool: https://tools.wmflabs.org/ia-upload/commons/init
The tool should be able to create good-quality DJVU from Archive files, and do not fail as often as it does now.
it should also hide, for the end-user, the uploading to Commons phase. The user should be able to upload a file on Internet Archive, and then use the ID of the file to directly create the Index page on Wikisource. We could have an "Advanced mode" that shows all the passages for experienced user, and a "Standard" one that makes things more simple.
  • More comments:
  • Proposer: Aubrey (talk) 11:18, 18 November 2017 (UTC)[]

DiscussionEdit

  • sounds like a plan ! I think it's about time we dedicated some more focused effort towards wikisource. —TheDJ (talkcontribs) 14:38, 18 November 2017 (UTC)[]
  • Also, if we can revive the BUB it would be awesome, and would help a lot to the workflow --Ninovolador (talk) 13:09, 20 November 2017 (UTC)[]
    • Should we be considering adding BUB's features to ia-upload? Sam Wilson 08:09, 4 December 2017 (UTC)[]
  • Strong endorsement. Anything to improve the upload process would be welcome and would encourage uptake on Wikisource. There is also the proposal to improve the process of creating Index pages (by making it easier to see a thumbnail of multiple pages rather than having to click into each individually) which was started on this phabricator ticket by Sam Wilson at Wikimania. Stinglehammer (talk) 17:51, 20 November 2017 (UTC)[]
  • endorse uploading works is a major bottleneck across multiple projects, requiring expertise, opaque user interface. need to make useable by new users. Slowking4 (talk) 23:57, 27 November 2017 (UTC)[]

VotingEdit

  •   Support A BUB-like process would be wonderful. NMaia (talk) 00:31, 28 November 2017 (UTC)[]
  •   Support, maybe it could be done with a specific Upload Campaign on Commons ? and it should definitely be bone in relation with the Structured Commons project (@SandraF (WMF):). VIGNERON * discut. 08:58, 28 November 2017 (UTC)[]
  •   Support --Liuxinyu970226 (talk) 13:31, 28 November 2017 (UTC)[]
  •   Support Sadads (talk) 13:54, 28 November 2017 (UTC)[]
  •   Support --Consulnico (talk) 15:19, 28 November 2017 (UTC)[]
  •   Support Manseng (talk) 15:25, 28 November 2017 (UTC)[]
  •   Support Acélan (talk) 15:47, 28 November 2017 (UTC)[]
  •   Support Sannita - not just another it.wiki sysop 20:13, 28 November 2017 (UTC)[]
  •   Support Thomas Obermair 4 (talk) 23:19, 28 November 2017 (UTC)[]
  •   Support Toto256 (talk) 06:30, 29 November 2017 (UTC)[]
  •   Support AlessioMela (talk) 10:37, 29 November 2017 (UTC)[]
  •   Support it seems an important issue to improve. Alexmar983 (talk) 11:22, 29 November 2017 (UTC)[]
  •   Support Donald Trung (Talk 🤳🏻) (My global lock 🔒) (My global unlock 🔓) 13:28, 29 November 2017 (UTC)[]
  •   Support --*j*jac (talk) 14:58, 29 November 2017 (UTC)[]
  •   SupportTheDJ (talkcontribs) 17:23, 29 November 2017 (UTC)[]
  •   Support Ocaasi (talk) 17:31, 29 November 2017 (UTC)[]
  •   Support Mathieugp (talk) 19:36, 29 November 2017 (UTC)[]
  •   Support Atudu (talk) 04:32, 30 November 2017 (UTC)[]
  •   Support The wikisource workflow (including the creation of DjVu from Googlebook or from JPG scans) shall be improved and made easier for everyone. Accurimbono (talk) 08:10, 30 November 2017 (UTC)[]
  •   Support but the feature : use the ID of the file to directly create the Index page on Wikisource may be too much, and full of surprises the novice contributor will not able to cope with. --Wuyouyuan (talk) 15:49, 30 November 2017 (UTC)[]
  •   Support Mickey83 (talk) 21:49, 30 November 2017 (UTC)[]
  •   Support Sahaquiel9102 (talk) 22:07, 30 November 2017 (UTC)[]
  •   Support, to ease newcomers' lives. Trizek from FR 11:31, 1 December 2017 (UTC)[]
  •   Support Jayantanth (talk) 14:26, 1 December 2017 (UTC)[]
  •   Support --Jarekt (talk) 21:09, 1 December 2017 (UTC)[]
  •   Support ~Cybularny Speak? 13:39, 2 December 2017 (UTC)[]
  •   Support Viticulum (talk) 20:09, 2 December 2017 (UTC)[]
  •   Support Elena moz (talk) 22:16, 2 December 2017 (UTC)[]
  •   Support Bzhqc (talk) 10:39, 3 December 2017 (UTC)[]
  •   Support PMG (talk) 16:52, 3 December 2017 (UTC)[]
  •   Support LikeLifer (talk) 18:43, 3 December 2017 (UTC)[]
  •   Support HugoHelp (talk) 02:41, 4 December 2017 (UTC)[]
  •   Support Bodhisattwa (talk) 11:50, 5 December 2017 (UTC)[]
  •   Support Ouvrard (talk) 15:42, 5 December 2017 (UTC)[]
  •   Support MartinPoulter (talk) 10:31, 6 December 2017 (UTC)[]
  •   Support Important improvement. εΔω 11:15, 6 December 2017 (UTC)
  •   Support Aubrey (talk) 19:19, 6 December 2017 (UTC)[]
  •   Support --Edhral 19:47, 6 December 2017 (UTC)[]
  •   Support Micru (talk) 20:10, 6 December 2017 (UTC)[]
  •   Support Tpt (talk) 20:30, 6 December 2017 (UTC)[]
  •   Support --Emmepici (talk) 21:11, 6 December 2017 (UTC)[]
  •   Support --Silvio Gallio (talk) 21:37, 6 December 2017 (UTC)[]
  •   Support Barsetti46 (talk) 03:00, 7 December 2017 (UTC)[]
  •   Support Thurs (talk) 06:14, 7 December 2017 (UTC)[]
  •   SupportNala Discuter 08:12, 7 December 2017 (UTC)
  •   Support --EusebiaP (talk) 09:42, 7 December 2017 (UTC)[]
  •   Support --Sbubi (talk) 09:54, 7 December 2017 (UTC)[]
  •   Support --Afnecors (talk) 09:56, 7 December 2017 (UTC)[]
  •   Support --Chiara (talk) 11:18, 7 December 2017 (UTC)[]
  •   Support --Alex brollo (talk) 10:28, 7 December 2017 (UTC)[]
  •   Support -- Игорь Филиппов (talk) 10:43, 7 December 2017 (UTC)[]
  •   Support --Xavier121 (talk) 11:09, 7 December 2017 (UTC)[]
  •   Support Yes, Wikisources processes are diffucult. It's really slowing down community growing. Artem.komisarenko (talk) 00:02, 8 December 2017 (UTC)[]
  •   Support  Bertrand GRONDIN   → (Talk) 17:39, 9 December 2017 (UTC)
  •   Support Clockery Fairfeld (talkenWS) 13:08, 10 December 2017 (UTC)[]
  •   Support Ruslik (talk) 13:38, 10 December 2017 (UTC)[]
  •   Support Jahl de Vautban (talk) 19:25, 10 December 2017 (UTC)[]
  •   Support Zppix (talk) 20:54, 10 December 2017 (UTC)[]
  •   Support Spinster (talk) 22:29, 10 December 2017 (UTC)[]
  •   Support Candalua (talk) 06:02, 11 December 2017 (UTC)[]
  •   Support Psychoslave (talk) 08:52, 11 December 2017 (UTC)[]
  •   Support Seudo (talk) 09:37, 11 December 2017 (UTC)[]
  •   Support — Luchesar • T/C 14:37, 11 December 2017 (UTC)[]
  •   Support Abbe98 (talk) 17:05, 11 December 2017 (UTC)[]
  •   Support X:: black ::X (talk) 17:13, 11 December 2017 (UTC)[]