Problem: Citation bot is very powerful, but needs hugely expanded capacity to meet demand and stop requests timing out.
Proposed solution: 1/ A new front end queuing system for Citation bot, similar to that used by InternetArchiveBot, which allows much bigger jobs and gives priority to single-page requests; 2/ Many more threads than the current limit of four; 3/ enhanced capacity for the Zotero servers on which Citation bot relies for filling bare URLs
Who would benefit: Editors trying to improve references, especially complex refs such as those to scholarly journals, whether on single articles or in batch.
I especially like the idea of having a queuing function so (assuming we cannot find additional compute capacity) at least it won't time out all the time. --Mblumber (talk) 01:13, 11 January 2022 (UTC)Reply[reply]
For IABot, the main non-interactive bot runs on a VPS see Cloud VPS which anyone can request to have. IABot also uses Toolforge for interactive user batch requests. Citation bot could request a VPS (or multiple VPS) running multiple instances on the same VPS and/or multiple instances on the grid (Toolforge) ie. simply increase the Toolforge slot quota. However, I think the main bottleneck for Citation bot is Citoid/Zotero. -- GreenC (talk) 05:18, 11 January 2022 (UTC)Reply[reply]
What would be good, is if the database consulting services of citoid and citationbot could be shared by both tools. Probably not that easy to do however, i suspect they are in different languages. —TheDJ (talk • contribs) 11:06, 12 January 2022 (UTC)Reply[reply]
Citationbot already pulls from Citoid results I believe. Izno (talk) 02:36, 17 January 2022 (UTC)Reply[reply]
I think we should make Citation bot a global feature and we can translate the interface in many languages. Thingofme (talk) 12:23, 12 January 2022 (UTC)Reply[reply]
It would certainly be nice to have more Citation bot capacity. Qwerfjkl (talk) 18:20, 26 January 2022 (UTC)Reply[reply]
Support Congestion with this bot is so bad that editors are not creating articles out of frustration. If Citation bot is not given extra capacity, I predict that the legitimacy of this Community Wishlist Survey itself will be damaged. Abductive (talk) 18:46, 28 January 2022 (UTC)Reply[reply]
Support Citation bot is great when it works, but can take forever to run e.g. on pages with hundreds of papers cited as references. If it breaks, you just have to run it again and hope it works this time. Parallel requests to data sources would help. Modest Genius (talk) 20:21, 31 January 2022 (UTC)Reply[reply]
Support I often use citation bot, and find it annoyingly slow at times and often times out for no apparent reason. I really don't know how BHG puts up with it, she's almost certainly the single largest user of it currently. Mako001 (talk) 03:40, 5 February 2022 (UTC)Reply[reply]
Support I have often seen the edits that Citation bot makes, but I have never been successful in getting it to handle a single page. Just today I have attempted to have it process one particular page about ten times over a period of six hours, but each simply hung until it timed out. There is a huge capacity problem here, apparently. --R. S. Shaw (talk) 05:27, 5 February 2022 (UTC)Reply[reply]