Community Wishlist Survey 2022/Citations/More capacity for Citation bot

More capacity for Citation bot

  • Problem: Citation bot is very powerful, but needs hugely expanded capacity to meet demand and stop requests timing out.
  • Proposed solution: 1/ A new front end queuing system for Citation bot, similar to that used by InternetArchiveBot, which allows much bigger jobs and gives priority to single-page requests; 2/ Many more threads than the current limit of four; 3/ enhanced capacity for the Zotero servers on which Citation bot relies for filling bare URLs
  • Who would benefit: Editors trying to improve references, especially complex refs such as those to scholarly journals, whether on single articles or in batch.
  • More comments: This has been repeatedly discussed at User talk:Citation bot, but the excellent maintainer faces hurdles which he cannot surmount: see e.g. https://en.wikipedia.org/w/index.php?title=User_talk:Citation_bot&oldid=1064839514#And_failure_is_the_usual_option_again
  • Phabricator tickets:
  • Proposer: BrownHairedGirl (talk) 18:42, 10 January 2022 (UTC)Reply[reply]

Discussion

  • I especially like the idea of having a queuing function so (assuming we cannot find additional compute capacity) at least it won't time out all the time. --Mblumber (talk) 01:13, 11 January 2022 (UTC)Reply[reply]
  • For IABot, the main non-interactive bot runs on a VPS see Cloud VPS which anyone can request to have. IABot also uses Toolforge for interactive user batch requests. Citation bot could request a VPS (or multiple VPS) running multiple instances on the same VPS and/or multiple instances on the grid (Toolforge) ie. simply increase the Toolforge slot quota. However, I think the main bottleneck for Citation bot is Citoid/Zotero. -- GreenC (talk) 05:18, 11 January 2022 (UTC)Reply[reply]
  • I concur with this proposal. -- TheInternetGnome (talk) 10:09, 11 January 2022 (UTC)Reply[reply]
  • Resources are certainly needed in this area. For an alternative approach to getting people working on this, see also w:WP:VPT#Proposed Google Summer of Code project: expanding citations. Enterprisey (talk) 08:09, 12 January 2022 (UTC)Reply[reply]
  • What would be good, is if the database consulting services of citoid and citationbot could be shared by both tools. Probably not that easy to do however, i suspect they are in different languages. —TheDJ (talkcontribs) 11:06, 12 January 2022 (UTC)Reply[reply]
    This. Enterprisey (talk) 09:55, 13 January 2022 (UTC)Reply[reply]
    Citationbot already pulls from Citoid results I believe. Izno (talk) 02:36, 17 January 2022 (UTC)Reply[reply]
  • I think we should make Citation bot a global feature and we can translate the interface in many languages. Thingofme (talk) 12:23, 12 January 2022 (UTC)Reply[reply]
  • It would certainly be nice to have more Citation bot capacity. Qwerfjkl (talk) 18:20, 26 January 2022 (UTC)Reply[reply]

Voting