Community Tech bot

Archives

---

1

Popular pages: what is the "total views" number counting?

Hi @MusikAnimal (WMF): At the start of the popular pages report example here is a line for "Total views:". What is this the total views of? In the case I've given, it's not a total of the views of the 500 listed articles; that comes to about 67 million, but the "Total views" number is just over twice that. Is it counting the total views for all articles in scope of the Wikiproject? I've had a look at the code on GitHub but can't find where this is calculated. I'm using these numbers in a research paper and want to be sure what they measure. Thanks in advance for any help, MartinPoulter (talk) 15:32, 1 December 2023 (UTC)

@MartinPoulter Apologies for the late reply! Indeed, the "Total views" is across all pages of that WikiProjects. Many WikiProjects simply have too many pages to list on one wiki page, which is what the cut-off is 500 (or whatever is configured at en:User:Community Tech bot/Popular pages config.json). MusikAnimal (WMF) (talk) 02:21, 19 December 2023 (UTC)

Remove Importance column from Popular pages

Hi @MusikAnimal (WMF): w:Wikipedia:WikiProject Anarchism/Popular pages is showing an Importance column even though the project does not use an Importance rating. What would be the best way to have the bot remove this? I did not see documentation on Community Tech/Popular pages bot. czar 14:41, 26 December 2023 (UTC)

@Czar It seems like a narrow use case so I'm think using mw:TemplateStyles would be best, as opposed to adding an option to the bot's config or something. I've implemented this, and since the bot ignores the first section, the "Importance" column should remain hidden as future updates are made. Best, MusikAnimal (WMF) (talk) 00:25, 3 January 2024 (UTC)

Using TemplateStyles sounds like a good solution but I whenever I've tried to create a template style for a WikiProject page, it wouldn't let me, due to not having the rights to change the content model of the style page in the Wikipedia namespace to "Sanitized CSS", and I didn't feel comfortable with the rigmarole of getting an admin to do it. StefenTower (talk) 00:35, 3 January 2024 (UTC)

Thanks! For anyone attempting to do this in the future, here are the diffs: [1][2] czar 13:28, 3 January 2024 (UTC)

@StefenTower Indeed, a sysop is needed unless you move your TemplateStyles under the Template namespace, which would be odd placement in this case, I think. The other alternative as I mentioned is to introduce a configuration option, but that would also need sysop intervention as you'd need to change w:User:Community Tech bot/Popular pages config.json. I think making an edit request on the config talk page and asking to change the content model of a related page is fine, even though technically it's not an "edit request". Just my 2c. All I know is there are admins who are are happy to help :) MusikAnimal (WMF) (talk) 17:43, 3 January 2024 (UTC)

Thank you. I was afraid I'd have to defend such a request for it being "unusual", but now I know better. :) StefenTower (talk) 18:56, 3 January 2024 (UTC)

Popular pages not updating

Hi,

This page WikiProject_Classical_music/Popular_pages seems like its not updating properly.

I looked at User:Community Tech bot/Popular pages and Community_Tech/Popular_pages_bot#Troubleshooting and but could not identify the cause...

Thanks in advance Gor1995 (talk) 23:32, 3 January 2024 (UTC)

@Gor1995 No articles show up at all when using Special:PageAssessments, which tells me there is a storage issue with the template. At quick glance, I suspect w:Special:Diff/1175985846 by @WOSlinker is the culprit. That changed from using the w:Template:WPBannerMeta to using w:Module:WikiProject banner directly. The latter appears to use the {{#assessment}} parser function, but I'm not certain if it works as expected. I see the various U.S. Roads WikiProjects are also empty (example), and similar there's w:Special:Diff/1174265071 by @MSGJ. I checked a few other templates that also use the module, such as w:Template:WikiProject Agriculture and w:Template:WikiProject Africa, and they are working correctly. The difference I see in the implementation seems to be the passing in of the |class= and |assessment= parameters. I would try doing the same for w:Template:WikiProject Classical music, etc. Hope this helps, MusikAnimal (WMF) (talk) 18:01, 9 January 2024 (UTC)

The classical music project has not maintained article assessments since 2009 [3] MSGJ (talk) 18:19, 9 January 2024 (UTC)

Gor1995 & MSGJ, If you look at the last line of the deleted WPBannerMeta/core template, it seems as though the pageassessments tag was still set even if class and importance were not used. So I think just adding {{#assessment:Classical music||}} to Template:WikiProject Classical will fix it. Or maybe Module:WikiProject_banner should apply it all the time? -- WOSlinker (talk) 10:30, 10 January 2024 (UTC)

What is the purpose of using PageAssessments if class and importance are not used by the project? MSGJ (talk) 10:40, 10 January 2024 (UTC)

@MSGJ It still groups the pages under the WikiProject in the page assessments database, which is necessary to generate the popular pages report. It can also help answer questions like "who's active in this WikiProject". I'm working on phab:T344464 for example which also relies on the page assessment data being complete. MusikAnimal (WMF) (talk) 06:20, 15 January 2024 (UTC)

Even if I would understand any of the points raised here (I don't), there's nothing I can do about it because the template is protected. Updating en:Wikipedia:WikiProject Classical music/Popular pages worked until August 2023. I would like to see it working again. Can somebody who understands the problem please fix en:Template:WikiProject Classical music or whatever page needs fixing? -- Michael Bednarek (talk) 06:44, 15 January 2024 (UTC)

Following up on en:Module talk:WikiProject banner MSGJ (talk) 11:08, 19 January 2024 (UTC)

Looks like it's fixed now, thanks! -- Gor1995 (talk) 11:05, 5 February 2024 (UTC)

maybe the same as above?

Not sure of the correct process to request more frequent updates of the WikiProject Oceania popular page - it has residual issues from incorrectly identified items that have not fitted into the Oceania scope/subject by a misfiring bot process in 2023. Is it possible to ask for more frequent updates, or is it just a matter of being patient for an otherwise restricted process... :JarrahTree (talk) 02:24, 5 February 2024 (UTC)

@JarrahTree The bot only runs once a month. WikiProject Oceania however is a rather small project. so you could instead get real-time results using toolforge:massviews. See the troubleshooting tips for more information. Here is an example for results over the past 20 days. I'll admit there are bugs with Massviews, that I hope to fix soon. If you see a bunch of errors, try refreshing after the query finishes. Hope this helps, MusikAnimal (WMF) (talk) 22:24, 14 February 2024 (UTC)

@MusikAnimal (WMF) (talk. Thank you very much, your reply is appreciated, thank you... :JarrahTree (talk) 02:12, 15 February 2024 (UTC)

Popular pages reports behind schedule

Tracked in Phabricator:
Task T365780

Normally a popular pages report (like here) would have gone through its monthly update days ago. Any idea when this will be back up and running? StefenTower (talk) 22:06, 14 May 2024 (UTC)

@StefenTower We had a bit of a late start this month, then things broke. I believe it is all sorted out now. The bot should get through all WikiProjects in due time. Apologies for the disruption! MusikAnimal (WMF) (talk) 15:45, 15 May 2024 (UTC)

Thanks for the update. I see that it's running now. Cheers! StefenTower (talk) 17:50, 15 May 2024 (UTC)

Now it seems to be stalled again. It stopped at WikiProject Disability yesterday morning. StefenTower (talk) 21:21, 16 May 2024 (UTC)

Sorry :( I've got this tracked at phab:T365780. For this month's run, I'm just manually restarting, but I hope to have everything fixed for June's run. MusikAnimal (WMF) (talk) 01:57, 24 May 2024 (UTC)

Thank you for your work, but I am concerned we're going to run out of this month before April's reports are generated. Two projects I'm involved with are still missing their April report. If there's a way I can run these individually, please let me know. Thanks. StefenTower (talk) 21:21, 24 May 2024 (UTC)

@StefenTower We can do that! WikiProject Louisville is under 20,000 pages, so for that you could use toolforge:massviews, i.e. [4]. Though I admit there's an issue (quite similar to what the bot is facing!) with throttling of the Pageviews API. For Massviews, just let it "finish" with all the errors, then hit refresh and it should work the second time.

Apologies for the inconvenience. MusikAnimal (WMF) (talk) 22:17, 24 May 2024 (UTC)

I meant produce the official report, as I knew about Massviews. What I didn't know is Massviews works better after a refresh. Thanks for that nugget! StefenTower (talk) 22:40, 24 May 2024 (UTC)

By the way, this helped with one way I use the report, but the other aspect of how it shows the quality/importance assessments of each entry and being able to sort by those is needed. I haven't been able to figure out a way to generate this separately from this report. StefenTower (talk) 19:02, 26 May 2024 (UTC)

@StefenTower I just ran a one-off for w:Wikipedia:WikiProject Louisville/Popular pages. MusikAnimal (WMF) (talk) 23:08, 26 May 2024 (UTC)

Thank you very much! StefenTower (talk) 23:18, 26 May 2024 (UTC)

lag for new reports?

I think I set up these two correctly recently:

• en:Wikipedia:WikiProject Hungary/Popular pages
• en:Wikipedia:WikiProject Montenegro/Popular pages

But the bot didn't touch them, and seems to have been largely idle on the popular pages updates for the last couple of days. What's going on? --Joy (talk) 19:36, 16 October 2024 (UTC)

@Joy The "Name" property should match what is entered into en:Special:PageAssessments. I.e. it's Hungary, not WikiProject Hungary. Fixed with w:Special:Diff/1252774530. See also the troubleshooting tips. Best, — MusikAnimal ^talk 22:01, 22 October 2024 (UTC)

Thanks! Hoping it works now (still not seeing any changes). Any chance we can get this semi-obvious prefix workaround implemented in code? :) --Joy (talk) 22:11, 22 October 2024 (UTC)

@Joy The bot only runs monthly, but I have ran one-off jobs for the two projects so you don't need to wait a week :)

We could auto-strip the "WikiProject" prefix, but the bot is written to be wiki-agnostic, so it has no knowledge of "WikiProject" as a norm, so to speak. I think I'd rather not hack around it, and let the database (w:Special:PageAssements) be the source of truth. Thanks for the suggestion, nonetheless. — MusikAnimal ^talk 23:39, 22 October 2024 (UTC)