COIBot for dewikiEdit

hi user:Beetstra!
is COIBot running for dewiki anywhere at (at freenode the bot spoke to #cvn-wp-de.)
i'd like to post several queries, because we found a spamming network at dewiki and want to collect more information about it, see,,, -- seth (talk) 10:32, 19 September 2021 (UTC)

@Lustiger seth: de.wikipedia is not in ownchannel in User:COIBot/Settings. Nonetheless, COIBot should reply to all your questions in any channel where it is, regardless of the 'source' of the information. Do you want to see if we can get COIBot into libera's #cvn-wp-de?
Note that there is also always User:COIBot/Poke. --Dirk Beetstra T C (en: U, T) 10:39, 19 September 2021 (UTC)
Additionally, you could set up {{LinkSummary}} on de.wikipedia for those discussions, and I can make COIBot easily report automatically then. I've not done this yet, but we could even enable COIBot on de.wikipedia and make it report there for de.wikipedia specific reports (it is all controlled through settings). --Dirk Beetstra T C (en: U, T) 10:44, 19 September 2021 (UTC)
"COIBot should reply to all your questions in any channel where it is": ah, ok. that might be sufficient. which channel do you suggest to use?
User:COIBot/Poke: that might be sufficient, too. so could i just add about 20 entries there? (i'm i in the grantedusers group already as i'm a "sysop"?)
using LinkSummary at dewiki and generate de-specific reports sounds interesting, too. -- seth (talk) 18:11, 19 September 2021 (UTC)
and it would be great, if i could generate user reports such as w:en:Wikipedia:WikiProject Spam/UserReports, but for de. -- seth (talk) 20:35, 19 September 2021 (UTC)
@Lustiger seth: - I think that #wikimedia-external-links is rather silent, the real feed channels are often to noisy and you might miss (parts of) the bot's answers.
Poking works for all of the users with granted rights, it is just to 'poke' the bot to report, it will not track those like it would on other pages. The settings that define what COIBot follows/reads for templates is defined in m:User:COIBot/Settings variables: pokepages, followpages, autopokepages and linksummarypages, and regex-lists in regexpages; if you seem to be continuously ignored, add yourself to grantedusers; note that the bot sometimes disconnects from the wikimedia feeds and misses edits through that, and that it sometimes takes time before settings take effect as they are not continuously read with every action that it might need to take (it only reads the settings before it saves to see whether it has editing_on set to '1'). (feel free to adapt the settings, that is the reason they are on-wiki, user:Billinghurst can help as well, he has access to console and IRC as well).
You can just copy {{LinkSummary}} and {{UserSummary}} to de, and adapt the links a bit. It is then just a matter of changing the settings on meta to have it parse those as well (it requires a restart of the core of the bot since that is where that information is parsed). I am not sure whether you can translate the name into German or that I then have to adapt the code (or that I have caught that through localised 'i18n' settings). (to have the reports saved to de.wikipedia we need to have bot-rights on de.wikipedia and set up the local settings and path/category structure - I am rather time limited so I am not sure when/if I will have time to get to the depths of that, it should work mostly through adapting the settings though). (Please let me know what names that you would like to use on de.wikipedia for the templates and I can see if I can get it to work, time allowing).
Poking works on {{UserSummary}} just like for {{LinkSummary}} on all 'poke enabled' pages. Note that sometimes pages are there missed for poking, or that Wikimedia may make COIBot fail saving (blacklisted links, edit filters, etc.) or that the saving module crashes due to a too large report size. Sometimes it takes two or three tries, but sometimes it will never save the report and you will have to use IRC tools to get some data. --Dirk Beetstra T C (en: U, T) 06:16, 20 September 2021 (UTC)
i used the poking yesterday and it seemed to have worked: User:COIBot/LinkReports/ :-)
so i added some more domains there. should i delete the entries in the poke list by myself after the bot has generated the pages?
the LinkSummary template is great as it is. the UserSummary template fits to enwiki only. so i created a german version now: w:de:template:UserSummary. another possibility would be to create a third param such that one could use {{UserSummary|lustiger_seth|de}} in order to replace the default language (en). then i even would not need a local version of that template.
by the way: some links in the UserSummary template don't work, because internal links and GET params are mixed up there. -- seth (talk) 08:28, 20 September 2021 (UTC)
@Lustiger seth: Forgot to say that you also need {{IPSummary}} (for reporting users that are an IP, it has different tools).
I am happy that poking works. You can blank them at will, claim an own section there, the bot looks at the added part of the diff and extracts the added templates from that text. What is on the page has no function afterwards. I know some people use it by blanking and self-reverting the set that they want to refresh sometimes.
For the templates, I would expect that you would want to rename it to your own language (w:de:Template:GebrauchersAbstrakt; is this Abstrakt the right translation of Summary, I am not even sure whether I would use abstrakt or Samenvatting in Dutch)?? Problem there is that I think that 'UserSummary'/'IPSummary' and 'LinkSummary' are hard-coded regexes (I will put te German translations if prefers as soon as I can). What the template displays and what links should work is irrelevant for the bot. The templates also exist here on meta, they have different links and different display format (I like the meta-format more).
Thanks for noticing some links are broken - I will have a look (but apparently then these links are not used a lot, no-one noticed before). --Dirk Beetstra T C (en: U, T) 08:49, 20 September 2021 (UTC)
(talk page stalker) "Abstrakt" does not exist as a noun in German ("Abstract" is used but only in context of papers); you would use "Zusammenfassung". ~~~~
User:1234qwer1234qwer4 (talk)
09:50, 20 September 2021 (UTC)
@1234qwer1234qwer4: I was expecting that, Dutch 'Samenvatting' is also for me a better term. Dirk Beetstra T C (en: U, T) 10:06, 20 September 2021 (UTC)
"user summary" would be something such as "User-Zusammenfassung" (as "user" can be used in german, too[1]) or "Benutzerzusammenfassung". but imho that does not fit to what the template really is.
and actually we have already w:de:template:user which redirects to w:de:template:Benutzer which gives similar but less output. so in theory i could add the link to COIbot reports there. however that would probably lead to long and unnecessary discussions. so a separate template that's primarily used in context of link additions should be fine. the name could be "Nutzerverlinkungen" or "Benutzerinfo" or alike, but as the template should be somehow crosswiki-usable, i'd prefer the somewhat canonical name UserSummary. (in fact i find the localization of such functional names totally counterproductive, but that's another topic.)
nevertheless, i'm still not sure, whether we need COIBot at dewiki or whether it would be sufficient or even better to store all the information here at meta. storing the information at meta might avoid some redundancy and might lead to more cross-wiki exchange of information. what do you think? and what would be easier for you? -- seth (talk) 21:46, 20 September 2021 (UTC)
@Lustiger seth: OK, the current names are the easiest anyway as the software is handling that already. Just let me know if there is ever a German language version and I will adapt the software accordingly then.
There is some local functionality that may be of use to people. E.g. the watchlisting of category-changes on the right categories shows you in your watchlist when COIBot saves a report of local interest (and you can act on it quickly, sometimes while the spammer is still on the current IP or at least active). Similarly the xwiki-reports would be reported to de.wikipedia, and you might be able to react on the additions to the German wikipedia of the links. Also on en.wikipedia the /Local reports are handled by a script which handles closing/addition/logging of blacklist handles (like we do here with SBHandler on meta as well). In short, it gives you some advantages/possibilities. The local reports will anyway be here on meta (see and its subcategories). It will however be a bit of tinkering to get it up and running (setting up the userpage and local settings, getting bot rights, setting up a tree for the reports, categorisation schemes, etc.) which may, due to my low availability, result in some messy times (badly formatted reports, settings not correct, and if there is anything that I did not properly catch in the coding it may stay even longer). (it would however make a nice testcase and I could catch the process in a 'manual' for next times). --Dirk Beetstra T C (en: U, T) 10:07, 21 September 2021 (UTC)
ok, so a local version would have some benefits. however, let's first cope with this here at meta, because this seems to be less time-expensive.
for users and for some links the poking does not seem to work, see User:COIBot/Poke#current_dewiki_seo_spam. what could be the reason? -- seth (talk) 07:30, 24 September 2021 (UTC)
@Lustiger seth: That the reports did not get made can have several reasons: the bot can be blocked for page creation for some reason (title blacklist - unlogged; spam blacklist), the bot can have missed the edit (instability of the network), or reports are too big (which results in the procedure to crash due to memory issues). I have tried to re-poke, I hope they come up. --Dirk Beetstra T C (en: U, T) 07:30, 26 September 2021 (UTC)
i tried to re-poke already.[2] it did not seem to help. -- seth (talk) 07:08, 27 September 2021 (UTC)
@Lustiger seth: I re-tried those as well. I have to see the bot logs (which I can't access from here), there are some which seem to be consistently missed. Dirk Beetstra T C (en: U, T) 10:52, 27 September 2021 (UTC)

repoke: protected or open commandEdit

I have added command. Is it protected or open to all?  — billinghurst sDrewth 23:09, 3 November 2021 (UTC)

@Billinghurst: it is open. —Dirk Beetstra T C (en: U, T) 03:45, 4 November 2021 (UTC)


we have this one to poke under user's noses. Same construct as {{deferlocal}}  — billinghurst sDrewth 09:40, 14 November 2021 (UTC)

@Billinghurst: we need a Template:Blacklist-toolbox somewhere at the top. -- Dirk Beetstra T C (en: U, T) 10:23, 14 November 2021 (UTC)
Do you mean for listing the available templates, like is done in SRCU? If yes, can we wait until the allow and disallow rename is done in the next weeks? We can take notes of what we want to build in the list in the meantime.  — billinghurst sDrewth 11:24, 14 November 2021 (UTC)

liwa3 "link nr search"Edit

<sDrewth> LiWa3_1 link nr add \beurogenes\.blogspot\.\w{2,4}
<LiWa3_1> Item '\\beurogenes\\.blogspot\\.\\w{2,4}' added to nr (INSERT INTO linkwatcher_noredirlist (rule,cloak,reason) VALUES ('\\beurogenes\\.blogspot\\.\\w{2,4}','wikisource/billinghurst',)).
<wm-bot> Change on a page User:COIBot/XWiki/ was modified, changed by Billinghurst link edit summary: /* Discussion */ Closed
<sDrewth> link nr search eurogene
<LiWa3_1> Searching linkwatcher_noredirlist (nr) for rules matching eurogene gives no results
<sDrewth> link nr search eurogene.*
<LiWa3_1> Searching linkwatcher_noredirlist (nr) for rules matching eurogene.* gives no results
<sDrewth> link nr search .*eurogene.*
<LiWa3_1> Searching linkwatcher_noredirlist (nr) for rules matching .*eurogene.* gives no results
<sDrewth> LiWa3_1 link nr search \beurogenes\.blogspot\.\w{2,4}
<LiWa3_1> Searching linkwatcher_noredirlist (nr) for rules matching \beurogenes\.blogspot\.\w{2,4} gives no results
<sDrewth> LiWa3_1 link nr search \\beurogenes\.blogspot\\.\\w{2,4}
<LiWa3_1> Searching linkwatcher_noredirlist (nr) for rules matching \\beurogenes\.blogspot\\.\\w{2,4} gives no results
<sDrewth> LiWa3_1 link nr search \\beurogenes\\.blogspot\\.\\w{2,4}
<LiWa3_1> Searching linkwatcher_noredirlist (nr) for rules matching \\beurogenes\\.blogspot\\.\\w{2,4} gives no results

I am not managing to get the search right for the noredir components. <shrug>  — billinghurst sDrewth 02:26, 21 November 2021 (UTC)

@Billinghurst: Nah, I'll put it on the todo list to have a look at. --Dirk Beetstra T C (en: U, T) 04:56, 21 November 2021 (UTC)

adsense analysis going wild <=> web.archive.orgEdit

The xwiki reports of COIBot has kicked up so that reports are now three times the size that they were see history. Seeing this on predodminantly blogspot reports, though am seeing it elsewhere too, and seems to be related to Special:WhatLinksHere/User:COIBot/LinkReports/ which is the wayback machine  — billinghurst sDrewth 11:43, 27 November 2021 (UTC)

Probably happens because the archive has the original website's AdSense, and then that gets assigned to There is some data in there, but maybe I should code against storing adsense for (we may have that already). Please put it in User:COIBot/Wishlist and maybe I will get to it at some point. Dirk Beetstra T C (en: U, T) 10:41, 28 November 2021 (UTC)