Grants talk:IdeaLab/Measure replacement rate among the admins

Individual engagement grant? edit

Latest comment: 5 years ago1 comment1 person in discussion

I only wanted to type down the idea as part of the Inspire campaign… :D — Jeblad 22:27, 19 July 2018 (UTC)Reply

Related Research edit

Those interested in this idea, may also be interested in this Research paper. Where they found that admins on Wikia wikis did not seems to turn over very much.

Link to a draft version of the article.

It was published in the Journal of Communication which is a very good social science journal. — The preceding unsigned comment was added by Groceryheist (talk)

Comments from PEarley (WMF) edit

Latest comment: 5 years ago3 comments2 people in discussion

Hey @Jeblad:, @Gryllida:, and @Mustafa desamangalam:,

This is a great idea! I know that communities often struggle to determine whether they have enough admins, and whether their processes are refreshing the admin group effectively. Some of your ideas about ratios have been looked at by Holder on de.wiki, here’s a presentation they gave at de.wiki’s 2015’s Adminconvention.

Dear Friends @Jeblad:, @Gryllida: Yes I also think that this is a good idea. I know that communities often struggle to determine whether they have enough admins, and whether their processes are refreshing the admin group effectively.

If you are interested in developing this proposal further in terms of funding, myself and some of my colleagues working on the Community Health initiative would be happy to look at some of the technical feasibility aspects of the idea. This might help the proposal get more specific in terms of work needed. Best regards, Patrick Earley (WMF) (talk) 21:02, 7 September 2018 (UTC)Reply

@PEarley (WMF): It could be interesting to look into this. Email me?

The core idea isn't anything more than a spacial page with results from an analysis of number of logged group transitions over a year for an admin normalized over the number of logged group transitions over a year for an autoconfirmed user. They should be over a year to remove periodic changes. Unfortunately promotion to autoconfirmed isn't logged. (Anymore?) It is although possible to recreate this information.

Just as an additional note; there are several other measurements that can be done, and it isn't quite clear which one is the best. One measure is the mean time before promotion from one group to another group, typically from autoconfirmed to admin. If this number grows to big then the admin group becomes aged. Another measure is the number of admins normalized against the number of active users. If this number gets to low the admins will be overloaded. A better (at least simpler) measure of this could be to simply check the fraction of admins in the RC-feed. This number reflects the actual activity level, which is a better overall measure. — Jeblad 01:07, 8 September 2018 (UTC)Reply

@Jeblad:, sent you a mail. Patrick Earley (WMF) (talk) 20:36, 21 September 2018 (UTC)Reply