Learning and Evaluation/Plan your program metrics/Convert new users

Learning and Evaluation

Convert New Users

Goal: convert new users into contributors or into active editors
Example Programs, Projects, or Events
  • create a on-wiki tutorial for users with less than 10 edits (e.g. Wikipedia Adventure, Teahouse)
  • editing workshop or series of editathons
  • invite wiki loves monuments contributors to make edits



Measurement Tool

Inputs


Number of organizing and supporting staff and volunteers (ambassadors, mentors etc.)

Count of supporting staff and volunteers

Meeting Records, Logs, Reported estimates


Hours invested by staff and volunteers organizing and executing

Estimate of hours invested

Calendar Records, Logs, Reported estimates


In-kind donations (prizes, etc),

Estimated value in currency (comparable cost)


Funds or money used

Budget accounting

Budget spreadsheet


Participant pool to draw new account creators to convert from

Participant usernames

Project or event page or other username list



Measurement Tool

Outputs

Number of participants involved in the project or program event

Count of total number of participants

Project or event page or other participant tracking


Number of acquired new account users

Number of participant usernames with less than 10 edits

Wikimetrics, Edits (from event date forward) or Threshold (from account registration date forward)


Amount of text improved during event

Number of bytes added or removed

Wikimetrics, Bytes Added



Measurement Tool

Short term outcomes


( Activation )


Participant motivation to contribute

Participant self-report

Poll or questionnaire


Participant skills (editing skills, policy knowledge, process awareness)

Participant self-report AND/OR direct observation

Poll or questionnaire AND/OR quizzes/tasks with monitoring (i.e., human observer or mechanical observation via Wikimetrics/Mediawiki)


Number of new institutions/partnerships

Count of new institutions and partners working to implement Wikimedia programs

Direct observation/Program documentation



Measurement Tool

Intermediate outcomes


( Productivity )


Number of participants who became contributors
(10+ edits over lifetime)

Number of Contributors (10+ edits over lifetime)

Wikimetrics, Threshold (from account registration date forward) or Edits (from event date forward)


Amount of text improved since the program event

Number of bytes added or removed

Wikimetrics - Bytes Added


( Retention )


New Editor retention

Number of new editors survived (i.e., 1+ edits in past 30-days) at 30 days and 3, 6, and 12 months

Wikimetrics - Survival (from account registration date) or Edits (from event date)


New Editor Conversion to Active Editors

Number of new editors became active editors (i.e., 5+ edits in past 30-days) at 30 days and 3, 6, and/or 12 months

Wikimetrics - Rolling New Active Editors (from account registration date forward) Rolling Active Editors (from event date forward), or Edits (from event date forward)