Learning and Evaluation/Plan your program metrics/Convert new users

Part of the Wikimedia Resource Center

Learning and Evaluation

• Start
• Plan
• Report
  • Overview
  • Setting goals and measures
  • Plan your program metrics
  • Global metrics
  • Capturing your metrics
• Contribute
• News and Events

Back to Measures for Evaluation Convert New Users Goal: convert new users into contributors or into active editors Example Programs, Projects, or Events create a on-wiki tutorial for users with less than 10 edits (e.g. Wikipedia Adventure, Teahouse) editing workshop or series of editathons invite wiki loves monuments contributors to make edits

Measurement Tool

Inputs

Number of organizing and supporting staff and volunteers (ambassadors, mentors etc.)

Count of supporting staff and volunteers

Meeting Records, Logs, Reported estimates

Hours invested by staff and volunteers organizing and executing

Estimate of hours invested

Calendar Records, Logs, Reported estimates

In-kind donations (prizes, etc),

Estimated value in currency (comparable cost)

Funds or money used

Budget accounting

Budget spreadsheet

Participant pool to draw new account creators to convert from

Participant usernames

Project or event page or other username list

Measurement Tool

Outputs

Number of participants involved in the project or program event

Count of total number of participants

Project or event page or other participant tracking

Number of acquired new account users

Number of participant usernames with less than 10 edits

Wikimetrics, Edits (from event date forward) or Threshold (from account registration date forward)

Amount of text improved during event

Number of bytes added or removed

Wikimetrics, Bytes Added

Measurement Tool

Short term outcomes

( Activation )

Participant motivation to contribute

Participant self-report

Poll or questionnaire

Participant skills (editing skills, policy knowledge, process awareness)

Participant self-report AND/OR direct observation

Poll or questionnaire AND/OR quizzes/tasks with monitoring (i.e., human observer or mechanical observation via Wikimetrics/Mediawiki)

Number of new institutions/partnerships

Count of new institutions and partners working to implement Wikimedia programs

Direct observation/Program documentation

Measurement Tool

Intermediate outcomes

( Productivity )

Number of participants who became contributors
(10+ edits over lifetime)

Number of Contributors (10+ edits over lifetime)

Wikimetrics, Threshold (from account registration date forward) or Edits (from event date forward)

Amount of text improved since the program event

Number of bytes added or removed

Wikimetrics - Bytes Added

( Retention )

New Editor retention

Number of new editors survived (i.e., 1+ edits in past 30-days) at 30 days and 3, 6, and 12 months

Wikimetrics - Survival (from account registration date) or Edits (from event date)

New Editor Conversion to Active Editors

Number of new editors became active editors (i.e., 5+ edits in past 30-days) at 30 days and 3, 6, and/or 12 months

Wikimetrics - Rolling New Active Editors (from account registration date forward) Rolling Active Editors (from event date forward), or Edits (from event date forward)