Grants:APG/Proposals/2015-2016 round1/Wikimedia Argentina/Staff proposal assessment/da

Other languages:
English • ‎dansk • ‎español • ‎français • ‎বাংলা

The staff proposal assessment is one of the inputs into the Funds Dissemination Committee (FDC) proposal review process, and is reviewed by the FDC in preparation for and during the in-person deliberations each round. The purpose of the staff proposal assessment is to offer the FDC an overview of the expert opinions of the FDC staff team about this annual plan grant proposal, and includes (1) An overview about all applications in the current round; (2) A narrative assessment; (3) An assessment that ranks each applicant according to specific criteria in program design, organizational effectiveness, and budgeting.

Overview for all assessments

Grants:APG/Proposals/2015-2016 round1/FDC staff assessments overview/da

Oversigt

Summary

Current (projected) Upcoming (proposed) Proposed change (as a +/- percentage)

FDC or PEG funding

$212,000.00 $241,614.00 14%

Budget

$212,000.00 $241,614.00 14%

Personale

3.5 3.5 0%

Overview of strengths and concerns

This section summarizes the strengths and concerns identified by staff, which are explained in the detailed narrative section of this assessment.

Strengths

  • Strong focus on diversity (global south organization, focus on gender)
  • Leadership in movement practices at a regional level (Iberocoop)
  • Some approaches may be scalable (e.g. online training in education program)

Concerns

  • Targets too low with respect to funding requested and number of staff
  • Results improved recently, but past results do not correspond to past funding
  • Plan is overly complex, will likely be difficult to track

Staff proposal assessment narrative

This section takes an in-depth look at this organization's past performance and current plans.

Context and effectiveness

This section takes a close look at this organization's context. Here are some questions we will consider:

Miljø

How does this organization's environment (including its local context and its community) enable this plan to succeed and have impact?

  • There are significant opportunities to expand reach to those not yet served by or contributing to the Wikimedia projects. We see potential for this both through Wikimedia Argentina’s focus at their national level, as well as in the Spanish-speaking world (through its regional work).
  • Wikimedia Argentina operates in a large geographic area, and aims to expand its work beyond the capital of Buenos Aires. Wikimedia Argentina is operating in the context of the country government’s embrace of inclusive technology, which may enable opportunities for partnerships.
  • Beyond focusing on Spanish Wikipedia, which is an important opportunity to expand the reach of the Wikimedia projects, Wikimedia Argentina works across several other Wikimedia projects, including Wikivoyage and Wikisource.

Past performance

Will this organization's past performance with program implementation enable this plan to succeed?

  • Wikimedia Argentina has shown improved results in 2015, already exceeding its accomplishments of the past several years, which is a good indication that future results will improve.
  • Wikimedia Argentina has shown stronger results in terms of outputs around participation (e.g. numbers of participants or new editors involved), while content-focused online outcomes (e.g. images in use, articles) have not been strong. It’s important to note that outputs related to participation may be a good indicator of Wikimedia Argentina’s expanding reach, which is particularly important in a context where there are significant opportunities for reaching new people. Yet, at this level of funding, those output indicators should be complemented by more evidence of significant online impact (e.g. content, contributors retained), or other scalable achievements.
  • Wikimedia Argentina has been laying important foundations to build future work, and these accomplishments do not come through in the global metrics. While we know this work is important and that Wikimedia Argentina faces particular challenges in its working environment, which they have explained well, we are still concerned about the lack of significant online outcomes over the past several years of significant support.

Organizational effectiveness

Will this organization's overall effectiveness enable this plan to succeed?

  • After a year of many staff transitions in 2014, Wikimedia Argentina has had a year of stable staff, having managed these transitions effectively.
  • With the plan proposed, Wikimedia Argentina may struggle in evaluation, as there are an overwhelming number of metrics that they will need to track.
  • Wikimedia Argentina has continues to lead in the Iberocoop region, contributing to improving movement practices among this key group of organizations.
  • Wikimedia Argentina is documenting its learning, although in some cases, ineffective strategies, programs, and approaches are still being pursued: for example, Wikimedia Argentina’s overly complex approach to planning and the continuation of the Federalization approach, which has been adapted from a stand-alone program to a cross-cutting strategy.
  • Wikimedia Argentina conducted a community survey to learn more about how to engage more effectively with its community.

Strategi og programmer

This section takes a close look at this organization's programs. Here are some questions we will consider:

Strategi

Does this organization have a high-quality strategic plan in place, and are programs well-aligned with this strategic plan?

  • Wikimedia Argentina has a new strategic plan, which includes a clear way to evaluate long term results. Among the four strategic program areas identified in this plan, participation and liberation of content are strongly aligned with movement strategic priorities.
  • Wikimedia Argentina’s current plan is well-aligned with its strategic plan, as it incorporates these four strategic lines across its three programs (education, GLAM, community support).

Programmer

Do proposed programs have specific, measurable, time-bound objectives with clear targets, and are program activities and results logically linked? Are there specific programs with a high potential for impact?

  • Wikimedia Argentina has continued to prioritize gender and diversity in its work, incorporating diversity-relevant targets into its program objectives and doing specific program work toward these objectives.
  • In addition to improving on results during the current year, Wikimedia Argentina is setting higher targets (particularly in GLAM). Targets that show online impact in the areas of content and online participation (e.g. contributor retention) are still not high with respect to the amount of funding requested, although Wikimedia Argentina is setting strong targets for involving more participants and editors in its work.
  • We are pleased to see Wikimedia Argentina set more ambitious target for the upcoming year. Based on past performance, some of the proposed targets may not be realistic. For instance, Wikimedia Argentina has created or improved 617 articles so far in 2015, while their target for 2016 is 3,310. We realize that activities scheduled in the second half of the year may impact 2015 performance.
  • Wikimedia Argentina’s education work is building momentum. If successful, the online training approach could result in impact on a national scale, or beyond.
  • It will be important for Wikimedia Argentina to track students and teachers retained as part of this program, and Wikimedia Argentina is focusing on that now. It will also be important to link program activities to online impact. Given the expanding program, engaging more volunteers, scaling work, and building a platform for materials, may be too much for Wikimedia Argentina to take on.
  • Of Wikimedia Argentina’s three programs, community support is currently projecting the smallest results, and has a large budget compared with other programs.

Budget

Is this plan and budget focused on the programs with the highest potential for online impact?

  • Wikimedia Argentina is planning to increase its budget from $212,000 to $241,680, which is a significant increase at 14%.
  • This increase is almost entirely funded through Annual Plan Grant funding, since opportunities for fundraising are rare in Argentina.
  • We acknowledge the significant challenges of the devaluation of the Argentine Peso. At the same time, we need to evaluate the overall impact of each organization’s work with respect to the total amount of movement funding received. In this sense, while we understand that currency fluctuations are a large part of Wikimedia Argentina’s requested increase, we are still concerned about this significant increase in budget given our concerns about past performance.
  • While Wikimedia Argentina’s most costly program is Community Support at $37,923 in program expenses, this program is not likely to be Wikimedia Argentina’s most impactful program, raising concerns that the budget may not be weighted toward impact.

Summary of expert opinions (if applicable)

This section will summarize any expert opinions or other research.

N/A

Staff proposal assessment framework

This framework assesses annual plan grant proposals across the three dimensions of (1) Program design, (2) Organizational effectiveness, and (3) Budgeting. To complete the assessment, we identify whether each criterion is a strength or a concern:

  • Major strength
  • Strength
  • Neither a strength nor a concern
  • Concern
  • Major concern
Criterion Assessment Beskrivelse

Program design

P1. Strategi

Strength Wikimedia Argentina now has a quality strategic plan that includes ways to evaluate long term progress, and some of its programs are strongly aligned with this strategy and with movement priorities. Rationale for strategic alignment is clearly explained.

P2. Potential for impact at scale

Neither WMAR is planning programs that have potential to scale regionally through online resources and trainings. The organization has included some important outcome targets for 2016. WMAR has potential to expand reach by involving active and new editors in its activities. At the same time, some outcomes targeted are low, and past performance is not a strong indicator for impact at scale, especially corresponding to the amount requested.

P3. Objectives and evaluation methods

Svaghed WMAR's complicated and extremely detailed plan will be a challenge to track efficiently. We continue to struggle to understand WMAR's progress year over year, given the inconsistent approach to evaluation.

P4. Diversity

Stor styrke Diversity is a major strength for WMAR. WMAR conscientiously addresses work with female contributors and minorities as part of its programs, and includes targets related to these audiences. Furthermore, WMAR is working with emerging communities in the global south and is focusing on global south content in its work.

Organizational effectiveness

O1. Tidligere resultater

Concern Despite continued investment, we do not yet see online outcomes commensurate with funding. We acknowledge that WMAR has been doing important foundational work with education and now GLAM, but we have not yet seen this grow into quantifiable results beyond participants / reach. We see that the organization has been improving its results and we encourage them to continue in this direction.

O2. Læring

Neither WMAR is documenting its learning well. We do not yet see strong evidence that WMAR is applying learning effectively. For example, we sometimes see WMAR continuing to pursue programs and approaches that have proven ineffective in the past (e.g. Federalization, overly complex approach to program design).

O3. Improving movement practices

Strength WMAR continues to lead the Latin America movement collaboration through Iberocoop.

O4. Community engagement

Strength WMAR is doing its first community survey, which was high quality. The organization engaged the community in the development of its strategic and annual plans.

O5. Kapacitet

Concern We are concerned about the feasibility of this complicated plan, particularly given the evaluation required to complete it satisfactorily.

Budget

B1. Past budgeting and spending

Neither WMAR has budgeted effectively in the past, and is spending on target, yet past results are not commensurate with past funding. Large amounts have been allocated to travel and merchandise.

B2. Budget is focused on impact

Concern Proposed results are not commensurate with funding. Number of staff is high relative to proposed impact.

This staff proposal assessment is the work of FDC staff and is submitted by: KLove (WMF) (talk) 21:53, 9 November 2015 (UTC)

Staff proposal assessment framework

  • Major strength. This is something the organization does very well, and this is a strong indicator of future success.
  • Strength. This is something that the organization does well, and this could indicate future success.
  • Neither a strength nor a concern. This is something that does not indicate future success or make funding the application a risk, or aspects of this criterion conflict.
  • Concern. This is something that the organization does not do well, and this could make funding the application a risk.
  • Major concern. This is an area where the organization is not strong, and this could make funding the application a serious risk.
Criterion Beskrivelse

Program design

P1. Strategi

The organization has a quality strategic plan in place, programs are aligned with this strategy, and this strategy is aligned with online impact.

P2. Potential for impact at scale

Programs could lead to significant online impact at scale, and corresponding to the amount of funds requested.

P3. Evaluation methods

Programs include a plan for measuring results and ensuring learning, and employ effective evaluation tools and systems. Programs include SMART objectives, targets, and logic models.

P4. Diversity

Programs will expand the participation in and reach of the Wikimedia movement, especially in parts of the world or among groups that are not currently well-served.

Organizational effectiveness

O1. Tidligere resultater

This organization has had success with similar programs or approaches in the past, and has effectively measured and documented the results of its past work.

O3. Læring

This organization is addressing risks and challenges effectively, is learning from and documenting its experiences, and is applying learning to improve its programs.

O4. Improving movement practices

This organization effectively shares learning about its work with the broader movement and beyond, and helps others in the movement achieve more impact.

O5. Community engagement

This organization effectively engages communities and volunteers in the planning and implementation of its work.

O6. Capacity

This organization has the resources and ability (for example, leadership, expertise, staff, experience managing funds) to do the plan proposed.

Budget

B1. Past budgeting and spending

This organization has a history of budgeting realistically and managing funds effectively in the past.

B2. Budget is focused on programmatic impact

Based on past performance and current plans, funds are allocated to programs and activities with corresponding potential for programmatic impact.