The Wikimedia Foundation is looking for a collaborative, analytical, and creative Evaluation Strategist to support our community survey work and internal evaluation for the Community Engagement Department. We are seeking someone who is an early to mid-career evaluator with experience conducting mixed method surveys and/or internal evaluation in a non-profit or community setting.
The Evaluation Strategist will be a member of the Learning & Evaluation (L&E) team which sits in the Community Engagement Department. The L&E Team supports the intentional use of data and insights to inform decision-making about Wikimedia movement and Community Engagement Department strategy and programs. Our overall vision is to foster a culture of evaluation, reflection, and learning so that the Community Engagement Department and Wikimedia Movement are equipped to create meaningful social change.
We’d like you to do these things:
Community Survey Design and Management
- Plan, design, and implement large-scale community surveys in partnership with key stakeholders at the Wikimedia Foundation and among the Wikimedia community.
- Analyze the collected survey data, and extract patterns and trends.
- Collaboratively draw conclusions from the analyzed data, and prepare presentations and reports using best practices in data visualization.
- Present survey results in a manner that is relevant to different audiences, and which informs major strategic goals of the organization.
- Compare year-to-year change in survey results, and report on those trends as part of strategic planning processes.
- Provide guidance and coaching about best-practices in survey strategy and design.
- Connect and coordinate various data collection initiatives across the Foundation and the movement to optimize against survey fatigue, and to provide language consistency.
- Lend technical thought-leadership to Wikimedia groups and individuals that wish to run local and/or specialized surveys.
- Support the creation of an evaluation framework and system for the Community Engagement Department.
- Consult with and coach program staff to identify program goals and develop evaluation plans that enable them to monitor progress toward goals, understand effectiveness, and communicate their impact.
- Advise on and design approaches to measuring social change in the Wikimedia Movement, tapping into best practices from evaluation approaches such as equitable, participatory, developmental, and empowerment evaluation.
- Design data collection tools that enable program staff to measure progress toward goals and understand program effectiveness.
- Collect and analyze quantitative and qualitative data.
- Assist with the design, creation, and management of an internal reporting system.
- Create regular, user-friendly reports for program leaders and staff to monitor their results and make strategic decisions.
- Foster an internal culture of learning and evidence-based decision-making among colleagues and program leaders.
Learning & Evaluation Team support
- Support and collaborate with a distributed team of highly motivated staff and contractors, and our diverse international, multicultural community of volunteers.
- Communicate the work, goals, and outcomes of the L&E Team to internal and external audiences.
We’d like you to have these skills:
- Masters-level degree or equivalent training in an applied research field with a minimum of 2 years experience in survey design and survey data analysis.
- Formal education or at least 2 years of professional experience using program evaluation methods and practice.
- Quantitative data collection and analysis skills, especially with smaller sample sizes or non-parametric data.
- Qualitative data collection and analysis skills, especially in mixed-method settings and/or coding for open-ended survey items.
- Outstanding analytic skills and natural curiosity, paired with the ability to maintain a strategic perspective.
- Excellent verbal and written communication skills.
- Demonstrated capacity to work collegially with others with an open and approachable working style.
- Comfort with innovative, iterative, bottom-up collaborative teams, especially around crowd-sourced projects which rely on volunteer engagement.
- Familiarity with community service-focused, volunteer-based, and/or international initiatives.
- Commitment to inclusion and diversity. Cross-cultural sensitivity and awareness.
- A proficient level of written and spoken English, including the ability to communicate clearly with non-native English speakers. Non-native English speakers welcome!
And it would be even more awesome if you have this:
- Experience conducting evaluation in a philanthropy setting.
- Experience working with online communities, particularly as part of the free knowledge or open source movement.
- Global perspective, with significant experience living or working internationally.
- Fluency in languages other than English.
- Nonprofit, NGO or INGO experience
- Passion for or experience contributing to Wikipedia and the other Wikimedia projects.
The Wikimedia Foundation is...
...the nonprofit organization that hosts and operates Wikipedia and the other Wikimedia free knowledge projects. Our vision is a world in which every single human can freely share in the sum of all knowledge. We believe that everyone has the potential to contribute something to our shared knowledge, and that everyone should be able to access that knowledge, free of interference. We host the Wikimedia projects, build software experiences for reading, contributing, and sharing Wikimedia content, support the volunteer communities and partners who make Wikimedia possible, and advocate for policies that enable Wikimedia and free knowledge to thrive. The Wikimedia Foundation is a charitable, not-for-profit organization that relies on donations. We receive financial support from millions of individuals around the world, with an average donation of about $15. We also receive donations through institutional grants and gifts. The Wikimedia Foundation is a United States 501(c)(3) tax-exempt organization with offices in San Francisco, California, USA.
The Wikimedia Foundation is an equal opportunity employer, and we encourage people with a diverse range of backgrounds to apply
U.S. Benefits & Perks*
- Fully paid medical, dental and vision coverage for employees and their eligible families (yes, fully paid premiums!)
- The Wellness Program provides reimbursement for mind, body and soul activities such as fitness memberships, baby sitting, continuing education and much more
- The 401(k) retirement plan offers matched contributions at 4% of annual salary
- Flexible and generous time off - vacation, sick and volunteer days, plus 19 paid holidays - including the last week of the year.
- Family friendly! 100% paid new parent leave for seven weeks plus an additional five weeks for pregnancy, flexible options to phase back in after leave, fully equipped lactation room.
- For those emergency moments - long and short term disability, life insurance (2x salary) and an employee assistance program
- Pre-tax savings plans for health care, child care, elder care, public transportation and parking expenses
- Telecommuting and flexible work schedules available
- Appropriate fuel for thinking and coding (aka, a pantry full of treats) and monthly massages to help staff relax
- Great colleagues - diverse staff and contractors speaking dozens of languages from around the world, fantastic intellectual discourse, mission-driven and intensely passionate people
*Eligible international workers' benefits are specific to their location and dependent on their employer of record
Wikimedia Foundation website
Wikimedia Foundation blog
Annual Report - 2017
Location/Region: San Francisco, CA (94104)