University of Washington School of Public Health
Evaluation Specialist - Institute for Health Metrics and Evaluation
Closing Date: January 13, 2018
Posted: December 13, 2017
The Institute for Health Metrics and Evaluation (IHME) is an independent research center at the University of Washington. Its mission is to monitor global health conditions and health systems, as well as to evaluate interventions, initiatives, and reforms. IHME carries out a range of projects within different research areas including the Global Burden of Diseases, Injuries, and Risk Factors; Future Health Scenarios; Costs and Cost Effectiveness; Geospatial Analysis; Resource Tracking; and Impact Evaluations. The aim is to provide policymakers, donors, and researchers with the highest-quality quantitative evidence base to make decisions that achieve better health.
IHME has an outstanding opportunity for an Evaluation Specialist. The primary purpose of this position is to help develop and apply evaluation methods in a number of global settings to measure the impact of a variety of different programs, interventions and organizations on population health. A core research area for IHME is our Impact Evaluation portfolio. To contribute to this effort, this Researcher will contribute to the development, implementation and analysis of IHME’s evaluation efforts. They will be involved in several stages of evaluations, including developing needs assessment frameworks, baseline measurement strategies, on-going monitoring and end line evaluation plans. To do so, the individual must be able to identify and assess all available relevant data on the program, project or intervention in question. This includes data from surveys, vital registration, censuses, literature, registries, and administrative records. Through using established modelling tools creating novel code, he/she must incorporate all relevant data to produce up-to-date and scientifically-credible results at each evaluation stage. The Researcher will be involved in producing the tools and indicators used to evaluate and measure impact often being collected through primary data collection.
The Researcher will be integrally involved with the Global Fund Prospective Country Evaluation. The Prospective Country Evaluation (PCE) provides an opportunity to examine critical processes, outputs, outcomes, and ultimately the impact of Global Fund investments through a comprehensive country-level lens using a diverse array of data and methodologies. The IHME/PATH Global Evaluation Partnership (GEP) is working with Country Evaluation Partners (CEPs) in three countries: Democratic Republic of the Congo (DRC), Guatemala and Uganda for this study. The researcher will contribute to the development and implementation of analytics to perform resource tracking studies, output/outcome measurement, and impact evaluation of Global Fund Grants in DRC, Guatemala, and Uganda.
The researcher will be integrally involved in producing, critiquing, improving, and disseminating results. He/she must develop an understanding of IHME’s impact evaluation methodology and must already have a strong command of measurement and evaluation techniques, have experience working in global settings, and be proficient in a least one of the following: Stata, R or Python. The individual will work with senior research leads and take part in the intellectual exchange about how to improve upon study results and will be involved in creating papers and presentations that help share the results with broader audiences. The individual will be expected to interact successfully with a wide range of stakeholders and to describe complex concepts and materials concisely. Overall, he/she will be a critical member of an agile, dynamic research team. This position is contingent on project funding availability.
Research command and analyses
- Carry out quantitative analyses and participate in collaborative research projects.
- Perform resource tracking studies
- Perform output/outcome measurement studies
- Perform geospatial analyses
- Support in the review, construction, and verification of health indicators
- Develop, critique, and improve monitoring and evaluation techniques using IHME’s Impact Evaluation methods.
- Identify, review and assess data sources in order to determine their relevance and utility for ongoing analyses. Sources include vital registration, censuses, surveys, registries, administrative data, and academic literature. Become expert in understanding key data sources and, in particular, variations in these across and within countries.
- Play an integral role in the evaluation process including transforming and incorporating data, choosing and applying methods, identifying areas for improvement, and conveying results to diverse audiences.
- Develop and implement new computational and statistical methods. Create, test, and use relevant computer code (R, and/or Python).
- Communicate with external collaborators in order to best understand the nature, key characteristics, and context of the data and engage in critiques of the analytic results.
- For a given evaluation, become expert in understanding the demographic, geographic, and social characteristics in a country or other evaluation setting that might generate disparities or be useful for comparisons.
- Develop and maintain relationships with designated collaborators. Respond to and, as appropriate, integrate feedback from collaborators into the analyses. Work directly with collaborators to understand data to which they have access, and to in turn help them understand the methods being applied. Help to manage and orchestrate joint strategies for analysis.
- Effectively communicate and work with other staff at all levels in order to achieve team goals for the analyses and related outputs.
- Contribute to the development of ideas for new research projects.
Publication and dissemination
- Contribute to the production of annual country-specific and cross-country analysis reports
- Represent the research group at external meetings, seminars, and conferences.
- Write and lead publication of research findings in international peer-reviewed journals, policy reports, and other publications.
- Lead discussion in research meetings about results and analyses in order to vet, improve and finalize results.
- Document code and analytic approaches systematically so that analyses can be replicated by other team members.
- Support project leaders in the development of new funding proposals.
- Become a fully contributing member to the IHME team overall, lending help and support where needed, participating in mutual intellectual critique and development with colleagues, and acting as a mentor to more junior staff and peers contributing to the research process.
- Travel, as needed, to attend external meetings to represent the project’s findings, to build capacity and further strengthen research collaborations.
- Work with members of the data team to develop data visualizations and tools, as needed, to further communicate the results of the evaluation projects.
Master’s degree with a focus on measurement and evaluation in a global setting and 3–5 years of experience including 1 – 3 years of experience in evaluation studies.
- Demonstrated interest in the research described.
- Experience and demonstrated success in modelling using at least one of the following programming languages: Stata, Python, or R.
- Spanish professional working proficiency.