Evidence
Good policy advice is underpinned by good evidence. This means that the advice is informed by up-to-date data, contextual and other knowledge, people’s experiences and research from New Zealand and overseas.
Achieving evidence-informed policy requires several things of policy practitioners. First, a commitment to building the gathering and analysis of quantitative and qualitative data into your policy work – as the norm, not the exception. Second, building effective relationships with key resource people. These include experts in administrative data, official statistics, diverse research and evaluative techniques and community engagement. Third, you need to progressively broaden your own evidence-oriented knowledge and skill base over time. This will mean you can commission effective evidence-gathering, present evidence effectively, and critically evaluate how robust the evidence you and others have collected is.
Good practice in evidence-informed policy making matters. This includes being aware of any limitations of evidence used, and their implications for your recommendations, and ensuring your advice is candid about that. Good practice also means being unbiased in how you use evidence (both in what you use in your advice, and what you omit to use).
Resources
Below you will find a number of resources to help you get better at using evidence in your policy making.
- Chief Science Advisor Forum
Convened by the Prime Minister’s Chief Science Advisor, its purpose includes advancing the use of science to benefit New Zealand through promoting the use of evidence to inform policy development, practice and evaluation.
- Making sense of evidence: A guide to using evidence in policy
By the Social Policy Evaluation and Research Unit.
- Use of evidence in public policy
A summary of a roundtable held by Superu and the School of Government at Victoria University that was chaired by Dr Sarah Morton, Centre for Research on Families.
- Using Research Evidence – A Practice Guide
By Nesta.
- Enhancing Evidence-Informed Policy Making: A Report by the Prime Minister’s Chief Science Advisor
On the role of scientific evidence in policy making in New Zealand, by Sir Peter Gluckman.
Evaluation
Good evaluation of policy decisions is important because it helps inform future decision-making – and contributes to continuous improvement. Evaluation asks ‘What worked, and what didn’t work so well?’ Good evaluation needs to assess whether a policy solution met its objectives. It often helps you refine your initial problem definition. Good evaluation also needs to measure the impact the policy has made and for whom. For example, has the policy improved the outcomes and wellbeing of the general public, or a particular population group or people from a particular area? The other important question that evaluations can ask is ‘If not, why not and what can be done about it?’
As a policy practitioners, you may contribute to evaluation processes, commission evaluations of past policies, and/or use evaluation results. Becoming more familiar with good evaluation practice will help you in all those contexts.
Resources
These resources can help you build evaluation into your policy making.
- Making sense of evaluation
By the Social Policy Evaluation and Research Unit.
- Maximising Collaboration between Public Servants and Academics in Evidence-based Policy Making
A senior leaders’ round table with Professor Paul Cairney, University of Stirling.
- Evaluation standards for Aotearoa New Zealand
From the Social Policy Evaluation and Research Unit. See also the Evaluation Standards for Aotearoa New Zealand summary.
- BetterEvaluation
A range of methods and approaches that may help you to plan, design, oversee and use an evaluation.
- Magenta Book: Central government guidance on evaluation
From the United Kingdom’s Treasury.
- Policy Skills Framework
The Framework can help you assess your skills or those of your team in relation to using ‘Evidence and Insights' and 'Monitoring and Evaluation’ to support analysis.
- Development Pathways Tool
The tool provides lists of actions that can help policy practitioners to develop at three different levels. See in particular ‘Evidence and Insights' and 'Monitoring and Evaluation’.