Tag Archives: development policy

How to Evaluate the Impact of Research Projects?

Xavier Lemaire and Daniel Kerr from University College London attended the first annual workshop of the Understanding Sustainable Energy Solutions (USES) Network, held at the Wellcome Trust, London, UK on the 8th July 2014. The workshop was designed to give insights into how best to achieve impact and engagement with beneficiaries in the USES Network projects, which cover a wide variety of aspects of low carbon energy research in developing countries, from institutional networking assistance and business support, to technology dissemination for thermal and electrical energy, to institutional and residential energy efficiency. A number of sessions took place, with an aim to convey insights into how funders and research users engage with academic institutions and organisations conducting research; theories of change and the impacts, both potential and real, that past projects have achieved/failed to achieve; and how best to plan for and assess the impact of the USES projects, and what shared experiences could be brought to bear for the good of all involved projects.

The day began with three presentations on impact, engagement and theories of change. Ed Brown from Loughborough University, in conjunction with Alison Mohr from the University of Nottingham, led off with an introduction to the Participatory Impact Assessment (PIPA) methodology. Adrian Ely from the STEPs Centre at the University of Sussex, and Duncan Green from Oxfam also contributed via video presentations.

Of particular interest was the PIPA methodology for assessing impact, which seeks to identify the inter-linkages in the goals and priorities of all actors in research projects, for example funding agencies, research institutions, local and national governments, community organisations, NGOs and the wider population. Through identifying the synergies in these groups’ priorities and needs, the methodology hopes to provide a clearer insight into the potential impacts of research projects, and the methods needed to achieve them.

The following session saw a number of representatives from the Department for International Development and the Department for Energy and Climate Change, as well as the UKCDS and the Knowledge Transfer Network, conduct a roundtable discussion on the experiences of funding agencies and other organisations in engaging with research and researchers. Broad themes included the importance of quantitative measures of impact and results in the view of the funders and their objectives, as well as highlighting the divergence on timescales for results between public sector projects and research projects.

The whole-room discussions sessions that followed, as well as in the case study presentations, brought forward a number of recurring points. The importance of stakeholder engagement from the very beginning of a project  in achieving impact in research projects, particularly in developing country contexts, was consistently highlighted as a key factor. In-depth knowledge of local country contexts, as well as sectoral expertise in key project members, was identified as a useful factor in achieving project impacts. These factors, along with the targeting of invitations to actors based on their expertise, were also identified to be critical in the creation, funding and initial engagement of projects.

The final session focused on the proposed framework for reporting project impacts to DFID, and how shared experiences within the USES project could help to facilitate greater impacts for all involved projects. Finally, the day concluded with contributions from participants on how the USES network can support the involved projects, predominantly focusing around networking via social media and web networking spaces provided through the USES portal on the LCEDN website.

LCEDN Meeting July 2014Roundtable discussion at LCEDN USES Network Meeting, July 2014

– Xavier Lemaire & Daniel Kerr, UCL Energy Institute

STEPs Poster at the Asia Clean Energy Forum

A poster on the STEPs project was presented in the Marketplace of Ideas segment in the Asia Clean Energy Forum during June 2013. The Asia Clean Energy Forum over the last 8 years has emerged as one of the key clean energy event in Asia. This year’s forum held during 25-28 June attracted 640 participants from 55 countries and was held at the Asian Development Bank headquarters in Manila, Philippines. The forum was organised very well and had a good selection of speakers. The participation was mainly from business and governments followed by development agencies. The forum was supported by ADB and a number of governments including the UK government.

A poster was developed by UCL and SEA highlighting key aspects of the project. The poster and the idea about the use of PPPs for thermal energy service delivery were received well at the market place with several delegates stopping to study the material and seeking clarifications. Most questions I received were more about the problem of thermal energy service than the approach we are proposing. So this seems to be a problem which needs more attention from development policy and academic research. I also joined the panel discussion at the main conference on maximising energy access focusing on financing issues. During the panel discussions, I also flagged the challenges with thermal energy access and the need for more efforts to address this problem. This view was also supported by interventions from the floor.

So the participation at Asia Clean Energy Forum provided an opportunity to highlight the challenges with thermal energy access in developing countries and to introduce the STEPs project to clean energy, energy access and development practitioners in Asia.

Dr. Binu Parthan, SEA

CIMG2180STEPs poster at the Asia Clean Energy Forum 2013. Image: Sustainable Energy Associates