Evaluation Research
Date:
05/05/2014 - 07/05/2014
Organised by:
University of Cambridge
Presenter:
Dr Auty, Ms Cooke, and Mr Hooton
Level:
Advanced (specialised prior knowledge)
Contact:
Alison Brigden, esrcdtc@admin.cam.ac.uk
Map:
View in Google Maps (CB3 9DA)
Venue:
University of Cambridge Institute of Criminology, Sidgwick Avenue, Cambridge
Description:
This course is part of the Social Science Research Methods Centre training programme, which is a shared platform for providing research students with a broad range of quantitative and qualitative research methods skills that are relevant across the social sciences.
It will teach students the general concepts that underlie evaluation research, moving towards advanced evaluation theory, design and methodology. Topics covered include cost-benefit analysis, additionality, time discounting, net-present value, valuation techniques, evaluation design, the use of evidence in policy evaluation and more.
The course is offered as a three-day seminar consisting of six separate sessions.
5 May (sessions 1 - 2) is a preliminary day appropriate for MPhil or year 1 PhD students who have no prior training in evaluation; sessions 3 - 6 (Tues 6 - Weds 7 May) are more advanced and aimed at experienced students (year 2 PhDs onwards) who want to acquire specialized skills and knowledge in evaluation.
Students may attend all of the seminar or book for individual sessions.
Sessions:
1 Mon 5 May 09:00 - 13:00
2 Mon 5 May 14:00 - 18:00
3 Tues 6 May 09:00 - 13:00
4 Tues 6 May 14:00 - 17:00
5 Wed 7 May 09:00 - 13:00
6 Wed 7 May 14:00 - 18:00
Format: Presentations, demonstrations and practical exercises
Topics covered:
Session 1: Introduction to evaluation
Session 2: Introduction to evaluation theory – the challenge of integrating knowledge
For more information about these preliminary sessions, please contact the Cambridge ESRC DTC office direct (esrcdtc@admin.cam.ac.uk)
Session 3: Evaluation theory – contextualizing evaluation frames
This session will introduce and describe in some detail several mainstream and non-mainstream approaches to evaluation. Each of these approaches provides a different ways of seeing/valuing. The different approaches to evaluation frame will be disused with reference to four key assumptions; assumptions about methodology, ontology and epistemology, assumptions about the complexity of problems, assumptions regarding decisional contexts, institutional settings and policy processes and assumptions about welfare.
Session 4: Cost-benefit analysis
This session will explore the theoretical and practical issues surrounding the quantification of evaluations using the Cost-Benefit Analysis technique; the session will review the theoretical frameworks for developing CBA studies and the various measurement issues surrounding operationalization of a study including (but not limited to) leakage, control selections, measuring additionality, the use of revealed versus stated preference valuations, and more. Additionally the session will both conduct and review an in-class exercise on important financial and economic techniques for conducting CBA studies including the selection of appropriate valuation models, the incorporation of inflation and time discounting, and actual calculations for CBA. Finally, the session will have students develop a CBA study for a practical situation to illustrate important real-world considerations.
Session 5: Spatial evaluation techniques
This session will detail the theory and techniques for conducting evaluation research in a spatial context; the session will take lessons learned in previous sessions and apply them in a spatial setting with a discussion on the unique measurement issues that arise in spatial evaluations such as spatial autocorrelation, the treatment of geography, and more. Additionally, the lectures will explain the importance of differencing techniques and methods for control/counterfactual selection. The session will introduce students to spatial data sources and spatial data analysis software systems to allow further independent study. The session will finish with a practical exercise in which students design a spatial evaluation.
Session 6: Small-scale evaluations
This session will examine the strengths and shortcomings of small-scale evaluations. It will also discuss how to design a small-scale study that will adequately serve purpose of the research project in question. The course will then overview proper analysis techniques and will end by discussing appropriate representations of the findings. This session will also include practical exercises in small-scale evaluation design.
Taught using: Powerpoint, excel, internet
Assessment:
- One written submission on major course themes
- One written submission on evaluation design and application
Textbook(s): No textbook is used, however the following are given as recommended background texts:
The Green Book: Appraisal and Evaluation in Central Government. HM Treasury. 2003.
Fujiwara, D. and Campbell, R. (2011) Valuation Techniques for Social Cost-Benefit Analysis: Stated Preference, Revealed Preference, and Subjective Well-Being Approaches. HM Treasury
Other Reading:
Each session has recommended readings to reinforce the lectures and topics given in the seminar. More information and reading lists may be found at the Cambridge SSRMC training programme page: http://www.training.cam.ac.uk/jsss/programme/706574
Notes:
The course is designed to give a thorough overview of evaluation research. Students who have attended all sessions should have a strong basis with which to conduct evaluation research themselves or to apply these skills in a professional position. To gain maximum benefits from the course it is important that students do not see this course in isolation from other MPhil courses or research training they are taking.
Responsibility lies with each student to consider the potential for their own research using methods common in fields of the social sciences that may seem remote. Ideally this task will be facilitated by integration of the SSRMC with discipline-specific courses in their departments and through reading and discussion.
To book a place:
Please contact the Cambridge ESRC DTC (esrcdtc@admin.cam.ac.uk) stating your name, email address, and the sessions you wish to book. Any questions about the course should be directed to Sam Mather at ssrmc@hermes.cam.ac.uk
Should you require assistance with booking overnight accommodation in Cambridge, please wait until your place has been confirmed, and then contact esrcdtc@admin.cam.ac.uk
Cost:
Free of charge although please note that places are limited.
Website and registration:
http://esrc-dtc.cshss.cam.ac.uk/
Region:
East of England
Keywords:
Evaluation Research, Cambridge
Related publications and presentations: