Comparative Judgement Methods - Online (few places remaining)
Date:
08/09/2022 - 09/09/2022
Organised by:
NCRM, University of Southampton
Presenter:
Dr Ian Jones
Level:
Entry (no or almost no prior knowledge)
Contact:
Jacqui Thorp
Training and Capacity Building Coordinator
National Centre for Research Methods, University of Southampton
Email: jmh6@soton.ac.uk
Venue: Online
Description:
Comparative judgement methods are used by social scientists to construct reliable measurement scales that are difficult to construct using traditional methods. Such scales typically measure important but nebulous theoretical ideas such as ‘beauty’ or ‘writing quality’. Comparative judgement involves no coding schemes and no categorisation; instead judges make holistic decisions about which of two presented objects better represents the theoretical idea of interest. Comparative judgement methods have a long history but are only now gaining traction due to technological developments making them more accessible to researchers. The course will take attendees through the entire process of using comparative judgement to construct reliable measurement scales.
The course covers:
- The background and theory of comparative judgement
- How to choose suitable objects and judges
- How to design and run a comparative judgement study online
- How to process and interpret study outcomes
- How to evaluate reliability and validity
By the end of the course participants will:
- Know how to run a comparative judgement study using the free NoMoreMarking website
- Know how to process and interpret comparative judgement outcomes
IMPORTANT: Please note that this course includes computer workshops. Before registering please check that you will be able to access the software noted below. Please bear in mind minimum system requirements to run software and administration restrictions imposed by your institution or employer which may block the installation of software.
- Access to the website NoMoreMarking.com via a computer browser.
- I will demonstrate and provide code for processing data using R. Installing R prior to the online workshop is helpful but not essential.
Optional reading: examples of studies that used comparative judgement:
Jones, I., Bisson, M., Gilmore, C., & Inglis, M. (2019). Measuring conceptual understanding in randomised controlled trials: Can comparative judgement help? British Educational Research Journal, 45(3), 662–680. https://doi.org/10.1002/berj.3519
Rycroft-Smith, L., & Stylianides, A. J. (2022). What makes a good educational research summary? A comparative judgement study of mathematics teachers’ and mathematics education researchers’ views. Review of Education, 10(1), e3338.
Optional reading of an online how-to guide for comparative judgement:
https://www.notion.so/nmm/No-More-Marking-for-researchers-70cb4eec46d547cd91c65ff2066d415f
Course Times:
Day 1 (08.09.22): 10am to 1pm
Day 2 (09.09.22): 10am to 1pm
PLEASE NOTE THIS COURSE IS TAUGHT OVER TWO MORNINGS AND EQUATES TO ONE TEACHING DAY FOR PAYMENT PURPOSES.
Cost:
The fee per teaching day is: • £30 per day for students registered at UK/EU University. • £60 per day for staff at UK/EU academic institutions, UK/EU Research Councils researchers, UK/EU public sector staff and staff at UK/EU registered charity organisations and recognised UK/EU research institutions. • £100 per day for all other participants In the event of cancellation by the delegate a full refund of the course fee is available up to two weeks prior to the course. NO refunds are available after this date. If it is no longer possible to run a course due to circumstances beyond its control, NCRM reserves the right to cancel the course at its sole discretion at any time prior to the event. In this event every effort will be made to reschedule the course. If this is not possible or the new date is inconvenient a full refund of the course fee will be given. NCRM shall not be liable for any costs, losses or expenses that may be incurred as a result of its cancellation of a course, including but not limited to any travel or accommodation costs. The University of Southampton’s Online Store T&Cs also continue to apply.
Website and registration:
Region:
South West
Keywords:
Qualitative Approaches (other), Comparative judgement, Measurement, Reliability, Validity
Related publications and presentations:
Qualitative Approaches (other)