Item Response Theory and Computer Adaptive Testing

Date:

11/04/2018 - 13/04/2018

Organised by:

University of Cambridge Psychometrics Centre

Presenter:

Dr Tomoya Okubo, Aiden Loe

Level:

Entry (no or almost no prior knowledge)

Contact:

contact@psychometrics.cam.ac.uk
+44(0)1223769483

Map:

View in Google Maps  (CB2 1AG)

Venue:

Cambridge Judge Business School,
Trumpington Street, Cambridge

Description:

A three-day course introducing you to Item Response Theory (IRT) and Computer Adaptive Testing (CAT) using the R open-source statistical computing software and Concerto, the open-source online adaptive test development platform. Get first-hand experience of applying IRT analysis to questionnaire data and create item banks suitable for computer adaptive testing. 

  1. Introduction to R and RStudio
  2. Basic concepts of Item Response Theory (IRT)
  3. Generation of calibrated item banks using R packages
  4. Simulating CATs to assess item bank performance
  5. Scoring CATs using R
  6. Administering CATs using Concerto  

Prior experience with R is not necessary. Participants should bring their own laptops with the latest version of R installed ( https://www.r-project.org/ ) and also RStudio (http://www.rstudio.com/ide/download/ )

Day 1 – Introduction to R and Rstudio
10.30 – 11.30 R and Rstudio installation, Introduction to R
11.30 - 13.00 Data analysis and R basics, Practical (Part 1)
14.00 - 15.30 Practical (Part 2)
16.00 - 17.30 Practical examples and exercises, Questions

Day 2 – Item Response Theory (IRT)
09.30 - 11.00 IRT (Theory), Application of IRT models (Practical)
11.15 - 12.45 Different IRT response scales (dichotomous and polytomous)  (Theory), Analysing polytomous scales using the Rasch model (Practical)
14.00 - 15.30 IRT modelling  of the CESD depression scale (Theory & Practical)
6.00 - 17.30 IRT diagnostics of the CESD depression scale (Theory & Practical), Practical examples and exercises, Revisions and Questions

Day 3 – Computer Adaptive Testing (CAT) with Concerto
09.30 - 11.00 Computer Adaptive Testing (CAT Theory and Practical)
11.15 - 12.45 Firestar simulation of item bank performance (Practical), Programming a polytomous adaptive test using the catR package (Practical)
14.00 - 15.30 Introduction to adaptive testing in Concerto (Theory and Practical)
16.00 - 17.30 Final Revision & Exercise, Certificates and Q&A

Feedback from previous courses:

  • "The course was incredibly well pitched.. it was the best course I have ever attended in terms of quality of teaching!"
  • "The introduction to R was very useful for me, Aiden and Chris were good teachers and very helpful." 
  • "A really great atmosphere and great teaching that fostered a collaborative learning environment."
  • "I liked the 'spirit' of the workshop which was intense, motivating and very hands-on - thank you so much for a brilliant course!"
  •  "An excellent three days; it was incredibly informative, well-paced and well organised."

Cost:

Business: £800 (plus 20% VAT)
Academics: £600 (plus 20% VAT)
Students:£500 (plus 20% VAT)

Website and registration:

Region:

East of England

Keywords:

Rasch models, Item response theory, Neural networks, Machine learning, R, Psychometrics , Computer Adaptive Testing , CAT , Concerto , Item Bank

Related publications and presentations:

Rasch models
Item response theory
Neural networks
Machine learning
R

Back to archive...