Web Scraping for Social Scientists (online) (few places remaining)



Organised by:

The University of Edinburgh


Dr Diarmuid McDonnell is a lecturer in social sciences at the University of the West of Scotland


Entry (no or almost no prior knowledge)


Laura Marshall
Usher communications
Working week: Monday - Thursday

video conference logo

Venue: Online


There is an unprecedented amount of information on the internet that could usefully be harvested in order to build social science research datasets.

This one-day course will showcase suitable techniques for web scraping.

The value, logic and process of capturing data stored on websites will be described in detail, and practical examples and exercises will be demonstrated using the Python programming language.


It is most suited to empirical social science researchers but will be of value to researchers from a wide range of disciplines (e.g., digital humanities).

Course timings: 09:30 - 16:00

We will use the open-source (free) Python programming language in this course. Participants will only require access to a computer with an internet connection and a browser, as all of the interactive materials can be executed online.


Instructions for installing Python on your own machine will be provided during the course


The fee per teaching day is: • £30 per day for students registered at UK/EU University. • £60 per day for staff at UK/EU academic institutions, UK/EU Research Councils researchers, UK/EU public sector staff and staff at UK/EU registered charity organisations and recognised UK/EU research institutions. • £100 per day for all other participants In the event of cancellation by the delegate a full refund of the course fee is available up to two weeks prior to the course. NO refunds are available after this date. If it is no longer possible to run a course due to circumstances beyond its control, NCRM reserves the right to cancel the course at its sole discretion at any time prior to the event. In this event every effort will be made to reschedule the course. If this is not possible or the new date is inconvenient a full refund of the course fee will be given. NCRM shall not be liable for any costs, losses or expenses that may be incurred as a result of its cancellation of a course, including but not limited to any travel or accommodation costs. The University of Southampton’s Online Store T&Cs also continue to apply.

Website and registration:




Big data, Python, Research Ethics, Online Data Collection, Web scraping, Big data methods, Data science, Digital Social Research, Research Ethics

Related publications and presentations:

Big data
Research Ethics

Back to archive...