Programme: 2023 Research Methods e-Festival

How to identify salient issues in an election campaign: A methodological exploration

Speaker(s):

Abstract:

During election campaigns, there is more attention on current affairs and political news. While many issues can feature on the public agenda and shape voters' decisions, some issues tend to be core to determining most voters' choices. The data used to identify and track changes in these most important issues are typically derived from public opinion surveys of the electorate. However, increasingly, studies use social media data to measure the salience of issues on the public agenda. This session will compare data measuring the most important issues collected using both methods during an election campaign. First, I will compare the key issues identified by survey data gathered by YouGov as part of a national online survey in three recent election campaigns between 2020 and 2022, in the US, Germany and France, to those identified using data from the Twitter API. Second, I show how qualitative and (automated) quantitative approaches can be applied to discerning issue salience on Twitter and the differences that emerge. I conclude by discussing how the choice of survey data versus social media data using either manual or automated lexica (created and validated with AI techniques) can affect researcher insights into the most important issue during elections.

What is 'Airbag Moderation' and how does it build upon the concept of 'Moderation'?

Speaker(s):

Abstract:

The airbag in your car, your immune system, the provision of free meals in schools -- these systems (and many others) seem different at first glance yet actually operate in the same manner. However, until recently there was no term for this common functioning and, unsurprisingly, therefore no way to empirically test for their existence using statistical methods. Instead, researchers both conceived of, and tested, only part of these systems (via 'Moderation') with the consequence that this has introduced a sizeable gap in knowledge into many fields of research.

This webinar introduces a term that describes these systems, 'Airbag Moderation', encourages attendees to reflect upon the presence of these effects in their own professional field and/or area of research, and describes statistical options that exist to help empirically test for thier presence. Examples are considered from the fields of Psychology, Sociology, Education, and Biology.

What is time diary analysis of work?

Speaker(s):

Pierre Walthery, UK Data Service, University of Manchester and Centre for Time Use Research, University College London

Abstract:

The goal of this session will be to present an applied introduction to quantitative time diary analysis of paid and unpaid work. Since their emergence in the 1960s, time diary surveys have been extensively used to measure themes such as daily time allocation, gendered division of labour and patterns in leisure behaviour.

Data from time diary surveys also offer a unique insight into work by enabling the modelling of its duration; its distribution across the day and week; its social and spatial context; exploring the boundaries of paid and unpaid work in a more robust fashion than with traditional social surveys.

The talk will focus on providing essential tools for working with time diary dataset (ie data structure and time diary variables; common datasets and how to access them; examples of analysing daily and weekly work duration and probabilities).

How to Apply Network Models to Attitudinal Surveys: Mapping Psychiatric Disorders and Political Belief Systems (in R)

Speaker(s):

Abstract:

Do you want to learn how to analyze the relationships among survey items in your data and use sophisticated, algorithms to visualize their structure? This hands-on session will introduce students to 'psychometric' network analysis, which assumes that survey questions typically used to measure things like personality traits, psychiatric disorders, and political beliefs are not necessarily caused by a common underlying factor (i.e., latent variable models). Instead, network models are agnostic and use a data-driven approach in which each item may causally influence others in the system. These new analytical techniques thus allow links among survey items to be mapped in a visual network, in which the 'nodes' correspond to elements within the network and 'edges' to the magnitude and direction of their connections similar to what you might find in a social network. When networks are estimated for different subpopulations, network comparison statistics are available to test each network's overall connectivity, as well as the strength of individual edges for different groups.

What Are 'Association Rules' for Social Scientists? a data mining discussion

Speaker(s):

Abstract:

Association rules are used in market research to help guide the strategy for marketing toward better sales and revenue. THe methods of 'association rules' discernment can be used to work out what factors can predict (or act as precursors of) other outcomes. These methods are occasionally used in social science. For example one study used association rules to find correlation of social group memberships and occupations, and another application would be to p redict occupational moves by the existing occupation and the spending pattern. In this workshop, I explore 'Consumer Expenditure Surveys' as a social-science data source and explain what 'association rules' are. When applying the association rules to variables, I use a hypothesis-testing approach. It is thus a supervised, social data analytics application. (By contrast, typical data-science methods of data mining are unsupervised. I explain all this terminology.) I show results for two settings: 1) Indian consumer data and the occupational groups for 2014/5, with adoption of mobile phones a key indicator on the consumer-spending side; and 2) Indian spending on a range of technical goods, which have very low cross-correlations. In the first setting association rules are useful but regression is a close alternative. In the second setting, I develop advice for data cleaning to discover patterns in a large-data context - yet not assuming unsupervised data mining. The workshop is open to all, no prerequisite knowledge.

Anticolonial research? Moving beyond PAR and co-collaboration to supporting community-directed practice in the field

Speaker(s):

Hannah M B Gibbs, Extreme Citizen Science: (ExCiteS) University College London Department of Geography / Institute of Archaeology

Abstract:

Anticolonial research (an active process of change and resistance to colonial structures) does not assume access to Indigenous spaces for non-Indigenous goals. Research in fields such as anthropology, computer science, and Citizen Science actively decentres non-Indigenous perspectives. Working towards anticolonial practice requires acknowledging the impact of colonial legacies, reflexivity, positionality, and an awareness of power dynamics.

Token community involvement can be used to create the impression of social inclusiveness and diversity. Anticolonial research has the potential to create change. This workshop will explore what is anticolonial research? Following feedback from people involved in community-directed research, we will discuss how moving beyond Participatory Action Research (PAR) and co-collaboration can support research initiated, directed, and controlled by Indigenous or local communities, which protects the autonomy of those involved, who make decisions on their anonymity, involvement, research questions explored, research methods used, and how and where data is shared, and findings are presented.

How multilevel structures were plied and knotted on Indigenous string records, or Khipu of Peru.

Speaker(s):

Maria Koulouri, University of St Andrews

Abstract:

My PhD thesis explores the decipherment of a nineteenth-century hybrid text combining Spanish and Indigenous script from the Peruvian Andes, called the Khipu Board (Tabla Khipu). Previously, the Inka empire used the Khipu as recording devices for tax collection. Since the 1980s Multilevel Modelling has been widespread in various disciplines from education to archaeology. However, the wider public cannot easily perceive how multilevel structures were embedded in Indigenous Khipu records - used for 3,000 years - signed by colour, position and cord engineering itself.

What is Realist Evaluation?

Speaker(s):

Iveta Tsenkova, King's College London

Abstract:

This talk will provide a broad introduction to an innovative method - Realist evaluation in health and social science research. The talk will include a brief introduction into the theoretical background of the method in Critical Realism Philosophy, and will explore Realist Evaluation and its application to the MRC Framework for health intervention evaluations. Participants will get an understanding in the overall method, as well as challenges, limitations and controversies. No prior knowledge of Realist evaluations is required. Additional materials and resources will be provided to participants who want to learn more about the method.

What is the new CLOSER Training Hub?

Speaker(s):

Abstract:

This session provides an overview and demonstration of CLOSER's new online resource: the Training Hub. It will include a guide to what the Training Hub offers to researchers, alongside a live demonstration of the site, followed by an interactive Q&A session.

The CLOSER Training Hub provides guidance and resources in data harmonisation and cross-study research; data management; and research dissemination and impact. It aims to enhance researchers' knowledge and usage of longitudinal population study data in their research and increase the reach of their research findings. It also contains a directory of organisations delivering relevant training courses and seminars. This introductory session will be of interest to researchers seeking to maximise their use of longitudinal population study data and increasing the visibility and impact of their research.

What is ... the problem with 'statistical significance'?

Speaker(s):

Peter Martin, University College London

Abstract:

Many published research findings may be false. Attempts to replicate results from high-profile scientific studies too often contradict the original findings. One source of the problem is the way that statistical hypothesis tests are commonly used in contemporary research. In particular, many scientists misunderstand p-values. The 'p < 0.05' threshold was originally intended to protect researchers from over-interpreting random variation. But 'statistical significance' is now often wrongly perceived as indicating the scientific robustness of a finding. When a journal editor rejects a manuscript because 'the result is not significant', publication bias is the logical consequence.

This session will clarify the concepts at the heart of the debate about 'statistical significance'. We'll shine light on common mis-uses of p-values and explore how to avoid them. We'll also discuss proposed solutions to the problem, such as open science and registered research reports, as well as the idea of abandoning 'statistical significance' altogether.

Multiple-level and multiple-group gap decomposition using mediation analysis

Speaker(s):

Beatriz Gallo Cordoba, Monash University

Abstract:

Gap decomposition has been used as a strategy to better understand such gaps and propose policy initiatives to narrow such gaps. Gallo Cordoba, Leckie and Browne (2022) propose using mediation analysis as a tool to decompose achievement gaps in multiple levels (e.g. students, schools, local authorities) and multiple groups (e.g. White, Black, Asian). This interactive session will explain the intuition behind this decomposition technique and how to implement it in R and Stata in four steps: first, showing the equivalence between within- and between-level 2 (e.g. schools) gap decomposition and mediation analysis; second, applying mediation analysis to decompose the gap across multiple levels; third, applying mediation analysis to decompose the gap across multiple groups, and finally combining the last two steps to decompose the gap across multiple levels and groups. Participants are encouraged to bring their own data but mock data will be provided.

Collaborative analysis with lived experience researchers

Speaker(s):

Abstract:

In qualitative research, collaborative analysis is a useful method to embody different perspectives throughout the analysis process. This workshop will explore the potential benefits and different approaches to collaborating with individuals with lived experience, as well as the challenges it can bring.

It will involve a short talk explaining the rationale and different models, as well an example from the speaker’s own research, with lay members sharing their experiences of the process.

Participants will then break into groups to design an analysis plan, then come back together to discuss these plans, and then explore potential challenges that may be faced. Finally, participants will be given a short extract to code, and then split into groups again to discuss their similarities and differences. The workshop will end with time for questions for the speakers.

How to research using telephone interviews

Speaker(s):

Abstract:

Telephone interviews are a valuable method for generating qualitative data and conducting fieldwork at a distance. Many social researchers were prompted to shift to researching remotely due to COVID-19 social distancing rules. Telephone interviews offer a remote route to fieldwork but their value for researchers extends beyond the pandemic.

This interactive workshop provides practical guidance on conducting qualitative telephone interviews. The workshop will highlight the advantages of using telephone interviews and offer advice on how to overcome the challenges. We will guide you through processes of recruitment and ethics, as well as offering practical support on what to do before, during and after telephone interviews. You will have the opportunity to discuss your own research and develop your ideas with hands-on activities.

Innovation takes the wheel: the value of using novel approaches to explore views of novel technology

Speaker(s):

Clare Palmer, BritainThinks

Abstract:

With Self-Driving Vehicle (SDV) technology progressing rapidly, public attitudes and requirements for this novel technology need to be understood by stakeholders. Commissioned by the Department for Transport, BritainThinks led a complex research programme to understand how first-hand experiences of SDVs impact views of the technology and its role in future local transport systems. Using an innovative suite of research methods, we ran immersive deliberative workshops, quantitative surveys to measure the impact of exposure to the technology, and one of the first uses of EEG headsets in a 'live' field environment in partnership with University College London (UCL).

Clare Palmer (BritainThinks) and Rebecca Posner (DfT) will discuss the methodologies used and why, how different methods worked together, how we successfully brought the technology to life in a variety of local environments, and ultimately how our chosen methods contributed towards findings and policy perspectives.

In conversation with... Mike Michael and Jen Ross - prospective & speculative methodologies

Speaker(s):

Abstract:

Join us for a unique conversation between two researchers with longstanding interest in speculative and prospective methods in social science research. Together, they will be discussing their latest books: The Research Event: Towards Prospective Methodologies in Sociology (Michael 2022) and Digital Futures for Learning: Speculative Methods and Pedagogies (Ross 2023). Their conversation will focus on what Jen talks about in her book as as ‘glitches’ and Mike describes as ‘overspills’, and the importance of paying attention to and working with mess, excess and uncertainty in the research event. We will think together about what this work entails methodologically, and how to (partially!) account for it in design, engagement and analysis stages of research. Come and think creatively about the generative, troubling place of glitches and overspills in your own work.

What is the MRC/NIHR Framework for Developing and Evaluating Complex Interventions, and what does it tell us about developing programme theory?

Speaker(s):

Kathryn Skivington, University of Glasgow

Abstract:

The 2021 Framework includes six core elements of intervention research that should be attended to at each research phase (development, feasibility, evaluation, implementation): context, programme theory, stakeholders, uncertainties, intervention refinement, and economic considerations. This session will give a very brief overview of the Framework, and go beyond by providing more detail on the core element of programme theory. Programme theory describes how an intervention is expected to lead to its effects and under what conditions - the Framework suggests that it is essential for programme theory to be tested and refined at all research stages and used to guide the identification of uncertainties and research questions. This session will draw on examples of programme theory and provide suggestions for how its development and refinement can be approached.

How to mobilise your research in the policy landscape

Speaker(s):

Abstract:

Breaking news every hour, a continuous onslaught of social media posts, videos, podcasts and an endless stream of messages, calls and opinions vying for attention. If that's what life is like for most people, imagine being in government or parliament. Every day you are bombarded by more and more information competing to win the hearts and minds of those in power.

Tired of receiving descriptive briefings full of jargon, government officials, Members of Parliament and their advisors often end up resorting to 'The twin pillars of Google and asking people we know'. So how do time-poor researchers cut through the noise to capture the attention of policy and decision makers?

The session will focus on how to mobilise your research in the policy landscape, what influences policy and decision makers, and some tips and resources to help you on your journey to policy impact.

In conversation with contributors to the Handbook of Teaching and Learning Social Research Methods (edited by Nind, 2023)

Speaker(s):

Abstract:

The new Handbook of Teaching & Learning Social Research Methods illustrates the wide range of pedagogic approaches in the classroom, online, in the field and in informal contexts. Bringing together contributors from varied disciplines, methodological approaches and nations, it represents a landmark in the development of pedagogical culture for social research methods. The conversation session brings together some of the contributing authors to the Handbook to reflect on their experiences and research in the field. You can expect critical insights, passion and controversy as the authors discuss what they see as important to teaching and learning social research methods well. We invite other teachers and learners to join in the conversation.

Integrating survey data collected in different ways: how can we produce robust population estimates?

Speaker(s):

Abstract:

Face-to-face probability sample survey fieldwork is increasingly challenging and expensive, and many surveys are looking into alternative data collection options, including using multiple methods for data collection. Examples include using both probability and non-probability sampling frames, and/or modes of data collection (face-to-face and remote modes, e.g., online and telephone interviews). But how do survey researchers combine the resulting data to produce robust population estimates of prevalence or association? Should, and if so, how can the relative quality and inherent biases of the different data sources be taken into account? This panel discussion will bring together experts from across major survey organisations and academia to discuss the challenges of integrating data and offer their thoughts as to how surveys might address this problem . The panel discussion will be hosted by researchers from Natsal (www.natsal.ac.uk), one study facing this challenge.

Gaining access: methodological and ethical challenges of researching workplaces

Speaker(s):

Abstract:

My presentation focuses on the challenges of researching workplaces. The process of gaining access to workplaces is very often overlooked when discussing research methods. This can leave researchers with little guidance on how to negotiate their way into workplaces and establish the relationships that facilitate the process of collecting in-depth organisational data. Using my research experience of facilitating case studies of large workplaces, I discuss how to build trust with participants, and gain consent. First, I start by emphasizing the importance of reflecting on both our own position as researchers and the parameters of our research object, then by revising our definition of what is a workplace. I then discuss the various methods one can use to access workplaces with an emphasis on navigating the challenging scenarios a researcher may face as they seek gather data while also maintaining productive relationships with key organisational gatekeepers.

Experiences of video interviewing in two UK national cohort studies

Speaker(s):

Samantha Spencer

Abstract:

Using video interviewing to conduct social surveys is relatively new but interest in this mode accelerated considerably during the COVID-19 pandemic. During the pandemic this mode of interviewing was used on two large scale longitudinal studies, the 1958 National Child Development Study (NCDS) and the 1970 British Cohort Study (BCS70). Both studies had planned large face to face surveys which were not possible to conduct during this time. Video interviewing enabled fieldwork to take place until face to face interviews were again feasible.

We will discuss some of the key challenges arising including how to implement the video interview, training requirements and protocol adaptions, including the collection of highly sensitive information via video. We will present findings on response rates achieved, initial findings on the impact of video interviewing on data quality and will consider the future potential of video interviewing as a mode of data collection for population surveys.

What is Content Analysis and Inter-Coder Reliability?

Speaker(s):

Abstract:

Content analysis can be a useful tool to analyze a wide range of data, including texts, visuals, or backgrounds of actors in the public sphere. This session will cover the basics of getting started with content analysis: How to identify usable data, how to find a suitable coding scheme, and how to conduct the coding. Additionally, we will explore how to establish inter-coder reliability, including how to identify secondary coders, how to generate randomized subsamples, and how to calculate reliability scores. There will also be an opportunity for participants to ask their individual questions.

What is Topological Data Analysis Ball Mapper?

Speaker(s):

Simon Rudkin, University of Manchester

Abstract:

The value in visualising data early within the analysis cycle is well understood. Topological Data Analysis (TDA) is an emerging strand of data science which considers the shape of data. This session will show one methodology from the TDA toolkit which speaks to the benefits of visualising data. Taking an intuitive perspective, we will introduce Ball Mapper (TDABM) to view the joint distribution of multivariate datasets. All that is required are ordinal variables for which plotting a scatter plot would be logical. TDA considers data as a point cloud, the scatter plot being a 2-dimensional representation. TDABM enables the mapping of multi-dimensional point clouds. By mapping outcomes across the joint distribution, we may highlight regions of particular interest. TDABM then allows the user to link back to the data and identify exactly the data points involved. Examples will be taken from across the social sciences. Accompanying R code is provided.

From paper to pixel: Real-world experiences with digital tools in survey research

Speaker(s):

Eva Aizpurua, NatCen Social Research

Shanna Christie

Abstract:

This session explores the role of digital tools in survey research, with a focus on the transition from traditional paper-based research tools to digital ones. Our panel of experts will provide an overview of the opportunities and challenges posed by digital tools, discussing key topics such as adoption, coverage, comparability, and data quality. Drawing from their first-hand experience in implementing digital tools in social and health surveys, panellists will offer practical insights and guidance on how to integrate digital tools into research designs. This session is intended for individuals interested in gaining a deeper understanding of digital tools in survey data collection and considering making a transition from paper self-completions. Join us for an informative and engaging discussion on the role of digital tools in survey research.

Comparative Judgement methods

Speaker(s):

Rowland Seymour, University of Birmingham

Abstract:

Comparative judgement methods can be used to construct reliable measurement scales that elude more traditional methods. Such scales typically measure important but nebulous theoretical ideas such as ‘beauty’ or ‘writing quality’. Comparative judgement involves no coding schemes and no categorisation; instead judges make holistic decisions about which of two presented objects better represents the theoretical idea of interest. These methods have a long history but are only now gaining traction due to technological developments making them more accessible to researchers. Following an NCRM online training event in 2022, this panel event will feature three experts across five parts as follows:

1. What is a comparative judgement? An introduction and example (20mins, Rowland Seymour).

2. Comparative judgement in second language acquisition research (10mins, Marie-Josee Bisson).

3. Comparative judgement methods for comparing standards (10mins, Ian Jones).

4. Comparative judgement resources for researchers (5mins, Ian Jones).

5. Q&A (5mins, all panel members).

What is pedagogical content knowledge for research methods education and training?

Speaker(s):

Abstract:

Pedagogical content knowledge (PCK) refers to the mixing of knowledge about a subject and knowledge about how to teach; it includes understanding the (mis)conceptions and difficulties of learners with the subject and powerful ways for making subject knowledge comprehensible. It is how we translate subject content for learners. This session sums up some of the findings of NCRM's pedagogical research, including the recent systematic review of pedagogic literature. I argue that there is distinctive PCK for teaching research methods and even domain-specific PCK within this. However, PCK is dynamic and by reflecting on our own PCK, engaging in dialogue, and appreciating the evolving literature on research methods pedagogy, we can make teaching and learning research methods a more informed and enjoyable endeavour.

Measurement and intervention effectiveness: How to select questionnaire content that makes your intervention (not) work?

Speaker(s):

Clair Gamble, University of Dundee

Abstract:

A key condition for successful evaluations of interventions is that the evaluation criteria are sensitive to detect those changes or differences that are expected. Social science evaluations often rely on questionnaires as an important component of the evaluation criteria, assessing participants' experiences, views, and other subjectively defined characteristics. A common problem is that the questions are not well-targeted for the assessment purpose and do not evaluate relevant levels of the construct they are intended to measure.

This problem will first be illustrated with practice-based examples. We will then introduce the key concepts of what it means to identify or develop a fit-for-purpose evaluation tool, developing a framework based on program evaluation theories, psychometrics, and sampling theory. Participants will then explore with the support of interdisciplinary expertise in group work how to connect this to methods and problems they are familiar with.

What is the ECHILD Research Database?

Speaker(s):

ECHILD Team

Abstract:

We will introduce the ECHILD Research Database, which links longitudinal administrative records from health, education and social care for >20 million children in England. ECHILD will soon be available for access by accredited researchers on the ONS Secure Research Service. We will use this session to describe the data available in ECHILD, demonstrate how it can be used, and explain how to apply for access.

We propose a 2-hr workshop format, with break-out sessions, as follows:

- Introductions / ice breaker

- Introduction to HES / NPD / ECHILD

- Breakout sessions for participants to discuss any questions they have and their thoughts about how ECHILD could be used to answer a specific research question

- Q&A

- Breakout sessions with interactive whiteboard to explore the benefits of using ECHILD to evaluate specific research questions and find out what information is needed to plan a study

- Feedback session with members of the ECHILD team

Putting users' voices at the heart of research and evaluation

Speaker(s):

Abstract:

In the social sector, the lack of physical and cognitive diversity among funders and leaders within social sector organisations means that decision-makers rarely come from backgrounds that reflect the lived realities of end users (traditionally called ‘beneficiaries’). They often have little to no influence on decision-making and are unable to define the projects they are supposed to benefit from. Research often only includes end users when data is required from them rather than throughout the research cycle.

TSIC’s USERS methodology provides practical guidance on co-production with end users across various research stages. In this workshop, we will introduce the methodology and share examples. Participants will have the chance to turn theory into practice, by collaborating on designing a research plan in breakout rooms and exchanging learning in the main room.

How to Work with TikTok Data

Speaker(s):

Abstract:

With over 1 billion active users across the world, TikTok has firmly claimed its position as a leading social media platform. But unlike more established social media platforms like Facebook, Instagram or Twitter, research using TikTok data is still relatively scarce. In this session, we will explore how to use TikTok in social sciences research. Which data is available through TikTok? How do I access it? What are ethical considerations to keep in mind when using TikTok data? How do I work with TikTok data and which methods can I use to analyze it? As an audiovisual platform, TikTok data can be used for a variety of methodological approaches, examples of which will be explored further in this session. There will also be an opportunity for participants to ask their individual questions.

Mass Observing the everyday

Speaker(s):

Abstract:

This session will introduce participants to Mass Observation (MO) narrative data and demonstrate a new database resource (funded by Wellcome) to search and generate material from its Mass Observing COVID-19 collection. MO specialises in material about everyday life in Britain. It contains papers generated by the original Mass Observation social research organisation (1937 to early 1950s), and newer material collected continuously since 1981. It is a source of national qualitative longitudinal data, rich in peoples thoughts, experiences and opinions of everyday life. This session will explore the use and challenges of this material for learning and research across disciplines. www.massobs.org.uk

Learning from lockdown: balancing the benefits and pitfalls of virtual data collection.

Speaker(s):

Sally Sharp, University of Northampton

Abstract:

This webinar provides opportunities for the collaborative evaluation of virtual interviewing (VI). It is inspired by the critical reflections of two post graduate researchers forced to adopt alternative methods for data collection as a result of the COVID-19 restrictions. Our initial individual reflections challenged the view that VI was inferior to face-to-face methods. Despite different research areas and different professional backgrounds and driven by our shared interest in methodology, we continued reflecting collaboratively. We hosted two seminars with members of post graduate researcher (PGR) communities. Using reflexive thematic analysis, three overarching themes were created: choice, identity, and context, with ethics identified as integral. Using the themes as prompts for discussion, the webinar invites contributions from researchers and practitioners with experience of, or interest in, VI data collection and or data analysis. Our initial findings suggest VI has secured a place for the future, but what do others think?

How to Collaborate with External Partners for Policy Engagement and Impact

Speaker(s):

Dianna Smith, University of Southampton

Abstract:

This session shares the results of an earlier study, Policy Link, where examples of good practice were shared by academics and their external partners who inform local or national policy. The suggestions for good practice in engagement - when, how and with whom - are shared with a series of case studies to demonstrate how to put such ideas into practice to ensure your research is aligned to priority areas. A closer look at how you can adapt your short pitch for a range of audiences will support flexible thinking when meeting with different groups. Finally, there are suggestions on how to gather evidence for impact and monitor ongoing engagement.

How to Design and Deliver Inclusive Co-Design Approaches in Research Projects

Speaker(s):

Laura Wareing, Lancaster Medical School, Lancaster University

Abstract:

Inclusivity in co-design is integral to a meaningful process and representative outcomes, but it is a challenging task for researchers. This session will share how the PARITY project at Lancaster Medical School designed and delivered a series of inclusive co-design workshops, which aimed to develop criteria for evaluating cancer services with individuals from diverse populations. The interdisciplinary PARITY team will share details of the stages of the co-design approach, and how a series of design-led tools were used to guide and support inclusive involvement. We will share best-practice principles that were co-produced for engaging underrepresented groups in health service design, with insights into how and why they were used, and the challenges faced. Session participants are welcome to join an interactive discussion to exchange ideas on inclusive co-design approaches and methods, as well as examples of successes and failures.

Using Data Science for Evaluation

Speaker(s):

Michele Binci, Kantar Public

Abstract:

This session would be an opportunity to discuss the potential for data science applications in evaluations, with a focus on evaluations in the UK public policy domain. The existence of big data in the UK public sphere (e.g. longitudinal national surveys, administrative datasets, and programme management information systems) offers a unique opportunity to apply machine learning techniques to complement more traditional evaluation methods. In addition, data science applications such as natural language processing, satellite imagery and remote sensing, as well as web scraping can expand the evaluation toolbox at our disposal and enrich our evaluative judgments. We are proposing to discuss all this in the webinar, presenting applications from our current work and our plans for future applications. We would then open the floor to the research and methods expert participating int the conference and webinar to discuss the potential, risks and limitations associated with data science in evaluation.

Analysing qualitative data: how do we keep the vibrancy of data in our analysis and writing?

Speaker(s):

Abstract:

This session focuses upon the analysis of qualitative data. Being mindful of critiques of data analysis and sociological writing that renders social worlds and experiences as 'dead' (see Back and Puwar, 2012), this session explores how we can maintain the vibrancy of qualitative research (including interviews) throughout our analysis and writing. Qualitative interviews often offer nuanced accounts of people's everyday experiences and yet current work on how we analyse data often fails to address this question of the vibrancy of social worlds. By taking the example of my own research into dormant things, that seeks to understand the vibrancy of everyday objects, as well as the role these objects have in our lives, I outline ways to reinvigorate our data, as well as how to attune ourselves to the vibrancy of data.

What is the solution Secure Data Facilities could offer to enable reproducibility for papers based on personal and confidential data?'

Speaker(s):

Beate Lichtwardt, UK Data Service/ UK Date Archive, University of Essex

Abstract:

Reproducibility for articles based on personal, confidential and sensitive data remains a growing concern for journals, researchers, and data service providers. Access constraints and limited resources prevent peer reviewers from directly reproducing research based on these types of data. At the moment, researchers submit their code to a journal to support their findings. However, Secure Data Facilities are increasingly receiving inquiries about robust and transparent solutions to enable reproducibility for peer reviewers prior to paper publication.

Building on previous presentations on the topic, in this talk, we will present possible solutions Secure Data Facilities could offer to service the increasing demand to enable reproducibility for papers based on personal and confidential data.

What is the UKCenLS?

Speaker(s):

Nicola Shelton, UCL

Abstract:

This session provides an introduction to the UKCenLS and its support services and how we can help researchers to use data from the linked UK Census Longitudinal Studies for Northern Ireland, Scotland, and England & Wales. The UKCenLS provide a rich and powerful resource for research for a diverse range of academic disciplines, policy-makers, practitioners and third sector bodies. The format comprises a short introductory video (30 mins), followed by a live Q&A session (20 mins). The session will look at the resources for users including learning modules, application forms and abstracts and the support available from our teams. We will cover a range of topics from the benefits of how longitudinal Census data can be used to answer research questions, to accessing secure and synthetic datasets from UK Census longitudinal studies. This introductory session will provide a clear guide for researchers considering using longitudinal Census studies in their research.

What is accessibility in digital and online social research?

Speaker(s):

Abstract:

For social research to reflect our world as it is lived, research must be inclusive. In digital and online spaces, any claims to representation must be underpinned with technical foundations that ensure the research process is accessible to research teams, participants and wider publics irrespective of dis/ability. In this session, we will introduce the technical, social, legal, ethical and methodological dimensions of accessibility in digital and online research practice. We highlight useful intersections between digital accessibility and (feminist/hacker) epistemologies of bricolage to move from accommodating difference, to establishing conditions of 'radical hospitality'. We will also consider how researchers can to build connections and explore resources to support ongoing learning, to ensure accessibility principles are embedded in everyday digital and online research.

Qualitative Secondary Analysis: a multi-perspective discussion

Speaker(s):

Karen Tatham

Lisa Scullion

Cassie Lovelock

Abstract:

Qualitative Secondary Analysis (QSA) is a method receiving growing attention, bolstered by support from the ESRC Secondary Data Analysis Initiative and implicitly endorsed by UKRI requirements to archive qualitative datasets. This panel will bring together five researchers, all working on the same archived dataset (the Welfare Conditionality project), but with diverse relationships to, and lenses on, the data. Applying Heaton’s (2004) typology of QSA approaches, our panel includes researchers from the original project team now conducting more in-depth investigation of emergent issues from the primary study (supplementary analysis) or combining the data with additional datasets (amplified analysis), and early career researchers who have accessed the archive and are approaching the data with new empirical and theoretical questions (supra analysis), some under the supervision of original project team members. Panellists will critically and reflexively discuss the opportunities and challenges afforded by their diverse relationships to the dataset and to each other.

How do the Methods We Use Impact Our Understanding of a Topic of Study: Using School Choice Research as an Example

Speaker(s):

Abstract:

This debate uses research on school choice in the UK as an example to analyse how different research methods may impact the research process and outcomes, focusing on the research conducted by Diane Reay and her co-researchers (e.g., Reay, 1996; Reay & Ball, 1997), and that of Stephen Gorard and his colleagues (e.g., Gorard et al., 2001; Gorard et al., 2002; Gorard, 2000). The debate will be guided by the following major questions: 1) What are the different research methods used by Diane Reay and Stephen Gorard to study the impact of school choice policies on education stratification in the UK? 2) What are the divergent opinions reached by Reay and Gorard regarding the impacts of school choice policies on education stratification? 3) How do different research methods influence the interpretation and operationalisation of research questions, research design, and data collection and analysis strategies? 4) What are the implications of these divergent findings for policymakers and practitioners?

Creative Writing for Academics: methodologies, motivations and impacts

Speaker(s):

Gayle Letherby, Visiting Professor, Plymouth, Greenwich, Bath (Centre for Death and Society (CDAS))

Abstract:

The focus of the workshop will be to explore – through creative writing – different ways to tell our substantive and methodological research stories. This will include reflection on various materials including research diaries and data, pedagogic reflections, emotional, practical, theoretical and P/political concerns. This way of working, of writing, of academic storytelling, explicitly blurs the boundaries of ‘fact’ and ‘fiction’, which is arguably true of all narratives, whether made explicit or not (e.g. Letherby 2022). In addition to challenging traditional understandings of ‘good’, ‘valid’ and ‘tidy’ research it also has implications for the ways in which we define, and attempt to enact, engagement and impact, within, besides and beyond the academy. In addition to writing some short pieces of prose/poetry/song lyrics we will also engage in some creative editing.

Letherby, G. (2022) ‘Thirty Years and Counting: an-other auto/biographical story’ Auto/Biography Review 3(1) View of Thirty Years and Counting (autobiographyreview.com)

Many Models: Conducting Sensitivity Analyses in R

Speaker(s):

Abstract:

Typically, research papers in health and social science include the results of one, or a few, models. These are drawn from a wider universe of defensible models that could have been run, but results may not be robust to these other model specifications. Other times, answering a research question requires running a model over different subsets of the data or with different sets of variables (for instance, repeating a model across a set of ages). But writing the code to run multiple models can be daunting and error-prone. In this interactive workshop, we will demonstrate simple ways to run many models using the programming language R. We will also show how the results of many models can be combined and presented in simple, comprehensible ways and we will show how computationally demanding models can be run cost-effectively in the cloud. Attendees will require access to R and RStudio.

Cognitive interviewing: an interactive introduction

Speaker(s):

Marco Pomati, Q-Step Centre, School of Social Sciences, Cardiff University

Abstract:

Cognitive interviewing is a method used to improve the quality of survey questions. The goal of cognitive interviewing is to understand how people understand and respond to questionnaire questions, and to identify potential sources of confusion. It generally involves conducting semi-structured interviews with a range of respondents to understand their thought processes as they understand and answer questionnaire questions. Conducting cognitive interviewing before a survey is carried out generally results in better questionnaire questions and more confidence in the answers we receive. This session covers cognitive interviewing sampling, data collection and analysis through an interactive workshop with group activities.

Using Sankey plots to visualise complex pathway data in public health and social research

Speaker(s):

Abstract:

A Sankey diagram is a visualization used to depict a flow from one set of values to another. This two-hour workshop will provide an introduction into how to construct a Sankey plot to visualize and analyze complex patterns and pathways in public health and social data. In the first part of the workshop, the concept of Sankey plots and how they are used in public health and social research will be explained. This will be followed by a demonstration on how to generate Sankey plots in R studio software. In the second part of the workshop, participants will be divided into groups and each group will be given a research question and synthetic data that they will use to construct a Sankey plot to answer the research question. This will be followed by a general discussion on the benefits and drawbacks of the Sankey plot method.

Supporting digitally excluded respondents to take part in social surveys

Speaker(s):

Abstract:

With the UK having one of the highest internet penetrations in the world, it would be easy to assume there is little reason to worry about offering an offline completion mode for social surveys. We will argue that confidence in going online is by far universal, with substantial groups, which we define as digitally excluded, still requiring support when completing surveys.

Our session will present data on online confidence and online behaviours from the Ipsos probability KnowledgePanel and the Scottish Household Survey. Speakers will focus on practical approaches for supporting digitally excluded respondents and why this is important for reducing non-response bias. We will discuss how differing multiple complex needs dictate the different levels of support required, with examples from: Trussell Trust's Hunger in the UK research with people referred to food banks, the Welsh Value in Health Centre's surveys targeting patients with long term conditions, the GP Patient Survey.

Ethical uses of race and migration data

Speaker(s):

Abstract:

This webinar explores the ethical issues that need to be considered when researching race and migration with a particular focus on census data. Due to the geographical specificity of the data it is open to misuse to reinforce tropes of swamping, British culture under threat and the white British as a minority in cities. The population of Muslims in local authority areas was used to determine the allocation of funds for the Preventing Violent Extremism programme which led to social control and monitoring of 'suspect' populations. The release of data on migrants supported stories about Albanian migrants. Research shows that the majority of those arriving were granted refugee status, including those from Albania.

This paper argues that these potential harms justify the development of ethical practices when researching and publishing information about racialised migrants and minorities and the promotion of critical approaches to media reporting of related stories.

Understanding Policy and other Systems: An introduction to PRSM, the Participatory System Mapper

Speaker(s):

Abstract:

Systems Mapping is a method that can used to develop a 'map' that describes the causes and effects in any social or other system (Penn and Barbrook-Johnson, 2022). With Participatory Systems Mapping, stakeholders and others work collaboratively to develop a map that represents their collective beliefs about a system, for example, a policy domain or an environmental issue. In this webinar, I will introduce (a) PSM as a method (b) an app called PRSM (https://prsm.uk/), free software that runs in a browser and that allows groups to construct system maps virtually and in real time (c) the map analysis features that PRSM provides and (d) conclude with a 'hands-on' session for participants to try system mapping.

Video for Qualitative Research

Speaker(s):

Lucy Meechan, Kings College London

Abstract:

Video offers unprecedented opportunities for social science researchers, facilitating detailed analysis of cultures, social organisations and forms of communication. This session will briefly introduce the ways in which film, and more recently video, have increasingly become part of field studies and ethnography. It will provide practical advice for those interested in using video as part of qualitative research; addressing problems that can emerge when undertaking video-based studies, and demonstrating how video recordings can be subjected to detailed scrutiny and analysis. Presenting a small selection of video data fragments, the session will demonstrate how video can provide distinctive ways of presenting observations and findings, which can be relevant to both academic and practitioner audiences,

Teaching Social Research Methods: Taking a Decolonial Approach

Speaker(s):

Umeeka Raichura, Research Methods Commissioning Editor

Abstract:

This panel session will explore how research methods teaching can highlight/support decolonial approaches to research methods and methodologies.

Panelists will share their experience of embedding principles of decolonisation into research methods teaching with undergraduate and postgraduate students across the social sciences. With an emphasis on peer learning and collaboration, the session aims to showcase good practice for nurturing both student understanding of decolonial approaches to methods and methodologies, and their ability to apply such theories and concepts to their own research projects.

The first half of the session will include lightning talks from lecturers talking about their experience of teaching research methods from a critical perspective. The second half of the session will be a discussion spring-boarding from audience Q&A.

The session is aimed at anyone actively teaching social research methods who wants to, or has been, employing principles of decolonisation in their teaching.

Exploring the role of emotional labour within the research context

Speaker(s):

Catherine Quinn, Centre for Applied Dementia Studies, University of Bradford

Gill Toms

Alex Hillman

Abstract:

How often do we consider the role of emotions within the research process? Emotional labour refers to the management of emotions within the workplace. This is something we do when undertaking research, but we often only consider the impact of research on participants. Emotional labour can occur for researchers working in any type of research methodology during the data collection process. These emotions can have a positive role in building rapport and enabling the researcher to understand the participant’s world. But equally the researcher can find it hard to stay detached and it can lead to emotional strain. In this session we will draw on our experience in dementia research to explore and discuss the emotional impact of research on researchers. As well as considering the role of emotions in the research process we will suggest strategies that researchers can undertake to mitigate negative impacts.

Using zines in participatory social research

Speaker(s):

Abstract:

Zines are non-profit self-publications which have a history in grassroots social and political activism. Although zines defy any rules of production, they commonly incorporate text, drawings and re-claimed visuals to address a range of topics that occupy the intersection between personal and political. This workshop will demonstrate the advantages of zine-making as a method in interdisciplinary and participatory social research. A short talk will draw from research which utilised zine-making with refugee women to address complex methodological and ethical considerations around power imbalances, vulnerability to harm, participation and expressive control. In the second part of the workshop, participants will reflect some of the zine-making data from the project in breakout rooms, with questions to guide the discussion. No previous experience is required to attend the session, but participants should note that some of the zine pages shown address women's experiences of potentially triggering topics, including gender-based violence and asylum harms.

Collectively and creatively addressing challenges in coproduced dementia research: Working towards a more equitable future

Speaker(s):

Abstract:

Whilst coproduction is growing in popularity as a research approach, limited projects enable those living with dementia to be coresearchers. The societal stigma surrounding having a dementia often leads to a false assumption that those with dementia are unable to participate. However, many people living with dementia are capable of contributing to and leading research activities - more just needs to be done to empower those living with dementia to participate. We need to explore how to: 1) provide the necessary resources, training and time to do coproduction authentically and ethically; and 2) be reflexive and critical of challenges in a landscape that doesn't value coproduction. In this workshop led by the Edinburgh Centre for Research on the Experience of Dementia, we invite you to creatively engage with us to imagine a more equitable future. We will use creative methods to collectively address these issues and identify priorities for the future.

What are digital research ethics?

Speaker(s):

Abstract:

While ethical issues are faced by all social researchers the ethical issues posed by some digital platforms, digital spaces and mediated interactions can raise distinct ethical challenges (and opportunities).

This session will consider what it means to ethically collect data and to work with potentially sensitive data when using digital research tools and when researching digital spaces and objects. It will introduce researchers to principles underpinning ethical practice in digital contexts and will explore the complexities of managing issues of informed consent, anonymity and confidentiality in and through digitally mediated environments.

What is the role of Interactive Visualizations in Understanding Sexual Orientation, and Gender Identity?

Speaker(s):

Louise Capener, UK Data Service

Abstract:

The 2021 UK census introduced new questions on sexual orientation and gender identity, which were voluntary and potentially sensitive. This complicates analysis and means comparison of non-straight people, trans people or other novel group identifications may not be useful. Interactive visualisations allow audiences to test intuitions and focus on comparisons in otherwise impossible ways. Combining this novel census data with mental health, deprivation and rural/urban classifications or other demographic and environmental correlates can help understand how sexual orientation and gender are represented across the UK. We present the 2021 census data through three interactive visualisations to maximise clarity and minimise misunderstandings in the exploration of social and physical vulnerability.

What am I measuring here? In conversation with Kathleen Slaney about construct validity

Speaker(s):

Jan R. Boehnke, University of Dundee

Abstract:

Quantitative social science research often relies on asking people questions about characteristics that cannot be directly observed: e.g., attitudes, knowledge, or health perceptions. These characteristics are broader than the concrete questions themselves, often called 'concepts' or 'constructs'. But what does it mean to measure subjectively defined concepts? What does it mean to quantify 'achievement' or 'health-related quality of life'? In her 2017 book "Validating Psychological Constructs" (Palgrave Macmillan), Dr Slaney provided a commensurate view of the historical, philosophical, and practical dimensions of these questions. We will follow up on Dr Slaney's hope that her book contributes to a growing body of work aiming to better understand the assumptions underlying quantitative psychological research. We will place this discussion in her recent work on topics such as objectivity, problematic research and reporting practices, as well as questions about the importance of interdisciplinary perspectives in this discourse.

The how, when and why of Qualitative Secondary Analysis: Kahryn Hughes and Anna Tarrant in conversation

Speaker(s):

Anna Tarrant

Abstract:

This 'in conversation with' session will explore the how, when and why of Qualitative Secondary Analysis. Join Kahryn and Anna who will introduce Qualitative Secondary Analysis (QSA), not as a replacement for primary research, but as an established alternative or addition to the broader repertoire of qualitative research methods. Reflecting on developments in the field in the past two decades they will outline the historical conditions through which innovations in this burgeoning methodological field have emerged. They will discuss their own contributions to these debates and present examples of how qualitative data re-use have supported extensive new knowledge and theorisation. Delegates will be invited to consider the challenges of Qualitative Secondary Analysis and to pose questions both about utilising this methodology and engaging with the tsunami of international archived qualitative research data currently available.

The research ethics tree: engaging children with research ethics using an interactive tool

Speaker(s):

Abstract:

When a child becomes a participant in a research project, it is often their first exposure to research. Thus, understandably, they come with little understanding of what research is and their involvement in it. Whilst research consent forms - written in 'child-speak' - are helpful, they work on the assumption that children have understood the written content and if not, feel comfortable enough to ask questions during a first meeting. This is a big ask and often leaves child participants with superficial knowledge and understanding of ethical research.

Inspired by the work of Edwards and their 'Case of Ethics' (2019), I developed my own 'research ethics tree'; an interactive and visual representation of the research ethics involved in my PhD research. In this workshop, I will share my experiences of developing and using the tool. I will then invite the audience to engage in a 'make your own', thus inviting them to reflect on how they do, or could, support children's understanding of ethical research in their own practice.

What is an Imitation Game?

Speaker(s):

Abstract:

This interactive session will introduce the Imitation Game as a method for social research. We will describe the Game and its distinctive features including the close integration of qualitative and quantitative data, the ability to evaluate the distribution and content of expertise, and the possibilities this creates to explore ‘groupishness’. Using data from previous research, we will illustrate these insights and you will have the chance to see how you would fare as an Imitation Game Judge. The session will conclude by outlining a new variant of the method that makes it suitable for use on projects with a small budget and a tight timescale.

For the open research movement to succeed, we need to discuss what we mean by transparency

Speaker(s):

Abstract:

Open research practices are becoming increasingly popular, with the term ‘transparency’ being paramount. However, what researchers mean by ‘transparency’ varies considerably depending on disciplines, career stage, and methodological persuasions. We think it is important to discuss such themes. In this workshop, we will start with 2 short 15 minute presentations describing the context. The first presentation (Hayward Godwin) will focus on the context of open research. The second presentation (Christian Bokhove) will explain the challenge of coming to some understanding of what we mean by research transparency. After that, random break-out groups are created for three times 20 minute discussions about the topic. We ask representatives of each group to make notes in a collaborative document for each discussion topic. Finally, we return to feed back the results of the discussions. We aim to publish the collaborative document as a workshop result.

An experiential workshop on photovoice: participatory action research using photography with marginalized groups

Speaker(s):

Deborah Chinn, King's College London

Abstract:

Photovoice is an arts based participatory action research method in which participants highlight areas of concern in their lives through taking photographs, sharing and discussing these and using the insights to engage with policy makers and change agents. In this experiential workshop we will learn about photovoice by joining together to conduct our own photovoice mini-project to take us through the different stages of the photovoice method. We will also reflect on the theoretical background to photovoice, its current uses and the advantages and pitfalls of this method, drawing on the recently completed Feeling at Home project (www,feelingathome.org.uk) in which people with learning disabilities took photos about their home lives, and shared these with a variety of audiences.

Sensitivity analysis for missing data and measurement error

Speaker(s):

Abstract:

Missing data and measurement error are two common problems affecting social research. Sometimes we can rely on auxiliary data to adjust for them, but often all we have is just an educated guess, which can still be used to undertake sensitivity analysis.

In this workshop we will explore how to simulate a range of ‘likely’ scenarios based qualitative insights regarding the magnitude and direction of the suspected missing data or measurement error mechanisms. Specifically, we will use multiple imputations and the MICE package in R.

Following a short introduction to the topic, participants will be invited to work on one of two exercises: i) estimating the mitigating effect of ‘showing remorse in court’ when more punitive judges are less likely to complete their questionnaires; or ii) the association between unemployment and crime across Police Force areas when crime reporting rates are themselves affected by the unemployment rate.

The 60-Minute Protocol Reuse Challenge

Speaker(s):

Abstract:

Step-by-step protocols allow researchers to share detailed methods information in a format that can be readily reused and adapted to other contexts. This workshop explores the affordances and limitations of step-by-step protocols for the social sciences, through a hands-on introduction to the methods sharing platform protocols.io. At the heart of the workshop is a fun, fast-paced challenge inviting participants to select a sample protocol and then “fork” it for their own use, generating a copy that they can modify, mark up, and build on. After one hour, participants will share out their forked protocols and from there reflect as a group on the potential they see for protocol sharing and reuse. Participants will be asked to create a protocols.io account before the workshop so that as much setup as possible can be done in advance.

How to use simulation methods for power analyses and sample size calculations in cluster-randomised designs

Speaker(s):

Jan R. Boehnke, University of Dundee

Abstract:

Randomising units such as schools or health services with the goal to evaluate innovative programmes, interventions, or other changes to their usual practice has opened new possibilities to evaluate research questions in real-world settings These so-called 'cluster-randomised' trials have become a cornerstone when planning research with impact and are used in a wide range of sectors and disciplines. The session will briefly introduce this study design, and then focus on a technical aspect: how to design (frequentist) case-based simulation studies to determine required sample sizes to test pre-specified hypotheses in R. The presentation will draw on multiple practical examples from the presenter's experience and offer (i) a structured approach to designing such studies (incl. code examples) and (ii) point to existing resources for specific design types.

Arts and Humanities Methods: An Interdisciplinary Primer

Speaker(s):

Abstract:

This Q&A based discussion contributes to long-standing dialogues between the social sciences and the arts and humanities, providing a primer in the state of the art(s). The arts and humanities had to respond to a wave of digitalisation and demands to demonstrate impact far earlier than the social sciences. When it comes to methods, the response has been highly innovative and the panel will introduce and showcase work in arts methods (Kierans, Lybeck, Slocombe), digital humanities (Ashworth, Godfrey, Musi, Webb) and archival studies (Buchannan, Thomason) - areas which intersect with the social sciences but have methodological relevance across multiple research fields and link outwards to professional and institutional communities in the arts, design, heritage, government, architecture, medicine and more. The session offers an opportunity to explore resonances and will be of interest to all those seeking to expand their understanding of the methodological repertoires being developed beyond the disciplinary boundaries of the social sciences.

What is survey post-stratification for offline and online surveys?

Speaker(s):

Marco Pomati, Q-Step Centre, School of Social Sciences, Cardiff University

Abstract:

Survey post-stratification is a technique used to ensure that your sample accurately reflects the characteristics of the target population in terms of key demographic or other relevant variables. It involves using data from a reliable external source, such as a census, to construct a set of weights which are then applied to the survey data to adjust for any imbalances in the sample. If done properly, it can improve the accuracy of survey results by reducing bias and increasing representativeness. In brief, post-stratification weights are used in most surveys. If you have collected your own survey, you may want to consider constructing post-stratification weights. Similarly, whether you are analysing your own or secondary data, you may want to understand why and how these weights are constructed and how you should integrate them when reporting simpler and more complex results from your analysis.

How to analyze data from quantitative vignette studies

Speaker(s):

Thom Baguley, NTU Psychology, Nottingham Trent University

Abstract:

This workshop outlines the key characteristics of vignette studies and considers how the design of the study and the construction or selection of the vignettes impacts on the appropriate statistical model to employ, as this depends on subtle details of the design, selection and allocation of vignettes to participants. The ideal design will balance the fidelity of the vignettes to the real world phenomena being studied, the complexity of the allocation (including problems such as aliasing arising in fractional factorial designs) and statistical generalizability. Notably many published vignette studies have unmodeled heterogeneity between vignettes. This leads to underestimation of error variance in the statistical model and hence problems such as Type I error inflation. Multilevel models are proposed as a general approach to handling nested and crossed designs including unbalanced and fractional designs.

Methodological Innovations: Publishing Methodological Research

Speaker(s):

Roxanne Connelly, University of Edinburgh

Abstract:

In this panel session the editors of Methodological Innovations, Sage’s flagship social science research methods journal, will discuss publishing methodological research. The presenters will each share their own experiences of publishing methodological work on computational, statistical, qualitative, and creative research methods. The session will then welcome participants to ask questions about the processes of developing and publishing methodologically oriented publications.

Speakers:

Dr Ruth Boyask, Auckland University of Technology

Dr Leah Moyle, University of Plymouth

Dr Roxanne Connelly, University of Edinburgh

By Land, air, or internet? Doing fieldwork in a time of climate crisis

Speaker(s):

Nick Nash, Critical Research in Social Psychology (CRISP) Group, The University of Bath

Abstract:

Flying is a high-carbon activity that significantly contributes to the climate emergency. Throughout the pandemic, researchers adopted digital solutions for meetings traditionally requiring long-distance travel, such as for conferences or international collaborations (e.g. Zoom, Teams, Mural, Gather.Town) . These solutions continue to be embraced to reduce the climate impact, and increase accessibility, of international research projects. As sustainable travel policies become increasingly popular, we reflect on the practical, ethical, and methodological implications that such policies may have on research collaborations. Practical implications include challenges in communication and resource accessibility. Theoretical and methodological implications may emerge for data collection and analyses, particularly for fieldwork and qualitative research. Diversity, equality and inclusion impacts should also be considered as researchers of different career stages and demographics may experience different impacts on their professional development. This session will outline and provide a space to critically discuss potential implications of air travel-free research project policies.

More-than-Human Neighbouring - socio-microbiological engagement in research

Speaker(s):

Paul Hurley, University of Southampton

Abstract:

Using interdisciplinary approaches innovated in the team's previous research on Covid-19 on buses, 'More-than-human neighbouring' aims to support a paradigm shift in the microbiological sciences, health sciences and social sciences. It helps researchers to think socio-microbiologically about the shaping of human-microbial relations by material, social and cultural contingencies.

This 50 minute webinar will provide a short overview of the methodology, and create an opportunity for participants to undertake practical activities in their own workspace (whether at home or in the office) around the idea of (human and nonhuman) neighbouring, and the intersections of the social and microbiological. Participants will reflect in discursive breakout groups about potential relevance of the methodology in their own contexts, and how thinking with more-than-human neighbours might support different ways of doing research and intervention.

The webinar is intended for researchers of any discipline at any level, and there is no expectation for prior engagement with social or microbiological science.

What is nonlinear trajectory modelling with splines?

Speaker(s):

Ahmed Elhakeem, University of Bristol

Abstract:

Many developmental processes display non-linear patterns of change with age/time, which makes it important to accurately model the shape of their trajectory. Splines are highly flexible functions (formed by sets of connected piecewise polynomials) that can be used to model most complex nonlinear trajectories. In this session, I will introduce the concept of splines, focusing on three commonly used types: linear and natural cubic regression splines, and penalized regression splines. Using a synthetic cohort dataset and R code (to be provided on GitHub), I will then demonstrate how the standard linear mixed effects model - common method for handling correlated repeated measurements when analyzing longitudinal trajectories - can be easily extended to include spline functions (for age) to a model nonlinear trajectory for a repeated continuous outcome (early life body mass index). I will also introduce and demonstrate a spline-based nonlinear mixed effects model (SITAR) that is useful for modelling pubertal growth.

What is GIS?

Speaker(s):

Nick Bearman, Geospatial Training Solutions / UCL

Abstract:

This session will introduce GIS as a research method, showing how it can be used for research across almost all subjects. We will show some example uses of GIS, as well as cover the key things to consider when using GIS with your research. We will highlight different maps that could be created, as well as highlight some spatial analysis methods that might be useful to participants. We'll also cover some common issues with working with GIS and how to avoid these. Participants are encouraged to bring questions along to the session and Nick will pick one or two case studies to talk through the process of how we might go about mapping or doing spatial analysis on these projects.

What is systematic content analysis of legal text: on the Politics of Coding

Speaker(s):

Abstract:

Legal scholarship and practice are predominately based on the case analysis method. The law is articulated based on limited 'leading' cases, identified by judges or researchers having a bound of authority.

This talk will present a different approach, known as systematic content analysis of legal text (SCA). Shifting the focus away from leading cases towards the day-to-day application of the law, SCA attempts to bring the rigour of social science to the study of law. It represents a sought transformation from an authority- to a scientific-based methodology and invites investigations into underreported legal, economic, and political effects of rules and the decision-making process.

The talk will explore the epistemological roots of SCA, points to its power in exposing politics, as well as the limitation placed on it by politics. It draws attention to the role it may play in the future of legal research and practice, especially in Europe.

How to handle missing data and restore sample representativeness in longitudinal surveys

Speaker(s):

Michail Katsoulis

Abstract:

Missing data are common in longitudinal surveys, particularly due to attrition over waves of data collection, and can lead to substantial bias. Principled methods of missing data handling are usually required to obtain unbiased estimates in such settings. In this talk we will briefly cover the relevant missing data theory before discussing missing data methods and their application. There will be a particular emphasis on why and how variables other than those required for the analysis should be included in missing data handling. We will present findings from our recent work across several of the British birth cohorts (1958 National Child Development Study, 1970 British Cohort Study, Next Steps), including the use of linked administrative data. We will demonstrate that with careful analysis it is possible to largely restore sample representativeness despite the presence of selective attrition. There will be plenty of opportunity for questions and discussion.

What is researching 'in residence': the benefits and challenges

Speaker(s):

Abstract:

In 2022 Hallmark Care Homes employed its own in-house Researcher-in-Residence. This is the first role of its kind in the care home sector, and is underpinned by the philosophy that those who visit, work and live in care homes are experts in care and how it can be improved. Embedding a researcher within the organisation aims to empower and skill these 'internal experts' to understand, apply and contribute to research in their own care homes, across the organisation and the wider care home sector.

This presentation will describe the three main functions of the researcher-in residence: 1) Supporting individual care homes to identify, design and deliver their own research projects; 2) Co-ordinating organisation-wide research opportunities; and 3) Communicating latest evidence in practice-friendly ways. It will then explore the benefits and challenges of the approach from the perspectives of the researcher, the organisation, and crucially, in terms of successful research impacts.

What is?...[Velo]Mobile Methods: Practical Considerations when performing mobile methods by cycle.

Speaker(s):

Abstract:

In a previous 'What Is..?' session, Sarah Pink argued the need for researchers involved in sensory ethnography to, not only report their findings but also to document and reflect on the methods used in order to contribute to the development of this field. This session will focus on 'Mobile methods' and in particular the growing corpus of research using 'Velo-mobile Methods' - sensory ethnography while cycling. While there has been much discussion on the theory and potential of mobile methods less has been said about the actual practical aspects of 'doing' (velo)mobile methods, particularly within different social, cultural and geographical settings. The session will address this and will be of interest to current and potential 'velomobile researchers' and those who are interested in conducting sensory ethnography while on the move.

References:

Jones, Tim & Spinney, Justin (2016) Velomobile Methods: investigation | interrogation | interpretation. Available at: https://www.cycleboom.org/velomobile-methods-investigation-interrogation-interpretation/ [Accessed 20 Febriary 2023]

Pink, Sarah (2010) What is Sensory Ethnography. In: NCRM Research Methods Festival 2010, 5th - 8th July 2010, St. Catherine's College, Oxford. (Unpublished)

Investigating change across time: the challenges of cross-study comparative research and possible solutions

Speaker(s):

David Bann, UCL

Abstract:

Across the health and social sciences, addressing many key scientific or policy questions requires an understanding of whether a given quantity has changed over time—e.g., by year of data collection or by birth year. For example, has socioeconomic inequity in health narrowed? Has social mobility improved or worsened?

Comparative research initiatives are increasingly prominent components of health and social sciences, yet they are notoriously challenging to conduct. Seemingly innocuous analytical decisions can alter the conclusions drawn yet existing methodological training focuses on analysing single datasets.

This interactive workshop will:

1) Discuss the opportunities and key challenges of comparative research, as well as possible solutions.

2) Introduce a new open-access teaching resource that offers detailed instruction and reusable analytical syntax to guide newcomers on comparative analysis and data visualisation (in both R and Stata formats).

3) Facilitate a broader discussion of methodological issues and next steps in comparative research.

Adapting Old Methods for International Impact

Speaker(s):

Emily Upson, Newcastle University

Abstract:

This workshop will lead participants to reimagine transnational advocacy and policy influence through three participatory activities. Regionally specific crises will often develop a network of transnational advocates, through which attempts to influence the target state will be conducted. The workshop will use break out rooms to allow participants to compare their findings across field sites, and the different discoveries that would adapt the selected diagrams, and collaboratively construct new ones.

The inherited theory behind structures of power shape how we ‘see’ these advocacy communities, and how the communities see themselves. This includes Laura Nader’s vertical lines of power (Nader 1972), and human rights organization’s vested interest in seeming ‘global’ rather than literally situated (Kate Nash 2015). Now that academics are encouraged towards ‘impact’, this workshop encourages us to reimagine our old methodologies: adapting pre-existing critical models; mapping potential routes of change; and drawing current advocacy networks.

Introduction to using the Clinical Practice Research Datalink (CPRD)

Speaker(s):

Linda Wijlaars, University College London

Abstract:

The Clinical Practice Research Datalink (CPRD) is a database of anonymised electronic health records from a network of GP practices across the UK, going back to 1987 and covering information on 60 million patients. This rich data has been used for over 3,000 peer-reviewed publications. Recorded information includes patient characteristics, information on prescriptions, diagnoses, GP referrals, test results as well as linkage to other data (including death records, secondary care data, and information on area-level deprivation). Researchers can apply for access to the CPRD via the Medicines and Healthcare products Regulatory Agency (MHRA).

This workshop will provide an introduction to working with CPRD. We will cover:

- An overview of available data, their structure and how they are collected,

- Discussion on how to use CPRD for research,

- Approaches to phenotyping health conditions in CPRD & code sharing

- Breakout session for participants to explore synthetic CPRD data

Developing data skills outside the classroom: a reflection on students' learning through data fellowships and online data skills training

Speaker(s):

Jackie Carter, University of Manchester

Abstract:

This 'in conversation' session will discuss the research of the two contributors to learning data skills in the workplace or online. Jackie Carter has developed a Data Fellows programme which has placed 330 undergraduate students in 7 years into 60 organisations to develop their data skills through paid work placements. Many are now in research roles in the public, private and not for profit sector. She will reflect on how the programme has opened the door for many of these social science graduates to enter data careers. Her book 'Work placements, internships and applied social research' and 'Pathways into Research' and 'Pathways into Policy' booklets will provide the core reading for this conversation. Vanessa Higgins will discuss the online data skills training resources provided through the UK Data Service, and evidence through qualitative research how these are helping students acquire skills that they can use in their studies and research careers.

A Contemporary Understanding of Whole Brain Emulation and Mind Uploading

Speaker(s):

Abstract:

The webinar could be structured as follows.

How I came to research the topics of whole brain emulation and mind uploading.

An overview of on-going research into whole brain emulation and the potential for mind uploading as an output.

Key findings from my qualitative research with the public via a longitudinal global panel.

The challenges I faced in researching hypothetical concepts and how I overcame them.

An introduction to some AI driven apps and Brain to Computer Interfaces and their role in my research.

An explanation and a demo of a creative and novel storytelling website which aims to transport participants to future worlds where mind uploading is a reality.

Key themes/data collection a) attitudes to mind uploading b)evaluating the story telling website as a method including narrative engagement, transportation and identification with the characters.

My research contribution

Duration 35-40 minutes with 10-15 minutes for Q&A

Adapting research design to changing policy priorities: practical learnings from a series of five programme evaluations of the Safer Streets Fund

Speaker(s):

Christoph Koerbitz, Kantar Public UK

Abstract:

This session discusses how the research design of a complex, multi-year evaluation programme evolved over time, based on the experience of evaluating five iterations of the Safer Streets Fund, which supported ca. 250 local projects with nearly £100m in funding. Each study comprised a different combination of qualitative process evaluation approaches (e.g. in-depth case study research, analysis of MI data, stakeholder and end user interviews) and various impact evaluation methods (e.g. survey based difference-in-difference designs and synthetic control analysis of police recorded crime data). We discuss examples of methodological innovation, e.g. the Qualitative Impact Protocol (QuIP, developed by the University of Bath) which we used to elicit narrative causal statements from intended beneficiaries in order to craft contribution stories. We showcase what worked well and how we overcame challenges in adapting our research design in a way that responded to changing policy priorities.

How to impute migration flows time series using a Bayesian Additive Mixed Model?'

Speaker(s):

Andrea Aparicio-Castro, University of Manchester

Abstract:

Data on migration flows usually suffer from a high level of missingness. Several studies have imputed missing migration flows by using auxiliary predictors. However, auxiliary variables highly correlated to migration often require additional imputations of missing observations. We propose a Bayesian additive mixed gravity model that imputes missing data on migration flows and overcomes the dependence of the imputation process on incomplete and unreliable auxiliary data. Our proposed model relies on a gravity model extensively used in estimating migration flows. Our model uses widely available data on the population size of origins and destinations and a measure of the distance to predict migration volumes. The additive mixed part of our model allows (i) modelling the non-linear relationship between flows and time and (ii) capturing the non-uniformly-spaced trends of flows. We illustrate the use of our model with administrative data on migration reported by South American countries from 2000 to 2019.

Using pre-validated questionnaires - how to interpret their quality and appropriateness to your research

Speaker(s):

Clair Gamble, University of Dundee

Abstract:

Questionnaires are a core aspect of methodology across research disciplines. When looking to measure subjective responses, for example attitudes, knowledge, or mood states, there may be a range of 'pre-validated' instruments available. The question of how to decide on an appropriate tool for one's research has been discussed widely. A number of frameworks have been designed to support questionnaire development and evaluation, yet the reporting of psychometric properties in published research is often lacking in depth.

This session will introduce the theoretical frameworks that underpin questionnaire development, including core aspects of validity and reliability. Discussion will then focus on how to collate information about construct coverage and psychometric strength to determine the suitability of an instrument for individual research projects. Using practical examples, this session will also offer some practical tips on how to contribute to the process of psychometric evaluation with each use of a questionnaire.

How to use qualitiative 'timeline interviewing' when conducting research with political and profesional elites

Speaker(s):

Abstract:

This session is dedicated to exploring how qualitative 'timeline interviewing' can successfully be incorporated into fieldwork conducted with political and professional elites. The session will begin by introducing participants to graphic elicitation techniques in a broad sense, before moving on to examine the array of timelines that can be co-constructed during interviews. Laura will then present some timeline examples from her own research portfolio, and in doing so reflect on the opportunities and challenges that timeline interviewing presents for researchers seeking to engage with elite agents.

Open Science and Qualitative Methods: An exploration of tensions, challenges and opportunities

Speaker(s):

Annayah Prosser

Bogdana Huma

Veli-Matti Karhulahti

Moritz Braun

Abstract:

This symposium will explore current themes, issues and debates around the drivers and practices of Open Science and Qualitative research methods. The symposium begins with an introductory talk that will outline how Open Science, which mainly developed in response to questionable research practices within Social Psychology, has almost exclusively concerned itself with quantitative, deductive, hypothesis-testing methodologies, and paid little attention to what the tools, practices, and values of Open Science may mean for research that uses qualitative methodologies. A collection of four papers will then be shared by qualitative psychologists who engage with an array of qualitative methods in their own work. These papers variously examine, challenge and consider potential synergies and/or areas of progress between Open Science and qualitative methods. Together these papers will invite lively debate on a range on intersecting methodological matters that are pertinent to qualitative methodologists working within and beyond Psychology.

Experiments in Equitable Evaluation

Speaker(s):

Abstract:

The Science Museum Group (SMG) worked with The Social Investment Consultancy (TSIC) to conduct a summative evaluation of Medicine: the Wellcome Galleries at the Science Museum. The methodology for the project applied equitable evaluation principles to offer new insights on visitor research as well as on the Galleries. Community Leaders were engaged to co-produce the evaluation, working with SMG and TSIC to refine the research questions, create methodologies and develop the project outputs. Using innovative evaluation methodologies, the project gathered Community Leaders and young people’s feedback on the Galleries. The results were represented in a report and creative film.

The webinar will be a case study with speakers outlining the project, focussing on methodology, as well as discussing lessons learnt and answering audience questions. Speakers from both SMG and TSIC will offer both the perspective of an in-house researcher/client and of a consultancy, specialising in socially engaged practice.

Can we fix it? Care-infused collaborative research practices

Speaker(s):

Q Manivannan, University of St Andrews

Abstract:

How do you collaborate with researchers, practitioners, professionals, and artists across different geographies, cultures, industries, and disciplines?

The workshop channels relational and interpretivist research practices to help participants learn to work collectively. From the intricacies of co-authoring reports and papers, to working in a team to perform ethical research, the workshop tackles often unspoken power dynamics (the 'senior' and 'junior' scholar and practitioner) alongside ways to navigate professional hierarchies in team projects. It roots these questions within the importance to contextualize research practices. The workshop draws from decades of research on care in the social and political sciences, in conversation with scholarship by bell hooks, Virginia Held, Nell Noddings, and Roxani Krystalli, to understand what care-infused and collaborative research looks like in our own work -- whether within academia, or without. Participants will have the opportunity to continue collaborations with fellow participants after the workshop's conclusion.

What is institutional ethnography - and how do we use it for exploring (shadow) education practices?

Speaker(s):

Abstract:

This session focuses on institutional ethnography - an approach to studying 'the social' - and discusses how this methodological approach can be employed to examine often-hidden aspects of everyday educational practices. The presentation will be divided into two parts. The first part will introduce institutional ethnography, outlining its definition, key characteristics, and critical concepts involving this methodological standpoint. The second part of the presentation will illustrate the specific ways in which it can be used to understand educational practices and processes. Here, the session organiser will draw on her experience of pursuing an institutional ethnography and discuss how it helped her understand and unveil the shadow education system and its practices in relation to formal schooling.

Using corpus linguistics methods in longitudinal educational research

Speaker(s):

Abstract:

This session will provide an overview of the use of corpus linguistics methods to address questions in longitudinal educational research. Corpus linguistics methods, which are concerned with the use of computational techniques to analyse large collections of spoken and written texts, offer an advantage over qualitative methods in educational research. The session will exemplify these methods by utilising longitudinal textual secondary data in education. Participants will have an opportunity to familiarise themselves with corpus linguistics methods and free corpus tools and interpret the findings to explore longitudinal phenomena in the discipline of education.

Using conversation analysis in health intervention studies

Speaker(s):

Abstract:

This workshop is open to anyone who would like to understand how conversation analytic research may be used within health intervention studies. Participants will learn about the different ways that conversation analysis may contribute to pre-intervention and intervention phases of a study. For example, to inform training for a talk-based intervention, to enhance trial conduct or to assess intervention implementation. The workshop will include:

1. What is conversation analytic research and why might it be useful for health intervention studies?

2. Designing conversation analytic research within a randomised trial or implementation study.

3. Case studies of previous and ongoing use of conversation analysis in randomised trials.

Participants do not need to have any previous experience, skills or knowledge, although involvement in, or future ambitions towards using conversation analytic methods in health intervention studies would make the course more relevant.

What is Visual Organizational Ethnography?

Speaker(s):

Stephen Linstead, University of York

Abstract:

Visual Organizational Ethnography (VOE) is a creative method that enables communities and organizations to engage with their own cultural heritage as a springboard for change. It does this through both informational and emotional impact. Common questions will be addressed: How does VOE create or contribute to change? What ideas or concepts influence VOE? Why might I want to use VOE and for what purposes? We will then step by step consider getting access; gathering material; planning and pre-production; production; editing and curating; and creative sharing. Two examples of VOE in social science research are then discussed in detail: "Black Snow", a short documentary about a mining disaster which was the UKRI Best Research Film of 2018; and "The Rhythm of the Martyrs", a multimedia photography and sound exhibition with an accompanying photographic essay about peace walls and murals in Belfast. The full guide will be available for participants.

Integrating the teaching and learning of qualitative methods and tools: adaptable models drawing on the Five-Level QDA method

Speaker(s):

Christina Silver, CAQDAS Networking Project, Department of Sociology, University of Surrey

Abstract:

A continuing challenge in preparing students for qualitative research is teaching methodology and analysis technologies together. The Five-Level QDA method was developed to overcome these challenges and includes an adaptable pedagogical framework for integrating the teaching and learning of methods and tools. This workshop first presents the genesis and characteristics of Five-Level QDA. Then, drawing on experiences of its use in several UK and international HE institutions, models for integrating qualitative methods and tools teaching Five-Level QDA are presented and discussed. Finally, adaptable tools for its practical implementation are explored, including: Live Translation, a technique for facilitating learners to translate analytic tasks into software tools; Analytic Planning Worksheets which scaffold the teaching and learning of translation and facilitate systematic documentation of analytic process; and the Recurring Hourglass Instructional design which facilitates cumulative learning by alternating activities that have a broad, whole-group focus with those with a narrow, individual focus.

The potential and pitfalls in using Community Advisory Boards in participatory research

Speaker(s):

Abstract:

With the growing recognition of the importance of involving communities in social research, researchers have shown increasing interest in developing Community Advisory Boards (CAB). During a short talk, we will reflect our experiences of engaging seldom-heard groups, namely migrant children and young people, and refugee women affected by gender-based violence, in different research projects as Community Advisors. Our aim is to highlight the key practical and ethical considerations in CAB research and demonstrate strategies for co-production in different stages of the research process. The second part of the workshop will invite participants to work in breakout rooms to reflect the potential to use Community Advisory Boards in their own research, with the aid of Jamboards. The discussion will be structured around key questions on the likely challenges and approaches to Advisory Board recruitment, retention, compensation and the extent of their involvement in shaping the research process.

Creating Survey Weights

Speaker(s):

Abstract:

This workshop will introduce survey weighting and will be especially useful for those who plan to conduct their own survey or want to understand better how survey weights work. Both, design weights (those that adjust for unequal selection probabilities) and nonresponse weights (those that adjust for nonresponse) will be covered. Theoretical part will use simple examples and simple words to explain what weights are, why they are important and how they are created. A practical part will let participants create their own weights. Access to Stata and knowledge of a logistic regression is recommended but is not a requirement for participation in the workshop.

How to Use Collaborative Event Ethnography to Support Interdisciplinary Research on Complex Social Issues

Speaker(s):

Jennifer L. Lanterman, University of Nevada, Reno

Abstract:

Collaborative event ethnography (CEE) allows researchers to both "study up" to examine large-scale phenomena and "study down" by focusing on individual experiences (Brosius & Campbell, 2010). CEE also allows researchers to examine complex, large-scale, and dynamic social phenomena in action. This workshop explains the CEE method and process, and we share an example of how CEE supported interdisciplinary research on a complex social issue.

When collaborative and participatory research gets messy!

Speaker(s):

Niamh O'Brien

Zuzana Zilkova

Abstract:

This panel will share examples of adapting approaches when participatory research doesn't go to plan by using real-life examples.

As representatives of the collaborative and participatory methodological special interest group, our research covers multiple social disciplines in and out of academia.

Several experts will each provide a 3-minute lightening talk featuring case studies of where our research required us to adapt, the journeys we have been through and the lessons we have learned. Followed by a Q&A, break-out discussion and a final ask the experts plenary.

This session will be of interest to anybody who wants to collaborate, co-produce, or co-create with a variety of participants in any sector or discipline. Some prior research experience would be of benefit.

In Search of Your Personal Research Paradigm

Speaker(s):

Sandar Win, Department of Finance, Accounting and Business Systems Sheffield Hallam University

Abstract:

The research paradigm is often overlooked by PhD supervisors and supervisees. Researchers usually focus on identifying research gaps and influenced by dominant research methodologies in their fields of study. In this webinar, we will highlight the importance of knowing our own personal research paradigms before commencing our research. The webinar will be based on our published paper 'Reflecting and integrating the contextual influences of ambiguities and institutional power in organisational research design: A case of Myanmar' published in Management and Organization Review. We will reflect our personal struggles of conducting research when the dominant research paradigm is not aligned with our own personal research paradigm, and how we utilised those struggles as opportunities to develop research questions that address grand challenges. Then, we will provide suggestions on how researchers can be confident in pursuing research with their own personal research paradigms.