Evidential Pluralism, Social Science Methodology, and Policy-Relevant Research

Some social scientists are adherents of methodological monism, the belief that there is only one valid method for research on specific kinds of social science questions or even for social research in general. For instance those in the evidence-based medicine and evidence-based policy (EBM and EBP) communities take randomized control trials (RCTs) as the method for establishing causal claims, with even carefully stratified observational studies attempting to mimic RCTs as a poor second best. Others embrace methodological pluralism, which argues that it is permissible – and even necessary – to rely on multiple methods in social science.

Monists generally argue that we should base our social science claims on only the soundest type of evidence, especially where those claims will be used to affect people’s lives and well-being, noting ‘Garbage in, garbage out’. Pluralists tend to urge two arguments to the contrary. First, different types of evidence can be used to make up for weaknesses in other types. Second, a claim is not genuinely well established if there are outstanding questions about whether the central facts that are necessary for it to hold are in place. But there are always a variety of different kinds of facts necessary for even fairly simple social-sciences claims to hold, different kinds of facts that call for different methods.

The EBM+ group, which has been gaining traction in the UK, urges causal pluralism primarily on the first grounds. Note though that what they advocate is a limited kind of causal pluralism –  ‘causal dualism’ — which demands both RCT evidence and evidence of a casual mechanism in order to secure a causal claim. The second reason plays a prominent role in the work of those who focus on the context and conditions that are necessary if the processes by which a cause is supposed to achieve its effects are to succeed.

This research project investigates the advantages and disadvantages of different kinds of  methodological monism and methodological pluralism for different questions, and it analyses how different types of studies can be better combined. It is especially concerned with how issues of methodological monism and pluralism affect the ways social scientists conduct policy-relevant research and how the use of plural methods can be improved in this domain.

Professor Cartwright has been pursuing this project with political scientist Hilde van Meegdenburg and philosopher of social science Rosa Runhardt (both from the Netherlands), along with postgraduate researcher Gabriel Nyberg (from UCSD) and undergraduate researcher Shahzen Chauhan (from Durham). It is currently sponsored by summer grants for research assistants from UCSD and Durham.