🌻 Causal Mapping outputs not just codes but a model you can query to answer useful questions

SOURCE NOTE (consolidation): This file is a draft/fragment. The flagship QDA-facing paper is now: Causal mapping as causal QDA.
Companion methods notes: Magnetisation; A simple measure of the goodness of fit of a causal theory to a text corpus.

In the first part of this series Causal mapping is a simple yet powerful form of qualitative coding, we argued that causal mapping is a simple yet powerful form of qualitative coding. We showed how its focus on identifying causal links reduces and simplifies the analytical task and provides a clear, structured approach which is relatively easy to apply. However, the true strength of causal mapping lies not just in the coding process itself, but in its output: a query-able qualitative model.

Qualitative Data Analysis (QDA) most typically produces a written report alongside a deeper understanding in the minds of the researcher or research team, and hopefully also in the readers. It may also provide other outputs like tables of frequencies or co-occurrences.

We already argued that causal mapping is an especially useful form of QDA because:

From a List of Themes to a Network of Evidence#

Traditional QDA often produces additional outputs like tables of theme frequencies alongside narrative summaries. It is possible to query these to answer questions like "what themes did the younger respondents most often mention when also talking about the main theme".

Causal mapping provides a particularly rich output: a causal network — a qualitative knowledge graph where the factors (which can be understood as themes) are nodes and the causal claims are the links connecting them. This structure is inherently machine-readable and ready for analysis.

Thinking of the output as a model is key. Just as a quantitative researcher builds a statistical model to explain relationships in their data, a causal mapper builds a qualitative model of the causal beliefs expressed in texts. This is not unique to our Causal Map app: all applications of causal mapping provide, more or less explicitly, this kind of model, going right back to (Axelrod 1976). This model can then be used to answer new questions, often without needing to go back to the original source texts, though the underlying quotes and context are always available.

Some standard ways to answer useful questions#

Because the output is a structured network, we can apply a range of queries to explore the data. This gives us a library of pre-existing approaches to ask practical questions about the causal landscape described by the participants.

Here are some questions you can answer using causal mapping.

Individual questions — introduction
What are the narratives behind a specific link ?

It is important to frequently return to the original quotes associated with each factor or link to understand how different stakeholders interpret and talk about key concepts. This can be done in Causal Map by clicking on a link in the interactive map, or by printing out quotes for a particular filter (e.g. just for a single bundle of links) with additional context and metadata.

What are the emerging or unexpected factors ?

One way to do identify emerging or unexpected factors is to use the elements from your theory of change as your codebook while coding and only adding other elements when necessary, making a note of these additional elements.

Does the evidence support your theory of change ?

One way to do this is to use the elements from your theory of change as your codebook and only add other elements when necessary. Validated pathways of change (by showing which mechanisms are observed on the ground) and find gaps where expected pathways might be missing or where stakeholders list elements were not anticipated in the theory of change?

Assessing systems change

One of the most exciting applications of causal mapping is to assess change over time within a system. If we apply a systematic approach to coding (using blindfolded manual coding or AI-supported coding) we can compare the frequencies with which links or factors are mentioned over time. This becomes particularly interesting when applying inductive coding, so that new and emerging phenomena can be included into the codebook. Re-applying new codes to previously coded data would be very tedious with manual coding but is easy to do with AI-supported coding: Transforms Filters — Soft Recode with Magnetic Labels

Names of tables and fields

We can think of a causal map as a database consisting of two tables, the links table and the sources table. We don't need to have a separate table for the factors because the factors can be derived from the links table.

Counting and comparing influences

How much evidence is there for the influence of our intervention on a valued outcome? Is that a lot? Can we compare these numbers across pathways?

Combining questions

Causal mapping gets really useful when you start to combine the different questions you might want to ask in order to answer more sophisticated questions. We can think of many of the techniques as filters which filter the view in a particular way. Using multiple filters allows you to build up an answer to a question. Usually, order matters.

A corresponding library of filters#

The Causal Map app provides about 20 corresponding, ready-to-use filters to answer these kinds of questions, some based on existing causal mapping publications, some new.

In the list of typical queries above:

There are two types of filter:

Here as reference are more details: .

Chaining filters together#

Most importantly we can chain filters together, to answer corresponding, composite questions like: what are the most frequently mentioned upstream influences on these key outcomes, according to the younger respondents?

*Two filters in use in the Causal Map app. The first selects only factors which contain the word 'health' and their immediate causes and effects, and the second then selects the most frequently mentioned co-terminal bundles of links*.

Most of the core filters have nothing to do with AI or large language models. They are straightforward, transparent and deterministic. In the Causal Map app, they are available at a click and can be rearranged with drag and drop. But most of them are simple to reconstruct in a spreadsheet or a graph database, without using Causal Map at all.

Cutting to the chase with causal queries#

This ability to systematically query causal evidence is what allows causal mapping to cut to the chase. For evaluators and researchers, the core questions are very often about causation: "Did the program work?" and "How did it work?". Causal mapping structures the evidence provided in the texts to help researchers answer these types of questions.

A Model of Causal Evidence, Not Causal Facts#

It's crucial to be clear about one thing: Causal mapping is not a method of causal inference. It does not, on its own, tell you what truly causes what in the real world.

Instead, it creates a qualitative model of causal claims. The map organizes what people said about causation, allowing the researcher to weigh, compare, and synthesize this evidence. The logic we apply is one of evidence management:

Calling these causal claims "evidence" does not mean that anyone should necessarily believe it or that it has been verified1. It is simply raw material which we organise and inspect before drawing any conclusions. Researchers can choose to also code additional properties for each link and/or source such as "doubtful" or "reliable" or "verified" and include or exclude links by filtering on those properties.

If the researcher wants to make a causal judgement, they must interpret the map in context, examine the quotes and consider the source of the claims. The map is a powerful tool for structuring and clarifying that judgment.

In any case, many colleagues use causal mapping not to make causal inferences but simply to understand what people think causes what, and how, for example as a crucial prerequisite for planning policy, communications or interventions.

See also the other caveats we listed in the previous post: Causal mapping is a simple yet powerful form of qualitative coding.

Conclusion#

The real power of causal mapping as a QDA method is that it produces a query-able, qualitative model of causal evidence. This structured output allows researchers and evaluators to apply a range of standardized algorithms to answer practically relevant questions about the causal mechanisms at play, as seen by the sources.

Many researchers and evaluators like using causal mapping to explore their data. In the third part of this series, we will explore how these properties — a simplified coding task and a structured, query-able output — make causal mapping especially suited for transparent and verifiable automation with AI.


  1. Thanks to Stève Duchêne https://www.linkedin.com/in/steve-duchene/ for reminding us to clarify this. 

References

Axelrod (1976). The Cognitive Mapping Approach to Decision Making. In Structure of Decision : The Cognitive Maps of Political Elites.