The Role of NVivo in Realist Evaluation: Enhancing Transparency through Structured Data Analysis

Realist evaluation is a powerful approach to understanding and evaluating complex social programs, focusing on 'what works, for who, why, and in which circumstances' using Context, Mechanism, and Outcome Configurations (CMOC). This methodology has been used to analyze qualitative data in various fields, including grounded theory, interpretative phenomenological analysis, and realist meta-theory. However, the process of generating, refining, and testing complex program theories can be messy and challenging.

In this article, we propose that the use of NVivo, a computer-assisted qualitative data analysis software (CAQDAS), can help structure this iterative process when drawing on multiple data sources simultaneously. NVivo supports code-based inquiry, searching, and theorizing, combined with the ability to annotate and edit documents. This creates a structured track record of the analytical process, increasing its rigour and transparency.

We used NVivo in our realist evaluation project to build and refine program theories using literature and interview data. The software helped create an explicitly documented and evidenced audit trail of the process of program theory refinement, answering calls for further transparency in realist analysis. This article presents the evolving and complex process of coding several data sources to nodes and child nodes, while writing 'attached memos' to highlight the process of theory generation.

The use of NVivo has been instrumental in improving transparency in our project by providing a platform for documenting the analytical process. RAMESES I and II have developed consensus-based reporting guidelines for realist research, which we have adhered to in this study. Our experience demonstrates that NVivo can be a valuable tool in enhancing transparency and rigour in realist evaluation.

Nvivo meaning