Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Evidence triangulator: using large language models to extract and synthesize causal evidence across study designs

Shi, Xuanyu, Zhao, Wenjing, Chen, Ting, Yang, Chao and Du, Jian (2025) Evidence triangulator: using large language models to extract and synthesize causal evidence across study designs. Nature Communications, 16 (7355). ISSN 2041-1723

Abstract
Health strategies increasingly emphasize both behavioural and biomedical interventions, yet the complex and often contradictory guidance on diet, behavior, and health outcomes complicates evidence-based decision-making. Evidence triangulation across diverse study designs is essential for balancing biases and establishing causality, but scalable, automated methods for achieving this are lacking. In this study, we assess the performance of large language models in extracting both ontological and methodological information from scientific literature to automate evidence triangulation. A twostep extraction approach—focusing on exposure-outcome concepts first, followed by relation extraction—outperforms a one-step method, particularly in identifying the direction of effect (F1 = 0.86) and statistical significance (F1 = 0.96). Using salt intake and blood pressure as a case study, we calculate the Convergency of Evidence and Level of Convergency, finding a strong excitatory effect of salt on blood pressure (942 studies), and weak excitatory effect on cardiovascular diseases and deaths (124 studies). This approach complements traditional meta-analyses by integrating evidence across study designs, and enabling rapid, dynamic assessment of scientific controversies.
Metadata
Item Type:Article (Published)
Refereed:Yes
Subjects:Medical Sciences > Health
Medical Sciences > Sports sciences
DCU Faculties and Centres:DCU Faculties and Schools > DCU Business School
Publisher:Nature Publishing Group
Official URL:https://www.nature.com/articles/s41467-025-62783-x...
Copyright Information:Authors
ID Code:31504
Deposited On:05 Sep 2025 09:56 by Gordon Kennedy . Last Modified 05 Sep 2025 09:56
Documents

Full text available as:

[thumbnail of s41467-025-62783-x.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution 4.0
1MB
Metrics

Altmetric Badge

Dimensions Badge

Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record