Skip Navigation
Skip to contents

Epidemiol Health : Epidemiology and Health

OPEN ACCESS
SEARCH
Search

Author index

Page Path
HOME > Browse articles > Author index
Search
Stefano Parodi 1 Article
The clinical meaning of the area under a receiver operating characteristic curve for the evaluation of the performance of disease markers
Stefano Parodi, Damiano Verda, Francesca Bagnasco, Marco Muselli
Epidemiol Health. 2022;44:e2022088.   Published online October 17, 2022
DOI: https://doi.org/10.4178/epih.e2022088
  • 6,129 View
  • 123 Download
  • 7 Web of Science
  • 9 Crossref
AbstractAbstract AbstractSummary PDFSupplementary Material
Abstract
OBJECTIVES
The area under a receiver operating characteristic (ROC) curve (AUC) is a popular measure of pure diagnostic accuracy that is independent from the proportion of diseased subjects in the analysed sample. However, its actual usefulness in the clinical context has been questioned, because it does not seem to be directly related to the actual performance of a diagnostic marker in identifying diseased and non-diseased subjects in real clinical settings. This study evaluates the relationship between the AUC and the proportion of correct classifications (global diagnostic accuracy, GDA) in relation to the shape of the corresponding ROC curves.
METHODS
We demonstrate that AUC represents an upward-biased measure of GDA at an optimal accuracy cut-off for balanced groups. The magnitude of bias depends on the shape of the ROC plot and on the proportion of diseased and non-diseased subjects. In proper curves, the bias is independent from the diseased/non-diseased ratio and can be easily estimated and removed. Moreover, a comparison between 2 partial AUCs can be replaced by a more powerful test for the corresponding whole AUCs.
RESULTS
Applications to 3 real datasets are provided: a marker for a hormone deficit in children, 2 tumour markers for malignant mesothelioma, and 2 gene expression profiles in ovarian cancer patients.
CONCLUSIONS
The AUC is a measure of accuracy with potential clinical relevance for the evaluation of disease markers. The clinical meaning of ROC parameters should always be evaluated with an analysis of the shape of the corresponding ROC curve.
Summary
Key Message
The area under a ROC curve is a measure of diagnostic accuracy with potential clinical relevance, whose meaning should always be evaluated analysing the shape of the corresponding curve.

Citations

Citations to this article as recorded by  
  • Interpretable machine learning for predicting chronic kidney disease progression risk
    Jin-Xin Zheng, Xin Li, Jiang Zhu, Shi-Yang Guan, Shun-Xian Zhang, Wei-Ming Wang
    DIGITAL HEALTH.2024;[Epub]     CrossRef
  • Current and future distribution of Forsythia suspensa in China under climate change adopting the MaxEnt model
    En Wang, Zongran Lu, Emelda Rosseleena Rohani, Jinmei Ou, Xiaohui Tong, Rongchun Han
    Frontiers in Plant Science.2024;[Epub]     CrossRef
  • Dysbiosis of intestinal microbiota and metabolism caused by acute patulin exposure in mice
    Ting Zhang, Zimeng Guo, Jiayin Che, Min Yan, Jingyimei Liang, Furong Wang, Jinhong Hu, Wei Song, Yahong Yuan, Tianli Yue
    Food Frontiers.2024; 5(4): 1819.     CrossRef
  • Knee-Loading Predictions with Neural Networks Improve Finite Element Modeling Classifications of Knee Osteoarthritis: Data from the Osteoarthritis Initiative
    Alexander Paz, Jere Lavikainen, Mikael J. Turunen, José J. García, Rami K. Korhonen, Mika E. Mononen
    Annals of Biomedical Engineering.2024; 52(9): 2569.     CrossRef
  • Navigating test accuracy metrics used in diagnostic evaluation
    Ahmad Hamdan, Lubna A. Zar, Suhail A. Doi, Tawanda Chivese, Muhammad N. Khan, Salma M. Khaled, Giridhara R. Babu, Habib Hasan Farooqui
    Current Opinion in Epidemiology and Public Health.2024; 3(3): 45.     CrossRef
  • Assessment of urine metabolite biomarkers for the detection of S. haematobium infection in pre-school aged children in a rural community in Zimbabwe
    Herald Midzi, Thajasvarie Naicker, Arthur Vengesai, Lucy Mabaya, Petros Muchesa, Tariro L. Mduluza-Jokonya, Aaron Garikai Katerere, Donald Kapanga, Maritha Kasambala, Francisca Mutapi, Takafira Mduluza
    Acta Tropica.2024; 258: 107327.     CrossRef
  • A machine learning-based prediction of hospital mortality in mechanically ventilated ICU patients
    Hexin Li, Negin Ashrafi, Chris Kang, Guanlan Zhao, Yubing Chen, Maryam Pishgar, Upaka Rathnayake
    PLOS ONE.2024; 19(9): e0309383.     CrossRef
  • Identification of key signaling pathways and hub genes related to immune infiltration in Kawasaki disease with resistance to intravenous immunoglobulin based on weighted gene co-expression network analysis
    Yue Wang, Yinyin Cao, Yang Li, Meifen Yuan, Jin Xu, Jian Li
    Frontiers in Molecular Biosciences.2023;[Epub]     CrossRef
  • Escherichia coli triggers α-synuclein pathology in the LRRK2 transgenic mouse model of PD
    Dongxiao Liang, Han Liu, Ruoqi Jin, Renyi Feng, Jiuqi Wang, Chi Qin, Rui Zhang, Yongkang Chen, Jingwen Zhang, Junfang Teng, Beisha Tang, Xuebing Ding, Xuejing Wang
    Gut Microbes.2023;[Epub]     CrossRef

Epidemiol Health : Epidemiology and Health
TOP