Skip Navigation
Skip to contents

Epidemiol Health : Epidemiology and Health



Page Path
HOME > Search
1 "Mada"
Article category
Publication year
Diagnostic test accuracy: application and practice using R software
Sung Ryul Shim, Seong-Jang Kim, Jonghoo Lee
Epidemiol Health. 2019;41:e2019007.   Published online March 28, 2019
  • 21,238 View
  • 700 Download
  • 96 Web of Science
  • 59 Crossref
AbstractAbstract AbstractSummary PDFSupplementary Material
The objective of this paper is to describe general approaches of diagnostic test accuracy (DTA) that are available for the quantitative synthesis of data using R software. We conduct a DTA that summarizes statistics for univariate analysis and bivariate analysis. The package commands of R software were “metaprop” and “metabin” for sensitivity, specificity, and diagnostic odds ratio; forest for forest plot; reitsma of “mada” for a summarized receiver-operating characteristic (ROC) curve; and “metareg” for meta-regression analysis. The estimated total effect sizes, test for heterogeneity and moderator effect, and a summarized ROC curve are reported using R software. In particular, we focus on how to calculate the effect sizes of target studies in DTA. This study focuses on the practical methods of DTA rather than theoretical concepts for researchers whose fields of study were non-statistics related. By performing this study, we hope that many researchers will use R software to determine the DTA more easily, and that there will be greater interest in related research.
Korean summary
통계프로그램으로서의 R이 대세인 연구환경에서 R을 활용한 체계적인 메타분석 안내서가 요구되어지며 본 연구는 이에 대한 좋은 해답이 될 것이다. 더욱이 본 연구는 진단검사 메타분석 (Diagnostic test accuracy)의 이론과 더불어 R을 활용한 실습위주의 내용으로 구성되어져 있어 누구나 쉽게 실행할 수 있을 것이다. 본 연구를 통하여 많은 연구자들이 보다 쉽게 본인의 연구분야에 적용하여 관련 연구가 활성화되기를 바란다.


Citations to this article as recorded by  
  • The Efficacy and Safety of Metastasis-directed Therapy in Patients with Prostate Cancer: A Systematic Review and Meta-analysis of Prospective Studies
    Marcin Miszczyk, Pawel Rajwa, Takafumi Yanagisawa, Zuzanna Nowicka, Sung Ryul Shim, Ekaterina Laukhtina, Tatsushi Kawada, Markus von Deimling, Benjamin Pradere, Juan Gómez Rivas, Giorgio Gandaglia, Roderick C.N. van den Bergh, Gregor Goldner, Stephane Sup
    European Urology.2024; 85(2): 125.     CrossRef
  • Comparable performance of antigen‐detecting rapid test by healthcare worker‐collected and self‐collected swabs for SARS‐CoV‐2 diagnostic: A systematic review and meta‐analysis
    Samuel Johnson Kurniawan, Maria Mardalena Martini Kaisar, Helen Kristin, Soegianto Ali
    Reviews in Medical Virology.2024;[Epub]     CrossRef
  • Diagnostic performance of angiography‐derived fractional flow reserve and CT‐derived fractional flow reserve: A systematic review and Bayesian network meta‐analysis
    Zhongxiu Chen, Junyan Zhang, Yujia Cai, Hongsen Zhao, Duolao Wang, Chen Li, Yong He
    Journal of Evidence-Based Medicine.2024; 17(1): 119.     CrossRef
  • Advancing accuracy in breath testing for lung cancer: strategies for improving diagnostic precision in imbalanced data
    Ke-Cheng Chen, Shuenn-Wen Kuo, Ruei-Hao Shie, Hsiao-Yu Yang
    Respiratory Research.2024;[Epub]     CrossRef
  • Diagnostic Accuracy of Deep Learning for the Prediction of Osteoporosis Using Plain X-rays: A Systematic Review and Meta-Analysis
    Tzu-Yun Yen, Chan-Shien Ho, Yueh-Peng Chen, Yu-Cheng Pei
    Diagnostics.2024; 14(2): 207.     CrossRef
  • The diagnostic utility of heparin-binding protein among patients with bacterial infections: a systematic review and meta-analysis
    Amira Mohamed Taha, Khaled Abouelmagd, Mohamed Mosad Omar, Qasi Najah, Mohammed Ali, Mohammed Tarek Hasan, Sahar A. Allam, Roua Arian, Omar El Sayed Rageh, Mohamed Abd-ElGawad
    BMC Infectious Diseases.2024;[Epub]     CrossRef
  • Comparative Study of Different Imaging Modalities for Diagnosis of Bone Metastases of Prostate Cancer
    Keunyoung Kim, Mihyang Ha, Seong-Jang Kim
    Clinical Nuclear Medicine.2024; 49(4): 312.     CrossRef
  • The diagnostic performance of ultrafast MRI to differentiate benign from malignant breast lesions: a systematic review and meta-analysis
    Yoav Amitai, Vivianne A. R. Freitas, Orit Golan, Rivka Kessner, Tamar Shalmon, Rina Neeman, Michal Mauda-Havakuk, Diego Mercer, Miri Sklair-Levy, Tehillah S. Menes
    European Radiology.2024;[Epub]     CrossRef
  • Clinical Presentation, Risk Factors, and Comparison of Laboratory Diagnostics for Seasonal Influenza Virus Among Cambodians From 2007 to 2020
    Agus Rachmat, Gerard C Kelly, Long Khanh Tran, Nathaniel Christy, Chonthida Supaprom, Vireak Heang, Sokha Dul, Jose A Garcia-Rivera, Satharath Prom, Heng Sopheab, John S Brooks, Ian J Sutherland, Karen S Corson, Andrew G Letizia
    Open Forum Infectious Diseases.2024;[Epub]     CrossRef
  • Juvenile sex estimation using the elevation of the auricular surface: A systematic review and meta‐analysis
    Maura K. Griffith, Carolyn Rando
    International Journal of Osteoarchaeology.2024;[Epub]     CrossRef
  • Prognostic nutritional index as a predictive marker for acute kidney injury in adult critical illness population: a systematic review and diagnostic test accuracy meta-analysis
    Jia-Jin Chen, Tao-Han Lee, Pei-Chun Lai, Chih-Hsiang Chang, Che-Hsiung Wu, Yen-Ta Huang
    Journal of Intensive Care.2024;[Epub]     CrossRef
  • Identifying the culprit artery via 12‐lead electrocardiogram in inferior wall ST‐segment elevation myocardial infarction: A meta‐analysis
    Peng Zhou, Yingying Wu, Meng Wang, Yikai Zhao, Yangjie Yu, Maieryemu Waresi, Huiyang Li, Bo Jin, Xinping Luo, Jian Li
    Annals of Noninvasive Electrocardiology.2023;[Epub]     CrossRef
  • Clinical value of alarm features for colorectal cancer: a meta-analysis
    Leonardo Frazzoni, Liboria Laterza, Marina La Marca, Rocco Maurizio Zagari, Franco Radaelli, Cesare Hassan, Alessandro Repici, Antonio Facciorusso, Paraskevas Gkolfakis, Cristiano Spada, Konstantinos Triantafyllou, Franco Bazzoli, Mario Dinis-Ribeiro, Lor
    Endoscopy.2023; 55(05): 458.     CrossRef
  • CA125 for the Diagnosis of Advanced Urothelial Carcinoma of the Bladder: A Systematic Review and Meta-Analysis
    Hsuan-Jen Lin, Rouh-Mei Hu, Hung-Chih Chen, Chung-Chih Lin, Chi-Yu Lee, Che-Yi Chou
    Cancers.2023; 15(3): 813.     CrossRef
  • Performance of screening tools for cervical neoplasia among women in low- and middle-income countries: A systematic review and meta-analysis
    Sabrina K. Smith, Oguchi Nwosu, Alex Edwards, Meseret Zerihun, Michael H. Chung, Kara Suvada, Mohammed K. Ali, Nebiyu Dereje
    PLOS Global Public Health.2023; 3(2): e0001598.     CrossRef
  • Diagnostic accuracy of point-of-care lung ultrasound for COVID-19: a systematic review and meta-analysis
    Ashley Matthies, Michael Trauer, Karl Chopra, Robert David Jarman
    Emergency Medicine Journal.2023; 40(6): 407.     CrossRef
  • Influence of seasonal and operator variations on diagnostic accuracy of lateral flow devices during the COVID-19 pandemic: a systematic review and meta-analysis
    Ashwin Krishnamoorthy, Subashini Chandrapalan, Gohar JalayeriNia, Yaqza Hussain, Ayman Bannaga, Ian Io Lei, Ramesh Arasaradnam
    Clinical Medicine.2023; 23(2): 144.     CrossRef
  • Prognostic role of different findings at echocardiography in acute pulmonary embolism: a critical review and meta-analysis
    Ludovica Anna Cimini, Matteo Candeloro, Magdalena Pływaczewska, Giorgio Maraziti, Marcello Di Nisio, Piotr Pruszczyk, Giancarlo Agnelli, Cecilia Becattini
    ERJ Open Research.2023; 9(2): 00641-2022.     CrossRef
  • Virotyping and genetic antimicrobial susceptibility testing of porcine ETEC/STEC strains and associated plasmid types
    Nick Vereecke, Sander Van Hoorde, Daniel Sperling, Sebastiaan Theuns, Bert Devriendt, Eric Cox
    Frontiers in Microbiology.2023;[Epub]     CrossRef
  • The Diagnostic Power of Circulating miR-1246 in Screening Cancer: An Updated Meta-analysis
    Khanh Quang Huynh, Anh Tuan Le, Thang Thanh Phan, Toan Trong Ho, Suong Phuoc Pho, Hang Thuy Nguyen, Binh Thanh Le, Thuc Tri Nguyen, Son Truong Nguyen, Ihtisham Bukhari
    Oxidative Medicine and Cellular Longevity.2023; 2023: 1.     CrossRef
  • A Systematic Review and Meta-Analysis Comparing the Diagnostic Accuracy Tests of COVID-19
    Juan Jeferson Vilca-Alosilla, Mayron Antonio Candia-Puma, Katiusca Coronel-Monje, Luis Daniel Goyzueta-Mamani, Alexsandro Sobreira Galdino, Ricardo Andrez Machado-de-Ávila, Rodolfo Cordeiro Giunchetti, Eduardo Antonio Ferraz Coelho, Miguel Angel Chávez-Fu
    Diagnostics.2023; 13(9): 1549.     CrossRef
  • Prediction Models for Intrauterine Growth Restriction Using Artificial Intelligence and Machine Learning: A Systematic Review and Meta-Analysis
    Riccardo Rescinito, Matteo Ratti, Anil Babu Payedimarri, Massimiliano Panella
    Healthcare.2023; 11(11): 1617.     CrossRef
  • Machine learning algorithms for diagnosis of hip bone osteoporosis: a systematic review and meta-analysis study
    Fakher Rahim, Amin Zaki Zadeh, Pouya Javanmardi, Temitope Emmanuel Komolafe, Mohammad Khalafi, Ali Arjomandi, Haniye Alsadat Ghofrani, Kiarash Shirbandi
    BioMedical Engineering OnLine.2023;[Epub]     CrossRef
  • Diagnostic accuracy of biomarkers to detect acute mesenteric ischaemia in adult patients: a systematic review and meta-analysis
    Annika Reintam Blaser, Joel Starkopf, Martin Björck, Alastair Forbes, Karri Kase, Ele Kiisk, Kaja-Triin Laisaar, Vladislav Mihnovits, Marko Murruste, Merli Mändul, Anna-Liisa Voomets, Kadri Tamme
    World Journal of Emergency Surgery.2023;[Epub]     CrossRef
  • The utility of long non-coding RNAs in chronic obstructive pulmonary disease: a comprehensive analysis
    Qi Lin, Chaofeng Zhang, Huixin Weng, Yating Lin, Yucang Lin, Zhipeng Ruan
    BMC Pulmonary Medicine.2023;[Epub]     CrossRef
  • Diagnostic accuracy of whole-body magnetic resonance imaging versus positron emission tomography-computed tomography for the staging of pediatric lymphoma: a systematic review and meta-analysis
    Deeksha Bhalla, Manisha Jana, Devasenathipathy Kandasamy
    Pediatric Radiology.2023; 53(13): 2683.     CrossRef
  • Diagnostic test accuracy of machine learning algorithms for the detection intracranial hemorrhage: a systematic review and meta-analysis study
    Masoud Maghami, Shahab Aldin Sattari, Marziyeh Tahmasbi, Pegah Panahi, Javad Mozafari, Kiarash Shirbandi
    BioMedical Engineering OnLine.2023;[Epub]     CrossRef
  • Diagnostic performance of CL Detect rapid-immunochromatographic test for cutaneous leishmaniasis: a systematic review and meta-analysis
    Behailu Taye Gebremeskele, Gashaw Adane, Mohammed Adem, Fitsumbrhan Tajebe
    Systematic Reviews.2023;[Epub]     CrossRef
  • Reliability of machine learning to diagnose pediatric obstructive sleep apnea: Systematic review and meta‐analysis
    Gonzalo C. Gutiérrez‐Tobal, Daniel Álvarez, Leila Kheirandish‐Gozal, Félix del Campo, David Gozal, Roberto Hornero
    Pediatric Pulmonology.2022; 57(8): 1931.     CrossRef
  • How to Analyze the Diagnostic Performance of a New Test? Explained with Illustrations
    Deepak Dhamnetiya, Ravi Prakash Jha, Shalini Shalini, Krittika Bhattacharyya
    Journal of Laboratory Physicians.2022; 14(01): 090.     CrossRef
  • Diagnostic accuracy of magnetic resonance imaging targeted biopsy techniques compared to transrectal ultrasound guided biopsy of the prostate: a systematic review and meta-analysis
    E. J. Bass, A. Pantovic, M. J. Connor, S. Loeb, A. R. Rastinehad, M. Winkler, Rhian Gabe, H. U. Ahmed
    Prostate Cancer and Prostatic Diseases.2022; 25(2): 174.     CrossRef
  • Diagnostic performance and prognostic impact of coronary angiography‐based Index of Microcirculatory Resistance assessment: A systematic review and meta‐analysis
    Weijia Li, Tatsunori Takahashi, Saul A. Rios, Azeem Latib, Joo Myung Lee, William F. Fearon, Yuhei Kobayashi
    Catheterization and Cardiovascular Interventions.2022; 99(2): 286.     CrossRef
  • Assessing the Knowledge of the Osteopathic Profession in New York City’s Eastern European Communities
    Justin Chin, Lina Kleyn, Emily Dube, Mark Terrell, Christine M Lomiguen, Mikhail Volokitin
    Cureus.2022;[Epub]     CrossRef
  • The diagnostic accuracy of clinical tests for anterior cruciate ligament tears are comparable but the Lachman test has been previously overestimated: a systematic review and meta-analysis
    Pawel A. Sokal, Richard Norris, Thomas W. Maddox, Rachel A. Oldershaw
    Knee Surgery, Sports Traumatology, Arthroscopy.2022; 30(10): 3287.     CrossRef
  • Comparison of Diagnostic Test Accuracy of Cone-Beam Breast Computed Tomography and Digital Breast Tomosynthesis for Breast Cancer: A Systematic Review and Meta-Analysis Approach
    Temitope Emmanuel Komolafe, Cheng Zhang, Oluwatosin Atinuke Olagbaju, Gang Yuan, Qiang Du, Ming Li, Jian Zheng, Xiaodong Yang
    Sensors.2022; 22(9): 3594.     CrossRef
  • Clinical Validity of 16α-[18F]Fluoro-17β-Estradiol Positron Emission Tomography/Computed Tomography to Assess Estrogen Receptor Status in Newly Diagnosed Metastatic Breast Cancer
    Jasper J.L. van Geel, Jorianne Boers, Sjoerd G. Elias, Andor W.J.M. Glaudemans, Erik F.J. de Vries, Geke A.P. Hospers, Michel van Kruchten, Evelien J.M. Kuip, Agnes Jager, Willemien C. Menke-van der Houven van Oordt, Bert van der Vegt, Elisabeth G.E. de V
    Journal of Clinical Oncology.2022; 40(31): 3642.     CrossRef
  • Diagnostic Performance of Antigen Rapid Diagnostic Tests, Chest Computed Tomography, and Lung Point-of-Care-Ultrasonography for SARS-CoV-2 Compared with RT-PCR Testing: A Systematic Review and Network Meta-Analysis
    Sung Ryul Shim, Seong-Jang Kim, Myunghee Hong, Jonghoo Lee, Min-Gyu Kang, Hyun Wook Han
    Diagnostics.2022; 12(6): 1302.     CrossRef
  • Diagnostic Accuracy of Machine Learning Models on Mammography in Breast Cancer Classification: A Meta-Analysis
    Tengku Muhammad Hanis, Md Asiful Islam, Kamarul Imran Musa
    Diagnostics.2022; 12(7): 1643.     CrossRef
  • Association of No Evidence of Disease Activity With No Long-term Disability Progression in Multiple Sclerosis
    Dalia Rotstein, Jacqueline Madeleine Solomon, Maria Pia Sormani, Xavier Montalban, Xiang Y. Ye, Dina Dababneh, Alexandra Muccilli, Prakesh Shah
    Neurology.2022;[Epub]     CrossRef
  • Prospective study of Na[18F]F PET/CT for cancer staging in morbidly obese patients compared with [99mTc]Tc-MDP whole-body planar, SPECT and SPECT/CT
    Sharjeel Usmani, Najeeb Ahmed, Gopinath Gnanasegaran, Fareeda Al kandari, Fahad Marafi, Ahmed Bani-Mustafa, Ahmed Musbah, Maryam Jassem Almashmoum, Tim Van den Wyngaert
    Acta Oncologica.2022; 61(10): 1230.     CrossRef
  • Structured data vs. unstructured data in machine learning prediction models for suicidal behaviors: A systematic review and meta-analysis
    Danielle Hopkins, Debra J. Rickwood, David J. Hallford, Clare Watsford
    Frontiers in Digital Health.2022;[Epub]     CrossRef
  • Growth Differentiation Factor-15 as a Candidate Biomarker in Gynecologic Malignancies: A Meta-analysis
    Dipayan Roy, Anupama Modi, Purvi Purohit, Manoj Khokhar, Manu Goyal, Shailja Sharma, Puneet Setia, Antonio Facciorusso, Praveen Sharma
    Cancer Investigation.2022; 40(10): 901.     CrossRef
  • Diagnostic accuracy of MRI techniques for treatment response evaluation in patients with brain metastasis: A systematic review and meta-analysis
    Wouter H.T. Teunissen, Chris W. Govaerts, Miranda C.A. Kramer, Jeremy A. Labrecque, Marion Smits, Linda Dirven, Anouk van der Hoorn
    Radiotherapy and Oncology.2022; 177: 121.     CrossRef
  • Accuracy of Diagnostic Tests for the Detection of Chagas Disease: A Systematic Review and Meta-Analysis
    Mayron Antonio Candia-Puma, Laura Yesenia Machaca-Luque, Brychs Milagros Roque-Pumahuanca, Alexsandro Sobreira Galdino, Rodolfo Cordeiro Giunchetti, Eduardo Antonio Ferraz Coelho, Miguel Angel Chávez-Fumagalli
    Diagnostics.2022; 12(11): 2752.     CrossRef
  • Assessment of the accuracy of 11 different diagnostic tests for the detection of Schistosomiasis mansoni in individuals from a Brazilian area of low endemicity using latent class analysis
    Silvia Gonçalves Mesquita, Roberta Lima Caldeira, Tereza Cristina Favre, Cristiano Lara Massara, Lílian Christina Nóbrega Holsbach Beck, Taynãna César Simões, Gardênia Braz Figueiredo de Carvalho, Flória Gabriela dos Santos Neves, Gabriela de Oliveira, La
    Frontiers in Microbiology.2022;[Epub]     CrossRef
  • Diagnosis of pathological conditions through electronic nose analysis of urine samples: a systematic review and meta-analysis
    Helga A.S. Afonso, Mariana V. Farraia, Mónica A. Vieira, João Cavaleiro Rufo
    Porto Biomedical Journal.2022; 7(6): e188.     CrossRef
  • Meta-analysis of diagnostic test accuracy studies with multiple thresholds for data integration
    Sung Ryul Shim
    Epidemiology and Health.2022; 44: e2022083.     CrossRef
  • A systematic review and meta-analysis of the diagnostic accuracy of biparametric prostate MRI for prostate cancer in men at risk
    E. J. Bass, A. Pantovic, M. Connor, R. Gabe, A. R. Padhani, A. Rockall, H. Sokhi, H. Tam, M. Winkler, H. U. Ahmed
    Prostate Cancer and Prostatic Diseases.2021; 24(3): 596.     CrossRef
  • Diagnosis of Alzheimer’s Disease in Developed and Developing Countries: Systematic Review and Meta-Analysis of Diagnostic Test Accuracy
    Miguel A. Chávez-Fumagalli, Pallavi Shrivastava, Jorge A. Aguilar-Pineda, Rita Nieto-Montesinos, Gonzalo Davila Del-Carpio, Antero Peralta-Mestas, Claudia Caracela-Zeballos, Guillermo Valdez-Lazo, Victor Fernandez-Macedo, Alejandro Pino-Figueroa, Karin J.
    Journal of Alzheimer's Disease Reports.2021; 5(1): 15.     CrossRef
  • Breath biopsy of breast cancer using sensor array signals and machine learning analysis
    Hsiao-Yu Yang, Yi-Chia Wang, Hsin-Yi Peng, Chi-Hsiang Huang
    Scientific Reports.2021;[Epub]     CrossRef
  • Meta-Analysis and Systematic Review of the Application of Machine Learning Classifiers in Biomedical Applications of Infrared Thermography
    Carolina Magalhaes, Joaquim Mendes, Ricardo Vardasca
    Applied Sciences.2021; 11(2): 842.     CrossRef
  • Predicting Clinical Outcomes in Acute Ischemic Stroke Patients Undergoing Endovascular Thrombectomy with Machine Learning
    Yao Hao Teo, Isis Claire Z. Y. Lim, Fan Shuen Tseng, Yao Neng Teo, Cheryl Shumin Kow, Zi Hui Celeste Ng, Nyein Chan Ko Ko, Ching-Hui Sia, Aloysius S. T. Leow, Wesley Yeung, Wan Yee Kong, Bernard P. L. Chan, Vijay K. Sharma, Leonard L. L. Yeo, Benjamin Y.
    Clinical Neuroradiology.2021; 31(4): 1121.     CrossRef
  • Application of artificial intelligence in diagnosis of osteoporosis using medical images: a systematic review and meta-analysis
    L. Gao, T. Jiao, Q. Feng, W. Wang
    Osteoporosis International.2021; 32(7): 1279.     CrossRef
  • The Accuracy of Visceral Adiposity Index for the Screening of Metabolic Syndrome: A Systematic Review and Meta-Analysis
    Moniba Bijari, Sara Jangjoo, Nima Emami, Sara Raji, Mahdi Mottaghi, Roya Moallem, Ali Jangjoo, Amin Saberi, Pawel Grzmil
    International Journal of Endocrinology.2021; 2021: 1.     CrossRef
  • Immunofluorescence Targeting PBP2a Protein: A New Potential Methicillin Resistance Screening Test
    Serenella Silvestri, Elisa Rampacci, Valentina Stefanetti, Michele Trotta, Caterina Fani, Lucia Levorato, Chiara Brachelente, Fabrizio Passamonti
    Frontiers in Veterinary Science.2021;[Epub]     CrossRef
  • Accuracy of malaria diagnostic tests performed on non-invasively collected samples: a systematic review and meta-analysis
    Celestin Danwang, Jean Jacques Noubiap, Jacob Souopgui, Jean Gaudart, Jean Cyr Yombi, Annie Robert
    BMJ Global Health.2021; 6(6): e005634.     CrossRef
  • Perceptions of the osteopathic profession in New York City’s Chinese Communities
    Justin Chin, Sarah Li, Gregory Yim, YaQun Arlene Zhou, Peter Justin Wan, Emily R Dube, Mikhail Volokitin, Sonu Sahni, Mark A Terrell, Christine M Lomiguen
    Family Medicine and Community Health.2020; 8(1): e000248.     CrossRef
  • Perceptions of the Osteopathic Profession in New York City's Korean Communities
    Justin Chin, DO, Haeinn Woo, OMS-IV, Diane Choi, OMS-III, Emily Dube, MS, Mikhail Volokitin, MD, DO, Christine Lomiguen, MD
    Osteopathic Family Physician.2020; 13(1): 12.     CrossRef
  • Development of a voiding diary using urination recognition technology in mobile environment
    Gun Hyun Park, Su Jin Kim, Young Sam Cho
    Journal of Exercise Rehabilitation.2020; 16(6): 529.     CrossRef

Epidemiol Health : Epidemiology and Health