| Peer-Reviewed

A Comparison of the Lehmann and GLM ROC Models

Received: 8 December 2020    Accepted: 25 March 2021    Published: 7 May 2021
Views:       Downloads:
Abstract

Recently, several regression methods have been developed to model the receiver operating characteristic curve (ROC), as a measure of accuracy for potential biomarker use in diagnostic testing and disease detection. In this paper, we investigate the Lehmann ROC regression model and compare it to more commonly used ROC regression methods that are found in the literature. The comparative performance of the methods are evaluated using simulated data from the normal, extreme value, and the Weibull distributions. Theory suggests that the Lehmann method should only work well when using the Weibull distribution. Our simulation results suggest that the performance of these methods is more complicated than the theory might suggest. The methods were demonstrated using data from a study concerning the clinical effectiveness of leukocyte elastase determination in the diagnosis of coronary artery disease (CAD).

Published in Science Journal of Applied Mathematics and Statistics (Volume 9, Issue 2)
DOI 10.11648/j.sjams.20210902.13
Page(s) 57-72
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2024. Published by Science Publishing Group

Keywords

Cox’s Model, Youden Index, Extreme Value, Beta and Weibull Distributions

References
[1] Todd A Alonzo and Margaret Sullivan Pepe. Distribution-free roc analysis using binary regression techniques. Biostatistics, 3 (3): 421–432, 2002.
[2] A Amaro, F Gude, R Gonzalez-Juanatey, C Iglesias, F Fernandez-Vazquez, J Garcia-Acuna, and M Gil. Plasma leukocyte elastase concentration in angiographically diagnosed coronary artery disease. European Heart Journal, 16 (5): 615–622, 1995.
[3] CA Beam. Random-effects models in the receiver operating characteristic curve-based assessment of the effectiveness of diagnostic imaging technology: concepts, approaches, and issues. Academic Radiology, 2: S4, 1995.
[4] Ralf Bender, Thomas Augustin, and Maria Blettner. Generating survival times to simulate cox proportional hazards models. Statistics in Medicine, 24 (11): 1713– 1723, 2005.
[5] Tianxi Cai. Semi-parametric roc regression analysis with placement values. Biostatistics, 5 (1): 45–60, 2004.
[6] Tianxi Cai and Margaret Sullivan Pepe. Semiparametric receiver operating characteristic analysis to evaluate biomarkers for disease. Journal of the American Statistical Association, 97 (460): 1099–1107, 2002.
[7] David R Cox. Regression models and life-tables. Journal of the Royal Statistical Society: Series B (Methodological), 34 (2): 187–202, 1972.
[8] DR Cox. Partial likelihood. biometrika, 62, 269- 276. Mathematical Reviews (MathSciNet): MR400509 Zentralblatt MATH, 312, 1975.
[9] Elizabeth R DeLong, David M DeLong, and Daniel L Clarke-Pearson. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 44 (3): 837–845, 1988.
[10] Silvia Ferrari and Francisco Cribari-Neto. Beta regression for modelling rates and proportions. Journal of Applied Statistics, 31 (7): 799–815, 2004.
[11] CA Gatsonis. Random-effects models for diagnostic accuracy data. Academic Radiology, 2: S14–21, 1995.
[12] Musie Ghebremichael, Haben Michael, Elijah Paintsil, and Jack Tubbs. Comparing the diagnostics accuracy of cd4+ t-lymphocyte count and percent as a surrogate markers of pediatric hiv disease. Journal of Mathematics and Statistics, 15: 55–64, 2019.
[13] Mithat Gönen and Glenn Heller. Lehmann family of roc curves. Medical Decision Making, 30 (4): 509–517, 2010.
[14] E. L. Lehmann. The power of rank tests. Ann. Math. Statist., 24 (1): 23–43, 03 1953.
[15] Christos T Nakas, Todd A Alonzo, and Constantin T Yiannoutsos. Accuracy and cut-off point selection in three-class classification problems using a generalization of the youden index. Statistics in Medicine, 29 (28): 2946– 2955, 2010.
[16] Margaret Sullivan Pepe. Three approaches to regression analysis of receiver operating characteristic curves for continuoustestresults. Biometrics, pages 124–135, 1998.
[17] Margaret Sullivan Pepe. An interpretation for the roc curve and inference using glm procedures. Biometrics, 56 (2): 352–359, 2000.
[18] Margaret Sullivan Pepe and Tianxi Cai. The analysis of placement values for evaluating discriminatory measures. Biometrics, 60 (2): 528–535, 2004.
[19] Mar´ıa Xosé Rodr´ıguez-Álvarez, Pablo G Tahoces, Carmen Cadarso-Suárez, and Mar´ıa José Lado. Comparativestudyofrocregressiontechniquesłapplications for the computer-aided diagnostic system in breast cancer detection. Computational Statistics & Data Analysis, 55 (1): 888–902, 2011.
[20] Sarah Stanley and Jack Tubbs. Beta regression for modeling a covariate adjusted roc. Science Journal of Applied Mathematics and Statistics, 6 (4): 110, 2018.
[21] Mary Lou Thompson and Walter Zucchini. On the statistical analysis of roc curves. Statistics in Medicine, 8 (10): 1277–1290, 1989.
[22] Anna N Angelos Tosteson and Colin B Begg. A general regression methodology for roc curve estimation. Medical Decision Making, 8 (3): 204–215, 1988.
[23] William J Youden. Index for rating diagnostic tests. Cancer, 3 (1): 32–35, 1950.
Cite This Article
  • APA Style

    Melissa Innerst, Jack D. Tubbs, Musie Ghebremichael. (2021). A Comparison of the Lehmann and GLM ROC Models. Science Journal of Applied Mathematics and Statistics, 9(2), 57-72. https://doi.org/10.11648/j.sjams.20210902.13

    Copy | Download

    ACS Style

    Melissa Innerst; Jack D. Tubbs; Musie Ghebremichael. A Comparison of the Lehmann and GLM ROC Models. Sci. J. Appl. Math. Stat. 2021, 9(2), 57-72. doi: 10.11648/j.sjams.20210902.13

    Copy | Download

    AMA Style

    Melissa Innerst, Jack D. Tubbs, Musie Ghebremichael. A Comparison of the Lehmann and GLM ROC Models. Sci J Appl Math Stat. 2021;9(2):57-72. doi: 10.11648/j.sjams.20210902.13

    Copy | Download

  • @article{10.11648/j.sjams.20210902.13,
      author = {Melissa Innerst and Jack D. Tubbs and Musie Ghebremichael},
      title = {A Comparison of the Lehmann and GLM ROC Models},
      journal = {Science Journal of Applied Mathematics and Statistics},
      volume = {9},
      number = {2},
      pages = {57-72},
      doi = {10.11648/j.sjams.20210902.13},
      url = {https://doi.org/10.11648/j.sjams.20210902.13},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.sjams.20210902.13},
      abstract = {Recently, several regression methods have been developed to model the receiver operating characteristic curve (ROC), as a measure of accuracy for potential biomarker use in diagnostic testing and disease detection. In this paper, we investigate the Lehmann ROC regression model and compare it to more commonly used ROC regression methods that are found in the literature. The comparative performance of the methods are evaluated using simulated data from the normal, extreme value, and the Weibull distributions. Theory suggests that the Lehmann method should only work well when using the Weibull distribution. Our simulation results suggest that the performance of these methods is more complicated than the theory might suggest. The methods were demonstrated using data from a study concerning the clinical effectiveness of leukocyte elastase determination in the diagnosis of coronary artery disease (CAD).},
     year = {2021}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - A Comparison of the Lehmann and GLM ROC Models
    AU  - Melissa Innerst
    AU  - Jack D. Tubbs
    AU  - Musie Ghebremichael
    Y1  - 2021/05/07
    PY  - 2021
    N1  - https://doi.org/10.11648/j.sjams.20210902.13
    DO  - 10.11648/j.sjams.20210902.13
    T2  - Science Journal of Applied Mathematics and Statistics
    JF  - Science Journal of Applied Mathematics and Statistics
    JO  - Science Journal of Applied Mathematics and Statistics
    SP  - 57
    EP  - 72
    PB  - Science Publishing Group
    SN  - 2376-9513
    UR  - https://doi.org/10.11648/j.sjams.20210902.13
    AB  - Recently, several regression methods have been developed to model the receiver operating characteristic curve (ROC), as a measure of accuracy for potential biomarker use in diagnostic testing and disease detection. In this paper, we investigate the Lehmann ROC regression model and compare it to more commonly used ROC regression methods that are found in the literature. The comparative performance of the methods are evaluated using simulated data from the normal, extreme value, and the Weibull distributions. Theory suggests that the Lehmann method should only work well when using the Weibull distribution. Our simulation results suggest that the performance of these methods is more complicated than the theory might suggest. The methods were demonstrated using data from a study concerning the clinical effectiveness of leukocyte elastase determination in the diagnosis of coronary artery disease (CAD).
    VL  - 9
    IS  - 2
    ER  - 

    Copy | Download

Author Information
  • Mathematics Department, Juniata College, Huntingdon, the United States

  • Department of Statistical Science, Baylor University, Waco, the United States

  • Biostatistics, Harvard University and Ragon Institute, Boston, the United States

  • Sections