Semiparametric Estimation of Receiver Operating Characteristic Surface

Ben K. Koech^1,

¹Department of Mathematics and Computer Science, University of Eldoret, P O Box 9591-30100, Eldoret, Kenya

Cite this paper

Ben K. Koech. Semiparametric Estimation of Receiver Operating Characteristic Surface. American Journal of Applied Mathematics and Statistics. 2018; 6(6):218-223. doi: 10.12691/AJAMS-6-6-1

Abstract

Receiver operating characteristic curve analysis is widely used in biomedical research to assess the performance of diagnostic tests. Estimation of receiver operating characteristic curves based on parametric approach has been widely used over years. However, this is limited by the fact that distribution of almost all diseases in epidemiology cannot be established quite easily. Semi parametric methods are robust as it allows computability and the distributions based on this are flexible. Furthermore, there is need for generalization of the receiver operating characteristic curve (since, the analysis largely assumes that test results are dichotomous) to allow tests to have more than two outcomes. The receiver operating characteristic curve was generalized to constitute a surface, which uses volume under the surface (VUS) to measure the accuracy of a diagnostic test. Dirichlet process mixtures of normals, which is a robust model that can handle nonstandard features in data in modelling the diagnostic data, were used to model the test outcomes. Semiparametric Dirichlet process mixtures of normals for receiver operating characteristic surface estimation were fitted using Markov Chain Monte Carlo with simple Metropolis Hastings steps. The Semi-parametric simulation results indicate that even when the parametric assumption holds, these models give accurate results as the volume under the surface (VUS) for both methods were greater than 1/6, the value of a “useless test”. Graphically, the semiparametric receiver operating characteristic surface has the appealing feature of being continuous and smooth, thus allowing for useful interpretation of the diagnostic performance at all thresholds.

Keywords

Bayesian Semiparametric Estimation, Dirichlet process mixtures of normals, Receiver operating characteristics, Volume Under Surface

Copyright

This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

References

[1]	Ferguson, T. S (1983). Bayesian Density Estimation by Mixtures of Normal Distributions, in Recent Advances in Statistics, eds. H. Rizvi and J. Rustagi, New York: Academic Press.
[2]	West, M. (1990). Bayesian kernel density estimation. Institute of Statistics and Decision Sciences, Duke University.
[3]	Erkanli, A., Sung, M., Costello, E.J., & Angold, A. (2006). Bayesian semi-parametric ROC analysis. Statistics in Medicine. 25, 3905-3928.
[4]	Branscum, A. J., Johnson, W. O., Hanson, T. E. & Gardner, I. A. (2008). Bayesian semiparametric ROC curve estimation and disease diagnosis. Statistics in Medicine. 27, 2474-2496.
[5]	Choi, Y., Johnson, W.O., Gardner, I. A., & Collins, M.T. (2006). Bayesian inference for receiver operating characteristic curves in the absence of a gold standard. Journal of Agricultural Biology and Environmental Statistics. 11: 210-229.
[6]	Hall, P. & Zhou, X. H. (2003). Nonparametric estimation of component distributions in a multivariate mixture. Annals of Statistics.31, 201-224.
[7]	Ferguson, T. S. (1974). Prior distributions on spaces of probability measures. The Annals of Statistics 2, 615-629.
[8]	Heckerling, P. S. (2001). Parametric three-way receiver operating characteristic surface analysis using Math-ematica. Medical Decision Making. 20, 409-417.
[9]	Li, J., Zhou, X.H. (2009). Nonparametric and Semiparametric Estimation of the Three Way Receiver Operating Characteristic Surface. Journal of Statistical Planning and Inference. 139, 4133-4142.
[10]	Antoniak, C. E. (1974). Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems. Annals of Statistics, 2, 1152-74.
[11]	Ferguson, T.S.(1973). A Bayesian Analysis of Some Nonparametric Problems. The Annals of Statistics, (1), 209-230.
[12]	Hsieh, F. & Turnbull, B.W. (1996). Nonparametric and semiparametric estimation of the receiver operating characteristic curve. Annals of Statistics. (24), 25-40.
[13]	Escobar, M.D. & West, M. (1995) Bayesian Density Estimation and Inference Using Mixtures. Journal of the American Statistical Association, 90: 577-588.
[14]	MacEachern, S. N. & Muller, P. (1998). Estimating mixture of Dirichlet Process Models. Journal of Computational and Graphical Statistics, 7 (2): 223-338.
[15]	Neal, R. M. (2000). Markov Chain sampling methods for Dirichlet process mixture models. Journal of Computational and Graphical Statistics, 9: 249-265.
[16]	Kraemer, H. C. (1992). Evaluating Medical Tests. Sage Publications.
[17]	Jokiel-Rokita, A. & Pulit, M. (2013). Nonparametric estimation of the ROC curve based on smoothed empirical distribution functions, Statistics andComputing, 23, 703-712.
[18]	Luo, J. & Xiong, C. (2012). DiagTest3Grp: An R Package for Analyzing Diagnostic Tests with Three Ordinal Groups. Journal of Statistical Software. 51(3), 1-24.
[19]	Inacio de Carvalho, V., Jara, A., Hanson, T. E. & de Carvalho, M. (2013). Bayesian nonparametric ROC regression modeling, Bayesian Analysis, 3, 623-646.
[20]	Inácio V, Turkman AA, Nakas CT, Alonzo TA. (2012) Nonparametric Bayesian Estimation of the Three-Way Receiver Operating Characteristic Surface. Biometrical Journal. 53(6): 1011-1024.
[21]	Nakas, C. T. and Yiannoutsos, C. T. (2004). Ordered multiple-class ROC analysis with continuous measurements. Statistics in Medicine. 23, 3437-3449.
[22]	Nakas, C. T., Alonzo, T. A. &Yiannoutsos, C. T. (2010). Accuracy and cut-off point selection in three-class classification problems using a generalization of the Youden index. Statistics in Medicine. 29, 2946-2955.
[23]	Escobar, M. D. (1990). Estimating Normal Means With a Dirichlet Process Prior Technical Report 512, Department of Statistics: Carnegie Mellon University.