Missing data in multivariate categorical datasets are commonly handled under the Missing at Random (MAR) assumption, although this assumption may be inadequate when nonresponse is associated with unobserved response patterns. This study develops a covariate-dependent Bayesian latent class model for multiple imputation under Missing Not at Random (MNAR), denoted by BLCMMNAR. The model specifies covariate-dependent latent class membership through multinomial logistic regression, while the missingness indicators are modelled as Bernoulli variables with class-specific response probabilities. The response and missingness processes are thereby associated through their shared dependence on latent class membership. Bayesian estimation is implemented using Gibbs sampling, with Pólya–Gamma data augmentation for the class-membership regression coefficients, and missing responses are generated from the posterior predictive distribution. Finite-sample performance was examined through 500 simulation replications under scenarios with no, moderate, and strong covariate effects at primary sample sizes of 500 and 1,000. Multiple-imputation RMSE was additionally examined across sample sizes of 500, 1,000, 1,500, 2,000, and 2,500 to assess its behaviour with increasing sample size. BLCMMNAR was evaluated alongside a baseline Bayesian latent class model without covariates (BLCM0) and a covariate-dependent MAR formulation (BLCMMAR). Across the simulation settings, bias in multiple-imputation estimates was negligible for all three models, while relative RMSE varied by scenario and sample size. BLCMMNAR attained the lowest multiple-imputation RMSE in three of the six primary simulation conditions and recovered the class-specific response probabilities with small bias and RMSE. Recovery of latent class proportions and class-membership coefficients varied across scenarios and sample sizes, and improved point recovery did not uniformly correspond to improved interval calibration. The models were further applied to data from 32,156 women in the 2022 Kenya Demographic and Health Survey (KDHS). All three specifications were fitted with ten latent classes, but their posterior class occupancies differed. The completed-data and imputed-only distributions showed substantial sensitivity to the assumed missingness specification, particularly for skilled antenatal care, skilled delivery, and household decision-making outcomes. BLCM0 and BLCMMAR produced broadly similar imputations for several outcomes, whereas BLCMMNAR produced materially different distributions. Class-specific response probabilities under BLCMMNAR also exhibited substantial heterogeneity across latent classes. These findings demonstrate the importance of accounting for potential nonignorable missingness in Bayesian multiple imputation of multivariate categorical data and provide a framework for assessing the sensitivity of imputations to alternative assumptions about the missingness process.
| Published in | American Journal of Theoretical and Applied Statistics (Volume 15, Issue 6) |
| DOI | 10.11648/j.ajtas.20261506.11 |
| Page(s) | 317-340 |
| Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
| Copyright |
Copyright © The Author(s), 2026. Published by Science Publishing Group |
Multiple Imputation, Bayesian latent Class Model, Missing Not at Random, Multivariate Categorical Data, Covariate-dependent Latent Class Model, Latent Class-dependent Missingness
| [1] | Roderick J. A. Little, Donald B. Rubin. Statistical analysis with missing data. John Wiley & Sons. 2019. |
| [2] | Craig K. Enders. Applied missing data analysis. Guilford Publications. 2022. New York, NY. |
| [3] | Jeroen K Vermunt, Joost R Van Ginkel, L Andries Van der Ark, Klaas Sijtsma. 9. multiple imputation of incomplete categorical data using latent class analysis. Sociological Methodology. 2008, 38(1). pp. 369--397. |
| [4] | Davide Vidotto, MC Kaptein, JK Vermunt. Multiple imputation of missing categorical data using latent class models: state of art. Psychological Test and Assessment Modeling. 2015, 57(4). pp. 542--576. |
| [5] | Donald B. Rubin. Multiple imputation for survey nonresponse. John Wiley & Sons. 1987. New York. |
| [6] | Stef van Buuren. Flexible Imputation of Missing Data. Chapman and Hall/CRC. 2018. 2nd edition. Boca Raton, FL. |
| [7] | Davide Vidotto, Jeroen K. Vermunt, Katrijn Van Deun. Bayesian Latent Class Models for the Multiple Imputation of Categorical Data. Methodology. 2018, 14(2). pp. 56--68. |
| [8] | Joseph L. Schafer. Analysis of Incomplete Multivariate Data. Chapman & Hall/CRC. 1997. Boca Raton, FL. |
| [9] | Joseph L Schafer, Recai M Yucel. Computational strategies for multivariate linear mixed-effects models with missing values. Journal of Computational and Graphical Statistics. 2002, 11(2). pp. 437--457. |
| [10] | Donald B Rubin. Inference and missing data. Biometrika. 1976, 63(3). pp. 581--592. |
| [11] | Elinor Curnow, Rosie P. Cornish, Jon E. Heron, James R. Carpenter, Kate Tilling. Multiple imputation using auxiliary imputation variables that only predict missingness can increase bias due to data missing not at random. BMC Medical Research Methodology. 2024, 24(1). pp. 231. |
| [12] | Emily Kawabata, Daniel Major-Smith, Gemma L. Clayton, Chin Yang Shapland, Tim P. Morris, Alice R. Carter, Alba Fernandez Sanles, Maria Carolina Borges, Kate M. Tilling, Gareth J. Griffith, Louise A. C. Millard, George Davey Smith, Deborah A. Lawlor, Rachael A. Hughes. Accounting for bias due to outcome data missing not at random: comparison and illustration of two approaches to probabilistic bias analysis: a simulation study. BMC Medical Research Methodology. 2024, 24(1). pp. 278. |
| [13] | Antonio Linero. Nonparametric Bayes: Inference under nonignorable missingness and model selection. PhD thesis, University of Florida. 2015. |
| [14] | Thomas Richard Sullivan. Multiple imputation for handling missing outcome data. PhD thesis, The University of Adelaide. 2017. |
| [15] | Hyekyung Jung, Joseph L. Schafer, Byungtae Seo. A latent class selection model for nonignorable missing data. Computational Statistics & Data Analysis. 2011, 55(1). pp. 122--133. |
| [16] | Garrett M. Fitzmaurice, Marie Davidian, Geert Verbeke, Geert Molenberghs. Longitudinal data analysis. Chapman & Hall/CRC. 2008. Boca Raton, FL. |
| [17] | Han Du, Craig Enders, Brian Tinnell Keller, Thomas N. Bradbury, Benjamin R. Karney. A Bayesian latent variable selection model for nonignorable missingness. Multivariate Behavioral Research. 2022, 57(2-3). pp. 478--512. |
| [18] | Thais Viana Paiva. Multiple imputation methods for nonignorable nonresponse, adaptive survey design, and dissemination of synthetic geographies. PhD thesis, Duke University. 2014. |
| [19] | Johanna Muñoz, Orestis Efthimiou, Vincent Audigier, Valentijn MT de Jong, Thomas PA Debray. Multiple imputation of incomplete multilevel data using Heckman selection models. Statistics in Medicine. 2024, 43(3). pp. 514--533. |
| [20] | Fares Qeadan, William A. Barbeau. Enhancing imputation accuracy for catch-all missing data mechanisms with DFBETAS and leverage. Research in Statistics. 2025, 3(1). pp. 2451682. |
| [21] | Michael J. Daniels, Joseph W. Hogan. Missing data in longitudinal studies: Strategies for Bayesian modeling and sensitivity analysis. Chapman & Hall/CRC. 2008. Boca Raton, FL. |
| [22] | Paul Gustafson. Bayesian inference for partially identified models. The International Journal of Biostatistics. 2010, 6(2). pp. 1--20. |
| [23] | Donald Hedeker, Robin J Mermelstein, Hakan Demirtas. Analysis of binary outcomes with missing data: missing= smoking, last observation carried forward, and a little multiple imputation. Addiction. 2007, 102(10). pp. 1564--1573. |
| [24] | Daniel Mark Tompsett, Finbarr Leacy, Margarita Moreno-Betancur, Jon Heron, Ian R White. On the use of the not-at-random fully conditional specification (narfcs) procedure in practice. Statistics in Medicine. 2018, 37(15). pp. 2338--2353. |
| [25] | Jacques-Emmanuel Galimard, Sylvie Chevret, Emmanuel Curis, Matthieu Resche-Rigon. Heckman imputation models for binary or continuous MNAR outcomes and MAR predictors. BMC Medical Research Methodology. 2018, 18(1). pp. 90. |
| [26] | Steffi Pohl, Benjamin Becker. Performance of missing data approaches under nonignorable missing data conditions. Methodology. 2020, 16(2). pp. 147--165. |
| [27] | Jungwun Lee, Margaret Lloyd Sieger, Jon D. Phillips. A latent class pattern mixture model for nonignorable nonresponses in multivariate categorical data. Computational Statistics. 2025, 40(8). pp. 4367--4397. |
| [28] | Jung Wun Lee, Ofer Harel. A Latent Class Selection Model for Categorical Response Variables with Nonignorably Missing Data. Statistics and Its Interface. 2024, 17(4). pp. 635--648. |
| [29] | Silvia Bacci, Francesco Bartolucci. A multidimensional latent class IRT model for non-ignorable missing responses. Journal of Applied Statistics. 2013, 40(10). pp. 2137--2153. |
| [30] | Daniel Fundi Murithi, Josephine Njeri Ngure, Victor Muthama Musau. Bayesian Latent Class Models for Multiple Imputation of Multivariate Categorical Data Under Ignorable Missingness Mechanism. American Journal of Theoretical and Applied Statistics. 2026, 15(5). pp. 231--242. |
| [31] | Jeroen K Vermunt. Latent class modeling with covariates: two improved three-step approaches. Political Analysis. 2010, 18(4). pp. 450--469. |
| [32] | Linda M. Collins, Stephanie T. Lanza. Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences. John Wiley & Sons. 2010. Hoboken, NJ. |
| [33] | C Mitchell Dayton, George B Macready. Concomitant-variable latent-class models. Journal of the American Statistical Association. 1988, 83(401). pp. 173--178. |
| [34] | Karen Nylund-Gibson, Andrew Young Choi. Ten frequently asked questions about latent class analysis. Translational Issues in Psychological Science. 2018, 4(4). pp. 440. |
| [35] | Alan Agresti. Categorical Data Analysis. John Wiley & Sons. 2013. 3rd edition. Hoboken, NJ. |
| [36] | Anna Ivanova, Geert Molenberghs, Geert Verbeke. Mechanism for Missing Data Incorporated in Joint Modelling of Ordinal Responses. Journal of the Royal Statistical Society: Series C (Applied Statistics). 2017, 66(5). pp. 1049--1064. |
| [37] | Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, Donald B. Rubin. Bayesian data analysis. Chapman & Hall/CRC. 2013. 3rd edition. Boca Raton, FL. |
| [38] | Christian P. Robert. The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation. Springer. 2021. 3rd edition. New York, NY. |
| [39] | Karen Bandeen-Roche, Diana L Miglioretti, Scott L Zeger, Paul J Rathouz. Latent variable regression for multiple discrete outcomes. Journal of the American Statistical Association. 1997, 92(440). pp. 1375--1386. |
| [40] | Stuart Geman, Donald Geman. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1984, 6(6). pp. 721--741. |
| [41] | Martin A Tanner, Wing Hung Wong. The calculation of posterior distributions by data augmentation. Journal of the American Statistical Association. 1987, 82(398). pp. 528--540. |
| [42] | Nicholas G Polson, James G Scott, Jesse Windle. Bayesian inference for logistic models using pólya-Gamma latent variables. Journal of the American Statistical Association. 2013, 108(504). pp. 1339--1349. |
| [43] | Ricardo Cardoso Pereira, Pedro Henriques Abreu, Pedro Pereira Rodrigues, Mário A. T. Figueiredo. Imputation of data Missing Not at Random: Artificial generation and benchmark analysis. Expert Systems with Applications. 2024, 249. pp. 123654. |
| [44] | Zhenqiu Laura Lu, Zhiyong Zhang, Gitta Lubke. Bayesian Inference for Growth Mixture Models with Latent Class Dependent Missing Data. Multivariate Behavioral Research. 2011, 46(4). pp. 567--597. |
| [45] | An Creemers, Niel Hens, Marc Aerts, Geert Molenberghs, Geert Verbeke, Michael G. Kenward. A Sensitivity Analysis for Shared-Parameter Models for Incomplete Longitudinal Outcomes. Biometrical Journal. 2010, 52(1). pp. 111--125. |
| [46] | Kenya National Bureau of Statistics, Ministry of Health (Kenya), ICF International. Kenya Demographic and Health Survey 2022. Technical report, KNBS and ICF. 2023. Nairobi, Kenya and Rockville, Maryland, USA. |
| [47] | Bridget E. Weller, Natasha K. Bowen, Sarah J. Faubert. Latent Class Analysis: A Guide to Best Practice. Journal of Black Psychology. 2020, 46(4). pp. 287--311. |
APA Style
Murithi, D. F., Ngure, J. N., Musau, V. M. (2026). A Bayesian Latent Class Framework for Multiple Imputation of Multivariate Categorical Data Under Ignorable and Non-Ignorable Missingness. American Journal of Theoretical and Applied Statistics, 15(6), 317-340. https://doi.org/10.11648/j.ajtas.20261506.11
ACS Style
Murithi, D. F.; Ngure, J. N.; Musau, V. M. A Bayesian Latent Class Framework for Multiple Imputation of Multivariate Categorical Data Under Ignorable and Non-Ignorable Missingness. Am. J. Theor. Appl. Stat. 2026, 15(6), 317-340. doi: 10.11648/j.ajtas.20261506.11
@article{10.11648/j.ajtas.20261506.11,
author = {Daniel Fundi Murithi and Josephine Njeri Ngure and Victor Muthama Musau},
title = {A Bayesian Latent Class Framework for Multiple Imputation of Multivariate Categorical Data Under Ignorable and Non-Ignorable Missingness},
journal = {American Journal of Theoretical and Applied Statistics},
volume = {15},
number = {6},
pages = {317-340},
doi = {10.11648/j.ajtas.20261506.11},
url = {https://doi.org/10.11648/j.ajtas.20261506.11},
eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajtas.20261506.11},
abstract = {Missing data in multivariate categorical datasets are commonly handled under the Missing at Random (MAR) assumption, although this assumption may be inadequate when nonresponse is associated with unobserved response patterns. This study develops a covariate-dependent Bayesian latent class model for multiple imputation under Missing Not at Random (MNAR), denoted by BLCMMNAR. The model specifies covariate-dependent latent class membership through multinomial logistic regression, while the missingness indicators are modelled as Bernoulli variables with class-specific response probabilities. The response and missingness processes are thereby associated through their shared dependence on latent class membership. Bayesian estimation is implemented using Gibbs sampling, with Pólya–Gamma data augmentation for the class-membership regression coefficients, and missing responses are generated from the posterior predictive distribution. Finite-sample performance was examined through 500 simulation replications under scenarios with no, moderate, and strong covariate effects at primary sample sizes of 500 and 1,000. Multiple-imputation RMSE was additionally examined across sample sizes of 500, 1,000, 1,500, 2,000, and 2,500 to assess its behaviour with increasing sample size. BLCMMNAR was evaluated alongside a baseline Bayesian latent class model without covariates (BLCM0) and a covariate-dependent MAR formulation (BLCMMAR). Across the simulation settings, bias in multiple-imputation estimates was negligible for all three models, while relative RMSE varied by scenario and sample size. BLCMMNAR attained the lowest multiple-imputation RMSE in three of the six primary simulation conditions and recovered the class-specific response probabilities with small bias and RMSE. Recovery of latent class proportions and class-membership coefficients varied across scenarios and sample sizes, and improved point recovery did not uniformly correspond to improved interval calibration. The models were further applied to data from 32,156 women in the 2022 Kenya Demographic and Health Survey (KDHS). All three specifications were fitted with ten latent classes, but their posterior class occupancies differed. The completed-data and imputed-only distributions showed substantial sensitivity to the assumed missingness specification, particularly for skilled antenatal care, skilled delivery, and household decision-making outcomes. BLCM0 and BLCMMAR produced broadly similar imputations for several outcomes, whereas BLCMMNAR produced materially different distributions. Class-specific response probabilities under BLCMMNAR also exhibited substantial heterogeneity across latent classes. These findings demonstrate the importance of accounting for potential nonignorable missingness in Bayesian multiple imputation of multivariate categorical data and provide a framework for assessing the sensitivity of imputations to alternative assumptions about the missingness process.},
year = {2026}
}
TY - JOUR T1 - A Bayesian Latent Class Framework for Multiple Imputation of Multivariate Categorical Data Under Ignorable and Non-Ignorable Missingness AU - Daniel Fundi Murithi AU - Josephine Njeri Ngure AU - Victor Muthama Musau Y1 - 2026/11/11 PY - 2026 N1 - https://doi.org/10.11648/j.ajtas.20261506.11 DO - 10.11648/j.ajtas.20261506.11 T2 - American Journal of Theoretical and Applied Statistics JF - American Journal of Theoretical and Applied Statistics JO - American Journal of Theoretical and Applied Statistics SP - 317 EP - 340 PB - Science Publishing Group SN - 2326-9006 UR - https://doi.org/10.11648/j.ajtas.20261506.11 AB - Missing data in multivariate categorical datasets are commonly handled under the Missing at Random (MAR) assumption, although this assumption may be inadequate when nonresponse is associated with unobserved response patterns. This study develops a covariate-dependent Bayesian latent class model for multiple imputation under Missing Not at Random (MNAR), denoted by BLCMMNAR. The model specifies covariate-dependent latent class membership through multinomial logistic regression, while the missingness indicators are modelled as Bernoulli variables with class-specific response probabilities. The response and missingness processes are thereby associated through their shared dependence on latent class membership. Bayesian estimation is implemented using Gibbs sampling, with Pólya–Gamma data augmentation for the class-membership regression coefficients, and missing responses are generated from the posterior predictive distribution. Finite-sample performance was examined through 500 simulation replications under scenarios with no, moderate, and strong covariate effects at primary sample sizes of 500 and 1,000. Multiple-imputation RMSE was additionally examined across sample sizes of 500, 1,000, 1,500, 2,000, and 2,500 to assess its behaviour with increasing sample size. BLCMMNAR was evaluated alongside a baseline Bayesian latent class model without covariates (BLCM0) and a covariate-dependent MAR formulation (BLCMMAR). Across the simulation settings, bias in multiple-imputation estimates was negligible for all three models, while relative RMSE varied by scenario and sample size. BLCMMNAR attained the lowest multiple-imputation RMSE in three of the six primary simulation conditions and recovered the class-specific response probabilities with small bias and RMSE. Recovery of latent class proportions and class-membership coefficients varied across scenarios and sample sizes, and improved point recovery did not uniformly correspond to improved interval calibration. The models were further applied to data from 32,156 women in the 2022 Kenya Demographic and Health Survey (KDHS). All three specifications were fitted with ten latent classes, but their posterior class occupancies differed. The completed-data and imputed-only distributions showed substantial sensitivity to the assumed missingness specification, particularly for skilled antenatal care, skilled delivery, and household decision-making outcomes. BLCM0 and BLCMMAR produced broadly similar imputations for several outcomes, whereas BLCMMNAR produced materially different distributions. Class-specific response probabilities under BLCMMNAR also exhibited substantial heterogeneity across latent classes. These findings demonstrate the importance of accounting for potential nonignorable missingness in Bayesian multiple imputation of multivariate categorical data and provide a framework for assessing the sensitivity of imputations to alternative assumptions about the missingness process. VL - 15 IS - 6 ER -