WIREs Computational Statistics

Goodness‐of‐fit testing in sparse contingency tables when the number of variables is large

Early View

Abstract The Pearson and likelihood ratio statistics are commonly used to test goodness of fit for models applied to data from a multinomial distribution. When data are from a table formed by the cross‐classification of a large number of variables, the common statistics may have low power and inaccurate Type I error level due to sparseness. One approach to finding a valid approximation to the achieved significance level (ASL) is to use a bootstrap distribution for the test statistic. For a composite null hypothesis with unknown parameters, the parametric bootstrap has been employed. The parametric bootstrap can be computationally demanding, but a recent development provides a method for computationally efficient calculation of the Pearson–Fisher statistic for very large sparse tables. Another approach employs orthogonal components of the Pearson–Fisher statistic obtained from lower‐order marginal distributions of a large cross‐classified table rather than the joint distribution. These statistics are used essentially for focused tests and have mostly been applied to latent variable models. They have very good performance for Type I error rate and power, even when applied to a sparse table. However, there are limitations when the number of variables becomes larger than 20. Some related statistics also employ lower‐order marginals, but they are not components of the Pearson–Fisher statistic. The performance of these approaches is compared for obtaining a valid ASL for a goodness‐of‐fit test applied to a very large multi‐way contingency table. The approaches are compared with a small simulation study. This article is categorized under: Types and Structure > Categorical Data Statistical and Graphical Methods of Data Analysis > Bootstrap and Resampling Statistical Models > Fitting Models

Related Topics

Related Publications

Related Content

Site Footer


This website is provided by John Wiley & Sons Limited, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ (Company No: 00641132, VAT No: 376766987)

Published features on StatisticsViews.com are checked for statistical accuracy by a panel from the European Network for Business and Industrial Statistics (ENBIS)   to whom Wiley and StatisticsViews.com express their gratitude. This panel are: Ron Kenett, David Steinberg, Shirley Coleman, Irena Ograjenšek, Fabrizio Ruggeri, Rainer Göb, Philippe Castagliola, Xavier Tort-Martorell, Bart De Ketelaere, Antonio Pievatolo, Martina Vandebroek, Lance Mitchell, Gilbert Saporta, Helmut Waldl and Stelios Psarakis.