Statistics in Medicine

Assessing screening tests: extensions of McNemar's test

Journal Article

  • Author(s): Peter A. Lachenbruch, Cornelius J. Lynch
  • Article first published online: 21 Dec 1998
  • DOI: 10.1002/(SICI)1097-0258(19981015)17:19<2207::AID-SIM920>3.0.CO;2-Y
  • Read on Online Library
  • Subscribe to Journal


We address the problem of comparing a new screening test to a currently available screening test in the absence of a gold standard. When both tests are given to each participant in a clinical trial, the usual analytical approach is to apply McNemar's test for equality of the off‐diagonal probabilities, with rejection of the null hypothesis implying that the tests differ. For assessing equivalence, however, we consider a compound null hypothesis that the new test gives either fewer or more positive results than the standard. If both parts of this hypothesis are rejected, we assert equivalence in the rate of positive responses. We propose an extension of McNemar's test for this situation. A companion step is to construct a confidence interval for the ratio of the marginal probabilities and assert equivalence if the interval is sufficiently small. It is also important that the tests agree a large proportion of the time. This can be verified with a complementary two‐tailed binomial test. Another situation arises when there is a gold standard for disease diagnosis, and we wish to compare the sensitivity and specificity of two screening tests. We show that a 2 degrees‐of‐freedom chi‐square test based on two McNemar‐like tables is an appropriate test. © 1998 John Wiley & Sons, Ltd.

Related Topics

Related Publications

Related Content

Site Footer


This website is provided by John Wiley & Sons Limited, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ (Company No: 00641132, VAT No: 376766987)

Published features on are checked for statistical accuracy by a panel from the European Network for Business and Industrial Statistics (ENBIS)   to whom Wiley and express their gratitude. This panel are: Ron Kenett, David Steinberg, Shirley Coleman, Irena Ograjenšek, Fabrizio Ruggeri, Rainer Göb, Philippe Castagliola, Xavier Tort-Martorell, Bart De Ketelaere, Antonio Pievatolo, Martina Vandebroek, Lance Mitchell, Gilbert Saporta, Helmut Waldl and Stelios Psarakis.