Research Synthesis Methods

Inquisitio validus Index Medicus: A simple method of validating MEDLINE systematic review searches

Journal Article

We offer a new method of validation for the effectiveness of MEDLINE searches used in systematic reviews, the Inquisitio Validus Index Medicus. Validation is essential to ensure that relevant studies are not missed by the MEDLINE search strategy.


To demonstrate the validation method, a sample of six updated Cochrane reviews with comprehensive searches was used. The MEDLINE searches of both the original and updated reviews were tested to determine the percent of eligible MEDLINE‐indexed studies retrieved by the search (recall).


The validation method was robust and was able to demonstrate that the retrieval of relevant studies from MEDLINE was sub‐optimal. The approach to revising searches in our sample appeared unsystematic. Some poorly performing searches were used unchanged in the updates, and of the two amended strategies, one performed worse than the original when tested against studies included in the original, while the other improved recall.


There is a clear need for search validation. Using this validation method can determine whether the search of the main database performs adequately or needs to be revised to improve recall, allowing the searcher an opportunity to improve their search strategy. Validation of the search is recommended for systematic reviews, where the intent is to identify all relevant studies. Copyright © 2011 John Wiley & Sons, Ltd.

Related Topics

Related Publications

Related Content

Site Footer


This website is provided by John Wiley & Sons Limited, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ (Company No: 00641132, VAT No: 376766987)

Published features on are checked for statistical accuracy by a panel from the European Network for Business and Industrial Statistics (ENBIS)   to whom Wiley and express their gratitude. This panel are: Ron Kenett, David Steinberg, Shirley Coleman, Irena Ograjenšek, Fabrizio Ruggeri, Rainer Göb, Philippe Castagliola, Xavier Tort-Martorell, Bart De Ketelaere, Antonio Pievatolo, Martina Vandebroek, Lance Mitchell, Gilbert Saporta, Helmut Waldl and Stelios Psarakis.