

It is one of several such tools, including Yahoo! ® Babel Fish ( SDL FreeTranslation ® ( and Bing ® Translator ( In an analysis of four translation tools for a limited set of language pairs, Google Translate was found to perform best based on human judgment of translation accuracy. Google Translate® is a free, Web-based program with an excellent reputation for accurate, natural translation ( ). Therefore, a reliable, free, easily available service to translate articles may allow EPCs to easily broaden the scope of their systematic reviews, without introducing possible language bias by restrictions based on language. Formally translating all non–English-language articles is costly and resource-intensive, particularly if performed at the stage of full-text article screening. Percentage of studies from Medline search for randomized controlled trials in various languages.ĮPCs have varying capacities to extract non–English-language articles, based on the language knowledge of their staff. Table 1 shows the number and frequency of publications in other languages with more than 0.5 percent penetration. Using a literature search module for randomized controlled trials, 11 a search in Medline from 1996 to May 25, 2012, found that of 2,982,047 citations, 92 percent were published in English. 4 - 10 Nevertheless, excluding studies solely based on language runs counter to the concept of systematic review, of including all known evidence, particularly as investigators are being encouraged to include non-peer-reviewed and other studies in the grey literature. 1, 3 However, numerous other studies have found that excluding non-English publications may not result in substantial bias (changes in estimates of treatment effects). Thus, in most instances, EPC reports may be at risk of selection bias based on language (if there is reason to suspect differential publication of studies in English language and non-English journals) 1 and may not be following Standard 3.2.6 from the recent Institute of Medicine's (IOM) “Finding What Works in Health Care: Standards for Systematic Reviews,” 2 “Search for studies reported in languages other than English if appropriate.” The IOM report notes that there is some known evidence of language bias (e.g., investigators in Germany may be more likely to publish their negative results in German language publications and their positive results in English language publications). One included German- and French-language studies for nonoperative interventions (which were sparse), but only English-language publications for operative treatments “due to lack of translation resources.” Three of the CERs wrote that the language restriction was due to lack of resources or prohibitive translation costs, despite the recognition in one CER “that requiring studies to be published in English could lead to bias.” One placed no language restriction on comparative studies but included only English-language cohort studies. Two did not report language restriction in their methods chapter and included one study each in Dutch and German. Four explicitly did not impose any language restriction.

Among 28 other recent Comparative Effectiveness Reviews (CERs) with final or draft documents downloadable from the AHRQ Web site, 20 were restricted to English-language publications. One report included studies in languages for which the EPC had “available fluency” and only one reported not restricting by language. In a sample of 10 recent Evidence Reports (numbers 189-198), 8 were restricted to English-language publications. Systematic reviews conducted by the Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Centers (EPCs) most commonly restrict literature searches to English language publications.
