Background: The impact of medical research is usually judged on the basis of citations in the serial literature. A better test of its utility is through its contribution to clinical practice guidelines (CPGs) on how to prevent, diagnose, and treat illness. This study aimed to compare the parameters of lung cancer research papers with those cited as references in lung cancer CPGs from 16 countries, and the Cochrane Collaboration. These comparisons were mainly based on bibliographic data compiled from the Web of Science (WoS).

Methodology: We examined 7357 references (of which 4491 were unique) cited in a total of 77 lung cancer CPGs, and compared them with 73,214 lung cancer papers published in the WoS between 2004 and 2018.

Results: References used by lung CPGs were much more clinical than the overall body of research papers on this cancer, and their authors predominantly came from smaller northern European countries. However, the leading institutions whose papers were cited the most on these CPGs were from the USA, notably the MD Anderson Cancer Center in Texas, the Memorial Sloan Kettering Cancer Center, New York, and the Mayo Clinic in Rochester, Minnesota. The types of research cited by the CPGs were primarily clinical trials, as well as three treatment modalities (chemotherapy, radiotherapy and surgery). Genetics, palliative care and quality of life were largely neglected. The median time gap between papers cited on a lung CPG and its publication was 3.5 years longer than for WoS citations.

Conclusions: Analysis of the references on CPGs allows an alternative means of research evaluation, and one that may be more appropriate for clinical research than citations in academic journals. Own-country references show the direct contribution of research to a country's health care, and other-country references show the esteem in which this research has been held internationally. © 2021 King's College London