Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-02-05T23:11:36.042Z Has data issue: false hasContentIssue false

Case report classics in otolaryngology – head and neck surgery: citation analysis

Published online by Cambridge University Press:  12 June 2018

L W Edelmayer
Affiliation:
Otolaryngology – Head and Neck Surgery, Augusta University, Georgia, USA
J E Fenton
Affiliation:
Graduate Entry Medical School, University of Limerick, Ireland Department of Otorhinolaryngology, Graduate Entry Medical School, University of Limerick, Ireland
S A Yellin
Affiliation:
Graduate Entry Medical School, University of Limerick, Ireland
D J Shearer
Affiliation:
Graduate Entry Medical School, University of Limerick, Ireland
D H Coelho*
Affiliation:
Otolaryngology – Head and Neck Surgery, Virginia Commonwealth University, Richmond, USA
*
Address for correspondence: Dr Daniel H Coelho, Department of Otolaryngology – Head and Neck Surgery, Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA Fax: +1 804 828 5799 E-mail: daniel.coelho@vcuhealth.org
Rights & Permissions [Opens in a new window]

Abstract

Objectives

To analyse publication and citations trends of case reports within otolaryngology – head and neck surgery literature, with specific attention to the most-cited reports.

Study design

Database query.

Methods

Web of Science was searched for article type ‘case reports’ published in the leading otolaryngology – head and neck surgery journals since 1945. Variables including publication dates, citation dates and numbers, author, author number, and others were recorded and analysed for trends. The reports with the most citations (classics) were further studied.

Results

Of nearly 67 000 published articles in leading otolaryngology – head and neck surgery journals, the overall number of case reports as a percentage of the total has substantially decreased over time. A total of 110 case report classics were identified for which citations have increased.

Conclusion

Although the case report may not be worthy of its tarnished record, declining trends in publication suggest a limited future for this valuable research and educational resource.

Type
Main Articles
Copyright
Copyright © JLO (1984) Limited, 2018 

Introduction

Case reports are the simplest form of descriptive study, long considered a valuable research and educational resource. They have been the cornerstone of medical education and training for decades. Nonetheless, their publication within the top medical journals has become substantially less commonplace.Reference Flood and Kenyon1 There are many explanations for this shift, especially in today's era where the importance of evidence-based medicine is stressed. The recent explosion of high-quality research may leave little room for anything else in journals where pages are limited. Moreover, as case reports are relatively low in the hierarchy of clinical decision-making (resting above only expert opinion), publishers may perceive a poor citation rate.Reference Nieder, Pawinski and Dalhaug2, Reference Burns, Rohrich and Chung3 By publishing only those papers likely to receive a high number of citations, journals may aim to maximally increase their impact factor. The converse, however, is also true. Publishing articles that are poorly cited, as is assumed regarding the case report, has been shown to have a negative effect on the impact factor of a journal.Reference Nabil and Samman4

It remains to be seen whether the case report is worthy of its now tarnished reputation and declining publication rates. This study aimed to analyse trends in the publication and citation of classic case reports within otolaryngology – head and neck surgery, and to determine whether the general perception of low citation rates of case reports within the field is warranted.

Materials and methods

The Web of Science database (which also included both the Medline and Biosis online databases) was queried on 12 August 2016. Using the filters provided by the database (e.g. ‘document type = case report’, ‘language = English’ and ‘timespan = all years’), the top 10 otolaryngology – head and neck surgery journals (by impact factor, as per our previous study) were searched.Reference Coelho, Edelmayer and Fenton5 Two authors (LWE, DHC) reviewed each article and included only reports that described the medical history of a single patient, as per the standard definition.Reference Greenhalgh6 Reports of multiple cases, including case series, were excluded.

The top 100 most-cited case reports were selected and considered ‘case report classics’. If more than 1 report shared the same number of citations as the 100th most-cited report, they were included. The journals that published the ‘case report classics’ were then queried again for the total number of articles published. Using the same search criteria as above, all reports, irrespective of number of citations, were selected.

Results

Case report trends

Between 1945 and 2016, there were 66 953 total articles published by the 10 journals examined in this study. A total of 10 107 were case reports, representing 15.1 per cent of all published articles. Over time, the total number of articles published has increased markedly, while the number of case reports has increased marginally (Figure 1). Case reports as a percentage of all published articles decreased steadily over the same time period (Figure 2). By the end of the first decade in the new millennium, there was a consistent downtrend, with only 15.0 per cent of all published articles being case reports. For the most recent years with complete data available, the percentage has continued to decrease, with only 8.82 per cent and 8.5 per cent of all published articles being case reports in 2014 and 2015 respectively.

Fig. 1. Case reports and total number of articles published by year.

Fig. 2. Case reports as a percentage of total articles published by year.

Case report classics

Between 1945 and 2016, 110 case report classics (as defined above) with 34 or more citations were identified. The average number of citations per case report was 50.5, for a total of 5555 citations. There were 32 (29.1 per cent) case reports with 50 or more citations.

The most-cited case report, ‘A new treatment for chronic secretory otitis media’, by Armstrong, published in Archives of Otolaryngology – Head & Neck Surgery (now JAMA Otolaryngology – Head & Neck Surgery), had 321 citations, and has been cited an average of 5.1 times per year since publication (Table I). This case report, as well as the case report ‘Unusual neoplasms of the esophagus - review of literature and report of a case’ (by Gregg and Stamler, also published in Archives of Otolaryngology), are the earliest case report classics that met the inclusion criteria, both being published in 1954.

Table I. Top ten most-cited otolaryngology case reports

The most recent case report to make the list was ‘Propranolol for airway hemangiomas: case report of novel treatment’ by Buckmiller et al., published in 2009 in The Laryngoscope, with 89 citations. This case report also has the highest number of average citations per year since publication, at 11.1, and is within the top 10 most-cited case reports according to our methods (Table I).

Six of the top 10 otolaryngology – head and neck surgery journals (by impact factor) did not publish any classic case reports. The journal Archives of Otolaryngology published the most case report classics (n = 52, 47.3 per cent) (Table II). Five out of the top 10 most-cited case report classics were published in The Laryngoscope, 4 were in Archives of Otolaryngology, and 1 was in JARO – Journal of the Association for Research in Otolaryngology. Four of the case reports with the highest average per year citation rate were published in The Laryngoscope.

Table II. Classic case reports by journal of publication

The yearly distribution of classic case reports by publication date are displayed in Figure 3. Eight of the case report classics included in this study were published in the 1950s (all published in the journal Archives of Otolaryngology (since renamed JAMA Otolaryngology – Head & Neck Surgery). Six were published in the 1960s and 10 in the 1970s. The bulk of the case report classics (n = 47) were published in the 1980s. The year with the most case report classics published was 1980, with eight reports. The years 1984 and 1985 each saw the publication of seven classic case reports. The number of classic case reports has steadily declined since then, with 29 published in the 1990s and 10 in the 2000s. No case reports published in the 2010s had enough citations to qualify as a classic. The yearly distribution of the 5555 citations of the 110 case report classics is shown in Figure 4. The year in which the most classic reports were cited was 2008 (n = 214).

Fig. 3. Case report classics by year of publication.

Fig. 4. Citations of case report classics by year.

The average number of authors per case report classic is 3.4. The median number of authors is three, where most of the articles had two authors (mode). The case report classic with the most authors is ‘Consequences of neural asynchrony: a case of auditory neuropathy’ by Kraus et al. (published in 2000 in JARO – Journal of the Association for Research in Otolaryngology), with a total of 10 authors. Only 9 of the 110 case report classics had self-citations. The author with the most case report classics was HF Biller, with five articles. His most-cited case report is ‘A new technique for wide-field exposure of the base of the skull’, published in Archives of Otolaryngology in 1981, with 74 citations. That article is also one of the top 10 case reports with the highest average number of citations per year.

Eleven countries were represented in the publication of these case report classics. The majority of the case report classics were written by, or collaborated with, US authors (n = 102, 92.7 per cent), with 99 (90.0 per cent) being strictly US authors. The country with the second most case report classics published was Switzerland, with four articles (3.6 per cent). The UK was represented by authors from three papers, where two of those were collaborations with US authors.

Discussion

Publications in medical journals, especially those with a high impact factor, are viewed as educational currency that demonstrates the level of influence and accomplishment of an author.Reference Bhattacharrya, Miller and Ropper7 One measure of the success of a publication is the number of citations it receives, and this number is largely influenced by the strength of the evidence presented in the paper.Reference Coelho, Edelmayer and Fenton8 Citing high levels of evidence provides a more robust background to the results to be presented in each study.Reference Callaham, Wears and Weber9

It is often assumed, especially in our current environment of evidence-based medicine, that case reports represent the lowest level of evidence. Many journal editors may consider the case report as ‘filler’ material, as they need little editing and can be inserted as the need arises. Those of the same outlook may similarly presume it to be a platform for novice academics to ‘wet their feet’ and cushion their curriculum vitae.Reference Flood and Kenyon1 Conversely and pedagogically, we often consider randomised clinical trials, systematic reviews and meta-analyses as the highest level of evidence.Reference Yitschaky, Yitschaky and Zadik10 Is this the situation the case report has found itself in, that it is mere filler rather an edifying supplemental didactic? Where does the case report fit in with current evidence-based otolaryngology?

In this study, only 3 case reports had over 100 citations and were considered an overall ‘citation classic’, comprising less than 0.33 per cent of the 906 classics found in our previous study.Reference Coelho, Edelmayer and Fenton8 This value acts as either a clarion call for a revival of case reports in otolaryngology – head and neck surgery literature or as verification that there is no demand for case reports in our current condition of publication. The total number of articles published each year in these journals has been increasing, while the proportion of case reports published each year has dramatically decreased since the 1970s. In fact, that number of actual case reports is likely to be substantially lower, as the Web of Science document type definition of ‘case report’ is broader than the ‘single case’ definition.

This decrease may be a result of the position held by some that usually new discoveries from case reports are not supported by additional research, that they may include ‘misleading elements in clinical presentation’, and that they do ‘more harm than good by emphasizing the bizarre’.Reference Vandenbroucke11 Yet it is safe to assume that all forms of research have their proper place.Reference Sackett and Wennberg12

Strict submission criteria enforced by many journals can prevent countless case reports from ever being submitted. Take for instance the journal Otolaryngology – Head and Neck Surgery, which requires case reports to be no more than 700 words, does not allow literature reviews, and any case reports describing therapeutic interventions are not considered (as they require higher levels of evidence). Other well-regarded journals, for example The American Journal of Rhinology & Allergy, do not accept case reports at all, and refer all case reports to their open access journal. Some journals accept case reports, but also mention in the author guidelines that if it is not accepted it can be published in their open access journal (e.g. Clinical Otolaryngology). Such pay-to-publish practices may discourage authors from submitting their work at all. Other high impact factor journals (i.e. Current Opinion in Otolaryngology & Head and Neck Surgery, and Otolaryngologic Clinics of North America) publish by invitation only and do not publish case reports. Alternatively, there are some journals which still see the value of the case report, such as Otology & Neurotology and JAMA Otolaryngology – Head & Neck Surgery; these provide space within each journal for a ‘clinical capsule report’, ‘imaging case of the month’ or ‘temporal bone histopathology case of the month’. Other non-open access journals also solicit and accept case reports, but they are in general publications with lower impact factors, and may not be as widely read.

An argument for the case report can be made. The inception of an investigation first begins with an unexpected observation. Then the observation is documented, and, as paraphrased by Vanderbrouke, becomes ‘refutations of our previously held beliefs…which…leads to new conjectures—new ideas, and new theories’.Reference Vandenbroucke11 This then forms into a discussion or a review of many cases. Based on these multiple observations, we can perform a meta-analysis of these case reports and case series, and hopefully reach a significant wake of new conclusions.Reference Jenicek13 The educational endeavours ignited by the discussion of these rare events allow for a continual ‘intermingling of surprise, deduction, and induction’ that eventually lead to more formal analyses.Reference Vandenbroucke11 Therefore, the highest hierarchical mode of investigation (i.e. randomised control trials) stem from the inception of a question created by a case report. The aim of the evidence-based investigation is ameliorated by the aim of the case report, and the case report rightfully becomes complementary to the modern study.

For example, when BF McCabe began describing cases of patients with autoimmune vasculitides developing sensorineural hearing loss in 1979, more cases of autoimmune disease related to sensorineural hearing loss began appearing (i.e. ulcerative colitis). This illumination led to an increased interest in the pathophysiology, treatment and prevention, and eventually to the greater hierarchical studies performed (randomised control trials), and now to the current (though still incomplete) understanding we have today.Reference McCabe14Reference Weber, Jenkins and Coker16 This was also the case in the retraction of many drugs from the market, prompted by case reports, as well as the discovery of and alternative use for sildenafil as it was being studied as an anti-hypertensive.Reference Flood and Kenyon1, Reference Jenicek13, Reference Friedman, Woodcock, Lumpkin, Shuren, Hass and Thompson17 In historical medical education, case reports were used to educate on disease processes through individual patient experience of illness and treatment.Reference Cohen18 Case reports catch rare occurrences, add to the disease narrative and advance knowledge of disease pathophysiology that can lead to improved patient care.Reference Bhattacharrya, Miller and Ropper7, Reference Rison19 As individual diseases affect each patient differently, it is important to document the often subtle variations of both common and uncommon processes.

The inverse can be argued that the rate of rare occurrences may be decreasing and thus the content of modern case reports is no longer novel. Of interest, the proportion of case reports published each year since the 1970s has been decreasing, whereas the yearly number of citations of case reports has been increasing in the same amount of time. (Note that although Figure 4 reflects a decrease in classic report citations over the last decade, the citations per year to publications per year ratio for case reports is rising.) This inverse relationship may be a sign that the importance of the case report, in the eyes of the journals publishing them, matches its presumed lower level of evidence, resulting in a decrease in overall case report journal acceptance. However, the upward trend noted in case report citation indicates otherwise. Do we as a medical society hold onto the novelties of the past? Has the collective conscious of readers and authors become aware of the lack of case report publications and sought to revive the legacy of those before us? Do we long to recognise Armstrong, Biller, Montgomery and other giants of otolaryngology – head and neck surgery as we peruse and study new findings within the clinical data that are presented in these journals? Is this a sign of a need for increased publication of case reports, or of intrigue in historical medicine?

We can make many assumptions as to why the rare, but highly cited case reports are referenced at the rate that they are. Some introduce a new technique or tool used in disease treatment. Those case reports that outlined treatment procedures remain highly cited. This may be because the results led to the introduction of tools and treatments that are still used today, such as the grommet, the T-tube tracheal stent, propranolol for airway haemangiomas and the bone-anchored auricular prosthesis. Many of these case reports are cited by publications that further refined and developed treatments and procedures, such as techniques used for wide-field exposure of the skull base. Some case reports are cited by health economists, who examine the cost effectiveness of treatments and evaluate indications for treatment. Others were the first to describe and name a disease process. One case report outlining a disease process of necrotising fasciitis (streptococcal gangrene) of the face, describes its aetiology, pathogenesis, diagnosis and treatment. As such, it is used as the original reference when describing further developments in treatment and pathogenesis. This may be the case where the original article remains the leading citation. It is, however, interesting to think about current otolaryngological diseases that were first introduced as a case report, and yet they are not as highly cited. Could it be these cases and their observed disease state and treatment have been integrated into the collective otolaryngology knowledge base, and thus are not considered to require a citation?

We do not infer that these high impact factor journals have in any way actively tried to quash the existence of the case report in order to protect their well-deserved reputations. It may be that it is becoming increasingly difficult to present a case that has not been presented in some form or fashion already. Whereas the breadth of knowledge continues to grow, these rare occurrences may become rarer.

Woe be unto the reader of a journal who is inundated with multiple case presentations, when the desire for a concentrated form of clinically relevant data is diluted. There is a change in publication trends, whereby journals may publish fewer case reports in favour of publications reporting higher levels of evidence. When so much clinically relevant information is available, why ‘waste’ space in a journal with a case report, as there are so much clinically relevant data to be presented and discussed within the limited confines of those printed pages.

This could be an argument for a highly impactful otolaryngology – head and neck surgery case report only journal. Yet the formation of such journals (some online), including BMJ Case Reports – Otolaryngology/ENT, Otolaryngology Case Reports, and Case Reports in Otolaryngology, has been achieved but lacks impact. More importantly, the online journals are open access journals that charge a fee for a guaranteed publication. This has arguably turned the publication of case reports into a cacophony of material, and provides limited merit to its authors or contribution to the otolaryngology – head and neck surgery community.

This study is not without its limitations. While the authors used certain filters and keywords to search for the case reports, we understand that a number of publications may have been overlooked; for instance, true case reports may not have been reported as such within the Web of Science database. We also acknowledge that using only the top 10 most impactful journals excludes possible case reports that may have had a significant number of citations and would have met inclusion criteria otherwise. As the Web of Science database does not have access to articles published before a certain date, this would exclude those articles. One last weakness of the study was the use of a subjective minimum inclusion count of 34 citations. We believe that in order to have a workable dataset, a minimum number of citations needs to be employed. We agreed on setting the minimum number of citations to a number that would bring the total list to approximately 100 case reports.

While the citation rates of case report classics have been evaluated here, future studies could examine submission rates of all case reports, to determine whether their submission rates have fallen in proportion to their publication rates. This is in spite of many previous attempts to revitalise the case report and increase their presence amongst published medical literature.Reference Lennon and Fenton20

  • Case reports have research and educational value; however, perceived limited impact has tarnished their reputation

  • Publications of case reports within the top otolaryngology – head and neck surgery journals have declined over the last six decades

  • Citation rates of the top cited reports continue to increase

  • A total of 110 ‘classic’ case reports were identified and analysed for common or differentiating features

  • Case reports are poorly represented amongst classic (most-cited) articles in otolaryngology – head and neck surgery

  • Although the case report may not be worthy of its tarnished record, a decline in publication suggests a limited future for this valuable resource

Conclusion

Despite the acknowledgement of over 100 ‘case report classics’, the declining presence of case reports amongst published literature may be attributed to an assumed low citation. Multiple influences, including more restrictive submission criteria by journals, the perception of case reports as having a low level of evidence and the theory of decreasing novelty in disease presentations, may keep many case reports from publication. Though the publication of case reports in otolaryngology – head and neck surgery journals is declining, there appears to be an upward trend in the number of citations of case reports. Nevertheless, case reports are very poorly represented amongst citation classics in otolaryngology – head and neck surgery, confirming the conventional belief of low citation rates.

Competing interests

None declared

Footnotes

Dr D H Coelho takes responsibility for the integrity of the content of the paper

Portions of this study were presented at the 24th and 25th Sylvester O'Halloran Perioperative Scientific Symposia, 2–4 March 2016 and 2–4 March 2017 respectively, Limerick, Ireland.

References

1Flood, LM, Kenyon, G. The ENT case report in the era of evidence-based medicine: a defence and a guide. J Laryngol Otol 2009;123:13Google Scholar
2Nieder, C, Pawinski, A, Dalhaug, A. Contribution of case reports to glioblastoma research: systematic review and analysis of pattern of citation. Br J Neurosurg 2012;26:809–12Google Scholar
3Burns, PB, Rohrich, RJ, Chung, KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg 2011;128:305–10Google Scholar
4Nabil, S, Samman, N. The impact of case reports in oral and maxillofacial surgery. Int J Oral Maxillofac Surg 2012;41:789–96Google Scholar
5Coelho, DH, Edelmayer, LW, Fenton, JE. Citation analysis of otorhinolaryngology journals: follow-up study. J Laryngol Otol 2015;129:489–93Google Scholar
6Greenhalgh, T. How to read a paper. Getting your bearings (deciding what the paper is about). BMJ 1997;315:243–6Google Scholar
7Bhattacharrya, S, Miller, J, Ropper, AH. The case for case reports. Ann Neurol 2014;76:484–6Google Scholar
8Coelho, DH, Edelmayer, LW, Fenton, JE. A century of citation classics in otolaryngology-head and neck surgery journals revisited. Laryngoscope 2014;124:1358–62Google Scholar
9Callaham, M, Wears, RL, Weber, E. Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA 2002;287:2847–50Google Scholar
10Yitschaky, O, Yitschaky, M, Zadik, Y. Case report on trial: do you, doctor, swear to tell the truth, the whole truth and nothing but the truth? J Med Case Rep 2011;5:179Google Scholar
11Vandenbroucke, JP. In defense of case reports and case series. Ann Intern Med 2001;134:330–4Google Scholar
12Sackett, DL, Wennberg, JE. Choosing the best research design for each question - it's time to stop squabbling over the “best” methods. BMJ 1997;315:1636Google Scholar
13Jenicek, M. Clinical Case Reporting in Evidence-Based Medicine. Oxford: Butterworth-Heinemann, 1999;117Google Scholar
14McCabe, BF. Auto-immune sensorineural hearing loss. Ann Otol Rhinol Laryngol 1979;88:585–9Google Scholar
15Harris, JP, Sharp, PA. Inner-ear autoantibodies in patients with rapidly progressive sensorineural hearing loss. Laryngoscope 1990;100:516–24Google Scholar
16Weber, RS, Jenkins, HA, Coker, NJ. Sensorineural hearing loss associated with ulcerative colitis. A case report. Arch Otolaryngol Head Neck Surg 1984;110:810–12Google Scholar
17Friedman, MA, Woodcock, J, Lumpkin, MM, Shuren, JE, Hass, AE, Thompson, LJ. The safety of newly approved medicines: do recent market removals mean there is a problem? JAMA 1999;281:1728–34Google Scholar
18Cohen, H. How to write a patient case report. Am J Health Syst Pharm 2006;63:1888–92Google Scholar
19Rison, RA. A guide to writing case reports for the Journal of Medical Case Reports and BioMed Central Research Notes. J Med Case Rep 2013;7:239Google Scholar
20Lennon, P, Fenton, JE. The case for the case report: refine to save. Ir J Med Sci 2011;180:529–32Google Scholar
Figure 0

Fig. 1. Case reports and total number of articles published by year.

Figure 1

Fig. 2. Case reports as a percentage of total articles published by year.

Figure 2

Table I. Top ten most-cited otolaryngology case reports

Figure 3

Table II. Classic case reports by journal of publication

Figure 4

Fig. 3. Case report classics by year of publication.

Figure 5

Fig. 4. Citations of case report classics by year.