Clinical evaluation of marketed orthodontic products: are researchers behind the times? A meta-epidemiological study
Progress in Orthodontics volume 18, Article number: 14 (2017)
The role of marketing and industry in the treatment decisions of orthodontists has received increasing attention in recent years with clinical research typically undertaken subsequent to established use of these devices and often failing to confirm the promise of manufacturers’ claims. This meta-epidemiological study was undertaken to assess the proportion of clinical trials in orthodontics evaluating commercially marketed products and to evaluate the direction of the results of these studies.
Electronic searching was undertaken to identify randomized controlled trials (RCTs) published over a 5-year period (1 January 2012 to 31 December 2016). Data obtained included the type of marketed intervention, direction of effect and declaration of both industry sponsorship and conflict of interest.
Eighty-four RCTs published in 23 scientific journals were included with the highest percentage in the American Journal of Dentofacial Orthopedics (AJO-DO) (23.8%), followed by the European Journal of Orthodontics (EJO) (14.3%), Journal of Orthodontics (JO) (10.7%) and Angle Orthodontist (AO) (10.7%). Overall, 45% (38/84) of clinical trials assessed involved analysis of marketed products after their introduction. Interventions to improve oral health or circumvent the risk of iatrogenic damage, such as white spot lesions, were most commonly assessed (15.8%), with the relative merits of non-surgical adjuncts (14.1%) and other orthodontic auxiliaries (13.1%) also frequently evaluated. In 44% of RCTs, a positive effect of the marketed intervention was not reported. Industry sponsorship of the research was declared in 9.5% RCTs. No significant associations between the direction of the effect and both declaration of industry sponsorship (p = 0.56) and conflict of interest (p = 0.96) were detected. Moreover, for marketed and non-marketed products, no significant associations for both declaration of industry sponsorship (p = 0.44) and conflict of interest (p = 0.28) were found.
Almost half of orthodontic clinical trials over the past 5 years involve analysis of marketed products after their introduction. The results highlight a potential source of waste in orthodontic research emanating from existing approaches to licensing and marketing of orthodontic products.
Engagement of orthodontists with industry and commercial interests is necessary to facilitate the development, refinement and adoption of novel products. There has, however, been concerns in recent years that financial interests have led to vociferous advertisement and early adoption of relatively untested products, culminating in a plea that “truth not product should drive progress” in orthodontics . This situation is not unique to orthodontics with an acceptance that clinical judgments relating to selection of medical pharmacological agents may be affected by inducements and financial motives [2, 3].
In order to mitigate the misleading effects of the fevered promotion of apparently unique products by commercial interests, clinical decisions should where possible be evidence-based. Ideally, the latter should be founded upon patient wishes and professional experience, allied to the assurance offered by best available evidence. While dentistry and orthodontics lagged behind pioneering medical specialties, evidence-based orthodontics is now firmly recognized . In 2015, for example, there were 89 dental journals and eight orthodontic journals with an impact factor, with 596 citable papers published in these orthodontic journals alone, and the past decade has seen significant increases in the quantity of systematic reviews in orthodontics with 157 published between 2000 and 2014, although the yield from many of these has been limited .
Within this evidence-based approach, clinical trials which incorporate random allocation of participants to treatment groups are considered optimal to allow evaluation of the comparative effectiveness of interventions. However, clinical trials are expensive to undertake, are time-consuming and are demanding in terms of evaluation and follow-up. As such, while the relative frequency of clinical trials has increased in orthodontics, it is known that systematic reviews comparing the effectiveness of interventions almost invariably cite a lack of primary studies, particularly those of high quality, with a mean of just four clinical trials included in orthodontic meta-analyses . Moreover, the spotlight has been placed on deficient conduct and reporting of biomedical research in the recent years . In addition, meta-epidemiological research in orthodontics has indicated that inadequate randomization procedures, blinding and handling of missing data are pervasive within clinical trials .
However, in view of the marketing of orthodontic products and the lack of need for clinical evidence prior to advertisement and clinical adoption of novel orthodontic products, a further potential problem is the costly and avoidable focus of orthodontic trials on the evaluation of established, marketed products. This study therefore aims to assess the prevalence of clinical trials in orthodontics evaluating commercially marketed products. A further aim is to evaluate the direction of the results of these studies and whether these are affected by industry sponsorship.
Electronic searching of a single database (PubMed) was undertaken in 15th February 2017. The term “orthodontics” was searched using PubMed filters. All English language randomized controlled trials (RCTs) in orthodontics over a 5-year period (1 January 2012 to 31 December 2016) were considered for inclusion. Based on the Cochrane criteria for the selection of RCTs, studies were screened for eligibility using the following eligibility criteria: human participants, interventions related to healthcare, experimental studies, presence of a control group and randomization of participants to control and treatment groups. Studies described in the title or abstract as “prospective”, “comparative”, or “efficacy” were further analysed to determine if randomization of participants was undertaken. Conference abstracts and laboratory-based randomized trials involving extracted human teeth were excluded. A single author (JS) screened potentially relevant articles.
All data were extracted using a pre-specified data collection sheet with specific coding of items. Data obtained from each study included the date of publication, journal, region of authorship (1 = Europe, 2 = America, 3 = other), number of authors, type and justification of marketed intervention, direction of intervention effect (1 = positive effect compared to control, 2 = negative effect compared to control, 3 = no difference detected between interventions or between intervention and untreated control) and declaration of both any industry sponsorship (1 = industry funded and declared, 2 = no industry sponsorship to declare, 3 = not clearly declared) and conflict of interest (1 = conflicts exist and declared, 2 = no conflicts to declare, 3 = not clearly declared).
Descriptive statistics including means were used to report the study outcomes. Cross-tabulation between individual RCTs and marketed and non-marketed products reported direction of effect and declaration of industry sponsorship, and conflict of interest was undertaken using the chi-square test or Fisher’s exact t test as appropriate. The level of statistical significance for all tests was pre-specified at 0.05. Statistical analyses were performed with STATA® version 14.2 software (Stata Corporation, College Station, TX, USA).
Initial screening yielded 362 potentially relevant articles. Based on availability of the papers and the eligibility criteria, 278 results were excluded. In total, 84 RCTs published in 23 scientific journals were therefore included in this study (Fig. 1).
In terms of order of prevalence of RCTs within specific journals, the highest percentage were published in the American Journal of Orthodontics and Dentofacial Orthopedics (AJO-DO) (23.8%), followed by the European Journal of Orthodontics (EJO) (14.3%), Journal of Orthodontics (JO) (10.7%) and Angle Orthodontist (AO) (10.7%) (Table 1). The frequency of publication of RCTs per year was 2015 (27.4%), 2013 (23.8%), 2012 (22.6%), 2014 (19.0%) and 2016 (7.2%). The mean number of authors was 5.1 (SD 2.6, range 1–14). The majority of RCTs were conducted in Europe (48.1%), followed by non-American and European countries (33.3%) and American (17.9%).
Overall, 45% (38/84) of clinical trials assessed involved analysis of marketed products after their introduction. The remaining trials (46/84) assessed non-clinical interventions and non-marketed products such as growth modification and removable appliances, closing loops and archwires. Interventions to improve oral health and to circumvent risks of treatment, such as the treatment of post-orthodontic white spot lesions (15.8%), were most commonly assessed, with trials also frequently involving assessment of non-surgical adjuncts (14.1%) and orthodontic auxiliaries (13.1%). The most commonly cited justifications for the intervention under investigation were to promote treatment efficiency (33.3%), to reduce iatrogenic effects (20.2%) and to reduce pain experience during treatment (16.7%). In over 50% RCTs, a positive effect of the intervention was reported. Industry sponsorship of the research was declared in 9.5% RCTs. However, in a third (33.3%) of RCTs, whether industry sponsorship was involved is not clearly stated. The absence of a conflict of interest was clearly stated in 50%, while in 46.4%, whether a conflict of interest existed was not outlined (Table 2). For individual RCTs, no significant associations between the direction of the intervention effect and both declaration of industry sponsorship (p = 0.56) and conflict of interest (p = 0.96) were detected. Similarly, for marketed and non-marketed products, no significant associations for both declaration of industry sponsorship (p = 0.44) and conflict of interest (p = 0.28) were found.
The present meta-epidemiological study highlights that almost half of orthodontic trials involve clinical evaluation of the relative merits of marketed products. Many of these do not confirm the effectiveness of these interventions, with almost 44% reporting no improvement related to the product. While these findings do not detract from the centrality of developing novel interventions in enhancing and streamlining orthodontics, it does suggest that there may be a disconnect between the marketing and clinical outcomes. This also highlights the potential merit in incorporating independent clinical research earlier in the research and development process .
A relatively high percentage of contemporary clinical trials (one third) focused on techniques to hasten orthodontic treatment—a zeitgeist in contemporary practice. These include both and non-surgical adjuncts with these thus far offering limited, largely equivocal results. Moreover, little difference in the rate of tooth movement with both surgical approaches and non-surgical approaches has been highlighted in recent systematic reviews—the latter encompassing vibratory stimulation, use of masticatory adjuncts and light-mediated aids [9, 10]. Despite the relatively high number of primary studies identified in the present review, these systematic reviews have bemoaned a lack of high-quality evidence within these areas suggesting that further research may still be required. The onus remains, therefore, on undertaking clinical trials with low risk of bias and focusing on consistent and relevant outcomes . Furthermore, non-surgical adjuncts have associated cost and often rely on patient compliance. There is also evidence that surgical adjuncts may lead to anxiety and potentially hamper experiences of treatment .
A considerable percentage of studies involved assessment of interventions to reduce pain during orthodontics and other harms associated with treatment. This focus is encouraging as these outcomes are likely to resonate both with patients and professionals with pain known to represent a common reason for avoidance and indeed abandonment of orthodontic treatment . Novel approaches evaluated include both pharmacological and novel non-pharmacological agents with increasing emphasis on the latter, although evidence in support of a range of non-pharmacological agents, including vibratory stimulation and masticatory adjuncts, in reducing subjective pain experience is limited .
Overall, the findings from the present review place existing practices in terms of the licensing and marketing of orthodontic devices and products into focus. In particular, it is accepted that clinical evidence evaluating the relative merits of a clinical technique follow its introduction. As such, the licensing of these techniques does not hinge on the existence of this supporting clinical data. Historically, the potential pitfalls associated with this approach were exemplified by the re-introduction of self-ligating brackets. This was accompanied by positive and indeed compelling marketing, which was given credence by the findings from early non-randomized studies [15, 16]. However, these observations were contradicted by more robust randomized studies, which consistently failed to corroborate either the manufacturers’ claims or the findings from earlier research [17, 18]. This situation is typical of differences in research design  and was aggravated by the subsequent refinement of bracket sub-types, including introduction of updated versions, meaning that by the time potentially influential research was published, obsolete products were being reported on. As such, clinical research should be encouraged at an earlier stage during orthodontic product development to mitigate against this time lag and to provide a meaningful and contemporary clinical underpinning.
There is no doubt that industry has facilitated the refinement of orthodontic practices and experiences with relatively recent advancements including the advent of fully customized labial and lingual systems, as well as very meaningful change in appliance aesthetics . Many of these improvements are clear and do not necessarily require supporting evidence; however, claims in relation to reduced treatment times and lower requirement for extractions, for example, both require clinical evidence. In the absence of evidence in this respect, advertising claims may be misleading both to clinicians and patients, as evidenced in the medical literature [21, 22], particularly when marketed directly to the latter. As such, it is important for both that this is sought at an early juncture but also that advertising claims are modified and, where necessary, moderated in response to emerging clinic evidence. Enforcement of the latter could certainly be undertaken in advertisements appearing in dental publications and at dental conferences. Indeed, an analysis of advertisements in orthodontic journals over a 2-year period (2012–2013) highlighted that many of the claims made are not evidence-based with one quarter of these citing unpublished research . Moreover, given the recent emphasis on poor yield from biomedical research , it is important to highlight that there is an academic cost attached to clinical evaluation of marketed products after their development, with the research itself being costly and time-consuming. In addition, this approach has the potential to stymie researchers from themselves undertaking original research and development, while focusing on secondary evaluation. As such, proving the clinical effectiveness of a product or in some cases debunking false marketing claims may have negative implications on the overall trajectory of orthodontic research. This is particularly important at present in view of the high proportion of dental research that is devoid of patient-centred outcomes, potentially further diluting the benefit and relevance of clinical research . At a time when academic research funding is constrained, funding of independent academics by industry may therefore be encouraged to mitigate this; examples of this are beginning to emerge . Notwithstanding this, it is important that these funded studies are undertaken and reported independently; meta-epidemiological findings from restorative dentistry suggest that best practice is being followed in this respect at present .
The present study was restricted to clinical trials, in isolation. Moreover, relatively few clinical trials were identified; however, we did obtain a sample over a 5-year period. It is therefore likely representative of contemporary research practice. Further analysis could be undertaken in time; however, unless changes are made in relation to regulatory requirements or orthodontic companies make a decision to embrace independent clinical research at an earlier stage, it is likely that the status quo will continue to apply.
Overall, 45% (38/84) of orthodontic trials over the past 5 years have involved analysis of marketed products after their introduction. Many of these have focused on techniques to accelerate tooth movement and to reduce both orthodontic pain and other side effects. The results highlight a potential source of waste in orthodontic research emanating from existing approaches to licensing and marketing of orthodontic products.
Peck S. So what’s new? Arch expansion, again. Angle Orthod. 2008;78:574–5. doi:10.2319/0003-3219-78.3.574.
Giannakakis IA, Ioannidis JP. Arabian nights1001 tales of how pharmaceutical companies cater to the material needs of doctors: case report. BMJ. 2000;321:1563e4.
Charatan F. Doctors say they are not influenced by drug companies’ promotions. BMJ. 2001;322(7294):1081.
Sackett DL, Haynes RB, Tugwell P. Clinical epidemiology: a basic science for clinical medicine. Boston: Little, Brown and Company; 1985.
Koletsi D, Fleming PS, Eliades T, Pandis N. The evidence from systematic reviews and meta-analyses published in orthodontic literature. Where do we stand? Eur J Orthod. 2015;37:603–9. doi:10.1093/ejo/cju087.
Glasziou P, Altman DG, Bossuyt P, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383:267–76. doi:10.1016/S0140-6736(13)62228-X.
Lempesi E, Koletsi D, Fleming PS, Pandis N. The reporting quality of randomised controlled trials in orthodontics. J Evid Based Dent Pract. 2014;14:46–52.
Powell WW, Jason O-S. “Universities as creators and retailers of intellectual property: life-sciences research and commercial development.” To profit or not to profit: the commercial transformation of the nonprofit sector. 1998. p. 169–93.
Fleming PS, Fedorowicz Z, Johal A, El-Angbawi A, Pandis N. Surgical adjunctive procedures for accelerating orthodontic treatment. Cochrane Database Syst Rev. 2015;6:CD010572.
El-Angbawi A, McIntyre GT, Fleming PS, Bearn DR. Non-surgical adjunctive interventions for accelerating tooth movement in patients undergoing fixed orthodontic treatment. Cochrane Database Syst Rev. 2015;11:CD010887.
Tsichlaki A, O’Brien K. Do orthodontic research outcomes reflect patient values? A systematic review of randomized controlled trials involving children. Am J Orthod Dentofacial Orthop. 2014;146:279–85.
Uribe F, Padala S, Allareddy V, Nanda R. Patients’, parents’, and orthodontists’ perceptions of the need for and costs of additional procedures to reduce treatment time. Am J Orthod Dentofacial Orthop. 2014;145:S65–73.
Lew K. Attitudes and perceptions of adults towards orthodontic treatment in an Asian community. Community Dent Oral Epidemiol. 1993;21:31–5.
Fleming PS, Strydom H, Katsaros C, MacDonald L, Curatolo M, Fudalej P, Pandis N. Non-pharmacological interventions for alleviating pain during orthodontic treatment. Cochrane Database Syst Rev. 2016;12:CD010263.
Eberting JJ, Straja SR, Tuncay OC. Treatment time, outcome, and patient satisfaction comparisons of Damon and conventional brackets. Clin Orthod Res. 2001;4:228–34.
Harradine NW. Self-ligating brackets and treatment efficiency. Clin Orthod Res. 2001;4:220–7.
Scott P, DiBiase AT, Sherriff M, Cobourne MT. Alignment efficiency of Damon3 self-ligating and conventional orthodontic bracket systems: a randomized clinical trial. Am J Orthod Dentofacial Orthop. 2008;134:470.e1–8.
Miles PG. Self-ligating vs conventional twin brackets during en-masse space closure with sliding mechanics. Am J Orthod Dentofacial Orthop. 2007;132:223–5.
Vandenbroucke JP. Why do the results of randomised and observational studies differ? BMJ. 2011;343:7020.
Banks P, Elton V, Jones Y, Rice P, Derwent S, Odondi LO. The use of fixed appliances in the UK: a survey of specialist orthodontists. J Orthod. 2010;37:43–55.
Van den Bulte C, Lilien GL. Medical innovation revisited: social contagion versus marketing effort 1. Am J Sociol. 2001;106:1409–35.
Relman AS. Separating continuing medical education from pharmaceutical marketing. JAMA. 2001;285:2009–12.
Livas C, Kouskoura T, Ren Y, Katsaros C, Pandis N. Are claims made in orthodontic journal advertisements evidence-supported? Angle Orthod. 2015;85:184–8.
Fleming PS, Koletsi D, O’Brien K, Tsichlaki A, Pandis N. Are dental researchers asking patient-important questions? A scoping review. J Dent. 2016;49:9–13.
https://learn.invisalign.com/internationalresearch. Accessed 22 Mar 2017.
Schwendicke F, Tu YK, Blunck U, Paris S, Göstemeyer G. Effect of industry sponsorship on dental restorative trials. J Dent Res. 2016;95:9–16.
JS collected the data. JS, PSF and NP interpreted the data. JS, PSF and NP designed the study, analysed the data and drafted the article. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Seehra, J., Pandis, N. & Fleming, P.S. Clinical evaluation of marketed orthodontic products: are researchers behind the times? A meta-epidemiological study. Prog Orthod. 18, 14 (2017). https://doi.org/10.1186/s40510-017-0168-y