Randomized controlled trials in pediatric surgery: could we do better? Quality of reporting internal and external validity data from randomized controlled trials evaluating stents for percutaneous coronary intervention. The quality of reporting of randomized controlled trials in solid organ transplantation. Evolution of the randomized controlled trial in oncology over three decades. Imiquimod 5% cream monotherapy for cutaneous squamous cell carcinoma in situ (Bowen's disease): a randomized, double-blind, placebo-controlled trial. CONSORT adoption and quality of reporting of randomized controlled trials: a systematic analysis in two dermatology journals. Comparison of registered and published primary outcomes in randomized controlled trials. Results of a multicentre randomised controlled trial of statistical process control charts and structured diagnostic tools to reduce ward-acquired meticillin-resistant Staphylococcus aureus: the CHART Project. Secular changes in the quality of published randomized clinical trials in rheumatology.
Randomized controlled trials (RCTs) are accepted as the gold standard for assessing the effectiveness of clinical interventions but are rarely reported in pediatric surgery. Have RCTs submitted to the British Association of Paediatric Surgeons (BAPS) Annual Congress during the last 5 years been adequately designed and large enough to produce a valid result?
                Abstracts accepted by the Annual BAPS Congress meetings between 1996 and 2000 were examined in collaboration with a senior health services researcher. The quality of the design, methodology, statistical analysis and conclusions, and the adequacy of the sample size were assessed for all identifiable clinical RCTs.
                From 760 accepted abstracts, there were only 9 RCTs (1%) of clinical interventions. In only 4 trials was the relevant primary end-point specified at the outset of the study, and none documented the method of randomization. Only one abstract mentioned blinding with respect to the intervention or outcome measure. Sample sizes were inadequate to detect even large clinical differences. To date, only one of these RCTs has been published in an English-language, peer-reviewed journal.
                Clear guidelines exist for the conduct of RCTs, yet compliance with these standards was rarely documented in abstracts of pediatric surgical RCTs presented at BAPS. Sample sizes were inadequate. RCTs in pediatric surgery are difficult to perform, but the specialty would benefit from well-designed, carefully conducted, multicentre, clinical RCTs to advance evidence-based practice.
                Copyright 2003, Elsevier Science (USA). All rights reserved. Stents are commonly used to treat patients with coronary artery disease. However, the quality of reporting internal and external validity data in published reports of randomised controlled trials (RCTs) of stents has never been assessed.The objective of our study was to evaluate the quality of reporting internal and external validity data in published reports of RCTs assessing the stents for percutaneous coronary interventions.
                A systematic literature review was conducted. Reports of RCTs assessing stents for percutaneous coronary interventions indexed in MEDLINE and the Cochrane Central Register of Controlled Trials and published between January 2003 and September 2008 were selected. A standardized abstraction form was used to extract data. All analyses were adjusted for the effect of clustering articles by journal.
                132 articles were analyzed. The generation of the allocation sequence was adequate in 58.3% of the reports; treatment allocation was concealed in 34.8%. Adequate blinding was reported in one-fifth of the reports. An intention-to-treat analysis was described in 79.5%. The main outcome was a surrogate angiographic endpoint in 47.0%. The volume of interventions per center was described in two reports. Operator expertise was described in five (3.8%) reports. The quality of reporting was better in journals with high impact factors and in journals endorsing the CONSORT statement.
                The current reporting of results of RCTs testing stents needs to be improved to allow readers to appraise the risk of bias and the applicability of the results. Randomized controlled trials (RCTs) of interventions provide the highest level of evidence about efficacy but their value either alone or within a meta-analysis is dependent on its methodological quality. For this reason recent RCTs in organ transplantation were assessed for quality. RCTs published between 2004 and 2006 (n = 332) were assessed, after excluding duplicate and nonEnglish reports. Quality was evaluated using the Jadad score plus allocation concealment and intention to treat analysis. We noted journal type, journal author instructions, funding source, sample size and number and location of study centres. Around one-third of RCTs had a Jadad score of 3 or greater (indication of a methodologically good quality trial) and the other two parameters were satisfied in just over one third. Although the majority of trials were published in speciality journals the quality of those published in general journals was superior. Commercially sponsored trials were of better quality as were multicentre trials in contrast to single centre trials. Overall quality of reporting of RCTs in organ transplantation is poor and as RCTs provide the highest level of evidence in evaluations of interventions there needs to be a concerted effort within the transplant community to improve the standards of RCTs. The randomized controlled trial (RCT) is the gold standard for establishing new therapies in clinical oncology. Here we document changes with time in design, sponsorship, and outcomes of oncology RCTs.
                Reports of RCTs evaluating systemic therapy for breast, colorectal (CRC), and non-small-cell lung cancer (NSCLC) published 1975 to 2004 in six major journals were reviewed. Two authors abstracted data regarding trial design, results, and conclusions. Conclusions of authors were graded using a 7-point Likert scale. For each study the effect size for the primary end point was converted to a summary measure.
                A total of 321 eligible RCTs were included (48% breast, 24% CRC, 28% NSCLC). Over time, the number and size of RCTs increased considerably. For-profit/mixed sponsorship increased substantially during the study period (4% to 57%; P < .001). There was increasing use of time-to-event measures (39% to 78%) and decreasing use of response rate (54% to 14%) as primary end point (P < .001). Effect size remained stable over the study period. Authors have become more likely to strongly endorse the experimental arm (P = .017). A significant P value for the primary end point and industry sponsorship were each independently associated with endorsement of the experimental agent (odds ratio [OR] = 19.6, 95% CI, 8.9 to 43.1, and OR = 3.5, 95% CI, 1.6 to 7.5, respectively).
                RCTs in oncology have become larger and are more likely to be sponsored by industry. Authors of modern RCTs are more likely to strongly endorse novel therapies. For-profit sponsorship and statistically significant results are independently associated with endorsement of the experimental arm. We conducted a double-blind, placebo-controlled, randomized trial to evaluate the preliminary efficacy and safety of imiquimod 5% cream treatment for cutaneous squamous cell carcinoma (SCC) in situ.
                In all, 31 patients with biopsy-proven cutaneous SCC in situ were randomly assigned to placebo (vehicle) (n = 16) or imiquimod 5% cream (n = 15) daily for 16 weeks. Patients were assessed at week 28 for the primary end point, resolution of cutaneous SCC in situ.
                Of the 31 patients enrolled, 3 dropped out. Intention-to-treat analysis revealed 11 of the 15 patients (73%) in the imiquimod group achieved resolution of cutaneous SCC in situ, with no relapse during the 9-month follow-up period; none in the placebo group achieved resolution (P < .001). Imiquimod 5% cream was generally well tolerated and there were no serious adverse events.
                Topical imiquimod 5% cream has proven to be an effective treatment for cutaneous SCC in situ. However, studies to define the ideal dosing regimen and cost-effectiveness are required before it can be accepted as a recognized therapy.
                In this controlled trial, patients with cutaneous SCC in situ receiving topical imiquimod 5% cream as monotherapy experienced a high degree of clinical benefit compared with placebo. CONSORT (Consolidated Standards for Reporting Trials) guidelines were constructed to ensure optimal reporting quality of randomized controlled trials (RCTs).
                To determine the effect of the adoption of CONSORT on the reporting quality of RCTs, we performed a systematic evaluation of RCTs published in two dermatology journals pre- and post-CONSORT adoption.
                The journals selected for the study were the Journal of the American Academy of Dermatology and the British Journal of Dermatology. We selected RCTs published in 1997 and 2006 using both Medline and hand searching. The following critical CONSORT criteria were recorded: sample size, type of disease studied, type of control, single-centre or multicentre study, type of funding, blinding, methods and type of randomization, definition of a primary endpoint, justification for sample size selection and power calculation, population for analysis, and adequacy of group comparison. A multivariable analysis was conducted to determine factors associated with optimal reporting quality.
                In total, 98 studies were included. Improvement in reporting quality was evident for the specification of the randomization method (20% in 1997 vs. 45% in 2006, P < 0.01) and for the justification of sample size (22% in 1997 vs. 43% in 2006, P = 0.027). The percentage of studies with optimal reporting quality increased from 11% in 1997 to 28% in 2006 (P = 0.03). Factors significantly associated with a good methodological quality were pharmaceutical industry funding and publication in 2006 vs. 1997.
                There is a need to improve the reporting quality of RCTs published in dermatology journals. As of 2005, the International Committee of Medical Journal Editors required investigators to register their trials prior to participant enrollment as a precondition for publishing the trial's findings in member journals.
                To assess the proportion of registered trials with results recently published in journals with high impact factors; to compare the primary outcomes specified in trial registries with those reported in the published articles; and to determine whether primary outcome reporting bias favored significant outcomes.
                MEDLINE via PubMed was searched for reports of randomized controlled trials (RCTs) in 3 medical areas (cardiology, rheumatology, and gastroenterology) indexed in 2008 in the 10 general medical journals and specialty journals with the highest impact factors.
                For each included article, we obtained the trial registration information using a standardized data extraction form.
                Of the 323 included trials, 147 (45.5%) were adequately registered (ie, registered before the end of the trial, with the primary outcome clearly specified). Trial registration was lacking for 89 published reports (27.6%), 45 trials (13.9%) were registered after the completion of the study, 39 (12%) were registered with no or an unclear description of the primary outcome, and 3 (0.9%) were registered after the completion of the study and had an unclear description of the primary outcome. Among articles with trials adequately registered, 31% (46 of 147) showed some evidence of discrepancies between the outcomes registered and the outcomes published. The influence of these discrepancies could be assessed in only half of them and in these statistically significant results were favored in 82.6% (19 of 23).
                Comparison of the primary outcomes of RCTs registered with their subsequent publication indicated that selective outcome reporting is prevalent. Statistical process control (SPC) charts have previously been advocated for infection control quality improvement. To determine their effectiveness, a multicentre randomised controlled trial was undertaken to explore whether monthly SPC feedback from infection control nurses (ICNs) to healthcare workers of ward-acquired meticillin-resistant Staphylococcus aureus (WA-MRSA) colonisation or infection rates would produce any reductions in incidence. Seventy-five wards in 24 hospitals in the UK were randomised into three arms: (1) wards receiving SPC chart feedback; (2) wards receiving SPC chart feedback in conjunction with structured diagnostic tools; and (3) control wards receiving neither type of feedback. Twenty-five months of pre-intervention WA-MRSA data were compared with 24 months of post-intervention data. Statistically significant and sustained decreases in WA-MRSA rates were identified in all three arms (P<0.001; P=0.015; P<0.001). The mean percentage reduction was 32.3% for wards receiving SPC feedback, 19.6% for wards receiving SPC and diagnostic feedback, and 23.1% for control wards, but with no significant difference between the control and intervention arms (P=0.23). There were significantly more post-intervention 'out-of-control' episodes (P=0.021) in the control arm (averages of 0.60, 0.28, and 0.28 for Control, SPC and SPC+Tools wards, respectively). Participants identified SPC charts as an effective communication tool and valuable for disseminating WA-MRSA data. To assess the quality of published randomized clinical trials (RCTs) in rheumatology and to determine whether there has been improvement in quality between 2 time periods, 1987-1988 and 1997-1998.
                Using MEDLINE and a hand search of selected rheumatology journals, we identified RCTs of adult rheumatic diseases published in English in 1987-1988 or 1997-1998. We examined trial quality with an expanded version of the Jadad scale, which assesses the adequacy of reported random sequence generation, allocation concealment, blinding, and analysis. All trials were read by 1 reviewer, with prior standardization using a random sample read by 2 reviewers. We also evaluated "high"- versus "low"-impact journals based on citation index.
                Two hundred forty RCTs (1987-1988 119 RCTs, 1997-1998 121 RCTs) were assessed. Results showed improvement in the quality of the trials, but the rates of reported random sequence generation, allocation concealment, power, and intent-to-treat analyses were persistently low. Low rates of reports of random sequence generation, allocation concealment, and intent-to-treat analyses were present even in the high-impact journals.
                There has been improvement in the quality of reporting of RCTs in rheumatology between 1987-1988 and 1997-1998. However, methodologic problems such as lack of allocation concealment, inadequate random sequence generation, lack of reporting of power, and lack of intent-to-treat analyses remain common. Many of these problems are established sources of bias in RCTs and are easily rectifiable.
Little evidence from RCTs comparing the efficacy of different interventions for primary cutaneous SCCs exists. There is a clear need for well-designed randomised studies in order to improve the evidence base for the management of this condition.