Prevalence study of the randomized controlled trials in the Journal of Intellectual Disability Research: 1957-1994. Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. Examination of the analytic quality of behavioral health randomized clinical trials. A randomised controlled trial of the outcome of health assessment of people aged 75 years and over. An investigation of the adequacy of MEDLINE searches for randomized controlled trials (RCTs) of the effects of mental health care. Quality of reporting of randomized controlled trials in general endocrinology literature. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Randomized controlled trials in pediatric surgery: could we do better? Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials.
Systematic reviews of care are increasingly potent guides to clinical practice, and it is important that all relevant randomized controlled trials (RCTs) are identified by those within the speciality of learning disability who produce such works. All RCTs in the Journal of Intellectual Disability Research and its predecessor were identified by hand-searching (1957-1994), and the frequency, origin, intervention and quality of reporting of randomization were described. Electronic searches for the trials were undertaken for the years 1974-1994, and the quality of indexing was inspected and tested. These electronic searches were then compared to a 'gold standard' search. Fifty-six RCTs were identified. None contained the world 'randomized' in the title and only nine mentioned it in the abstract. Out of the 37 RCTs published between 1974 and 1994, 36 are in PsycLIT and 37 in MEDLINE. One MEDLINE record contained the wrong abstract. The methodological phrases used in the electronic records were poor, and thus, the precision of electronic searches, using both databases, was low. This international journal contains many relevant RCTs from around the world, involving several types of interventions. Unfortunately, these trials cannot be readily accessed electronically using methodological phrases designed to find RCTs. Improved quality of indexing would facilitate identification of RCTs and their dissemination. Cumulative meta-analysis of clinical trials (a Bayesian interpretation for accumulating evidence) will profoundly affect medical care by summarizing evidence in the assessment of technology innovations. Application of the technique to the randomized control trials (RCTs) of streptokinase treatment of acute myocardial infarction, reduction of peri-operative mortality by antibiotic prophylaxis, and prevention of death from bleeding peptic ulcers has revealed efficacy years before it was suspected by any other means. Arrangement of the trials according to event rate in the controls, effect sizes, quality of the trials or according to covariables of interest has supplied unique information. If carried out prospectively the technique supplies invaluable information regarding indications for another trial, the number of patients necessary to determine the validity of past trends, and the type of patients who might be benefitted. Careful examination in a cumulative manner of the prior trials can reduce the need for future large trials. Adoption of evidence-based practice (EBP) policy has implications for clinicians and researchers alike. In fields that have already adopted EBP, evidence-based practice guidelines derive from systematic reviews of research evidence. Ultimately, such guidelines serve as tools used by practitioners. Systematic reviews of treatment efficacy and effectiveness reserve their strongest endorsements for treatments that are supported by high-quality randomized clinical trials (RCTs). It is unknown how well RCTs reported in behavioral science journals fare compared to quality standards set forth in fields that pioneered the evidence-based movement. We compared analytic quality features of all behavioral health RCTs (n = 73) published in three leading behavioral journals and two leading medical journals between January 2000 and July 2003. A behavioral health trial was operationalized as one employing a behavioral treatment modality to prevent or treat an acute or chronic physical disease or condition. Findings revealed areas of weakness in analytic aspects of the behavioral health RCTs reported in both sets of journals. Weaknesses were more pronounced in behavioral journals. The authors offer recommendations for improving the analytic quality of behavioral health RCTs to ensure that evidence about behavioral treatments is highly weighted in systematic reviews.
                (c) 2006 Wiley Periodicals, Inc. To measure the outcomes of a health assessment, conducted by a nurse, of people aged 75 years and older (75+HA) living independently in their own homes.
                Randomised controlled trial (RCT).
                A convenience sample of six general practices within the Adelaide Western Division of General Practice (AWDGP). A random sample of 100 participants was drawn from practice age-sex registers. Data were collected in initial visits between 1 August 1998 and February 1999, then in follow-up visits one year later.
                Participants were aged 75 years and over on 1 August 1998 and living independently in the community. 145 eligible patients were invited to join the study, and 100 of these consented to enrol (69%).
                A 75+HA conducted in the participant's home by a nurse and reported to their usual general practitioner.
                Primary: number of problems in each group; number of participants with problems; and mortality. Secondary: physical function; psychological (including cognitive) function; falls; and admission to institution.
                There were no significant differences between the control and intervention groups at follow-up in the number of problems, the number of participants with problems, or mortality. In the intervention group, there was significant improvement in self-rated health, geriatric depression score (GDS 15), and number of falls.
                This RCT has not demonstrated improvement in health status of the intervention group which received a 75+HA compared with a control group left to usual care. Valid reviews of the effects of mental health care depend on identifying as high a proportion as possible of relevant randomized controlled trials (RCTs). To investigate the sensitivity and precision both of MEDLINE and of hand-searching for RCTs in mental health, 12 journals specializing in mental health and indexed by the National Library of Medicine (NLM) for MEDLINE were searched for the years 1971, 1976, 1981, 1986 and 1991. The sensitivity of the hand-search was 94% (95% Confidence Interval (CI) 93-95%), but it had a precision of only 7% (CI 6-8%). The optimal MEDLINE search had a sensitivity of only 52% (CI 48-56%) and a precision of 59% (CI 55-63%). Of the reports of RCTs identified by the hand-search, 9% (CI 7-11%) were not included in MEDLINE at all. Authors had included methodological descriptions in 84% (CI 80-88%) of RCTs found by the hand-search but missed by the MEDLINE search. Systematic reviews of mental health care which are based solely on MEDLINE searches of the literature will miss a large proportion of the relevant RCTs, and are thus liable to random error and bias. A register of mental health RCTs is urgently required. The reporting quality of randomized controlled trials (RCTs) is poor in general medicine and several areas of specialization but unknown in endocrinology.
                Our aim was to assess the reporting quality of RCTs in general endocrinology. A secondary objective was to identify predictors for better reporting quality.
                We systematically reviewed RCTs published in three general endocrinology journals between January 2005 and December 2006.
                We included parallel-design RCTs that addressed a question of treatment or prevention. Article selection and data abstraction were conducted by two reviewers independently, and disagreements were resolved by consensus.
                There were two main outcomes: 1) a 15-point overall reporting quality score (OQS) based on the Consolidated Standards for Reporting Trials (CONSORT); and 2) a 3-point key score, based on allocation concealment, blinding, and use of intention-to-treat analysis.
                Eighty nine RCTs were included. The median OQS was 10 (interquartile range = 2). Allocation concealment, blinding, and analysis by intention to treat were reported in 10, 20, and 16 of the 89 RCTs, respectively. A multivariable regression analysis showed that complete industrial funding [incidence rate ratio (IRR) = 1.014; 95% confidence interval (CI), 1.010-1.018], journal of publication (IRR = 1.068; 95% CI, 1.007-1.132), and sample size (IRR = 1.048; 95% CI, 1.026-1.070) were significantly associated with a slightly better OQS.
                The quality of RCT reporting in general endocrine literature is suboptimal. We discuss our results, highlight the areas where improvements are needed, and provide some recommendations. Few meta-analyses of randomised trials assess the quality of the studies included. Yet there is increasing evidence that trial quality can affect estimates of intervention efficacy. We investigated whether different methods of quality assessment provide different estimates of intervention efficacy evaluated in randomised controlled trials (RCTs).
                We randomly selected 11 meta-analyses that involved 127 RCTs on the efficacy of interventions used for circulatory and digestive diseases, mental health, and pregnancy and childbirth. We replicated all the meta-analyses using published data from the primary studies. The quality of reporting of all 127 clinical trials was assessed by means of component and scale approaches. To explore the effects of quality on the quantitative results, we examined the effects of different methods of incorporating quality scores (sensitivity analysis and quality weights) on the results of the meta-analyses.
                The quality of trials was low. Masked assessments provided significantly higher scores than unmasked assessments (mean 2.74 [SD 1.10] vs 2.55 [1.20]). Low-quality trials (score < or = 2), compared with high-quality trials (score > 2), were associated with an increased estimate of benefit of 34% (ratio of odds ratios [ROR] 0.66 [95% CI 0.52-0.83]). Trials that used inadequate allocation concealment, compared with those that used adequate methods, were also associated with an increased estimate of benefit (37%; ROR=0.63 [0.45-0.88]). The average treatment benefit was 39% (odds ratio [OR] 0.61 [0.57-0.65]) for all trials, 52% (OR 0.48 [0.43-0.54]) for low-quality trials, and 29% (OR 0.71 [0.65-0.77]) for high-quality trials. Use of all the trial scores as quality weights reduced the effects to 35% (OR 0.65 [0.59-0.71]) and resulted in the least statistical heterogeneity.
                Studies of low methodological quality in which the estimate of quality is incorporated into the meta-analyses can alter the interpretation of the benefit of intervention, whether a scale or component approach is used in the assessment of trial quality. Randomized controlled trials (RCTs) are accepted as the gold standard for assessing the effectiveness of clinical interventions but are rarely reported in pediatric surgery. Have RCTs submitted to the British Association of Paediatric Surgeons (BAPS) Annual Congress during the last 5 years been adequately designed and large enough to produce a valid result?
                Abstracts accepted by the Annual BAPS Congress meetings between 1996 and 2000 were examined in collaboration with a senior health services researcher. The quality of the design, methodology, statistical analysis and conclusions, and the adequacy of the sample size were assessed for all identifiable clinical RCTs.
                From 760 accepted abstracts, there were only 9 RCTs (1%) of clinical interventions. In only 4 trials was the relevant primary end-point specified at the outset of the study, and none documented the method of randomization. Only one abstract mentioned blinding with respect to the intervention or outcome measure. Sample sizes were inadequate to detect even large clinical differences. To date, only one of these RCTs has been published in an English-language, peer-reviewed journal.
                Clear guidelines exist for the conduct of RCTs, yet compliance with these standards was rarely documented in abstracts of pediatric surgical RCTs presented at BAPS. Sample sizes were inadequate. RCTs in pediatric surgery are difficult to perform, but the specialty would benefit from well-designed, carefully conducted, multicentre, clinical RCTs to advance evidence-based practice.
                Copyright 2003, Elsevier Science (USA). All rights reserved. Specific features of trial quality may be associated with exaggeration or shrinking of the observed treatment effect in randomized studies. Therefore, assessment of trial quality is often used in meta-analysis. However, the degree to which specific quality measures are associated with treatment effects has not been well established across a broad range of clinical areas.
                To determine if quality measures are associated with treatment effect size in randomized controlled trials (RCTs).
                Quality measures from published quality assessment scales were evaluated in RCTs included in meta-analyses from 4 medical areas (cardiovascular disease, infectious disease, pediatrics, and surgery). Included meta-analyses incorporated at least 6 RCTs, examined dichotomous outcomes, and demonstrated significant between-study heterogeneity in the odds ratio (OR) scale.
                Relative ORs comparing overall treatment effect (summary OR) of high vs low-quality studies, as determined by each quality measure, with relative ORs less than 1 indicating larger treatment effect in low-quality studies.
                Twenty-four quality measures were analyzed for 276 RCTs from 26 meta-analyses. Relative ORs of high vs low-quality studies for these quality measures ranged from 0.83 to 1.26; none was statistically significantly associated with treatment effect. The proportion of studies fulfilling specific quality measures varied widely in the 4 medical areas. In analyses limited to specific medical areas, placebo control, multicenter studies, study country, caregiver blinding, and statistical methods were significantly associated with treatment effect on 7 occasions. These relative ORs ranged from 0.40 to 1.74. However, the directions of these associations were not consistent.
                Individual quality measures are not reliably associated with the strength of treatment effect across studies and medical areas. Although use of specific quality measures may be appropriate in specific well-defined areas in which there is pertinent evidence, findings of associations with treatment effect cannot be generalized to all clinical areas or meta-analyses.
As only three relevant RCTs were identified, we have limited capacity to compare the benefits and harms of medical interventions currently used for treating EE. Further RCTs on therapies for EE are required.