Publication bias and meta-analyses: a practical example. Exercise training intervention after coronary angioplasty: the ETICA trial. Effectiveness and efficiency of a literature search strategy to answer questions on the etiology of occupational diseases: a controlled trial. An outreach intervention to implement evidence based practice in residential care: a randomized controlled trial [ISRCTN67855475]. Effects of training on quality of peer review: randomised controlled trial. What should be included in meta-analyses? An exploration of methodological issues using the ISPOT meta-analyses. Do clinical guidelines introduced with practice based education improve care of asthmatic and diabetic patients? A randomised controlled trial in general practices in east London. Educational workshop improved information-seeking skills, knowledge, attitudes and the search outcome of hospital clinicians: a randomised controlled trial. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies.
Publication bias is widely appreciated, but considerable time and effort are needed to locate and obtain data from unpublished randomized controlled trials (RCTs), those published in non-English language journals or those reported in the gray literature; for this publication, we will call this collection of trials the "gray+literature." However, excluding such trials from systematic reviews could introduce bias and give rise to misleading conclusions.
                We aimed to explore and quantify the impact of inclusion of gray+ literature on the results of all completed individual patient data (IPD) reviews coordinated by our group (13 meta-analyses). For each IPD review, results were calculated for RCTs fully published in English language journals and RCTs fully published in English language journals and the gray+literature.
                The IPD meta-analyses based only on RCTs that were fully published in English language journals tended to give more favorable results than those that included RCTs from the gray+literature. Although in most cases the addition of gray+data gave less encouraging results, moving the estimated treatment effect toward a null result, the direction of effect was not always predictable.
                We recommend that all systematic reviews should at least attempt to identify trials reported in the gray+literature and, where possible, obtain data from them. The goal of this study was to determine the effects of exercise training (ET) on functional capacity and quality of life (QOL) in patients who received percutaneous transluminal coronary angioplasty (PTCA) or coronary stenting (CS), the effects on the restenosis rate and the outcome.
                It is unknown whether ET induces beneficial effects after coronary angioplasty.
                We studied 118 consecutive patients with coronary artery disease (mean age 57+/-10 years) who underwent PTCA or CS on one (69%) or two (31%) native epicardial coronary arteries. Patients were randomized into two matched groups. Group T (n = 59) was exercised three times a week for six months at 60% of peak VO2. Group C (n = 59) was the control group.
                Only trained patients had significant improvements in peak VO2 (26%, p < 0.001) and quality of life (26.8%, p = 0.001 vs. C). The angiographic restenosis rate was unaffected by ET (T: 29%; C: 33%, P = NS) and was not significantly different after PTCA or CS. However, residual diameter stenosis was lower in trained patients (-29.7%, p = 0.045). In patients with angiographic restenosis, thallium uptake improved only in group T (19%; p < 0.001). During the follow-up (33+/-7 months) trained patients had a significantly lower event rate than controls (11.9 vs. 32.2%, RR: 0.71, 95% confidence interval [CI]: 0.60 to 0.91, p = 0.008) and a lower rate of hospital readmission (18.6 vs. 46%, RR: 0.69, 95% CI: 0.55 to 0.93, p < 0.001).
                Moderate ET improves functional capacity and QOL after PTCA or CS. During the follow-up, trained patients had fewer events and a lower hospital readmission rate than controls, despite an unchanged restenosis rate. To evaluate the effectiveness and efficiency of a search strategy to find evidence-based answers to questions related to the possible occupational etiology of diseases.
                A controlled trial of 70 occupational health physicians and 55 insurance physicians who were asked to answer one out of four 'occupational disease case-vignettes' following the steps of evidence-based medicine (EBM). The intervention group were given the search strategy as a tool.
                The intervention group scored significantly better than the control group in answering the main question of the case-vignette correctly (57% versus 37%) using more adequate search terms. The intervention group scored significantly better regarding satisfaction with the applied search strategy (28% very satisfied versus 8%). We found no differences in time spent in solving the case or in the intention of future practice of EBM.
                The introduction and application of specific search strategies can have a positive effect on the effectiveness of searching literature. Future initiatives for developing and testing specific search strategies in the field of occupational health should be encouraged. The aim of this project was to assess whether outreach visits would improve the implementation of evidence based clinical practice in the area of falls reduction and stroke prevention in a residential care setting.
                Twenty facilities took part in a randomized controlled trial with a seven month follow-up period. Two outreach visits were delivered by a pharmacist. At the first a summary of the relevant evidence was provided and at the second detailed audit information was provided about fall rates, psychotropic drug prescribing and stroke risk reduction practices (BP monitoring, aspirin and warfarin use) for the facility relevant to the physician. The effect of the interventions was determined via pre- and post-intervention case note audit. Outcomes included change in percentage patients at risk of falling who fell in a three month period prior to follow-up and changes in use of psychotropic medications. Chi-square tests, independent samples t-test, and logistic regression were used in the analysis.
                Data were available from case notes at baseline (n = 897) and seven months follow-up (n = 902), 452 residential care staff were surveyed and 121 physicians were involved with 61 receiving outreach visits. Pre-and post-intervention data were available for 715 participants. There were no differences between the intervention and control groups for the three month fall rate. We were unable to detect statistically significant differences between groups for the psychotropic drug use of the patients before or after the intervention. The exception was significantly greater use of "as required" antipsychotics in the intervention group compared with the control group after the pharmacy intervention (RR = 4.95; 95%CI 1.69-14.50). There was no statistically significant difference between groups for the numbers of patients "at risk of stroke" on aspirin at follow-up.
                While the strategy was well received by the physicians involved, there was no change in prescribing patterns. Patient care in residential settings is complex and involves contributions from the patient's physician, family and residential care staff. The project highlights challenges of delivering evidence based care in a setting in which there is a paucity of well controlled trial evidence but where significant health outcomes can be attained. To determine the effects of training on the quality of peer review.
                Single blind randomised controlled trial with two intervention groups receiving different types of training plus a control group.
                Reviewers at a general medical journal. Interventions Attendance at a training workshop or reception of a self taught training package focusing on what editors want from reviewers and how to critically appraise randomised controlled trials.
                Quality of reviews of three manuscripts sent to reviewers at four to six monthly intervals, evaluated using the validated review quality instrument; number of deliberate major errors identified; time taken to review the manuscripts; proportion recommending rejection of the manuscripts.
                Reviewers in the self taught group scored higher in review quality after training than did the control group (score 2.85 v 2.56; difference 0.29, 95% confidence interval 0.14 to 0.44; P = 0.001), but the difference was not of editorial significance and was not maintained in the long term. Both intervention groups identified significantly more major errors after training than did the control group (3.14 and 2.96 v 2.13; P < 0.001), and this remained significant after the reviewers' performance at baseline assessment was taken into account. The evidence for benefit of training was no longer apparent on further testing six months after the interventions. Training had no impact on the time taken to review the papers but was associated with an increased likelihood of recommending rejection (92% and 84% v 76%; P = 0.002).
                Short training packages have only a slight impact on the quality of peer review. The value of longer interventions needs to be assessed. To explore the impact of methodologic issues on the results of meta-analyses. The following issues were examined: the type of literature search strategy used; inclusion or exclusion of non-peer-reviewed studies; the inclusion or exclusion of non-English language publications; the effect of trial quality; and the inclusion or exclusion of non-placebo-controlled studies.
                The International Study of Perioperative Transfusion (ISPOT) meta-analyses were used to evaluate each of the methodologic issues. The 10 meta-analyses consisted of technologies to reduce the need for perioperative red blood cell transfusion. The number of trials for each of the meta-analyses varied from 2 to 45. Both EMBASE and MEDLINE searches were conducted, including the use of systematic search strategies.
                MEDLINE identified the vast majority of trials. Alone, MEDLINE would have missed 8 studies compared to 10 for EMBASE. Use of the systematic search strategies greatly reduced the number of articles to be reviewed compared to open searches. Type of publication, country of study origin, inclusion of non-English publications, and trial quality had very little impact on the estimates of effect. The use of placebo versus open-label control affected the magnitude of the odds ratio for two of the meta-analyses. The results of the two meta-analyses were not statistically significant if only placebo-controlled trials were included.
                While methodologic issues had very little impact on the ISPOT meta-analyses, further studies are needed in a variety of other clinical settings. Because MEDLINE, coupled with a review of the references in the identified trials, identified the vast majority of trials, one needs to consider the costs and benefits of searching EMBASE and the pursuance of unpublished and unindexed trials. To determine whether locally developed guidelines on asthma and diabetes disseminated through practice based education improve quality of care in non-training, inner city general practices.
                Randomised controlled trial with each practice receiving one set of guidelines but providing data on the management of both conditions.
                24 inner city, non-training general practices.
                East London.
                Recording of key variables in patient records (asthma: peak flow rate, review of inhaler technique, review of asthma symptoms, prophylaxis, occupation, and smoking habit; diabetes: blood glucose concentration, glycaemic control, funduscopy, feet examination, weight, and smoking habit); size of practice disease registers; prescribing in asthma; and use of structured consultation "prompts."
                In practices receiving diabetes guidelines, significant improvements in recording were seen for all seven diabetes variables. Both groups of practices showed improved recording of review of inhaler technique, smoking habit, and review of asthma symptoms. In practices receiving asthma guidelines, further improvement was seen only in recording of review of inhaler technique and quality of prescribing in asthma. Sizes of disease registers were unchanged. The use of structured prompts was associated with improved recording of four of seven variables on diabetes and all six variables on asthma.
                Local guidelines disseminated via practice based education improve the management of diabetes and possibly of asthma in inner city, non-training practices. The use of simple prompts may enhance this improvement. A double-blind randomised controlled trial was conducted on a group of Hong Kong hospital clinicians. The objective was to test if a three-hour educational workshop (with supervised hands-on practice) is more effective (than no training) to improve clinical question formulation, information-seeking skills, knowledge, attitudes, and search outcomes. The design was a post-test-only control group; recruitment by stratified randomization (by profession), blocked at 800. End-user training was more effective than no training in improving clinical question formulation, in raising awareness, knowledge, confidence and use of databases, but had made no impact on preference for secondary databases. It changed the attitude of clinicians to become more positive towards the use of electronic information services (EIS). Participants had higher search performance and outcomes (satisfaction with information obtained (NNT = 3), EIS satisfaction (NNT = 3) and success in problem solving (NNT = 4)). The workshop improved knowledge and skills in evidence-based searching, but this effect gradually eroded with time. Search logs confirmed that follow-up is required if effects are to be sustained. Longer effects on search behaviours appear to be positive. A randomised controlled trial is valuable in identifying cause-and-effect relations and to quantify the magnitude of the effects for management decision-making. Significant resources and time are invested in the production of research knowledge. The primary objective of this randomized controlled trial was to evaluate the effectiveness of three knowledge translation and exchange strategies in the incorporation of research evidence into public health policies and programs.
                This trial was conducted with a national sample of public health departments in Canada from 2004 to 2006. The three interventions, implemented over one year in 2005, included access to an online registry of research evidence; tailored messaging; and a knowledge broker. The primary outcome assessed the extent to which research evidence was used in a recent program decision, and the secondary outcome measured the change in the sum of evidence-informed healthy body weight promotion policies or programs being delivered at health departments. Mixed-effects models were used to test the hypotheses.
                One hundred and eight of 141 (77%) health departments participated in this study. No significant effect of the intervention was observed for primary outcome (p < 0.45). However, for public health policies and programs (HPPs), a significant effect of the intervention was observed only for tailored, targeted messages (p < 0.01). The treatment effect was moderated by organizational research culture (e.g., value placed on research evidence in decision making).
                The results of this study suggest that under certain conditions tailored, targeted messages are more effective than knowledge brokering and access to an online registry of research evidence. Greater emphasis on the identification of organizational factors is needed in order to implement strategies that best meet the needs of individual organizations.
                The trial registration number and title are as follows: ISRCTN35240937 -- Is a knowledge broker more effective than other strategies in promoting evidence-based physical activity and healthy body weight programming?
On the basis of the evidence in this review, no specific implications for practice are made. It is recommended, in general, that more, larger studies are done on ET preparation techniques. The studies need to be of a higher quality with better explained methods, more specified inclusion and exclusion criteria, and more participants.