Strategies for improving the quality of health care in maternal and child health in low- and middle-income countries: an overview of systematic reviews. Evidence to action: a tailored multifaceted approach to changing family physician practice patterns and improving preventive care. Is health equity considered in systematic reviews of the Cochrane Musculoskeletal Group? Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Impact of study quality on outcome in placebo-controlled trials of homeopathy. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Use of an 'evidence-based implementation' strategy to implement evidence-based care of asthma into rural district hospital emergency departments. Randomised controlled trial of a theoretically grounded tailored intervention to diffuse evidence-based public health practice [ISRCTN23257060]. Comparison of an enhanced versus a written feedback model on the management of Medicare inpatients with venous thrombosis.
There are many systematic reviews of continuing education programmes and educational strategies for quality improvement in health care. Most of the reviewed studies are one-off evaluations rather than impact evaluations with long-term follow-up. There are few systematic reviews of organisational, financial and regulatory interventions, and few high-quality studies. These interventions are probably as or more important than educational strategies, although they are less well evaluated. Few studies have been undertaken in low- and middle-income countries (LMIC) or that address maternal and child health (MCH). Thus, the results of the available studies and reviews need to be interpreted cautiously when applied to LMIC. Interactive workshops, reminders and multifaceted interventions can improve professional practice, and they generally have moderate effects. Educational outreach visits consistently improve prescribing but have variable effects on other behaviours. Audit and feedback interventions have variable effects on professional practice, but most often these are small to moderate effects. Mass-media and patient-mediated interventions may change professional practice. Multifaceted interventions that combine several quality-improvement strategies are also effective but may not be more so than single interventions. While all of these strategies are applicable to MCH in LMIC, the applicability of the results to rural settings, in particular, may be limited. Use of these strategies could exacerbate inequalities, and this should be taken into consideration when planning implementation. Scaling up and sustainability may be difficult to achieve in LMIC contexts and need careful consideration. The use of financial interventions has not been well studied; financial incentives and disincentives may be difficult to use effectively and efficiently, although their impact on practice needs to be considered. Organisational interventions are likely to be important, given that there are often underlying organisational or system problems. Regulatory interventions have not been well evaluated, but may sometimes be both inexpensive and effective. There are no 'magic bullets' or simple solutions for ensuring the quality of health care services. Interventions should be selected or tailored to address the underlying reasons for a failure to deliver effective services. Decision-makers should select the most appropriate interventions for specific problems. This requires a governance structure that clearly assigns responsibility for quality-improvement activities, priority setting, selection and design of interventions, and evaluation. Although there is much room for improvement in the performance of recommended preventive manoeuvres, many inappropriate preventive interventions are being done. We evaluated a multifaceted intervention, delivered by nurses trained in prevention facilitation, to improve prevention in primary care.
                Forty-six health service organizations (HSOs) were recruited from 100 sites in Ontario. After baseline data were collected, we randomly assigned the practices to either an 18-month (July 1997 to December 1998) multifaceted intervention delivered by 1 of 3 nurse facilitators (23 practices) or no intervention (23 practices). The unit of intervention and analysis was the medical practice. The outcome measure was an overall index of preventive performance, which was calculated as the proportion of eligible patients who received 8 recommended preventive manoeuvres less the proportion of eligible patients who received 5 inappropriate preventive manoeuvres.
                One HSO, in the intervention group, was lost to follow-up. Before the intervention, the index of preventive performance was similar for the intervention and control groups (31.9% [95% confidence interval (CI) 27.3%-36.5%] and 32.1% [95% CI 27.2%-37.0%] respectively). At follow-up the corresponding values were 43.2% (95% CI 38.4%-48.0%) and 31.9% (95% CI 26.8%-37.0%), for an absolute improvement in the intervention group of 11.5% (p < 0.001). The mean proportion of eligible patients who received the recommended manoeuvres was 62.3% (95% CI 58.2%-66.4%) in the intervention group, as compared with 57.4% (95% CI 54.1%-60.7%) in the control group, for an absolute improvement of 7.2% (p = 0.008). The corresponding values for the inappropriate manoeuvres were 19.1% (95% CI 15.6%-22.6%) and 25.5% (95% CI 20.0%-31.0%), for an absolute improvement of 4.4% (p = 0.019).
                The tailored multifaceted intervention delivered by nurse facilitators was effective in modifying physician practice patterns and significantly improved preventive care performance. To determine whether Cochrane Musculoskeletal Group (CMSG) systematic reviews and corresponding primary studies of rheumatoid arthritis interventions report and analyze the data needed to assess the effectiveness of interventions in reducing socioeconomic differences in health and/or improving the health of the poor.
                We selected all CMSG reviews on rheumatoid arthritis published since issue 1, 2003. Fourteen reviews were identified; 147 of the 156 primary studies included in these reviews were obtained and assessed. We extracted data on whether the dimensions place of residence, race/ethnicity/culture, occupation, gender, religion, education, socioeconomic status, and social capital and networks (PROGRESS) were reported or analyzed, and whether any interventions were aimed at disadvantaged or low- and middle-income country populations.
                Among the dimensions of PROGRESS reported at baseline in 147 primary studies, gender (89%) was the most commonly reported, followed by education (25%) and race/ethnicity (18%). Less than 50% of the systematic reviews reported dimensions of PROGRESS even when they had been reported in the primary study. Of 147 primary studies, 6 (5%) were aimed specifically at disadvantaged populations; another 6 reported on effectiveness by at least 1 dimension of PROGRESS.
                Primary studies of interventions for rheumatoid arthritis generally reported few variables necessary to answer questions about health inequalities. Most CMSG systematic reviews failed to assess those variables even when described in the primary studies. The Cochrane Health Equity Field welcomes the opportunity to provide guidance to systematic review authors on incorporating equity considerations into their reviews. Few meta-analyses of randomised trials assess the quality of the studies included. Yet there is increasing evidence that trial quality can affect estimates of intervention efficacy. We investigated whether different methods of quality assessment provide different estimates of intervention efficacy evaluated in randomised controlled trials (RCTs).
                We randomly selected 11 meta-analyses that involved 127 RCTs on the efficacy of interventions used for circulatory and digestive diseases, mental health, and pregnancy and childbirth. We replicated all the meta-analyses using published data from the primary studies. The quality of reporting of all 127 clinical trials was assessed by means of component and scale approaches. To explore the effects of quality on the quantitative results, we examined the effects of different methods of incorporating quality scores (sensitivity analysis and quality weights) on the results of the meta-analyses.
                The quality of trials was low. Masked assessments provided significantly higher scores than unmasked assessments (mean 2.74 [SD 1.10] vs 2.55 [1.20]). Low-quality trials (score < or = 2), compared with high-quality trials (score > 2), were associated with an increased estimate of benefit of 34% (ratio of odds ratios [ROR] 0.66 [95% CI 0.52-0.83]). Trials that used inadequate allocation concealment, compared with those that used adequate methods, were also associated with an increased estimate of benefit (37%; ROR=0.63 [0.45-0.88]). The average treatment benefit was 39% (odds ratio [OR] 0.61 [0.57-0.65]) for all trials, 52% (OR 0.48 [0.43-0.54]) for low-quality trials, and 29% (OR 0.71 [0.65-0.77]) for high-quality trials. Use of all the trial scores as quality weights reduced the effects to 35% (OR 0.65 [0.59-0.71]) and resulted in the least statistical heterogeneity.
                Studies of low methodological quality in which the estimate of quality is incorporated into the meta-analyses can alter the interpretation of the benefit of intervention, whether a scale or component approach is used in the assessment of trial quality. We investigated the influence of indicators of methodological quality on study outcome in a set of 89 placebo-controlled clinical trials of homoeopathy in three different ways: (1) The results of studies meeting single criteria (explicit statement of random allocation, allocation concealment, double-blinding, completeness of follow-up) of methodological quality were compared with those of studies not meeting the criteria in univariate and multivariate analyses; (2) The results of studies scoring above and below predefined scores in two quality assessment scales were compared; (3) Primary studies were consecutively entered into a cumulative meta-analysis according to the summary scores derived from the quality assessment scales. All analyses were performed using meta-regression methods. Studies that were explicitly randomized and were double-blind as well as studies scoring above the cut-points yielded significantly less positive results than studies not meeting the criteria. In the cumulative meta-analyses, there was a trend for increasing effect sizes when more studies with lower-quality scores were added. However, there was no linear relationship between quality scores and study outcome. We conclude that in the study set investigated, there was clear evidence that studies with better methodological quality tended to yield less positive results. Because summarizing disparate study features into a single score is problematic, meta-regression methods simultaneously investigating the influence of single study features seem the best method for investigating the impact of study quality on outcome. Significant resources and time are invested in the production of research knowledge. The primary objective of this randomized controlled trial was to evaluate the effectiveness of three knowledge translation and exchange strategies in the incorporation of research evidence into public health policies and programs.
                This trial was conducted with a national sample of public health departments in Canada from 2004 to 2006. The three interventions, implemented over one year in 2005, included access to an online registry of research evidence; tailored messaging; and a knowledge broker. The primary outcome assessed the extent to which research evidence was used in a recent program decision, and the secondary outcome measured the change in the sum of evidence-informed healthy body weight promotion policies or programs being delivered at health departments. Mixed-effects models were used to test the hypotheses.
                One hundred and eight of 141 (77%) health departments participated in this study. No significant effect of the intervention was observed for primary outcome (p < 0.45). However, for public health policies and programs (HPPs), a significant effect of the intervention was observed only for tailored, targeted messages (p < 0.01). The treatment effect was moderated by organizational research culture (e.g., value placed on research evidence in decision making).
                The results of this study suggest that under certain conditions tailored, targeted messages are more effective than knowledge brokering and access to an online registry of research evidence. Greater emphasis on the identification of organizational factors is needed in order to implement strategies that best meet the needs of individual organizations.
                The trial registration number and title are as follows: ISRCTN35240937 -- Is a knowledge broker more effective than other strategies in promoting evidence-based physical activity and healthy body weight programming? To determine if an evidence-based implementation (EBI) could lead to the successful implementation of evidence based care for adult asthma in small rural district hospitals.
                A controlled trial involving eight small rural hospitals (four each in the study and control groups) was conducted. Retrospective pre-intervention audits were conducted at all eight hospitals for 7 months (1 January 2004 to 31 July 2004) and evidence-practice gaps identified. An EBI was then used to implement established guidelines for the management of asthma in the study hospitals. Post-intervention audits were then performed over a period of 7 months (1 October 2004 to 31 April 2005).
                There were 52 presentations of asthma in the study hospitals in the pre-implementation phase and 47 post-implementation. The corresponding numbers for the control hospitals were 46 and 42 respectively. There were no statistically significant differences in the severity between the groups. Following the EBI there were significant improvements at the study hospitals for the documentation of severity (8% to 62%, p <0.001), use of spirometry (12% to 62%, p <0.001) and the use of written short-term asthma plans (9% to 26%, p = 0.05). There was a decrease in use of ipratropium in mild asthma (44% to 30%, p = 0.228), an increase in the use of systemic steroids (61% to 72%, p = 0.255) and no change in prescribing antibiotics for afebrile patients with asthma (21% to 21% p = 0.956). There was no significant change in practice at the control hospitals except for a decrease in the use of systemic steroids (48% to 21%, p = 0.011). For the six clinical indicators aggregate there was a significant increase in compliance with guidelines at the study hospitals (36% to 62%, p < 0.001) but no change at the control hospitals (31% to 31%, p = 0.970).
                The pre-intervention audits demonstrated low levels of compliance with asthma guidelines across six clinical indicators. An EBI significantly improved compliance across these six indicators, and no improvement was noted in the control hospitals. This study demonstrates that an EBI can alter clinical practice in small rural district hospitals. Previous studies have shown that Norwegian public health physicians do not systematically and explicitly use scientific evidence in their practice. They work in an environment that does not encourage the integration of this information in decision-making. In this study we investigate whether a theoretically grounded tailored intervention to diffuse evidence-based public health practice increases the physicians' use of research information.
                148 self-selected public health physicians were randomised to an intervention group (n = 73) and a control group (n = 75). The intervention group received a multifaceted intervention while the control group received a letter declaring that they had access to library services. Baseline assessments before the intervention and post-testing immediately at the end of a 1.5-year intervention period were conducted. The intervention was theoretically based and consisted of a workshop in evidence-based public health, a newsletter, access to a specially designed information service, to relevant databases, and to an electronic discussion list. The main outcome measure was behaviour as measured by the use of research in different documents.
                The intervention did not demonstrate any evidence of effects on the objective behaviour outcomes. We found, however, a statistical significant difference between the two groups for both knowledge scores: Mean difference of 0.4 (95% CI: 0.2-0.6) in the score for knowledge about EBM-resources and mean difference of 0.2 (95% CI: 0.0-0.3) in the score for conceptual knowledge of importance for critical appraisal. There were no statistical significant differences in attitude-, self-efficacy-, decision-to-adopt- or job-satisfaction scales. There were no significant differences in Cochrane library searching after controlling for baseline values and characteristics.
                Though demonstrating effect on knowledge the study failed to provide support for the hypothesis that a theory-based multifaceted intervention targeted at identified barriers will change professional behaviour. A multistate randomized study conducted under the Health Care Financing Administration's (HCFA's) Health Care Quality Improvement Program (HCQIP) offered the opportunity to compare the effect of a written feedback intervention (WFI) with that of an enhanced feedback intervention (EFI) on improving the anticoagulant management of Medicare beneficiaries who present to the hospital with venous thromboembolic disease.
                Twenty-nine hospitals in five states were randomly assigned to receive written hospital-specific feedback (WFI) of feedback enhanced by the participation of a trained physician, quality improvement tools, and an Anticoagulant Management of Venous Thrombosis (AMVT) project liaison (EFI). Differences in the performance of five quality indicators between baseline and remeasurement were assessed. Quality managers were interviewed to determine perceptions of project implementation.
                No significant differences in the change from baseline to remeasurement were found between the two intervention groups. Significant improvement in one indicator and significant decline in two indicators were found for one or both groups. Yet 59% of all quality managers perceived the AMVT project as being successful to very successful, and more EFI quality managers perceived success than did WFI managers (71% versus 40%). In the majority of EFI hospitals, physician liaisons played an important role in project implementation.
                Study results indicated that the addition of a physician liaison, quality improvement tools, and a project liaison did not provide incremental value to hospital-specific feedback for improving quality of care. Future studies with larger sample sizes, lengthier follow-up periods, and interventions that include more of the elements shown to affect practice behavior change are needed to identify an optimal feedback model for use by external quality management organizations.
This updated review reports on 15 studies that met the inclusion criteria (nine studies from this update and six studies from the 2008 update). Although these studies reported some positive outcomes, due to the small number of studies and the heterogeneity of interventions and outcome measures, it is not possible to draw generalisable inferences about the key elements of IPE and its effectiveness. To improve the quality of evidence relating to IPE and patient outcomes or healthcare process outcomes, the following three gaps will need to be filled: first, studies that assess the effectiveness of IPE interventions compared to separate, profession-specific interventions; second, RCT, CBA or ITS studies with qualitative strands examining processes relating to the IPE and practice changes; third, cost-benefit analyses.