Evaluation of general practice computer templates. Lessons from a pilot randomised controlled trial. What factors are associated with the integration of evidence retrieval technology into routine general practice settings? Cluster randomized controlled trial of the effectiveness of audit and feedback and educational outreach on improving nursing practice and patient outcomes. Pragmatic randomised trial to evaluate the use of patient held records for the continuing care of patients with cancer. A randomized evaluation of a computer-based nursing documentation system. Educational workshop improved information-seeking skills, knowledge, attitudes and the search outcome of hospital clinicians: a randomised controlled trial. Patient-based outcome results from a cluster randomized trial of shared decision making skill development and use of risk communication aids in general practice. Randomised controlled trial of a theoretically grounded tailored intervention to diffuse evidence-based public health practice [ISRCTN23257060]. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial.
We conducted a pilot randomised trial of computerised templates for the management of asthma and diabetes in general practice in six general practices in North London. Uptake of the guidelines by general practitioners and practice nurses was assessed using qualitative (semi-structured interviews designed to assess the users' views) and quantitative (change in use of the template during the study period) outcome measures. The practice nurses used the templates frequently but general practitioners rarely used them. Several reasons were offered for non-use of the templates, such as the length of the template and non-involvement in the care of asthma or diabetes. Despite this, however, health professionals were favourably disposed to the use of templates for general clinical care. Pilot investigations of computerised templates are best achieved by observational or quasi-experimental methods rather than a randomised controlled trial. The use of both qualitative and quantitative methods in this study allowed exploration of the barriers to use of computers. Information retrieval systems have the potential to improve patient care but little is known about the variables which influence clinicians' uptake and use of systems in routine work.
                To determine which factors influenced use of an online evidence retrieval system.
                Computer logs and pre- and post-system survey analysis of a 4-week clinical trial of the Quick Clinical online evidence system involving 227 general practitioners across Australia.
                Online evidence use was not linked to general practice training or clinical experience but female clinicians conducted more searches than their male counterparts (mean use=14.38 searches, S.D.=11.68 versus mean use=8.50 searches, S.D.=9.99; t=2.67, d.f.=157, P=0.008). Practice characteristics such as hours worked, type and geographic location of clinic were not associated with search activity. Information seeking was also not related to participants' perceived information needs, computer skills, training nor Internet connection speed. Clinicians who reported direct improvements in patient care as a result of system use had significantly higher rates of system use than other users (mean use=12.55 searches, S.D.=13.18 versus mean use=8.15 searches, S.D.=9.18; t=2.322, d.f.=154 P=0.022). Comparison of participants' views pre- and post- the trial, showed that post-trial clinicians expressed more positive views about searching for information during a consultation (chi(2)=27.40, d.f.=4, P< or =0.001) and a significantly greater number reported seeking information between consultations as a result of having access to an online evidence system in their consulting rooms (chi(2)=9.818, d.f.=2, P=0.010).
                Clinicians' use of an online evidence system was directly related to their reported experiences of improvements in patient care. Post-trial clinicians positively changed their views about having time to search for information and pursued more questions during clinic hours. Current understanding of implementation methods is limited, and research has focused on changing doctors' behaviors.
                Our aim was to evaluate the impact of audit and feedback and educational outreach in improving nursing practice and patient outcomes.
                Using a factorial design, cluster randomized controlled trial, we evaluated 194 community nurses in 157 family practices and 1078 patients with diagnosis of urinary incontinence (UI) for nurses compliance with evidence-linked review criteria for the assessment and management of UI and impact on psychologic and social well-being and symptoms. In the outreach arms, nurses' self-reported barriers informed development of tailored strategies.
                In comparison with educational materials alone, the implementation methods tested did not improve care at 6 months follow-up. Moderate rates of improvement (10-17% of patients) in performance for the assessment of UI and greater rates of improvement (20-30% of patients) for the management of care were found but effects were similar across arms. Improvement in patient outcomes was more consistently positive for educational outreach than for audit and feedback but differences were not significant. Adjustment for caseload size, severity or duration of UI and patients' age did not alter results.
                Printed educational materials alone may be as effective as audit and feedback and educational outreach in improving nurses' performance and outcomes of care for people with UI. Greater understanding of the underlying processes in improving performance within multidisciplinary teams through further, theory-driven studies with "no intervention" control groups and longer follow-up are needed. To evaluate the use of a multidisciplinary record held by patients with cancer in the community.
                Pragmatic randomised controlled trial.
                The environs of Swansea in south west Wales.
                501 patients under the care of the Department of Oncology, Singleton Hospital, Swansea.
                A patient held record used by the patient and healthcare professionals. Main outcome measures-Health related quality of life (EORTC QLQ-C30) measured at entry into the study and at 6 months; patients' views at 6 months; healthcare professionals' views collected after the completion of patient follow up; NHS resource and booklet use.
                1148 patients were eligible for the study; 501 were recruited (44%) and 344 completed the study (172 in each group). There was no significant difference between the two groups in change in quality of life or NHS resource use. The patient held record did not have an impact on communication but was significantly helpful to patients in preparing for appointments, reducing difficulties in monitoring their own progress, and helping them to feel more in control (p<0.05). Fifty three percent of patients would have preferred not to have a patient held record. There was a low level of use of the record by healthcare professionals but most of those who remembered using it indicated that they would prefer patients to have it.
                The patient held record is valued by some patients and professionals but has no significant impact on the quality of life of patients or NHS resource use. It has a positive impact on quality by helping patients feel more in control and prepare for meetings with healthcare staff. Patients who find it useful tend to be younger and have more professionals involved in their care. It is recommended that it should be made available to patients on request and used by them according to need. A two-month randomized, controlled trial based on 60 patients has been performed on a ward of the Department of Psychiatry at Heidelberg University Medical Center, Germany, to investigate the influence of computer-based nursing documentation on time investment for documentation, quality of documentation and user acceptance. Time measurements, questionnaires, documentation analysis and interviews were used to compare patients documented with the computer-based system (PIK group) with the control group (patients documented with the paper-based system). The results showed the advantages and disadvantages of computer-based nursing documentation. Time needed for nursing care planning was lower in the PIK group. Some formal aspects of quality were considerably better in the PIK group. On the other hand, time required for documentation of tasks and for report writing was greater in the PIK group. User acceptance increased significantly during the study. The interviews indicated a positive influence of PIK on the cooperation between nurses and physicians. A double-blind randomised controlled trial was conducted on a group of Hong Kong hospital clinicians. The objective was to test if a three-hour educational workshop (with supervised hands-on practice) is more effective (than no training) to improve clinical question formulation, information-seeking skills, knowledge, attitudes, and search outcomes. The design was a post-test-only control group; recruitment by stratified randomization (by profession), blocked at 800. End-user training was more effective than no training in improving clinical question formulation, in raising awareness, knowledge, confidence and use of databases, but had made no impact on preference for secondary databases. It changed the attitude of clinicians to become more positive towards the use of electronic information services (EIS). Participants had higher search performance and outcomes (satisfaction with information obtained (NNT = 3), EIS satisfaction (NNT = 3) and success in problem solving (NNT = 4)). The workshop improved knowledge and skills in evidence-based searching, but this effect gradually eroded with time. Search logs confirmed that follow-up is required if effects are to be sustained. Longer effects on search behaviours appear to be positive. A randomised controlled trial is valuable in identifying cause-and-effect relations and to quantify the magnitude of the effects for management decision-making. Shared decision-making (SDM) between professionals and patients is increasingly advocated from ethical principles. Some data are accruing about the effects of such approaches on health or other patient-based outcomes. These effects often vary substantially between studies.
                Our aim was to evaluate the effects of training GPs in SDM, and the use of simple risk communication aids in general practice, on patient-based outcomes.
                A cluster randomized trial with crossover was carried out with the participation of 20 recently qualified GPs in urban and rural general practices in Gwent, South Wales. A total of 747 patients with known atrial fibrillation, prostatism, menorrhagia or menopausal symptoms were invited to a consultation to review their condition or treatments. After baseline, participating doctors were randomized to receive training in (i) SDM skills; or (ii) the use of simple risk communication aids, using simulated patients. The alternative training was then provided for the final study phase. Patients were randomly allocated to a consultation during baseline or intervention 1 (SDM or risk communication aids) or intervention 2 phases. A randomly selected half of the consultations took place in 'research clinics' to evaluate the effects of more time for consultations, compared with usual surgery time. Patient-based outcomes were assessed at exit from consultation and 1 month follow-up. These were: COMRADE instrument (principal measures; subscales of risk communication and confidence in decision), and a range of secondary measures (anxiety, patient enablement, intention to adhere to chosen treatment, satisfaction with decision, support in decision making and SF-12 health status measure). Multilevel modelling was carried out with outcome score as the dependent variable, and follow-up point (i.e. exit or 1 month later for each patient), patient and doctor levels of explanatory variables.
                No statistically significant changes in patient-based outcomes due to the training interventions were found: COMRADE risk communication score increased 0.7 [95% confidence interval (CI) -0.92 to 2.32] after risk communication training and 0.9 (95% CI -0.89 to 2.35) after SDM training; and COMRADE satisfaction with communication score increased by 1.0 (95% CI -1.1 to 3.1) after risk communication, and decreased by 0.6 (95% CI 2.7 to -1.5) after SDM training. Patients' confidence in the decision (2.1 increase, 95% CI 0.7-3.5, P < 0.01) and expectation to adhere to chosen treatments (0.7 increase, 95% CI 0.04-1.36, P < 0.05) were significantly greater among patients seen in the research clinics (when more time was available) compared with usual surgery time. Most outcomes deteriorated between exit and 1 month later. There was no interaction between intervention effects.
                Patients can be more involved in treatment decisions, and risks and benefits of treatment options can be explained in more detail, without adversely affecting patient-based outcomes. SDM and risk communication may be advocated from values and ethical principles even without evidence of health gain or improvement in patient-based outcomes, but the resources required to enhance these professional skills must also be taken into consideration. These data also indicate the benefits of extra consultation time. Previous studies have shown that Norwegian public health physicians do not systematically and explicitly use scientific evidence in their practice. They work in an environment that does not encourage the integration of this information in decision-making. In this study we investigate whether a theoretically grounded tailored intervention to diffuse evidence-based public health practice increases the physicians' use of research information.
                148 self-selected public health physicians were randomised to an intervention group (n = 73) and a control group (n = 75). The intervention group received a multifaceted intervention while the control group received a letter declaring that they had access to library services. Baseline assessments before the intervention and post-testing immediately at the end of a 1.5-year intervention period were conducted. The intervention was theoretically based and consisted of a workshop in evidence-based public health, a newsletter, access to a specially designed information service, to relevant databases, and to an electronic discussion list. The main outcome measure was behaviour as measured by the use of research in different documents.
                The intervention did not demonstrate any evidence of effects on the objective behaviour outcomes. We found, however, a statistical significant difference between the two groups for both knowledge scores: Mean difference of 0.4 (95% CI: 0.2-0.6) in the score for knowledge about EBM-resources and mean difference of 0.2 (95% CI: 0.0-0.3) in the score for conceptual knowledge of importance for critical appraisal. There were no statistical significant differences in attitude-, self-efficacy-, decision-to-adopt- or job-satisfaction scales. There were no significant differences in Cochrane library searching after controlling for baseline values and characteristics.
                Though demonstrating effect on knowledge the study failed to provide support for the hypothesis that a theory-based multifaceted intervention targeted at identified barriers will change professional behaviour. To evaluate the use of a computerised support system for decision making for implementing evidence based clinical guidelines for the management of asthma and angina in adults in primary care.
                A before and after pragmatic cluster randomised controlled trial utilising a two by two incomplete block design. Setting: 60 general practices in north east England.
                General practitioners and practice nurses in the study practices and their patients aged 18 or over with angina or asthma.
                Adherence to the guidelines, based on review of case notes and patient reported generic and condition specific outcome measures.
                The computerised decision support system had no significant effect on consultation rates, process of care measures (including prescribing), or any patient reported outcomes for either condition. Levels of use of the software were low.
                No effect was found of computerised evidence based guidelines on the management of asthma or angina in adults in primary care. This was probably due to low levels of use of the software, despite the system being optimised as far as was technically possible. Even if the technical problems of producing a system that fully supports the management of chronic disease were solved, there remains the challenge of integrating the systems into clinical encounters where busy practitioners manage patients with complex, multiple conditions.
We found some limited evidence of effects on practice attributable to changes in record systems. It is clear from the literature that it is possible to set up the randomised trials or other quasi-experimental designs needed to produce evidence for practice. Qualitative nursing research to explore the relationship between practice and information use could be used as a precursor to the design and testing of nursing information systems.