Project Details

A project completed in 2011, undertaken by University of Auckland, to design, launch and evaluate a web-based educational package for those in healthcare settings who wish to perform a systematic review of published literature.

Aims: 

The main aims of the project were to:

  • assess the current Cochrane Protocol and Analysis course for authors of Cochrane systematic reviews
  • compare the course with a newly developed electronic educational course.

Methodology: 

The project methodology involved:

  • the design and launch of the electronic educational course
  • a comparative evaluation of didactic arm and web-based arm through self-reporting surveys
  • pre- and post-knowledge testing and surveys for both the current didactic and the pilot web-based course
  • qualitative analysis of the data.

Team

the university of auckland

Jane Clarke

Project Leader

The University of Auckland
the university of auckland

Associate Professor Jenny Weller

The University of Auckland
the university of auckland

Professor Cindy Farquhar

The University of Auckland

Status

Completed

Funding

$7,550.00 (excl GST)

$7,550.00 Regional Hub Project Fund

Key Findings

The key findings from the project included:

  • The evaluation of the current Protocol and Analysis workshop found that the majority of participants showed improvement in their knowledge although some participants performance remained unchanged. All participants expressed a high degree of satisfaction with the course. The lowest scores were for ‘small group discussions’ and ‘understanding the principles of developing a comprehensive search strategy’. The majority of participants were content with the nature of the small group work, although some participants evidently preferred lectures to small groups.
  • The development and construction of the web-based course proved to be a larger challenge than originally thought by the facilitators and although the tertiary educational facility provided the software, it soon became apparent that a high level of technical support was required to effectively utilise this software.
  • The resource implications for the ongoing maintenance of this web-based course (or modified versions of it) were thought to be similar to the didactic workshops. It was thought that the introduction of a web-based course would not necessarily result in savings.
  • The resource implications for the ongoing maintenance of this web-based course (or modified versions of it) were thought to be similar to the didactic workshops. It was thought that the introduction of a web-based course would not necessarily result in savings.
  • All participants would be keen to participate in a web-based course again. The judgment was to further improve the course. Recommendations from the participants were that this web-based course be used as a supplement to formal didactic teaching.
  • No conclusions about the comparisons of the two different courses (didactic and web-based) could be made because of the low number of participants who were recruited to complete the web-based course. As a result, no content or construct validity could be evaluated.

Key Recommendations

The key recommendations from the project were:

Future development | This package is of importance to healthcare practitioners to enable them to practice in an evidence-based manner through the transfer of research findings to clinical practice via systematic reviews. A widely accessible and effective e-learning educational intervention in evidence-based practice could have significant benefits for healthcare outcomes. It is recommended that a modified web course could be developed as a useful tool, and as an adjunct to the current didactic workshop. Modifications to the web-based course should include compulsory milestones where activities such as exercises are required.

Workshop recommendations | Recommendations for the Cochrane Protocol and Analysis workshops were that: the didactic course should be regularly reviewed especially in regard to methodology changes and in specialist information retrieval; both the host educational facility and its staff are aware of all of the prerequisite and appropriate resource implications for web-based learning.

Evaluation of training of authors of Cochrane systematic reviews in New Zealand and a pilot of a web-based alternative

A research report prepared by Jane Clarke, Jenny Weller and Cindy Farquhar.

(PDF, 223 KB, 8-pages).

  • 12 December 2011
Read more