By Author
  By Title
  By Keywords

July 1997, Volume 47, Issue 7

Original Article

Do Workshops Make A Difference in Improving the Capability of Physicians?

Inayat H. Thaver  ( Department of Health System Research and Development, Faculty of Health Management, Baqai Medical University, Karachi. )

Abstract

Continuing medical education (CME) activities have been shown to improve the capability and capacity of physicians for appropriate management of their patients. However, doubts have been raised about the role of workshops and seminars. This study is an attempt to find out whether workshops can improve the knowledge (capability) of practicing physician. Participants of 10 randomly selected workshops con­ducted in whole of Sindh were included for this study. A pre-test followed by post-test methodology used for 214 participants demonstrated that physicians’ knowledge increased for some of the basic facts after attending the workshop. However, when their knowledge was assessed with some problem-solving approach, no significant (P<0.05) change could be noted. It is recommended that workshops should be designed and conducted more carefully. Besides, some innovative approaches for CME should be compared with ‘workshops’ approach to determine their effectiveness (JPMA 47:186,1997).

Introduction

A practicing physician needs not only to update his knowledge and skills but also continually refresh the existing clinic performance styles and habits. The continuing medical education (CME) activities is one of the ways to improve physician’s knowledge and therefore, to improve patient outcome1. A number of education interventions have been used to facilitate CME2-5. Some of those include:
a) Formal CME programmes such as conferences, seminars, workshops and small group sessions1.
b) Outreach visits including academic detailing6, which has been used in a number of places and appears to work7 and is a cost- effective way of improving quality of drug therapy8,9.
C) Information feedback with suggestions for improvement has been shown to improve the clinical practice10-12.
d) Reminders like clinic guidelines orprotocols have shown to influence discharge rate and lower number of diagnostic tests in United Kingdom13 and decrease inC. section in USA14.
e) “Distant learning” using self-instruction methods combined with seminars and supervisoiy visits has been useful not only for skills training but also for solving current problems15.
A critical appraisal of the efficacy of CME on the performance of the physician has concluded that it can improve physician’s behaviour16. A positive behavioural change was also noted by reviewing 160 intervention studies, mainly in clinical disease management17. However, conferences have been noted to have little impact on improving professional practice18. This study was conducted to assess the change in knowledge and understanding of the physicians regarding management and control of diarrhoea after they had undergone two days of formal training.

Materials and Methods

This was quasi-experimental study utilizing the “pm-test followed by post-test” methodology. Twenty workshops were conducted invarious districts of Sindh during December, 1994 to March, 1995 for the medical officers working in government health system. Ten workshops were included in this study by randomly selecting them using simple lottery method. All the participants of selected workshops were part of this study. A self- administered questionnaire was developed to collect basic information of those medical officers and to assess the knowledge (and change in knowledge) for control and management of diarrhoea. A vignette of simple viral diarrhoea was also used to determine how they apply their knowledge for the management of a child having diarrhoea. The validity of using this vignette has already been established. Medical officers were asked to write down diagnosis, treatment and advice for that vignette. Standards were developed by a panel of experts and the answers were compared against those standards. Later the standards followed by MOs were assigned scores for comparison and determination of change in their knowledge. All the medical officers were given the same questionnaire before the commencement and at the end of workshop. No coercive methods were used and voluntaiy participation was encouraged. They were also requested not to take it as an examination. For ethical purposes, names of participants, workshop districts and names of instructors were kept confidential.

Results

A total of 214 medical officers (MOs) were included in the study, who were participants of 10 various workshops. These MOs had a mean age of 40 years (SD 3.7); mean years since graduation was 9 (SD 3.5 years). They have been working as government medical officers for 5 years, though 40% had a privatepractice also. The MOs claimed to work for an average of 7 hours attending 45 patients daily. Of all the MOs, only 20% had some prior training for management of diarrhoea, about 3 years back. For general assessment of knowledge and perception regarding management of diarrhoea, MOs were asked to prioritize their ranking pre-designed from a list for management and control of diarrhoeal diseases.

Table 1 shows thatthoughpnority ranking for management of diarrhoea did not vary before and after workshop, mean ranking for use of”anti- diarrhoeal” lowered and for “increased fluid intake” topped the rankings after the workshop, indicating improved changes. Sante results were also observed when MOs were asked to give priority ranking for control of diarrhoeal diseases, (from alist of intervention). However, there were few exceptions. A significantly (P<0.05) higher mean ranking was given to “adequate diet and nutrition” and “giving ORS” and lowered mean ranking to “killing of flies”, afterthe workshop (Table II).

The answers to vignette on simple viral diarrhoea was compared against the expected standards and then were assigned scores.

Table III illustrates that no significant change in scores achieved by MOs was noticed for diagnosis, treatment, advice and overall management. Although, after attending the workshop capabilities ofMOs did not improve, some of their prescribing practices showed apositive change. Thus prescription foranti­diarrhoeals, any drug and injection for management of vignette on diarrhoea decreased. However, strangely, prescription for ORS also decreased significantly, after the workshop (Table IV).

Discussion

This study has demonstrated a mixed outcome of the workshop. Mos demonstrated a positive change in improved knowledge for some of the facts, especially when the choices were listed indicating the role of conference in improving recent factual knowledge. However, they failed to apply these facts for a simulated case in a problem-solving approach and their deeply ingrained skills dominated the recently acquired knowledge. One may argue for the quality, context and resources usedforthe workshop, which mighthave influenced the results seen in our study. Nevertheless, by and large these workshops were conducted in a fashion and style which are in vogue for continuing medical education (CME) and training being conducted in most of our government and non-government organizations. It is recommended that if workshops or seminars are to be conducted, it should be supplemented with some other approach like information feedback and regular supervision. Combining conferences/workshops with active feedback on the performance of physician and peer review and an active participation of the physicians has shown to improve management practice for diarrhoea19. It is suggested that instead of the traditional appraoches for CME, innovative approaches which are more problem-oriented should also be tried and compared in term of resources inputs, economics and changes observed in capability and capacity of the participants. The syllabus, teaching methodology and skills of teachers conducting the workshop or any other training sessions should be continuously evaluated.

Acknowledgements

The author would like to acknowledge the support offered to him by Dr. Mir Mohammed Sheikh for collection of data. This study is based on evaluation of workshops sponsored by UNICEF and facilitated through Dr. Asif Aslam.

References

1. Stem, L.S. The effecttveness of continuing medical education: Eight research reports. J. Med. Educ., 1980:56:103-110.
2. Davtdoff. F., Goodspecd, R. and Clive,J. Changing test ordering behaviour: A randomized controlled trial comparing probabilistic reasoning with cost-con­tainment education. Med. Care, 1989;27:45- 57.
3. Manheim, L.M., Feinglass, J., Hughes, R. etal. Training houseofficers tobe cost conscious: Effects of an educational intervention on charges and length of stay.Med. Care, 1990;28:29. 42.
4. Fleming, D.M. andLawrence, M.S.T.A. Impactofauditon preventive measures. Br. Med. J., 1983;287:1853-1 854.
5. Gask, L., McGrath, G., Goldberg, D. et al. Improving the psychiatric skills of established general practitioners: Evaluation of group teaching. Med. Educ., 1987;21 :362-368.
6. Sanson-Fisher, R., Denise, R. and Bob, H. Behavioral and educational factors influencing academic detailing. Aust. Prescriber, 1993;16:95-96.
7. May, F., Gilbert, A., Hurley, E. et al. A drug and therapeutics information services for community medical practitioners. Aust. Prescriber, 1993; 16:49-51.
8. Avorn, J. and Soumerai, SB. Improving drug-therapy decisions through educational outreach: A randomized controlled trial of academically based “detailing”. N. EngI. J. Med., 1983;308: 1457- 1463.
9. Soumerai, S.B. and Avom, 3. Economic and policy analysis ofuniversity.based drug “detailing”. Med. Care, 1986;24:313-331.
10. Mitchell, MW. and Fowkes, F.G.R. Audit reviewed: Does feedback on performance change clinical behaviour? J. R. Coil. Physicians Lond., 1985;19:251-254.
11. Maynard, A. and Bloor, K. Health carereform: Informing difficult choices. Int. 3. Health Plan.Manag., 1995; 10:247-264.
12. Martin, A.R., Wolf, M.A., Thibodean, L.A. et al. A trial of two strategies to modify the test-ordering behaviour of medical residents. N. Engl.J. Med., 1980;303: 1330-1336.
13. Hall, R., Roberts, C.J., Coles, GA. et al. The impact of guidelines in clinical outpatient practice. 3. R. Coil. Physicians Lond., 1988;22:244-247.
14. Myers, S. and Gliecher, N. A successful programme to lower cesarean section rates. N. Eng. 3. Med., 1988;3 19:1511-1516.
15. Ndeki, S.S., Towle, A., Angel, CE. et al. Doctor’s continuing education in Tanzania: Distance learning. World Health Forum, 1995; 16:59-64.
16. Haynes, A.B., Davis, D.A.. Mckibbon, A. et al. A critical appraisal of the efficacy ofcontinuing medical education. JAMA., 1984;251 :61-64.
17. Davis, D.A., Thomson, MA., Oxman, A.D. et al. Changing physician performance: A systematic review of the effect ofcontinuing medical education strategies. JAMA., 1995;274:700-705.18. Soumerai, SB., McLaughlin, T.J. and Avorn, 3. Improving drug prescribing in primary care: A critical analysis of the experimental literature. Milbank Q., 1989;67:268-3 17.
19. Gutierrez, G., Guiscafre, H., Bronfman, M. et al. Changing physician prescribing patterns: Evaluation ofan educational strategy for acute diarrhoea in Mexico city. Med. Care, 1994;32:436-446.

Journal of the Pakistan Medical Association has agreed to receive and publish manuscripts in accordance with the principles of the following committees: