Application of direct observation of procedural skills in clinical skill training

doi:10.16352/j.issn.1001-6325.2022.10.1621

Abstract

Abstract: The training of clinical operational skill is an important part of medical education. Direct observation of procedural skills (DOPS) is a method to evaluate clinical operational skills. It has both teaching and evaluation functions. The evaluator directly observes the operation process of the evaluated and gives evaluation and feedback in time. This paper introduces the reliability, validity, feasibility, acceptability and educational significance and the current application of DOPS.

Key words: direct observation of procedural skills, clinical operation skills, reliability, validity, application

CLC Number:

YU Xiao-qing, GUO Chao, YI Jie, LIAO Quan, WENG Xi-sheng, LIANG Nai-xin, LI Shan-qing. Application of direct observation of procedural skills in clinical skill training[J]. Basic & Clinical Medicine, 2022, 42(10): 1621-1625.

References 27

[1]	Miller GE. The assessment of clinical skills/competence/performance[J]. Acad Med, 1990, 65(9 Suppl): S63-S67.
[2]	Rawekar A, Choudhari SG, Mishra V, et al. Formative assessment in practical for Indian postgraduates in health professions education: a strategic initiative towards competency-based education[J]. J Family Med Prim Care, 2020, 9: 3399-3404.
[3]	Wragg A, Wade W, Fuller G, et al. Assessing the performance of specialist registrars[J]. Clin Med (Lond), 2003, 3: 131-134.
[4]	魏冲, 毛玥莹, 李菁, 等. 客观结构化临床考试应用于规范化培训住院医师入科考试的实践探索[J]. 基础医学与临床, 2018, 38: 1513-1516.
[5]	张大明, 金征宇, 薛华丹, 等. OSCE在北京市放射科住院医师规范化培训Ⅰ阶段技能考试中应用的评价[J]. 基础医学与临床, 2017, 37: 1778-1781.
[6]	Naeem N. Validity, reliability, feasibility, acceptability and educational impact of direct observation of procedural skills (DOPS)[J]. J Coll Physicians Surg Pak, 2013, 23: 77-82.
[7]	白杨, 陈彬, 魏书婷. 操作技能直接观察评估在护理技能评估中的应用进展[J]. 护理研究, 2018, 32: 1680-1683.
[8]	Lorwald AC, Lahner FM, Nouns ZM, et al. The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: A systematic review and meta-analysis[J]. PLoS One, 2018, 13: e0198009.doi: 10.1371/journal.pone.0198009.
[9]	Mayne A, Wilson L, Kennedy N. The usefulness of procedure-based assessments in postgraduate surgical training within the intercollegiate surgical curriculum programme; A Scoping Review[J]. J Surg Educ, 2020, 77: 1227-1235.
[10]	Khan R, Zheng E, Wani SB, et al. Colonoscopy competence assessment tools: a systematic review of validity evidence[J]. Endoscopy, 2021, 53: 1235-1245.
[11]	Telford J, Gondara L, Pi S, et al. Higher adenoma detection, sessile serrated lesion detection and proximal sessile serrated lesion detection are associated with physician specialty and performance on Direct Observation of Proce-dural Skills[J]. BMJ Open Gastroenterol, 2021, 8: e000677. doi: 10.1136/bmjgast-2021-000677.
[12]	Siau K, Crossley J, Dunckley P, et al. Colonoscopy direct observation of procedural skills assessment tool for evaluating competency development during training[J]. Am J Gastroenterol, 2020, 115: 234-243.
[13]	Siau K, Crossley J, Dunckley P, et al. Direct observation of procedural skills (DOPS) assessment in diagnostic gastroscopy: nationwide evidence of validity and competency development during training[J]. Surg Endosc, 2020, 34: 105-114.
[14]	Liu CS, Wang YM, Lin HN. An 8-year retrospective survey of assessment in postgraduate dental training in complicated tooth extraction competency[J]. J Dent Sci, 2020, 16: 891-898
[15]	Jafarpoor H, Hosseini M, Sohrabi M, et al. The effect of direct observation of procedural skills/mini-clinical evaluation exercise on the satisfaction and clinical skills of nursing students in dialysis[J]. J Educ Health Promot, 2021, 10: 74. doi: 10.4103/jehp.jehp_618_20.
[16]	Mohamadirizi S, Mardanian F, Torabi F. The effect of direct observation of procedural skills method on learning clinical skills of midwifery students of medical sciences[J]. J Educ Health Promot, 2020, 9: 91. doi: 10.4103/jehp.jehp_672_19.
[17]	李晓勇, 姬乐, 刘涛, 等. DOPS联合Mini-CEX在普外科规培教学中的实践应用[J]. 继续医学教育, 2021, 35:13-15.
[18]	Dabir S, Hoseinzadeh M, Mosaffa F, et al. The effect of repeated direct observation of procedural skills (R-DOPS) assessment method on the clinical skills of anesthesiology residents[J]. Anesth Pain Med, 2021, 11: e111074. doi: 10.5812/aapm.111074.
[19]	万玉骁, 张丹丹, 李阳, 等. 改良DOPS量表在麻醉科住院医师技能考核与培训中的应用[J]. 继续医学教育, 2021, 35: 35-38.
[20]	Lagoo JY, Joshi SB. Introduction of direct observation of procedural skills (DOPS) as a formative assessment tool during postgraduate training in anaesthesiology: Explora-tion of perceptions[J]. Indian J Anaesth, 2021, 65: 202-209.
[21]	Weissenbacher A, Bolz R, Zimmermann A, et al. Mentoring and workplace-based assessments for final year medical students: An effective way to increase satisfac-tion and competence?[J]. Anaesthesist, 2021, 70: 486-496.
[22]	Li KF, Liu BZ, Wu FF, et al. Outcome-based student assessment enhances academic performance in basic medical laboratory course[J]. Adv Physiol Educ, 2021, 45: 269-275.
[23]	Khan MR, Shariff AH, Nasim S, et al. Effectiveness of laparoscopic skills workshop on enhancing knowledge and skills of surgical residents and its comparison with DOPS (direct observation of procedural skills) scores: prospective cohort study[J]. Med Sci Educ, 2020, 30: 861-867.
[24]	Ong MN, Lew KM, Cheong YJ, et al. Can we use peer-assisted learning to teach basic surgical skills?[J]. Malays J Med Sci, 2020, 27: 101-107.
[25]	Walsh CM, Scaffidi MA, Khan R, et al. Non-technical skills curriculum incorporating simulation-based training improves performance in colonoscopy among novice endoscopists: randomized controlled trial[J]. Dig Endosc, 2020, 32: 940-948.
[26]	Mouli TC, Davuluri A, Vijaya S, et al. Effectiveness of simulation based teaching of ventilatory management among non-anaesthesiology residents to manage COVID 19 pandemic-A Quasi experimental cross sectional pilot study[J]. Indian J Anaesth, 2020, 64(Suppl 2): S136-S140.
[27]	Ghiasian L, Hadavandkhani A, Abdolalizadeh P, et al. Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training[J]. Indian J Ophthalmol, 2021, 69: 574-578.