Journal of Surgical Education
Volume 65, Issue 2 , Pages 77-83 , March 2008

Assessing the Skills of Surgical Residents Using Simulation

  • Mohsen Tavakol, PhD

      Affiliations

    • Medical Education Unit, University of Nottingham, Nottingham, United Kingdom
    • Corresponding Author InformationCorrespondence: Inquiries to Mohsen Tavakol, PhD, School of Medicine, Nottingham University, QMC, Nottingham NG7 2HA, United Kingdom
    • ,
  • Mohammad Ali Mohagheghi, MD

      Affiliations

    • Medical Sciences/University of Tehran, Cancer Institute Research Centre, Tehran, Iran
    • ,
  • Reg Dennick, PhD

      Affiliations

    • Medical Education Unit, University of Nottingham, Nottingham, United Kingdom

References 

  1. Bradley P. The history of simulation in medical education and possible future directions. Med Educ. 2006;40:254–262
  2. Oxford University Press. http://www.oup.com
  3. Gordon J, Wilkerson W, Shaffer D, Armstrong E. ‘Practicing’ medicine without risk: students' and educators responses to high-fidelity patient simulation. Acad Med. 2001;76:469–472
  4. Issenberg SB, McGaghie WC, Hart IR, et al. Simulation technology for health care professional skills training and assessment. JAMA. 1999;282:861–866
  5. Issenberg SB, Scalesa RJ. Best evidence on high-fidelity simulation: what clinical teachers need to know. Clin Teacher. 2007;4:73–77
  6. Maran NJ, Glavin RJ. Low-to-high-fidelity simulation- a continuum of medical education?. Med Educ. 2003;37(suppl 1):22–28
  7. Epstein RM. Assessment in medical education. N Engl J Med. 2007;25:387–396
  8. Satava RM. Assessing surgery skills through simulation. Clin Teacher. 2006;3:107–111
  9. Pegden CD, Shannon RE, Sadowski RP. Introduction to Simulation using SIMAN. 2nd ed.. Hightstown, NJ: McGraw-Hill, Inc; 1995;
  10. American Psychological Association (APA)American Educational Research AssociationNational Council on Measurement in Education. Standards for educational and psychological tests. Washington, DC: American Psychological Association; 1974;
  11. McAleer S. Choosing assessment instruments. In:  Dent JA,  Harden RM editor. A Practical Guide for Medical Teachers. 2nd ed.. Edinburgh: Elsevier; 2005;p. 160–170
  12. Reznick RK. Teaching and testing technical skills. Am J Surg. 1993;165:358–361
  13. Gallagher AG, Ritter EM, Satava RM. Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc. 2003;17:1525–1529
  14. Moorthy K, Vincent C, Darzi A. Simulation-based training. BMJ. 2005;330:493–494
  15. Ker J, Mole L, Bradley P. Early introduction to interprofessional learning: a simulated ward environment. Med Educ. 2003;37:248–255
  16. Winckel CP, Reznick RK, Vohen R, Tavlor B. Reliability and construct validity of a structured technical skills assessment form. Am J Surg. 1994;167:423–427
  17. VanBlaricom AL, Goff BA, Chinn M, et al. A new curriculum for hysteroscopy training as demonstrated by an objective structured assessment of technical skills (OSATS). Am J Obstet Gynecol. 2005;193:1856–1865
  18. Holzman GB. Clinical simulation. In:  Coex KR,  Ewan CE editor. The Medical Teacher. London: Churchill Livingstone; 1998;p. 240–243
  19. Martin JA, Regehr G, Reznick R, et al. Objective structured of technical skill (OSTS) for surgical residents. Br J Surg. 1997;84:273–278
  20. Lenz GM, Mandel LS, Lee D, et al. Testing surgical skills of obstetric and gynecologic residents in a bench laboratory setting: validity and reliability. Am J Obstet Gynecol. 2001;184:1462–1470
  21. Reznick R, Regehr G, MacRae H, et al. Testing technical skills via an innovative “bench station” examination. Am J Surg. 1997;173:226–230
  22. Winckel CP, Reznick RK, Cohen R, Yaylor B. Reliability and construct validity of a structured technical skills assessment form. Am J Surg. 1994;167:423–427
  23. Goff BA, Lentz GM, Lee DM, Mandel LS. Formal teaching of surgical skills in an obstetric-gynecology residency. Obstet Gynecol. 1999;93:785–790
  24. Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65:S63–S67
  25. Wragg A, Wade W, Fuller G, et al. Assessing the performance of specialist registrar. Clin Med. 2003;3:131–134
  26. Marks M, Humphrey-Murto S. Performance assessment. In:  Dent JA,  Harden RM editor. A Practical Guide for Medical Teachers. 2nd ed.. Edinburgh: Elsevier; 2005;p. 323–334
  27. Harden R, Stevenson M, Wilson W, Willson G. Assessment of clinical competence using objective structured examination. BMJ. 1975;1:447–451
  28. Van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardized patients: state of the art. Teach Learn Med. 1990;2:58–76
  29. Rethans JJ, Sturmans F, Drop R, et al. Does competence of general practitioners predict their performance? (Comparison between examination setting and actual practice). BMJ. 1991;303:1377–1380
  30. Hodges B. OSCE! Variations on a theme by Harden. Med Educ. 2003;37:1134–1140
  31. Turnbull J, MacFadyen J, van Barneveld C, Norman G. Clinical work sampling: a new approach to the problem of in-training evaluation. Gen Intern Med. 2000;15:556–561
  32. Ram P, Grol R, Rethans JJ, et al. Assessment of general practitioners by video observation of communicative and medical performance in daily practice: issues of validity, reliability and feasibility. Med Educ. 1999;33:447–454
  33. Rethans JJ, Sturmans F, Drop R, Van der Vleuten C. Assessment of the performance of general practitioners by the use of standardized (simulated) patients. Br J Gen Prac. 1991;41:97–99
  34. Mandel LS, Lentz GM, Goff BA. Teaching and evaluating surgical skills. Obstet Gynecol. 2000;95:783–785
  35. Moorthy K, Munz Y, Sarker SK, Darzi A. Objective assessment of technical skills in surgery. BMJ. 2003;327:1032–1037
  36. Kopta JA. An approach to the evaluation of operative skills. Surgery. 1971;70:297–303
  37. Scott DJ, Valentine RJ, Bergen PC, et al. Evaluating surgical competency with the American board of surgery in-training examination, skill testing and intraoperative assessment. Surgery. 2000;128:613–622
  38. Cuschieri A, Francis N, Crosby J, Hanna GB. What do master surgeons think of surgical competence and revalidation?. Am J Surg. 2000;182:110–116
  39. Goff BA, Nielsen PE, Lentz GM, et al. Surgical skills assessment: a blinded examination of obstetrics and gynecology residents. Am J Obstet Gynecol. 2002;186:613–617
  40. Lentz GM, Mandel LS, Lee D, et al. Testing surgical skills of obstetrics and gynecology residents in a bench laboratory setting: validity and reliability. Am J Obstet Gynecol. 2001;184:1462–1468
  41. Satava RM. Assessing surgery skills through simulation. Clin Teacher. 2006;3:107–111
  42. Taylor A. Animal and Ethics: An Overview of Philosophical Debate. Peterborough, Ontario, Canada: Broadview Press; 2003;
  43. Kneebone RL, Nestel D, Vincent C, Darzi A. Complexity, risk and simulation in learning procedural skill. Med Educ. 2007;41:808–814
  44. Darzi A, Datta V, Mackay S. The challenge of objective assessment of technical skill. Am J Surg. 2001;181:484–486
  45. Mackay S, Datta V, Mandalia M, Basset P, Darzi A. Electromagnetic motion analysis in the assessment of surgical skill: relationship between time and movement. ANZ J Surg. 2002;72:632–634
  46. Datta V, Mackay S, Mandalia M, Darzi A. The use of electromagnetic motion tracking analysis to objectivity measurer open surgical skill in the laboratory-based model. J Am Coll Surg. 2001;193:479–485
  47. Datta V, Chang A, Machay S, Darzi A. The relationship between motion analysis and surgical technical assessment. Am J Surg. 2002;184:70–73
  48. Datta V, Mandalia M, Machay S, et al. Relationship between skill and outcome in the laboratory-based model. Surgery. 2002;131:318–323
  49. Torkington J, Smith R, Rees B, Darzi A. Skill transfer from virtual reality to a real laparoscopic task. Surg Endosc. 2001;15:1076–1079
  50. Rose J, Brown JD, Barreca M, et al. The Blue DRAGON- a system for monitoring the kinematics and the dynamics of endoscopic tools in minimally invasive surgery for objective laparoscopic skills assessment. Stud Health Technol Inform. 2002;85:412–418
  51. Macmillan AI, Cuschieri A. Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. Am J Surg. 1999;177:274–277
  52. Graham KS, Deary IJ. A role for aptitude testing in surgery?. J R Coll Surg Edinb. 1999;36:70–74
  53. McCloy R, Stone R. Virtual reality in surgery. BMJ. 2001;323:912–915
  54. Henriques DYP, Soechting JF. Approaches to study of haptic sensing. J Neurophysiol. 2005;93:3036–3043
  55. Williams RL, Srivastava M, Conatser RR, et al. Implementation and evaluation of a haptic playback system. Haptics-e J IEEE Robot Automat Soc. 2004;3:1–6
  56. Rolfsson G, Nordgren A, Bindzau S, et al. Training and assessment of laparoscopic skills using a haptic simulator. Stud Health Technol Inform. 2002;85:409–411
  57. DeOrio JK, Peden JP. Accuracy of haptic assessment of patellar symmetry in total knee arthroplasty. J Arthroplasty. 2004;19:629–634
  58. Broeren J, Bjorkdahl A, Pascher R, Rydmark M. Virtual reality and haptics as an assessment device in the postacute phase after stroke. Cyberpsychol Behav. 2002;5:207–211
  59. Szalay D, MacRae H, Regehr G. Using operative outcome to assess technical skill. Am J Surg. 2000;180:234–237

PII: S1931-7204(07)00255-3

doi: 10.1016/j.jsurg.2007.11.003

Journal of Surgical Education
Volume 65, Issue 2 , Pages 77-83 , March 2008

Article Tools