Journal of Surgical Education
Volume 66, Issue 6 , Pages 352-356 , November 2009

Refining the Evaluation of Operating Room Performance

  • Michael J. Kim, MD

      Affiliations

    • Department of Surgery, University of Rochester, Rochester, New York
    • Corresponding Author InformationCorrespondence: Inquiries to Michael J. Kim, MD, Department of Surgery, University of Rochester, 601 Elmwood Avenue, Box SURG, Rochester, NY 14642; fax
  • ,
  • Reed G. Williams, PhD

      Affiliations

    • Department of Surgery, Southern Illinois University, Springfield, Illinois
  • ,
  • Margaret L. Boehler

      Affiliations

    • Department of Surgery, Southern Illinois University, Springfield, Illinois
  • ,
  • Janet K. Ketchum

      Affiliations

    • Department of Surgery, Southern Illinois University, Springfield, Illinois
  • ,
  • Gary L. Dunnington, MD

      Affiliations

    • Department of Surgery, Southern Illinois University, Springfield, Illinois

References 

  1. ACGME. Accreditation Council for Graduate Medical Education: Surgery Program Requirements. http://www.acgme.org/acwebsite/rrc_440/440_prindex.asp2008;
  2. Gumbs AA, Hogle NJ, Fowler DL. Evaluation of resident laparoscopic performance using global operative assessment of laparoscopic skills. J Am Coll Surg. 2007;204:308–313
  3. Aggarwal R, Grantcharov T, Moorthy K, et al. Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Ann Surg. 2008;247:372–379
  4. Chang L, Hogle NJ, Moore BB, et al. Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov. 2007;14:122–126
  5. Larson JL, Williams RG, Ketchum J, et al. Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents. Surgery. 2005;138:640–647discussion: 647-649
  6. Wohaibi EM, Earle DB, Ansanitis FE, et al. A new web-based operative skills assessment tool effectively tracks progression in surgical resident performance. J Surg Educ. 2007;64:333–341
  7. Doyle JD, Webber EM, Sidhu RS, et al. A universal global rating scale for the evaluation of technical skills in the operating room. Am J Surg. 2007;193:551–555discussion: 555
  8. Ritchie WP, Rhodes RS, Biester TW. Workloads and practice patterns of general surgeons in the United States, 1995-97: a report from the American Board of Surgery. Ann Surg. 1999;230:533–542discussion: 542-543
  9. Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–278
  10. Guerlain S, Adams RB, Turrentine FB, et al. Assessing team performance in the operating room: development and use of a “black-box” recorder and other tools for the intraoperative environment. J Am Coll Surg. 2005;200:29–37
  11. Aggarwal R, Grantcharov T, Moorthy K, et al. An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg. 2007;245:992–999
  12. Regehr G, MacRae H, Reznick RK, Szalay D. Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med. 1998;73:993–997
  13. Way LW, Stewart L, Gantert W, et al. Causes and prevention of laparoscopic bile duct injuries: analysis of 252 cases from a human factors and cognitive psychology perspective. Ann Surg. 2003;237:460–469
  14. Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003;15:270–292
  15. Shea JA, Fortna GS. Psychometric methods. In:  Norman GR,  Van Der Vleuten CPM,  Newble DI editor. International Handbook of Research in Medical Education. Boston, Mass: Kluwer Academic Publishers; 2002;p. 97–126

 This research was conducted while Michael J. Kim was a Research Fellow in the Department of Surgery at Southern Illinois University.

 Supported in part by a grant from the American Board of Surgery.

PII: S1931-7204(09)00155-X

doi: 10.1016/j.jsurg.2009.09.005

Journal of Surgical Education
Volume 66, Issue 6 , Pages 352-356 , November 2009