A Novel, Web-Based Application for Assessing and Enhancing Practice-Based Learning in Surgery Residency

Introduction

Practice-Based Learning and Improvement (PBLI) is 1 of 6 integral competencies required by the Accreditation Council for Graduate Medical Education (ACGME) for proof of adequate resident training and accreditation of residency programs. Moreover, the Outcome Project of the ACGME is beginning to enforce the provision of documented, objective evidence of resident PBLI. Current assessment tools, such as resident portfolios and performance evaluations, by faculty tend to be qualitative in nature. However, few objective, outcome-based, and quantitative evaluation tools have been developed.

Methods

A web-based application was designed to assess every consultation performed by senior residents at a university-affiliated general surgery residency. In real time, residents documented patient presentations along with their initial impression and plan. As patient outcomes became available, they were also documented into this application, which allowed residents to self-assess whether their impressions and plans were correct. A running “batting average” (BA) is then calculated based on percentage correct.

Results

Seven senior residents participated in this study, which included a total of 459 consults: 222 documented by PGY4 residents and 237 documented by PGY5 residents. The average BA of PGY4 residents in their first 3 months was 82.9%, which was followed by 85.9%, 88.7%, and 94.3% for each of the next 3 quarters. For PGY5 residents, the corresponding results were 96.4%, 94.4%, 93.8%, and 96.4% respectively.

Conclusions

A web-based outcome-tracking program is useful for conducting rapid and ongoing evaluation of residents' practice-based learning, generating data for analysis of individual resident knowledge gaps, stimulating self-assessment and targeted learning, as well as providing objective data of PBLI for accreditation purposes.

Key Words: ACGME competencies, surgical residency, surgical education, practice based learning and improvement

Competency: Practice Based Learning and Improvement, Patient Care, Medical Knowledge