Practice Perfect - PRESENT Podiatry
Practice Perfect
top title divider

Competency-Based Residency Training
Part 2: What Would It Look Like?

lower title divider
Jarrod Shapiro

In last week’s Practice Perfect, Competency-Based Residency Training Part 1: Volume is Not Equivalent to Competence, we discussed the current state of podiatric residency training focusing more on volume than competency. I called on our profession’s leaders to begin moving our programs toward true competency-based education. But what does competency-based education look like? How is this actually different from programs requiring residents to complete minimum activity volumes and 36 months of training? Let’s take a look at what competency-based residency training might look like.

But before we get to competency-based education, it’s worth commenting a little further on the model we currently use, which is essentially how most sophisticated professional education takes place: the apprenticeship. The phases and structure of an apprenticeship look strikingly familiar to our residency structure1:

  1. Modeling – the act is observed and contemplated
  2. Approximating – observer begins to mimic the actions of the teacher 
  3. Fading – the learner performs an increasing amount of the operation while the teacher performs less  
  4. Self-directed Learning – learner performs the entire task with assistance from the teacher only when necessary 
  5. Generalizing – learner applies skills to multiple new scenarios  

Doesn’t this look a lot like what we do in residency training, along the old adage “see one, do one, teach one”? I don’t know if this system is better or worse than a competency-based model, but it doesn’t seem to be where our educational leaders want us to go.

Competence Versus Competency

The CPME refers to competency throughout the 320 document, and for our purposes, they are essentially synonymous. Of the various definitions I’ve come across, this one seems to be the best

“Those characteristics – knowledge, skills, mindsets, thought patterns, and the like – that when used whether singularly or in various combinations, result in successful performance.”

Consider this definition in relation to residency training. Successful performance in our case might look, for example, like completing a lower extremity surgery or applying a nonsurgical treatment with improved patient pain reduction and functional outcomes. That is what we want our trainees to be able to do after graduating from their training. This view is considered “behavioristic” and focuses on specific skills, in contrast to a “holistic” approach, focusing on broad clusters of abilities necessary for successful performance4.

Either way, the largely unanswered question about competency is how it relates to performance. Being able to do a thing competently doesn’t mean I will actually do that thing. Essentially, can doesn’t mean will. For example, if I am assessing a resident on their ability to do a preoperative history and physical, my presence in the room may affect how they handle the encounter in a manner different than if they were alone. This becomes the issue with the validity of assessing competency with our trainees. In what way do we most effectively assess our residents?


“We need to find the most effective way to transfer our expertise to our trainees, have our trainees perform to the highest standards possible, and then assess our trainees to demonstrate that level of quality to the public.”


What Competency-Based Training Looks Like

All this brings us finally to what competency-based training might look like. It turns out – somewhat anticlimactically – that it may be impossible to create true competency-based training. Let’s get to the utilitarian bottom line of this, though, since we have to do something. We’re training doctors whose job is to treat disorders affecting the lower extremities. We need to find the most effective way to transfer our expertise to our trainees, have our trainees perform to the highest standards possible, and then assess our trainees to demonstrate that level of quality to the public.

The competency-based residency of the future could look something like this:

  • MAVs and the 36-month minimum time requirements would be dissolved in favor of completion of demonstrated performance indicators.  
  • Our trainees would be “certified” in specific knowledge, skills, and behaviors and then moved sequentially to the next level with remediation and retesting occurring as necessary. 
  • Simulations would be used to introduce and assess procedural aspects prior to direct patient care experiences. For example, a resident would do 10 Austin osteotomies on bone models before doing one on a live patient. 
  • Focused constructive and documented feedback would be a standardized aspect of all simulations.  
  • Computer-based patient simulations would periodically determine knowledge and thought process aspects of patient care.  
  • Programs would use a nationally standardized set of assessment documents, rubrics, and checklists during the various examinations.  
  • OSCEs (objective structured clinical examinations) and OSATS (objective structured assessment of technical skills) tests at specific intervals would be performed. 
  • Residents would be required to keep a portfolio of their work during residency, including reports of testing results, certifications, and actual patient outcomes. 
  • Mentoring/preceptor letters would be included discussing specific interactions, ratings, and comments covering subjective aspects such as professionalism, strengths, and weaknesses. 

As you already noticed, this is a resource heavy method that would require the use of expensive technologies, faculty time, assessor training, and changes to our national accreditation system. Don’t hold your breath for this system to be instituted any time soon.

I’ll end this discussion by summarizing the conclusions from a well-written white paper review covering what we know on the competency assessment subject5:

  • Competency can be assessed by tests or inferred from performance.  
  • Competency is not performance. Internal and external factors will determine if a provider will apply that competency. 
  • Detailed and immediate feedback is effective for learning.  
  • Standards of competency must be clearly defined.  
  • Competency can be measured using a variety of methods, each with its own strengths and weaknesses.  
  • Assessors must be trained to accurately assess trainees.  
  • Different types of assessors at various levels can be used.  
  • Checklists are useful for giving feedback to trainees. 
  • Written or computerized tests are effective for evaluating knowledge but not skills. 
  • Experts and trained observers can effectively measure skill-based competencies, especially in the form of OSCEs. 

Until changes along these lines occur, we’ll remain in the MAV, activity-based, non-standardized apprenticeship-based residency education model, which is not optimal. One of my Western University partners and I are in the earliest stages of planning a move toward a more competency-based model for the Chino Valley Medical Center residency with future research to demonstrate its effectiveness. I hope to have more to report on this in the future.

Best wishes.
Jarrod Shapiro Signature
Jarrod Shapiro, DPM
PRESENT Practice Perfect Editor
[email protected]
article bottom border
References
  1. Educational Theory of Apprenticeship. Wikipedia. Last accessed 10/7/2017.
    Follow this link
     
  2. Teodorescu T. COMPETENCE VERSUS COMPETENCY: What is the Difference? Performance Improvement. Nov/Dec 2006;45(10).
    Follow this link
     
  3. The Competency Casebook: Twelve Studies in Competency-Based Performance Improvement. Dubois DD ed. HRD Press Inc. 1998, page v.
    Follow this link
     
  4. Nursing competence: what are we measuring and how should it be measured? Policy +. June 2009 Issue 18.
    Follow this link
     
  5. Kak N, Burkhalter B, and Cooper MA. Measuring the Competence of Healthcare Providers. Operations Research Issue Paper 2(1). Bethesda, MD: Published for USAID by the Quality Assurance Project.
    Follow this link
     
Get a steady stream of all the NEW PRESENT Podiatry eLearning by becoming our Facebook Fan. Effective eLearning and a Colleague Network await you.

This ezine was made possible through the support of our sponsors:

Grand Sponsor




Major Sponsor