American Board of Family Medicine Heart Failure Self-Assessment Module Simulation Actions vis-à-vis Guideline Recommendations

The American Board of Family Medicine (ABFM) introduced Maintenance of Certification for Family Physicians in 2004 in response to policy adopted by the American Board of Medical Specialties.¹ The ABFM reported in 2006 the initial Diplomate experiences with Maintenance of Certification for Family Physicians.² At that time, the ABFM had Self-Assessment Modules (SAMs, consisting of a 60-item knowledge assessment followed by a virtual patient clinical simulation) available only for hypertension, type 2 diabetes mellitus, asthma, and depression. Since that time, the ABFM has deployed modules for coronary artery disease, chronic heart failure, well child care, maternity care, preventive care, care of the vulnerable elderly, pain management, early childhood illness, cerebrovascular disease, and health behavior. Each of the SAMs includes a Diplomate assessment of both the knowledge assessment and the simulation components.

In addition to the Diplomates' subjective assessments of the SAMs, the ABFM captures the actions taken during each simulation, including the action itself, the simulated date and time of the action, and the simulated patient's current health state. This information is captured in an action log, which serves as a persistent record of the Diplomate's traversal through the simulation scenario.

The ABFM introduced the congestive heart failure SAM and associated simulation in 2006. We present here a graphical summary of simulation actions taken in the congestive heart failure SAM as extracted from the simulation action logs from 2006 to 2011. We present the results as a percentage of simulations in which given actions occurred.

The results indicate overall high use of angiotensin-converting enzyme inhibitors and/or angiotensin receptor blockers but surprisingly low use of β-adrenergic blocking agents (β-blockers). Digitalis preparations (DigitalisPrep) demonstrated very low use. The majority of Diplomates also did a formal assessment of left ventricular function (echocardiogram).

The CHF simulations generally present scenarios representing patients with stage C heart failure, as defined in the 2009 American College of Cardiology Foundation/American Heart Association heart failure guideline.³ According to that guideline, ACE inhibitors and β-adrenergic blockers should routinely be used in these patients.³ This discrepancy between recommended therapy and the low percentage of β-adrenergic blocker prescriptions in the simulations suggests that the knowledge assessments should perhaps place greater emphasis on the use of these agents in class C heart failure. The current congestive heart failure knowledge assessment contains only 7 items that reference β-blockers, and nearly all these present a β-adrenergic agent only as historical information in the clinical stem of the item rather than as a focus of decision-making in the item.

These results suggest that the simulations, although clearly presenting a virtual patient environment, can serve as a useful probe for identifying possible management gaps that should be emphasized in the SAM knowledge assessments. (Figure 1)

• Download figure
• Open in new tab

Figure 1.

Analysis of actions taken during the Chronic Heart Failure Simulations from 2005 through 2010. Percent is the percentage of simulations in which the action occurred. ACEInhibitors, an angiotensin converting enzyme (ACE) inhibitor prescribed; ACEInhibitorsARBS, ACE inhibitor or angiotensin receptor blocker prescribed; BetaBlockers, beta adrenergic blocking agent prescribed; DigitalisPrep, digitalis preparation prescribed; Echocardiogram, echocardiogram obtained; Hydralazine, hydralazine prescribed; Nitroglycerin, nitroglycerin prescribed; SmokingQuestions, patient queried regarding smoking behavior; StressImageStudy, Cardiac Stress Imaging Study obtained; TSH, thyroid stimulating hormone level obtained.