Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Abstracts In Press
    • Archives
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Abstracts In Press
    • Archives
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Research ArticleOriginal Research

Implementation and Evaluation of a Laboratory Safety Process Improvement Toolkit

Bethany M. Kwan, Douglas Fernald, Peter Ferrarone, Natalia Loskutova, Jodi Summers Holtrop, Elizabeth W. Staton and John M. Westfall
The Journal of the American Board of Family Medicine March 2019, 32 (2) 136-145; DOI: https://doi.org/10.3122/jabfm.2019.02.180109
Bethany M. Kwan
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
PhD, MSPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Douglas Fernald
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Ferrarone
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
MA, MSW
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Natalia Loskutova
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jodi Summers Holtrop
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
PhD, MCHES
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth W. Staton
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
MSTC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John M. Westfall
From the Department of Family Medicine, University of Colorado School of Medicine, Aurora, CO (BMK, DF, PF, JSH, EWS, JMW); American Academy of Family Physicians National Research Network, Leawood, KS (NL).
MD, MSPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Tables

    • View popup
    Table 1.

    Contents of the Agency for Healthcare Research and Quality's “Improving Your Laboratory Testing Process” Toolkit*

    ChapterDescription
    IntroductionDescribes purpose of the toolkit and overview of its use
    The Improvement ProcessDepicts example of the discrete steps in a lab testing process
    ASSESSProvides overview of assessments to guide focus and scope of improvement effort from practice and patient perspectives
        Assess Your Testing Process
        Assess Office Readiness
        Assess the Patient Experience
        Assess Your Documentation
    PLANProvides guidance on planning for improvements
        Plan for Improvements
    IMPLEMENTProvides guidance on implementing changes
        Get Ready and Implement Your Change
    RE-ASSESSGuides interpretation of effects of changes
        Reassess: Did We Improve?
    APPENDICESAdditional tools for assessment and communication
        The Patient Handout
        Electronic Health Record Evaluation
    • ↵* The final version of the AHRQ toolkit can be found here: https://www.ahrq.gov/professionals/quality-patient-safety/hais/tools/ambulatory-care/labtesting-toolkit.html.

    • View popup
    Table 2.

    Implementation and Data Collection Events, Timing, Participants, and Length of Interactions between Research Staff and Clinicians and Staff of Two Primary Care Practices

    TimingEventMaterialsDurationPractice 1 ParticipantsPractice 2 Participants
    4 to 5 weeks prior to start of pilot testingIntroductory phone callPractice participation information and agreements1 hourClinic managerClinician champion
    Week 1 of implementationBaseline Site Visit.Agenda4 hours total
    Toolkit
    Interview guides
    Toolkit orientation and project expectationsToolkit30 minutes1 Clinic managerProject lead clinician
    2 physicians, 1 physician assistant (PA), 3 medical assistants (MAs), 2 receptionists, 1 care coordinator4 resident physicians
    1 practice manager
    1 clinic manager
    2 lab staff
    Group interviews with practice toolkit implementation teamBaseline interview guide1.5 to 2 hours1 Clinic managerClinician champion
    1 physician2 resident physicians
    3 MAs1 lab staff
    Lab process observation and mappingProcess observation guide1.5 hours1 physicianClinician champion
    3 MAs2 lab staff
    2 weeks into implementationEarly implementation check-in callNone30 minutesClinic managerClinician champion
    4 weeks into implementationMid-point interviewsMid-point interview guide1 hourClinic managerClinician champion
    7 to 8 weeks post- baselineFollow-up site visitAgenda.4 hours
    Interview guide
    Group and individual interviewsFollow-up interview guide2 hoursClinic managerClinician champion
    3 MAs2 resident physicians
    2 MAs
    Process map revisionsBaseline process map1.5 hoursClinic managerClinician champion
    3 MAs1 resident physician
    1 lab staff
    1 lab manager
    12 weeks post-baselineFollow-up phone callFollow-up interview guide30 minutesClinic managerClinician champion
    • View popup
    Table 3.

    Characteristics of Two Practices Implementing the Agency for Healthcare Research and Quality's Improving Your Laboratory Testing Process Toolkit

    Practice CharacteristicsGeneral Internal Medicine PracticeFamily Medicine Residency Practice
    Number of clinicians4 physicians, 1 physician assistant34 physicians (24 residents, 10 faculty)
    Average number of patients per week160/week486/week
    SettingSmall metropolitan (50,000 to 250,000)Medium metropolitan (250,001 to 1000,000 people)
    Majority ownership of practiceIntegrated delivery systemMedical school
    Quality improvement teamYes; meets weeklyYes; meets 1 to 2 times per month
    Number of years using electronic health records8 years14 years
    Communication of lab results (portal, phone, and/or letter)All three, depending on patient or provider preference;All three, depending on patient or provider preference;
    Phone call used for urgent resultsPhone call used for urgent results
    Lab interface processBidirectionalBidirectional
    Patient population
    Children (under 18 years of age)0%36%
    Adult (between 18 and 64 years of age)79%56%
    Adult (Age 65 years and older)21%8%
    • View popup
    Table 4.

    Summary of Lab Safety Toolkit Use and Outcomes Case Reports

    Case Report 1
    SpecialtyFamily Medicine (FM)
    Practice TypeResidency
    LocationThis practice provides a full range of services and serves a mostly urban core population in a medium sized city (population 250,001 to 1,000,000) and includes a large refugee community.
    ContextThe practice uses one of the most widely used electronic health records (EHR) systems. This practice has experience with and established processes for doing quality improvement (QI,) including monthly QI meetings. The medical director runs or oversees all of the QI projects. The clinic manager is well trained and experienced in QI. The QI team displays all ongoing QI projects on a whiteboard in a central practice location to keep others in the practice apprised of ongoing QI efforts. They periodically undertake the QI process called Plan Do Study Act (PDSAs) and Kaizen events (rapid improvement events). Residents go through a practice management rotation where they gain exposure to QI. The clinic has good teamwork and communication between the physicians, residents, and the staff. Stable Medical Assistant (MA) staffing is a recent development and it has helped the clinic.
    Summary of Toolkit UseWhen the FM residency practice implementation team was first introduced to the toolkit, they had ideas about what they wanted to improve in their laboratory testing process. The implementation team initially thought they would work on test ordering, previously identified as a problem for their clinic through team discussions. However, when they met with the full practice and administered the “Assessing your Testing Process” tool to 15 to 20 clinicians, the results showed that inconsistent communication of results to patients was rated as more harmful to patients than were problems with the test ordering process. This was contrary to their initial opinions about which part of the testing process they anticipated working on at the outset of the project.
    OutcomesUsing the assessment data, the implementation team shifted the focus of their lab process improvement activities to focus on patient communication, specifically the process of ensuring all patients have received their results. The developed a “dot phrase” for the EHR to document patient preferences for receiving normal results by letter or another method. Dot phrases are shorthand codes that prepopulate common phrases into documentation for an encounter. For example typing “results” automatically adds the phrase “Patient would like normal results returned via mail.” Some MAs started using the dot phrases. They also developed a dot phrase for clinicians regarding their orders for communicating next steps to the patient pending lab results, so that the patient care staff know what action needs to be taken. The practice is piloting this in the clinic group and will then disseminate more broadly in the clinic. The practice also plans to make results letters in different languages, especially for the Somali refugee patients, but that plan has been harder to implement given the many dialects and the cost of translation services.
    Case Report 2
    SpecialtyGeneral Internal Medicine (GIM)
    Practice TypePart of an integrated health system
    LocationThe practice serves a mixed urban and suburban population in small sized city (population 50,000 to 250,000).
    ContextThis former private practice joined a local integrated health system about two years prior to this project. It used a widely used EHR system and maintains registries for patients with diabetes and hypertension. The practice is recognized as a Level III patient-centered medical home (PCMH), and is actively involved in multiple advanced primary care practice initiatives. It had a highly engaged practice manager, extensive QI experience, and a history of success with laboratory process improvement projects. The practice holds regular monthly QI team meetings, with representation from all applicable roles in the practice, two patients, plus the head of population health/ambulatory care for the affiliated hospital. There is good teamwork between the MAs and appropriate prompting and insistence on QI from the physicians. Staff engagement indicated a supportive climate and culture for QI. Data systems for monitoring patient experience were in place. The practice reviewed patient feedback quarterly and more frequently when feedback was less positive.
    Summary of Toolkit UseThe GIM practice used the Patient Experience Survey in the toolkit to assess their patients' level of understanding and knowledge about the lab tests that were ordered. Although most patients indicated on the survey that they did know why a test was ordered, the care teams observed that, due to the project, more patients were asking questions about what their lab test is or what the results mean.
    OutcomesOne MA said about this change from before the project to after the project finished: “It's maybe the realization that we are trying to make sure that they understand what's going on. Now that they know that, it's like, &lquote;Okay, well I can ask them questions. They don't mind if I ask questions.” This led the QI team to reinstitute systematic use of patient education handouts for commonly ordered lab tests and encourage care team members to engage patients in conversations about the reason for their tests and what results they should expect to receive and when. In consultation with the affiliated hospital, the practice created a handout on common blood tests to educate their patients about the test that was ordered and the reason why it was ordered. Thus, use of the revised toolkit helped the practice better engage patients in their care.
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 32 (2)
The Journal of the American Board of Family Medicine
Vol. 32, Issue 2
March-April 2019
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Implementation and Evaluation of a Laboratory Safety Process Improvement Toolkit
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
4 + 13 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Implementation and Evaluation of a Laboratory Safety Process Improvement Toolkit
Bethany M. Kwan, Douglas Fernald, Peter Ferrarone, Natalia Loskutova, Jodi Summers Holtrop, Elizabeth W. Staton, John M. Westfall
The Journal of the American Board of Family Medicine Mar 2019, 32 (2) 136-145; DOI: 10.3122/jabfm.2019.02.180109

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Implementation and Evaluation of a Laboratory Safety Process Improvement Toolkit
Bethany M. Kwan, Douglas Fernald, Peter Ferrarone, Natalia Loskutova, Jodi Summers Holtrop, Elizabeth W. Staton, John M. Westfall
The Journal of the American Board of Family Medicine Mar 2019, 32 (2) 136-145; DOI: 10.3122/jabfm.2019.02.180109
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Methods
    • Results
    • Discussion
    • Conclusions
    • Acknowledgments
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Multiple Research Methodologies Can Advance the Science of Family Medicine
  • Google Scholar

More in this TOC Section

  • Successful Implementation of Integrated Behavioral Health
  • Identifying and Addressing Social Determinants of Health with an Electronic Health Record
  • Integrating Adverse Childhood Experiences and Social Risks Screening in Adult Primary Care
Show more Original Research

Similar Articles

Keywords

  • Health Services Research
  • Implementation
  • Patient Safety
  • Primary Health Care
  • Qualitative Research
  • Quality Improvement
  • United States Agency for Healthcare Research and Quality

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire