Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Abstracts In Press
    • Archives
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Abstracts In Press
    • Archives
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Article CommentaryCommentary

Lost In Translation: The Value of Qualitative Data

David Lanier
The Journal of the American Board of Family Practice September 2005, 18 (5) 409-410; DOI: https://doi.org/10.3122/jabfm.18.5.409
David Lanier
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • References
  • Info & Metrics
  • PDF
Loading

At first glance, it would be easy to relegate the study by Backer et al,1 published in this issue of the Journal, to the growing inventory of articles reporting less than fully successful attempts to improve the implementation of effective clinical services in practice. The major goal of the Every Woman Matters study—to increase documentation of mammograms and Papanicolaou smears among eligible women seen in primary care practice—was achieved in less than a third of the practices in which the chosen intervention was introduced, and the observed increases reached statistical significance (compared with baseline) in only a single practice. There are a number of reasons, however, why Backer’s work should not be so quickly dismissed.

At the top of the list is the rich qualitative data included in the report, which describes the process of change (or resistance to change) that occurred in each of the practices. Of particular interest are the insights this information provides into practices that were unable to accomplish the goals they had set for themselves. The descriptions of the initial conditions in these practices—including the values of the practice leaders, the relationships among clinicians and staff, and methods of responding to the often chaotic health care environment—adds greatly to our understanding of why practice change in this country is often so difficult. Such information is all too frequently not collected or not included in published reports of more quantitative research. One wonders what valuable new knowledge about practice change might have been lost over the past 2 decades by the numerous investigators who, in clinical trials, carefully observed whether a given intervention succeeded or failed in changing physician practices but apparently took little notice of how these results might have been affected by the unique situations faced by the physicians enrolled in the study. If the Every Woman Matters study can be criticized for anything, it is that the observations of contextual factors were not even more detailed. It would have been valuable to know, for example, the extent to which each practice had access to computerized patient data (eg, patient registries or reminders) and how comfortable physicians and staff felt in using computers in the everyday delivery of preventive care.

Backer et al had good reason to believe that, in most practice settings, their intervention would significantly increase the rates of up-to-date preventive services. Previous research has shown that interventions focused on the individual physician are unlikely to be effective, and that interventions that rely on more than one method appear to be the most successful.2 Their intervention was multifaceted and targeted the entire practice team. It was based on the GAPS model, which calls for providing practices with individualized assistance in identifying and reducing barriers to quality improvement. This method has in the past been shown effective in increasing rates of preventive services delivery.3 In addition, the Every Woman Matters intervention had much in common with the more recently described STEP-UP approach, in which tailored interventions are applied to meet each practice’s unique and dynamic needs. In a recent study, implementation of the STEP-UP approach was shown to result in sustained increases (over 24 months) in the rate of delivery of preventive services in primary care practices.4

The odds, however, were against the Every Woman Matters study producing similarly positive quantitative results. The STEP-UP study involved 79 practices, 39 of which were randomized to the intervention; the Every Woman Matters sample was limited to 7 practices. The larger sample size allowed the STEP-UP study to demonstrate overall effectiveness despite the fact that the intervention’s effect was inconsistent. The impact was large in some practices; in others, it resulted in no change or even a decrease in services delivered. The failure of Backer’s study to demonstrate similarly positive overall results could simply be due to an inadequate sample of practices. The less positive results could also be related to the fact that the study practices were randomly selected from a list of those participating in the state-run, federally funded Every Woman Matters program, whereas practices volunteered to participate in the STEP-UP study and thus may have entered that study with a greater readiness for change. Before it is written off, the Every Woman Matters intervention deserves to be tested in a larger number of primary care practices. To determine just how widely and easily the intervention (if proven effective) could be disseminated, the investigators should collect not only qualitative contextual data about the practices but also information about the cost of implementation.

A decade of studies on how to translate research into practice has taught us, if nothing else, that bringing about change in practice will not be simple. The primary care practice is a much more complex system than most of us originally imagined, and there appears to be great diversity in the specific features of individual practice settings.5 Future research must not only look for innovative ways of effecting change in a wide configuration of practices. It also needs to take an in-depth look at primary care practices over time and to account for the effects on practice of the rapidly evolving health care environment. Data, and particularly qualitative data, that helps us understand practice and find better ways of facilitating positive change in practice must not be lost in the process of studying translation but instead be routinely collected as part of the research effort. This information will inevitably provide important lessons for improving the quality of care provided to our patients.

Notes

  • Conflict of interest: none declared.

  • Received for publication July 1, 2005.

References

  1. ↵
    Backer EL, Geske JA, McIlvain HE, et al. Improving female preventive health care delivery through practice change: an Every Woman Matters study. J Am Board Fam Pract 2005; 18: 401–8.
    OpenUrlAbstract/FREE Full Text
  2. ↵
    Greco PJ, Eisenberg JM. Changing physicians’ practices. N Engl J Med 1993; 329: 1271–4.
    OpenUrlCrossRefPubMed
  3. ↵
    Dietrich AJ, Woodruff CB, Carney PA. Changing office routines to enhance preventive care. The preventive GAPS approach. Arch Fam Med 1994; 3: 176–83.
    OpenUrlCrossRefPubMed
  4. ↵
    Stange KC, Goodwin MA, Zyzanski SJ, Dietrich AJ. Sustainability of a practice-individualized preventive service delivery intervention. Am J Prev Med 2003; 25: 296–300.
    OpenUrlCrossRefPubMed
  5. ↵
    Miller WL, Crabtree BF, McDaniel R, Stange KC. Understanding change in primary care practice using complexity theory. J Fam Pract 1998; 46: 369–76.
    OpenUrlPubMed
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family Practice: 18 (5)
The Journal of the American Board of Family Practice
Vol. 18, Issue 5
1 Sep 2005
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Lost In Translation: The Value of Qualitative Data
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
5 + 11 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Lost In Translation: The Value of Qualitative Data
David Lanier
The Journal of the American Board of Family Practice Sep 2005, 18 (5) 409-410; DOI: 10.3122/jabfm.18.5.409

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Lost In Translation: The Value of Qualitative Data
David Lanier
The Journal of the American Board of Family Practice Sep 2005, 18 (5) 409-410; DOI: 10.3122/jabfm.18.5.409
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Notes
    • References
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Empowering Family Physicians in Medical Staff Leadership to Foster Physician Well-Being
  • Maternity Care Deserts: Key Drivers of the National Maternal Health Crisis
  • Training in Gender Affirming Care is Medically Necessary
Show more Commentary

Similar Articles

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire