Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Abstracts In Press
    • Archives
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Abstracts In Press
    • Archives
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Research ArticleSpecial Communication

Looking Back to Move Forward: Reflections of PBRN Directors

C. J. Peek, Frank M. Reed, Ned Calonge, Paul A. Nutting, John Hickner, Wilson D. Pace, Jennifer Carroll, Linda Niebauer and Larry A. Green
The Journal of the American Board of Family Medicine September 2024, 37 (5) 955-968; DOI: https://doi.org/10.3122/jabfm.2023.230271R2
C. J. Peek
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frank M. Reed
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ned Calonge
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul A. Nutting
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
MD, MSPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John Hickner
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wilson D. Pace
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jennifer Carroll
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Linda Niebauer
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Larry A. Green
From the Department of Family Medicine and Community Health, University of Minnesota Medical School (CJP); Department of Biomedical and Pharmaceutical Sciences, University of Montana, (Retired) (FMD); Colorado School of Public Health, University of Colorado School of Medicine (NC); Department of Family Medicine, University of Colorado Health Sciences Center (retired) (PAN); (deceased) Department of Family Medicine, University of Illinois School of Medicine Chicago (JH); Department of Family Medicine, University of Colorado School of Medicine, DARTNet Institute, Colorado (WDP); Department of Family Medicine, University of Colorado School of Medicine, (JC, LN); University of Colorado School of Medicine (LAG).
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Figure 1.
    • Download figure
    • Open in new tab
    Figure 1.

    Change concepts in 1979 Ambulatory Sentinel Practice Network (ASPN) proposal.

Tables

  • Figures
    • View popup
    Table 1.

    Era 1. Launching a Brave New Idea (1978–1988)

    Events Calling for Something NewDevelopmental Response
    Mismatch between research and real-world needs
    A drive to investigate and define optimal care for patients seen in community practice and how it might differ from guidelines promulgated by academic centers.
    A few leaders with words for the problem, local experience, a new idea, and a starter plan
    ASPN proposed in 1978; endorsed by NAPCRG in 1979
    National doubts about the feasibility of gathering scattered, independent practices into a research enterprise
    PC practices not seen as places with research skills, questions, or answers. “Research starts with questions, not networks”; “Practicing docs won’t do research.”
    Pull together practices already successfully doing research
    Initiate a binational network with operations supported by enthusiastic volunteerism and in-kind efforts.
    Publish early studies pertinent to frontline practice, with evaluations of data completeness and accuracy.
    PBRN research about primary care was not appreciated by most medical journals.
    Most editors didn’t view primary care practice as a source of important questions and answers.
    Face to face visits with editors of journals to show PBRN purposes and capacities
    Publish in an expanding set of appreciative journals.
    No playbook for how to establish and operate a PBRN
    Little preexisting body of “how-tos” for running a network and studies. Processes and policies not clarified or institutionalized.
    Develop PBRN policies and procedures
    Criteria and processes were developed for developing studies, governance and decision-making, data14 requirements and protections, publication procedures, communication channels. Share widely with other PBRNs and learn from other PBRN’s experience.
    Pressing need for early financial support to complement the energetic volunteerism
    Funding for the PBRN itself—to maintain the network and collaboration as well as project-specific funds
    With bridge funding when primary funding suddenly went away
    Embed network in existing departments of family medicine and NAPCRG while obtaining foundation funding
    When primary funding stopped, FM organizations insisted practices continue as ASPN and together with health-oriented foundations, funded development and early projects, building network expenses into project budgets.
    Practices and their network champions enthusiastically continued network membership and studies.
    The opportunity to take a developmental step toward challenging studies of societal importance.
    The need to show success with well-funded timely important findings to pressing issues; demonstrate practice capacity to do research
    Obtain peer-reviewed research funding for large, challenging studies.
    Diversify funding from other sources, such as a cooperative agreement with the Centers for Disease Control (CDC) to determine the seroprevalence of human immune deficiency virus in frontline practice.
    At the end of this era:
    ASPN was a viable, committed network of US/Canada family physicians and practices dedicated to asking and answering questions about “health problems experienced by most of the people most of the time.”
    Proof of concept led to larger and more diversified funding for more challenging studies and expand into the mainstream of research. ASPN was poised for growth.
    • Abbreviations: PBRN, practice-based research network; ASPN, ambulatory sentinel practice network.

    • View popup
    Table 2.

    Era 2. Expansion into Mainstream of Research (1988–1999)

    Events Calling for Something NewDevelopmental Response
    Large, nationally important health care issues compelled practice-based research
    Such health policy issues revealed the need for development and expansion of primary care and research about emerging primary care issues.
    Seminal studies were published via ASPN. Examples: Otitis media, HIV seroprevalence, lab errors, depression in primary care
    ASPN shared its methods widely among regional primary care PBRNs and PBRNs in other specialties and urged the establishment of AHCPR.
    Balancing what practices and clinicians want with the needs of national research policy questions was seen as key to relevance, independence, financial sustainability and growth.
    Some funders aligned with PBRN purposes, e.g., Agency for Health Care Policy and Research (AHCPR); now AHRQ with legislative requirements focused on primary care.
    ASPN responded to clinicians in practices AND wider national policy questions in a way that clinicians experienced as also locally meaningful.
    Bring other family medicine research networks into the annual ASPN Convocation to share results and methods, build partnerships, and contemplate new studies.
    Help lead national PBRN conferences sponsored by the new AHRQ Center for Primary Care Research.
    Trends in research design and implementation emerged to challenge practice-based research.
    Addressing more complex clinical and public policy questions required methods not familiar to PBRNs, e.g. group randomized trials. Important questions outnumbered experienced PIs available to PBRNs.
    Recruit experienced PIs to become familiar with PBRN practice values and the strengths and constraints inherent in PBRN research
    Growing financial challenges came with more complex projects and network
    As ASPN rose to meet new research challenges came increased difficulty sustaining more complex network infrastructure required for more complex projects.
    Need recognized for alliance with a larger entity capable of ongoing infrastructure support
    Overlapping sources of funding established
    Foundations, NIH, AHCPR, HRSA, CDC grants & contracts provided substantial funds for larger studies.
    Established indirect cost rates for ASPN and capture as direct research expenses those that could not be funded through indirect cost rates.
    Partner with the AAFP as the AAFP National Research Network (NRN).
    At the end of this era:
    ASPN had deployed a portfolio of research methods matched to different questions and published many studies, including several large ones funded by nationally recognized research organizations, e.g., AHCPR on otitis media, NIMH on Depression Care, CDC on Lab Errors, and AHRQ on Referral in Primary Care.
    ASPN and many other PBRNs had become an established respected source of new and timely knowledge. Many PBRNs were established as a component of the health and health care research enterprise.
    AHRQ championed PBRNs and enabled networks to share strategies and methods.
    ASPN partnered with AAFP and entered Era 3 as the AAFP National Research Network.
    • Abbreviations: PBRN, practice-based research network; ASPN, ambulatory sentinel practice network.

    • View popup
    Table 3.

    Era 3. Scaling up and Adapting to Evolving Technology, Organizational, and Business Models in Health Care (2000–2021)

    Events Calling for Something NewDevelopmental Response
    Dramatic growth in number and complexity of studies along with network size.
    Emergence of many PBRNs, partnerships with array of academic organizations and— other PBRNs, move into large grants and randomized trials.
    Need for scaled up infrastructure with updated governance and relationships
    Full-scale governance and business model through AAFP NRN supported by internal and external relationships and partnerships with funders, agencies, and many others.
    Respond in nimble fashion to emerging opportunities such as patient engagement, safety, and disparities in practices across the country.
    The entry and rise of information technology in practices, especially widespread adoption of EHR.
    Clinician data entry added to non-research workload while providing a potential source of data for PBRN studies.
    The creation of federated or combined datasets allowed multiple practice / EHR databases to function as one for research.
    Form DARTNet36 as a collaboration of PBRN networks and research organizations to enable the use of new datasets emerging from practice information technology without every practice having to master that separately.
    Migration of local practice control to distant decision-makers and systems.
    Aggregations of practices; increasingly centralized, with standardized organizational processes and reduced local control.
    Continued rise of volume billing and the “medical industrial complex”49
    Rapid adaptation of PBRN rules, tools, research protocols, participants, decision-makers, and decision-making processes.
    Emphasis on patient/community engagement
    Availability of large-system resources such as practice facilitation for implementing studies and other processes.
    Growing emphasis on patient and community engagement in research.
    An imperative to better understand and care for minority or underserved patients
    Do PCORI-funded studies which entail by design patient and wide stakeholder engagement.
    Implement engagement broadly, beyond PCORI projects
    Often to better care for minority or underserved patients in the practice and improve trust in the research enterprise.
    Organizational and network approaches became less local and “high touch”; experienced as remote.
    Organizational constraints on use of social media reduced potential for these to connect people
    Engage clinicians and practices in multiple ways
    Participate in remaining face-face meetings and technology-enabled ways to maintain relationship when travel and face-to-face is more difficult.
    Maintain the voice of network members in developing ideas, questions, proposals.
    The limits of traditional publication to shift practice became increasingly apparent.
    The gap between “what we know and what we do” remained large.
    Engage implementation science and practice improvement organizations to enhance dissemination for PBRN members, not only those in a study or reading scientific journals.
    Broad dissemination channels to share findings to inform action in a wider circle of communities & policy-shapers.
    At the end of this era:
    PBRNs exist on a large scale engaged in a wide range of studies providing practice-based evidence.50
    Networks of networks share infrastructure and collaborate on very large studies.
    The NRN provides practical know-how, mentorship, consultants, and data management services.
    Findings are disseminated in a wide range of professional journals and through multiple communication channels.
    Consistent PBRN infrastructure funding remains a challenge.
    Practice and clinician spirit can be maintained in an environment far less personal than at ASPN origins. Yet updating ways to sustain relationship and connectivity remains a work in progress.
    • Abbreviations: PBRN, practice-based research network; ASPN, ambulatory sentinel practice network.

PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 37 (5)
The Journal of the American Board of Family Medicine
Vol. 37, Issue 5
September-October 2024
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Looking Back to Move Forward: Reflections of PBRN Directors
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
5 + 3 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Looking Back to Move Forward: Reflections of PBRN Directors
C. J. Peek, Frank M. Reed, Ned Calonge, Paul A. Nutting, John Hickner, Wilson D. Pace, Jennifer Carroll, Linda Niebauer, Larry A. Green
The Journal of the American Board of Family Medicine Sep 2024, 37 (5) 955-968; DOI: 10.3122/jabfm.2023.230271R2

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Looking Back to Move Forward: Reflections of PBRN Directors
C. J. Peek, Frank M. Reed, Ned Calonge, Paul A. Nutting, John Hickner, Wilson D. Pace, Jennifer Carroll, Linda Niebauer, Larry A. Green
The Journal of the American Board of Family Medicine Sep 2024, 37 (5) 955-968; DOI: 10.3122/jabfm.2023.230271R2
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Eras in the Spread of This PBRN Innovation
    • Balancing Archetypal PBRN Dilemmas
    • Future Horizons
    • Acknowledgments
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Clinically Relevant Family Medicine Research: Board Certification Updates
  • Google Scholar

More in this TOC Section

  • In Defense of Generalists: Primary Care Observations Have Systematic Advantages
  • Building a Primary Care Research Agenda for Latino Populations in the Setting of the Latino Paradox: A Report from the 2023 Latino Primary Care Summit
Show more Special Communication

Similar Articles

Keywords

  • Practice-based Research
  • Practice-Based Research Networks

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire