Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Research ArticleOriginal Research

Use of Patient-Reported Symptom Data in Clinical Decision Rules for Predicting Influenza in a Telemedicine Setting

W. Zane Billings, Annika Cleven, Jacqueline Dworaczyk, Ariella Perry Dale, Mark Ebell, Brian McKay and Andreas Handel
The Journal of the American Board of Family Medicine October 2023, 36 (5) 766-776; DOI: https://doi.org/10.3122/jabfm.2023.230126R1
W. Zane Billings
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Annika Cleven
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacqueline Dworaczyk
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ariella Perry Dale
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
PhD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark Ebell
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brian McKay
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andreas Handel
From the Department of Epidemiology and Biostatistics, University of Georgia, Athens, GA (WZB, APD, ME, AH); Department of Mathematics, St. Olaf College, Northfield, MN (AC); Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ (JD); Department of Family and Consumer Sciences, University of Georgia, Athens, GA (BM).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

Introduction: Increased use of telemedicine could potentially streamline influenza diagnosis and reduce transmission. However, telemedicine diagnoses are dependent on accurate symptom reporting by patients. If patients disagree with clinicians on symptoms, previously derived diagnostic rules may be inaccurate.

Methods: We performed a secondary data analysis of a prospective, nonrandomized cohort study at a university student health center. Patients who reported an upper respiratory complaint were required to report symptoms, and their clinician was required to report the same list of symptoms. We examined the performance of 5 previously developed clinical decision rules (CDRs) for influenza on both symptom reports. These predictions were compared against PCR diagnoses. We analyzed the agreement between symptom reports, and we built new predictive models using both sets of data.

Results: CDR performance was always lower for the patient-reported symptom data, compared with clinician-reported symptom data. CDRs often resulted in different predictions for the same individual, driven by disagreement in symptom reporting. We were able to fit new models to the patient-reported data, which performed slightly worse than previously derived CDRs. These models and models built on clinician-reported data both suffered from calibration issues.

Discussion: Patients and clinicians frequently disagree about symptom presence, which leads to reduced accuracy when CDRs built with clinician data are applied to patient-reported symptoms. Predictive models using patient-reported symptom data performed worse than models using clinician-reported data and prior results in the literature. However, the differences are minor, and developing new models with more data may be possible.

  • Clinical Decision Rules
  • Cohort Studies
  • Infectious Diseases
  • Influenza
  • Prospective Studies
  • Respiratory Tract Diseases
  • Students
  • Telemedicine
  • Triage
View Full Text
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 36 (5)
The Journal of the American Board of Family Medicine
Vol. 36, Issue 5
September-October 2023
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Use of Patient-Reported Symptom Data in Clinical Decision Rules for Predicting Influenza in a Telemedicine Setting
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
8 + 7 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Use of Patient-Reported Symptom Data in Clinical Decision Rules for Predicting Influenza in a Telemedicine Setting
W. Zane Billings, Annika Cleven, Jacqueline Dworaczyk, Ariella Perry Dale, Mark Ebell, Brian McKay, Andreas Handel
The Journal of the American Board of Family Medicine Oct 2023, 36 (5) 766-776; DOI: 10.3122/jabfm.2023.230126R1

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Use of Patient-Reported Symptom Data in Clinical Decision Rules for Predicting Influenza in a Telemedicine Setting
W. Zane Billings, Annika Cleven, Jacqueline Dworaczyk, Ariella Perry Dale, Mark Ebell, Brian McKay, Andreas Handel
The Journal of the American Board of Family Medicine Oct 2023, 36 (5) 766-776; DOI: 10.3122/jabfm.2023.230126R1
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Methods
    • Results
    • Discussion
    • Acknowledgments
    • Appendix.Use of Patient-reported Symptom Data in Clinical Decision Rules for Predicting Influenza in a Telemedicine Setting
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Practicing Family Medicine in a Pandemic World: Lessons for Telemedicine, Health Care Delivery, and Mental Health Care
  • Google Scholar

More in this TOC Section

  • Evaluating Pragmatism of Lung Cancer Screening Randomized Trials with the PRECIS-2 Tool
  • Perceptions and Preferences for Defining Biosimilar Products in Prescription Drug Promotion
  • Successful Implementation of Integrated Behavioral Health
Show more Original Research

Similar Articles

Keywords

  • Clinical Decision Rules
  • Cohort Studies
  • Infectious Diseases
  • Influenza
  • Prospective Studies
  • Respiratory Tract Diseases
  • Students
  • Telemedicine
  • Triage

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire