Abstract
Purpose: Family physicians (FPs) frequently evaluate skin lesions but may not have the necessary training to accurately and confidently identify lesions that require skin biopsy or specialist referral. We evaluated the diagnostic performance of a new, simplified dermoscopy algorithm for skin cancer detection.
Methods: In this cross-sectional, observation study, attendees of a dermoscopy course evaluated 50 polarized dermoscopy images of skin lesions (27 malignant and 23 benign) using the Triage Amalgamated Dermoscopic Algorithm (TADA). The dermoscopic criteria of TADA include architectural disorder (ie, disorganized or asymmetric distribution of colors and/or structures), starburst pattern, blue-black or gray color, white structures, negative network, ulcer, and vessels. The study occurred after 1 day of basic dermoscopy training. Clinical information related to palpation (ie, firm, dimpling) was provided when relevant.
Results: Of 200 course attendees, 120 (60%) participated in the study. Participants included 64 (53.3%) dermatologists and 41 (34.2%) primary care physicians, 19 (46.3%) of whom were FPs. Fifty-two (43%) individuals had no previous dermoscopy training. Overall, the sensitivity and specificity of TADA for malignant skin lesions was 94.8% and 72.3%, respectively. Previous dermoscopy training and years of dermoscopy experience were not associated with diagnostic sensitivity (P = .13 and P = .05, respectively) or specificity (P = .36 and P = .21, respectively). Specialty type was not associated with sensitivity (P = .37) but dermatologists had a higher specificity than nondermatologists (79% v. 72%, P = .008).
Conclusions: After basic instruction, TADA may be a useful dermoscopy algorithm for FPs who examine skin lesions as it has a high sensitivity for detecting skin cancer.
- Algorithms
- Biopsy
- Cross-sectional Studies
- Dermoscopy
- Palpation
- Physicians
- Family
- Referral and Consultation
- Sensitivity and Specificity
- Skin Neoplasms
- Triage
It has been proposed that the worldwide epidemic of skin cancer1,2 be addressed by all physicians involved in the ongoing primary care of patients.3 The current shortage of US dermatologists4,5 has heightened the need to involve other medical professionals in skin cancer management. Primary care physicians (PCPs), including family physicians (FPs), regularly see patients with skin concerns who are not being followed by or do not have access to dermatologists. Each of these patient encounters, regardless of its primary purpose, is an opportunity to detect skin cancer. In primary care settings, the clinical assessment of concerning lesions requires the ability to determine whether a biopsy or further evaluation by a specialist is warranted. However, PCPs often lack confidence in their abilities to recognize skin cancer.6 The dearth of dermatologic education in medical school curricula and family medicine residencies7,8 underscores the need for providing PCPs with better tools and training for the management of cutaneous lesions.9
Dermoscopy is a noninvasive diagnostic technique that has been shown to enhance the detection of skin cancer compared with naked-eye examination.10⇓–12 Although the use of dermoscopy has been gaining popularity among PCPs,13 training is required for it to become a beneficial tool.14⇓⇓–17 To facilitate the use of dermoscopy among nonexperts, several simplified dermoscopic algorithms have been validated.18,19 However, these algorithms were designed to detect specific subsets of pigmented skin cancers, primarily pigmented melanoma. This restricts their overall utility given that many basal cell carcinomas, squamous cell carcinomas, and even melanomas are not pigmented. To our knowledge, there are no proven clinical tools available to PCPs for evaluating nonpigmented skin lesions.20
The triage amalgamated dermoscopic algorithm (TADA) (Figure 1) was designed for the identification of both pigmented and nonpigmented skin cancers. In our experience, it can be difficult and time consuming to teach beginners the multitude of dermoscopic structures specific to a given malignancy. This is in part due to the poor interobserver concordance for most of these structures.21 However, the subjective interpretation of architectural disorder (ie, disorganized or asymmetric distribution of colors and/or structures) has been shown to have high interobserver agreement and discriminatory power for malignancy.21,22 TADA harnesses these attributes by prompting users to assess a lesion for architectural disorder, which if present, would suggest the need for a biopsy or specialist referral. However, given that several subtypes of skin cancer, such as nodular, spitzoid, and amelanotic melanoma, can appear as organized and symmetric lesions, TADA includes 6 additional, previously validated, dermoscopic patterns and features (starburst, blue-black or gray color, polarizing white structures, negative network, ulcer, vessels) to help identify these skin cancers.23,24,25⇓⇓⇓⇓–30 The presence of any 1 of the 6 additional criteria would also suggest the need for a biopsy or specialist referral.
The Triage Amalgamated Dermoscopic Algorithm (TADA).
One major difference between TADA and the other simplified screening algorithms is that TADA requires that commonly encountered and diagnostically unequivocal benign lesions, namely, angioma, dermatofibroma, and seborrheic keratosis, be excluded from the algorithm. In other words, before assessing for the algorithm's malignant criteria, one should first determine whether a lesion is a classic example of 1 of these 3 benign neoplasms. Although in many instances, these lesions can have dermoscopic structures that overlap with malignant lesions,31,32 they can, nonetheless, be differentiated based on their overall clinical and dermoscopic patterns. TADA thus asks observers to learn the salient dermoscopic patterns associated with these benign lesions, which, in our personal experience, are easy to teach and learn. In addition, the frequency with which these lesions are encountered in clinical practice allows one to rapidly gain experience in their identification.
The aim of this observational study was to determine the diagnostic accuracy of TADA for common malignant skin lesions (melanoma, basal cell carcinoma, squamous cell carcinoma) when used by individuals with 1 day of dermoscopy training versus those with more extensive training or experience.
Materials and Methods
Study Population
This study was approved by the Memorial Sloan Kettering Institutional Review Board without requirement for written informed consent in accordance with the Helsinki Declaration. The study was open to all attendees of a dermoscopy course and was not restricted by specialty type or prior dermoscopy training or experience.
Selection of Skin Lesions
The study lesions were selected retrospectively from dermoscopically imaged neoplasms seen by author AAM at Memorial Sloan Kettering Cancer Center in Hauppauge, NY. Sixty-two lesions that were deemed as representative examples of benign and malignant neoplasms by dermoscopists AAM and MAM were selected. Twelve of the 62 lesions were excluded due to suboptimal image quality or lack of polarized dermoscopic images, resulting in 50 study lesions. Melanomas, basal cell carcinomas, and squamous cell carcinomas were histopathologically proven as malignant (27 total: 16 malignant melanoma, including 3 nodular melanoma and 1 amelanotic melanoma, 7 basal cell carcinoma, 4 squamous cell carcinoma). Benign lesions were either biopsied or were known to be stable by comparison with prior images (23 total: 8 nevi, 5 seborrheic keratoses, 5 angioma, 4 dermatofibroma, 1 clear cell acanthoma). Lesions were imaged with contact polarized dermoscopy at a magnification factor of 10.
Evaluation of Cases and Data Collection
The study took place on the second day of a 3-day dermoscopy course, after participants had received 1 day of basic dermoscopy training. This included classroom sessions that covered the published dermoscopic features of common benign and malignant skin lesions, as well as the dermoscopic criteria used in the TADA algorithm. Participants were given quizzes and partook in unknown lesion identification sessions to reinforce the covered topics. Before the study commenced, participants also received a brief tutorial on how to use the TADA algorithm and fill out the provided worksheets. Although clinical images of the study lesions were not provided, clinical information related to palpation (ie, rough, firm, dimpling with lateral pressure) was provided when relevant. Dimpling with lateral pressure, for instance, is a common feature of dermatofibroma that can aid in their identification in the clinical setting.
TADA consists of 3 levels, which participants worked through in a stepwise manner for each study lesion. In level 1, participants were asked to determine whether the lesion was an unequivocal example of 1 of 3 benign neoplasms (angioma, dermatofibroma, or seborrheic keratosis). After excluding these 3, participants then moved to level 2, in which they assessed for the presence of architectural disorder. For lesions deemed as ordered/organized/symmetric, participants then moved to level 3 to evaluate for the remaining criteria. The presence of any 1 criterion from level 2 or 3 was considered to be suggestive of malignancy and indicated the need for a biopsy or specialist referral. After a participant identified any 1 criterion, they were instructed to stop filling out the worksheet and to wait for the next case. If none of the criteria were noted, the participants were led to the management decision of monitoring the lesion. Worksheets were collected and data entered into an electronic database that was used to estimate sensitivities and specificities.
Statistics
Descriptive statistics and graphical methods were used to assess and describe the characteristics of the study participants, the lesions used in the evaluations, and the individual dermoscopic characteristics of the lesions. A TADA classification variable was created from the responses for each lesion evaluation and coded as dichotomous (TADA positive = 1; TADA negative = 0). Level of experience in dermoscopy was assessed as a dichotomous variable with those reporting “any dermoscopic training” coded as 1 and no dermoscopic training coded as 0. In addition, level of experience with dermatology and dermoscopy was assessed as years practicing dermoscopy. To quantify the association for the presence/absence of each TADA feature with malignant status, tabular cross classifications and χ2 statistics were calculated. Measures of diagnostic accuracy along with 95% confidence intervals (CIs) were estimated using a general estimating equations approach for binary outcomes with the TADA evaluation response as the dependent variable and with the main independent variable being benign/malignant status. Two separate models were independently used to estimate the sensitivity and specificity. Given that study participants contributed multiple observations to the data set, and responses from a given individual have some level of correlation, an exchangeable correlation structure was used in the modeling approach. All analyses were performed with Stata v. 14.0, StataCorp, College Station, TX.
Results
Of the 200 attendees who were eligible to participate, 120 (60%) completed the study. A majority of the participants were female (n = 64; 53.3%), half were 50 years of age or less (n = 59; 49.2%), and a large proportion had medical specialties other than dermatology (n = 49; 41%). Of the latter group, 41 (84%) described their specialty as family medicine, family medicine/geriatrics, medicine, or medicine/skin cancer medicine. Over 50 individuals (43.3%) reported no previous dermoscopy training (Table 1). A total of 5641 lesion evaluations were performed (3034 malignant and 2607 benign) with an average of 47 evaluations per participant (of a possible 50).
Number of Study Participants Grouped by Profession, Dermoscopy Training, and Dermoscopy Experience
Overall, TADA had a sensitivity of 94.8% (95% CI, 93.9%–95.5%) and a specificity of 72.3% (95% CI, 70.5%–74.0%) for all study lesions. Sensitivity estimates for melanoma were 94%. Regarding nonmelanoma skin cancers, participants achieved sensitivities of 95% for basal cell carcinoma and 96% for squamous cell. Sensitivity estimates for pigmented versus nonpigmented nonmelanoma skin cancers were 93% versus 96% for basal cell carcinoma, respectively, and 95% versus 97% for squamous cell carcinoma, respectively. Specificities for benign study lesions were 5% for clear cell acanthoma, 63% for nevi, 73% for angioma, 81% for seborrheic keratosis, and 93% for dermatofibroma. The positive predictive value for TADA was 79.9% (95% CI, 78.6%–81.2%) and the negative predictive value was 92.2% (95% CI, 91.0%–93.3%).
Similar estimates of diagnostic performance were seen when stratified by medical specialty (dermatologists vs nondermatologists), prior dermoscopy training, or experience level with dermoscopy (Table 2). Diagnostic sensitivities achieved by individuals with and without previous dermoscopy training (before the first day of the course) were 95.0% (95% CI, 90.9%–99.4%) versus 93.3% (95% CI, 91.5%–95.1%), respectively. Participants with prior dermoscopic training also had similar estimates of diagnostic specificity compared with those without, 76.4% (95% CI, 66.9%–83.1%) versus 74.1% (95% CI, 70.2%–77.5%), respectively.
Sensitivity and Specificity of TADA Algorithm for Malignant Study Lesions (Melanoma, Basal Cell Carcinoma, Squamous Cell Carcinoma) Achieved by Dermatologists Versus Non-Dermatologists, Participants with Previous Dermoscopy Training Versus Those Without, and Participants with Less Than or Equal to One Year of Dermoscopy Experience Versus Those with Greater than One Year of Experience
Discussion
More than half of all physician office visits in the US are to PCPs, including FPs.33 These physicians are increasingly confronted with the management of skin lesions and are often the first line for skin cancer detection.15,34 In one study, 63% of patients with newly diagnosed melanoma had visited PCPs within the year before their diagnoses.35 Despite this, PCPs seem to lack sufficient knowledge and experience for evaluating malignant skin lesions, failing to identify as many as one third of skin cancers.36 Lack of training has been a reported barrier preventing these physicians from gaining the confidence and abilities necessary for skin cancer management. Although 54% of PCPs suggest having sufficient skills for diagnosing skin cancer,37 greater than 50% are requesting further knowledge to aid in the process.38
Several studies have demonstrated that dermoscopy can improve PCPs' abilities to accurately identify malignant skin lesions.14,15,17 In 2009, the American Academy of Family Physicians held the first dermoscopy course at their Annual Scientific Assembly Meeting. Since then, the demand for this course has increased and is currently being offered at 4 different times during the meeting, up from 3 times the previous year, to accommodate increased interest (published American Academy of Family Physicians program schedules). Although dermoscopy has been a proposed addition to PCPs' skin cancer curricula,16 the best dermoscopic method to learn is unknown. The classic approach to dermoscopy relies on users' expert knowledge of myriad and often nuanced dermoscopic structures and patterns necessary to generate the correct diagnosis. This requires significant training and practice to implement with high accuracy.23 To make dermoscopy easier to use for nondermatologists and to aid in its widespread adoption in general practice, several simplified screening algorithms have been introduced.18,19 The validation of these algorithms has shown that the inclusion of a select group of dermoscopic features is sufficient to allow inexperienced users to correctly identify a large proportion of skin cancers. However, the fact that these algorithms were designed for the detection of specific subsets of pigmented skin cancers, primarily pigmented melanoma, highlights the need for a new algorithm designed to detect both pigmented and nonpigmented malignancies.
In this study, 34% of the 120 participants were PCPs and 43% of the study population had no previous dermoscopy training before the first day of the course. This allowed us to evaluate the potential utility of TADA as an aid for skin cancer evaluations in primary care settings. TADA achieved an overall sensitivity for all skin cancers of 94.8%. This value was not influenced by participants' previous training or experience with dermoscopy, or medical specialty. The fact that training improves the diagnostic accuracy of inexperienced users has been demonstrated in previous studies.14⇓⇓⇓–18 However, the amount and type of training provided in these studies has varied considerably, from a 1-hour web-based tutorial plus a 15 lesion training set,18 to a 1-day training course,16 to the use of a dermoscopy textbook plus a 245 lesion training set.14 Future studies can help to elucidate whether the training modality for TADA can be further streamlined.
The specificity of TADA for all users was 72.3%. Remarkably, participants without dermoscopy training before the study correctly identified around 74% of benign lesions. These results compare favorably to the values reported from studies evaluating the performance of inexperienced dermoscopists when using other screening algorithms (32.8%–72%),18,19,39 with the added benefit of identifying a greater number and more varied types of malignancies overall. It can thus be concluded that the high sensitivity we observed with TADA would not have been at the expense of an increase in the number of unnecessary biopsies or referrals. In addition, the specificities for the 3 types of benign lesions included in the TADA algorithm ranged from 73.0% to 93.0%. This finding substantiates our view that it is possible to rather quickly train beginners to accurately identify classic examples of certain common, benign lesions. Although requiring users to gain additional rudimentary dermoscopic knowledge to identify these lesions is arguably a limitation of TADA, it also seemed to strengthen the algorithms indicated by the high specificities achieved for these lesions.
The results of this pilot study suggest that TADA can help inexperienced users who are motivated to learn dermoscopy detect both pigmented and nonpigmented skin cancers with very high sensitivities and specificities. As such, our results may not be generalizable to all PCPs. To make definitive statements about the usefulness of TADA as a clinical tool in primary care, our findings would need confirmation in a larger study with more PCPs evaluating a more diverse and larger sample size. Providing participants with clinical images in addition to dermoscopic images would also more closely correlate with the real-life situation in which the algorithm would be applied. Ideally, this would be achieved with a prospective study performed in a clinical setting. In addition, reader studies, such as this one, are often performed with photographic representations of dermoscopic images. This is not the same as viewing lesions in vivo. A prospective, clinical study would also allow us to account for the logistical aspects of operating a dermoscope. Further, by randomizing participants to various levels and durations of training, we might determine the most efficient teaching method for PCPs. To overcome some of these limitations, we plan to reevaluate the diagnostic accuracy of TADA as a function of training duration and didactic method with a large sample of FPs and family medicine residents.
Notes
This article was externally peer reviewed.
Funding: This research was funded in part through the NIH/NCI cancer center support grant P30 CA008748.
Conflict of interest: none declared.
- Received for publication February 22, 2016.
- Revision received June 3, 2016.
- Accepted for publication June 13, 2016.
References
In this issue
Jump to section
Related Articles
Cited By...
- Expert Consensus Statement on Proficiency Standards for Dermoscopy Education in Primary Care
- Training general practitioners in melanoma diagnosis: a scoping review of the literature
- Dermoscopy for melanoma detection and triage in primary care: a systematic review
- Teaching Benign Skin Lesions as a Strategy to Improve the Triage Amalgamated Dermoscopic Algorithm (TADA)
- Bread and Butter of Family Medicine: Guidelines, Population Screening, Diagnostic Evaluations, and Practice Models