Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Montreal Cognitive Assessment (MoCA) - A Sensitive Screening Instrument for Detecting Cognitive Impairment in Chronic Hemodialysis Patients

  • Frances E. Tiffin-Richards,

    Affiliations Department of Neurology, RWTH Aachen University Hospital, Aachen, Germany, Jülich Aachen Research Alliance (JARA) – Translational Brain Medicine, Aachen and Jülich, Germany

  • Ana S. Costa,

    Affiliations Department of Neurology, RWTH Aachen University Hospital, Aachen, Germany, Jülich Aachen Research Alliance (JARA) – Translational Brain Medicine, Aachen and Jülich, Germany

  • Bernhard Holschbach,

    Affiliation KfH Curatorship for Dialysis and Kidney Transplant e.V., KfH-Nephrology Center, Stolberg, Germany

  • Rolf D. Frank,

    Affiliation Department of Internal Medicine, St.-Antonius-Hospital Eschweiler, Eschweiler, Germany

  • Athina Vassiliadou,

    Affiliation Dialysis Center Aachen, Dialysis Center, Aachen, Germany

  • Thilo Krüger,

    Affiliation Division of Nephrology and Clinical Immunology, RWTH Aachen University, Aachen, Germany

  • Karl Kuckuck,

    Affiliations Department of Neurology, RWTH Aachen University Hospital, Aachen, Germany, Jülich Aachen Research Alliance (JARA) – Translational Brain Medicine, Aachen and Jülich, Germany

  • Theresa Gross,

    Affiliations Division of Nephrology and Clinical Immunology, RWTH Aachen University, Aachen, Germany, Department of Internal Medicine, Dresden-Friedreichstadt Hospital, Dresden, Germany

  • Frank Eitner,

    Affiliations Division of Nephrology and Clinical Immunology, RWTH Aachen University, Aachen, Germany, Bayer Pharma AG, Global Drug Development, Kidney Diseases Research, Wuppertal, Germany

  • Jürgen Floege,

    Affiliation Division of Nephrology and Clinical Immunology, RWTH Aachen University, Aachen, Germany

  • Jörg B. Schulz,

    Affiliations Department of Neurology, RWTH Aachen University Hospital, Aachen, Germany, Jülich Aachen Research Alliance (JARA) – Translational Brain Medicine, Aachen and Jülich, Germany

  • Kathrin Reetz

    kreetz@ukaachen.de

    Affiliations Department of Neurology, RWTH Aachen University Hospital, Aachen, Germany, Jülich Aachen Research Alliance (JARA) – Translational Brain Medicine, Aachen and Jülich, Germany, Institute of Neuroscience and Medicine (INM-4), Research Center Jülich GmbH, Jülich, Germany

Abstract

Background

Chronic kidney disease (CKD) patients undergoing hemodialysis (HD) therapy have an increased risk of developing cognitive impairment and dementia, which are known relevant factors in disease prognosis and therapeutic success, but still lack adequate screening in clinical routine. We evaluated the Montreal Cognitive Assessment (MoCA) for suitability in assessing cognitive performance in HD patients in comparison to the commonly used Mini-Mental State Examination (MMSE) and a detailed neuropsychological test battery, used as gold standard.

Methods

43 HD patients and 42 healthy controls with an average age of 58 years, were assessed with the MoCA, the MMSE and a detailed neuropsychological test battery, covering the domains of memory, attention, language, visuospatial and executive functions. Composite scores were created for comparison of cognitive domains and test results were analyzed using Spearman's correlation and linear regression. Cognitive dysfunction was defined using z-score values and predictive values were calculated. Sensitivity and specificity of the MoCA were determined using receiver operating characteristic (ROC) analysis.

Results

HD patients performed worse in all cognitive domains, especially in memory recall and executive functions. The MoCA correlated well with the detailed test battery and identified patients with cognitive impairment with a sensitivity of 76.7% and specificity of 78.6% for a cut-off value of ≤24 out of 30 points. In the detailed assessment executive functions accounted significantly for performance in the MoCA. The MMSE only discriminated weakly between groups.

Conclusions

The MoCA represents a suitable cognitive screening tool for hemodialysis patients, demonstrating good sensitivity and specificity levels, and covering executive functions, which appear to play an important role in cognitive performance of HD patients.

Introduction

The association of cognitive impairment and a higher incidence of dementia in patients with chronic kidney disease (CKD) has been increasingly acknowledged over the last few years [1][3] and represents an important issue in an already vulnerable population. The prevalence of cognitive impairment in chronic hemodialysis (HD) patients has been estimated at 30–80% [4][7]. In addition to being associated with cerebrovascular disease and potentially other types of brain injury [8], cognitive impairment may jeopardize treatment adherence by affecting the efficiency of every-day tasks, including correct medication and dietary rules [9]. Moreover, cognitive impairment is a significant predictor of mortality in HD patients [5].

The call for early detection of cognitive impairment in patients with CKD has yet to be translated to every-day clinical practice. The necessity has, however, been voiced in earlier studies and the use of short and easy-to-apply cognitive screening tools has been suggested [5], [10]. The Montreal Cognitive Assessment (MoCA) [11] is a screening test for cognitive impairment that covers major cognitive domains including episodic memory, language, attention, orientation, visuospatial ability and executive functions, while remaining brief and easy to administer. It is generally considered superior to the well-established Mini-Mental State Examination (MMSE) screening test [12], [13], since the MoCA not only assesses executive functioning, which may be particularly important in the CKD population [14], [15], but also presents a higher sensitivity for mild cognitive impairment. Accordingly, the MoCA has been evaluated and found to be an adequate screening tool in various clinical populations, e.g. Alzheimer's dementia (AD) [16], cerebral small vessel disease [17], and other medical conditions such as cardiovascular disease [18], as well as being able to discriminate between mild cognitive impairment and elderly controls [19]. Recently, the MoCA was also recommended as a standardized approach to cognitive assessment in patients undergoing HD [20]. Therefore our primary goal was to further evaluate the MoCA as a brief screening tool for cognitive impairment in HD patients in comparison to a comprehensive cognitive testing. To achieve this, the ability to distinguish between HD patients with and without cognitive impairment, the sensitivity, specificity and predictive values of the MoCA were assessed. Additionally, psychometric criteria such as concurrent and criterion validity of performance on the MoCA, a comprehensive neuropsychological test battery and the standard brief cognitive screening test MMSE were evaluated.

Subjects and Methods

Ethics Statement

The research project was carried out in accordance with the latest version of the Declaration of Helsinki and approved by the ethics committee of the Medical Faculty of the RWTH Aachen University in Germany (EK 179/11). All participants gave informed, written consent before participating.

Study population

Between February 2012 and March 2013, forty-eight patients on hemodialysis treatment were recruited from the Division of Nephrology of the RWTH Aachen University Hospital in Germany and three community based dialysis centers in the Aachen region. Forty-two matching healthy controls of varied intellectual and educational level, but without specific experience in neuropsychology, were recruited from the community and staff of the RWTH Aachen University. All participants with a history of neurological or psychiatric disease were excluded. In two cases of severe visual or motor impairment, specific tasks were not administered and therefore considered missing values. These cases included one patient with residual eye sight of 30% due to diabetic retinopathy and glaucoma and one patient with a disabilitating hand tremor.

Clinical and demographic data

Medical history and demographic data were gained via self-report and/or from medical records. Patients' clinical data included medical history, current medication, CKD etiology, dialysis vintage, serum values of sodium, potassium, hemoglobin, hematocrit, creatinine, pH value and blood sugar and were obtained from routine clinical blood samples taken at the beginning of each dialysis treatment. The duration of dialysis treatment, ultrafiltration volume, pre-dialysis blood pressure values and intradialytic hypotensive episodes, defined as systolic blood pressure < 90 mmHg and/or diastolic blood pressure <50 mmHg, were collected from the dialysis protocols. Cardiovascular risk factors, including nicotine consumption, body mass index (BMI), serum cholesterol and high blood pressure were rated using the SCORE risk charts of the European Society of Cardiology [21] using the low risk chart for the German population. Hypertension was defined as the prescription of antihypertensive medication. Comorbidities were quantified using the Charlson Comorbidity Index (CCI) [22] corrected for dialysis [23], or age in the healthy control group [22].

Neuropsychological testing

The neuropsychological test battery was administered to all subjects on a dialysis-free day by a psychologist or trained assistants. It consisted of two cognitive screening tests, the MoCA and the MMSE, as well as a detailed cognitive test battery that evaluated memory, language, attention, visuospatial ability and executive functions. As participants were partaking in a cross-sectional observational study with a repeated-measures design [24], previously validated alternate versions of the MoCA [25], as well as from other tests, were used to avoid practice effects. For all patients and controls the same order of test administration was used. The alternate versions of tests were contra-balanced in a pseudo-randomized order. Although all patients and controls underwent two rounds of testing, only the data of the first assessment was used in the current analyses and therefore not all participants completed the exact same version of all tests. Testing was performed in a quiet room with a low distraction level, but in cases of reduced mobility, testing was also performed in patients' hospital rooms. For the order of test administration, view List S1 in File S1.

The MoCA [11] is a brief screening tool assessing visuospatial and executive functions, attention, short-term memory, language and orientation, has been translated and adapted into several languages and is available freely on the Internet (http://www.mocatest.org). It includes tasks such as trail making test – part B, cube copying, clock drawing, naming, digit span backwards and forwards, serial subtraction, selective attention, sentence repetition, phonemic word fluency, verbal abstraction, a 5-word learning and delayed recall task, and spatial and temporal orientation. Completion time is approximately 10 to 15 minutes and a maximum of 30 points can be obtained.

The ability of the MoCA to screen for cognitive impairment in HD patients was to be evaluated through the comparison to a well-known screening test, the MMSE, and a detailed neuropsychological test battery. Given that our emphasis lay on the evaluation of the MoCA, detailed group analyses, such as correlation analysis, were not performed with the MMSE and the detailed neuropsychological battery.

The MMSE is a ten-minute screening test including questions to spatial and temporal orientation, immediate and delayed recall, language ability and oral command comprehension, serial subtraction and tasks to visuospatial ability. Here the German adaptation was used for all participants [12].

A more detailed analysis of the cognitive domains and psychometric characteristics, such as sensitivity, specificity and concurrent validity, of the MoCA was achieved by comparison to a detailed neuropsychological test battery. In the detailed neuropsychological test battery, verbal memory was examined using the California Verbal Learning Test (CVLT) [26], a word list recall task, and non-verbal memory was assessed with the Medical College of Georgia Complex Figures (MCGCF) test [27]. Attention was evaluated through a computer-based cued and non-cued reaction time (phasic and intrinsic alertness) task [28] and digit span forwards. Processing speed and executive functions were assessed using the Trail Making Task (TMT) forms A and B [29], phonemic and semantic word fluency [30], digit span backwards [31], and the interference task of the Stroop test [32]. The Boston Naming Test [33] gave information on overall language processing ability. Visuospatial abilities were tested with the copying task of the MCGCF and the Incomplete Letters subtest of the Visual Object and Space Perception (VOSP) test [34], which also served to identify individuals with visual impediments that could hinder further testing. We also included the Epworth Sleepiness Scale (ESS) [35] to measure daytime sleepiness. Subjective fatigue level was evaluated through a 10-point scale (0 = no fatigue to 10 = worst imaginable fatigue) adapted from the Brief Fatigue Inventory [36]. Depression and anxiety were quantified with the Hospital Anxiety and Depression Scale (HADS) [37]. For further detail on individual tests, see Table S1 in File S1.

Statistical analysis

Data analysis was performed using Microsoft Excel 2010, IBM SPSS Statistics 20 for Windows and MedCalc Software Version 12.5.0. The distribution of the collected data was determined using the Kolmogorov-Smirnov test. Due to heterogeneous normal and non-normal distribution of data, non-parametric tests were used and all test results are presented with median and interquartile ranges for better comparability. Demographic data is presented according to the distribution of the respective data. Differences, and respective effect sizes (r), between patients and controls regarding demographic and clinical data, as well as the neuropsychological test scores, were computed using the non-parametric Mann-Whitney-U test with Bonferroni correction for multiple testing. The interpretation of effect sizes followed Cohen's proposal for r as small at 0.10–0.29, medium at 0.30–0.49 and large at >0.50 [38]. Correlation analyses were carried out using Spearman's rank correlation coefficient rho (rs). We calculated standard z-scores for each cognitive test, using the healthy control group as the reference group and without replacing missing values. Based on the median of z-scores of the individual tests, we calculated composite scores for each cognitive domain – memory, attention, language, visuospatial, executive functions – as well as two overall composite scores. The overall composite scores were an executive composite score, including the executive functions and attention tasks, and a non-executive composite score comprising of the language, visuospatial and memory tasks. The same procedure was used to create composite scores of the cognitive domains of the MoCA. For further analysis, cognitive dysfunction was defined using z-score values. Mild cognitive impairment was classified as z-scores one to two standard deviation (SD) below the norm and severe cognitive impairment as more than two SD below the norm in ≥2 neuropsychological tests [5], [9]. To examine concurrent validity between the MoCA total scores and the test battery overall composite scores, a bivariate linear regression model with the MoCA as the dependent variable and the composite scores as the independent variables was calculated. The raw total scores of the MoCA were used without education correction [16], and age, years of education, depression and fatigue levels were added as covariates [2]. To establish the discriminative validity of the MoCA in identifying patients with and without cognitive impairment, sensitivity and specificity levels were evaluated using the receiver operating curve (ROC) analysis and the criteria for cognitive impairment as described above. The cut-off score was determined based on maximal sensitivity and specificity. Positive and Negative Predictive Values (PPV/NPV) were calculated for the optimal cut-off value identified by the ROC analysis.

Results

Characterization of the HD patient sample

Forty-three HD patients completed testing and were included in the current analyses. Details of clinical and demographic data are presented in Table 1. In comparison to the control group, HD patients had a significantly higher rate of hypertension, diabetes type 2, hypercholesterolemia and nicotine consumption, yet no significant difference concerning BMI. Levels of fatigue and sleepiness, as well as scores on the depression scale were higher in the patient group. On average, patients had been on dialysis treatment for 50 months and spent four hours on dialysis, three times per week, with an average ultrafiltration volume of 1.2 liters. The 10-year risk of a fatal cardiovascular disease lay at 3–4% [21] while the CCI scoring system for HD patients presented a mean 10-year survival rate of 25% [23].

Performance on the MoCA and association with demographic and clinical variables

HD patients achieved lower mean total scores in the MoCA than the control group. The deficits were especially prominent in the areas of executive functions, language ability and short-term memory capacity (Figure 1). The most difficult tasks appeared to be digit span backwards and forwards, phonemic word fluency, sentence repetition, verbal abstraction and immediate and delayed word recall (see Table S2 in File S1). No significant differences could be identified between groups in respect to visuospatial tasks, naming, level of attention (as tested in the letter cancellation and number subtraction tasks) or temporal and spatial orientation.

thumbnail
Figure 1. Group differences in cognitive domain composite scores of the Montreal Cognitive Assessment.

The bar chart in figure 1 displays the average points scored by the patient and control group for each of the cognitive domains of the Montreal Cognitive Assessment (MoCA). The group differences were assessed using the non-parametric Mann-Whitney-U test with respective p-values showing a significantly (p≤.001) poorer performance of the patient group in the domains of executive functions, episodic memory and language. Notes. *Executive: Trail Making Test (TMT) B, verbal abstraction, digit span backwards, phonemic word fluency; Visuospatial: cube copying, clock drawing; Memory: immediate and delayed word recall; Attention: digit span forwards, letter cancelation, number subtraction; Language: sentence repetition, animal naming; Orientation: temporal and spatial orientation. Group differences were assessed using the Mann-Whitney-U test with a significance level of p≤.001.

https://doi.org/10.1371/journal.pone.0106700.g001

In the patient group there was a negative association between the MoCA total score and age (rs = −.38, p<.05), which was not found in the control group. There was a positive association (rs = .28, p<.01) between the MoCA and education. From the association analysis between clinical variables and performance on the MoCA, only the CCI score for dialysis patients correlated negatively with the MoCA total scores (rs = −.53, p<.001), indicating that patients with a higher comorbidity score achieved lower results in the MoCA.

Performance on the detailed neuropsychological test battery

In the detailed neuropsychological testing, patients performed worse than the control group in all cognitive domains (Table 2). Patient performance was worse in tasks such as immediate and delayed verbal and visual memory, semantic and phonemic word fluency, as well as performance on the TMT, reaction-timed alertness and the Stroop interference task. Cognitive dysfunction was identified in 29 patients (70%), whereby for 10 patients (24%) cognitive dysfunction could be classified as mild cognitive impairment and for 19 patients (46%) as severe cognitive impairment.

Correlation analysis showed that the composite scores of the MoCA and the test battery correlated in the domains of executive functions (rs = .60, p<.001) and memory (rs = .53, p<.001), whereas the attention, language and visuospatial composites revealed no significant association. The MoCA and the MMSE total scores showed a moderate positive correlation (rs = .54, p<.001).

Association between the MoCA and the detailed neuropsychological assessment

Linear regression analysis revealed that the composite score including executive functions tasks explained 39% (β = 0.62, R2 = .39, p<.001) of the variance in the MoCA and the non-executive functions composite score explained 34% (β = 0.58, R2 = .34, p<.001). Together, executive and non-executive functions accounted significantly for overall performance on the MoCA (β = 0.42, R2 = .44, p<.001), while the covariates age (β = 0.26, R2 = .07, p<.05) and education (β = 0.23, R2 = .05, p<.05) only marginally affected variance in performance. Sleepiness and fatigue did not show a significant effect on cognitive performance, yet high scores on the depression scale had a mild effect (β = −0.36, R2 = .13, p<.001).

ROC analysis and predictive values

The ROC analysis disclosed an optimal cut-off for the MoCA at ≤24 points (Table 3), with a sensitivity of 76.7%, specificity of 78.6% and an area under the curve (AUC) of 0.755 (95% CI, 0.602–0.872). In comparison, the MMSE only achieved a sensitivity of 55.2%, and a specificity of 75.0%, and AUC of 0.701 (95% CI, 0.538 to 0.834) for an optimal cut-off of ≤28 points (Figure 2). Using a cut-off value of ≤24 for MoCA results, a total of 26 patients (59%) scored 24 points or lower, while 18 patients achieved a higher score. Respectively, a PPV of 0.88 and NPV of 0.61 could be calculated for the patient cohort. We identified 19 patients (46.3%) with a MMSE score of ≤28 points.

thumbnail
Figure 2. ROC curves for the cognitive screening tests Montreal Cognitive Assessment and Mini-Mental State Examination.

The receiver operating characteristics curves for the Montreal Cognitive Assessment (MoCA) and the Mini-Mental State Examination (MMSE) illustrate the discriminative capacity of each of the screening tests, displaying their individual sensitivity, specificity and area under the curve (AUC). The MoCA shows good levels of sensitivity and specificity, as well as an overall greater AUC than the MMSE, while the MMSE presents a high specificity and relatively low sensitivity. Notes. MoCA = Montreal Cognitive Assessment; MMSE = Mini-Mental State Examination; AUC = Area under the curve.

https://doi.org/10.1371/journal.pone.0106700.g002

thumbnail
Table 3. Criterion (cut-off) values and coordinates of the ROC curves of MoCA and MMSE.

https://doi.org/10.1371/journal.pone.0106700.t003

Discussion

Here we demonstrate that the MoCA is a valid and well-suited screening tool for cognitive impairment in HD patients. The MoCA was capable of discriminating between HD patients with and without cognitive impairment, as defined by performance on a comprehensive neuropsychological test battery, presenting good sensitivity and specificity levels, as well as a good concurrent validity. In contrast, the MMSE revealed only a weak group discriminative power.

Our main results confirm that the MoCA is able to reliably identify cognitive impairment in CKD patients undergoing hemodialysis. We could establish an optimal cut-off of ≤24 points out of a 30 points maximum, which is lower than the cut-off value of ≤26 described in the original data collected in a population of patients with AD and mild cognitive impairment (MCI) [11]. Given that cut-off values are population specific [39], several other studies have determined lower values in different populations, e.g. a cut-off of 23.5 in a population with MCI [19] and of 21/22 in a population with cerebral small vessel disease [17]. With a good sensitivity (76.67) and specificity (78.57) our findings are consistent with previous research, where the MoCA's sensitivity in detecting cognitive impairment ranged from 56% to 100%, while specificity varied between 29% and 87%, depending on the study population [11], [18], [40]. More specifically, in the detection of vascular cognitive impairment the MoCA presented a specificity of 68% and lower sensitivity of 56% in a population with silent cerebral infarction [40].

The detailed cognitive assessment showed a distinct difference in achievement between groups. This tendency was equally present in the MoCA results, whereas performance did not differ between groups for the MMSE. The prevalence of cognitive impairment of 70% in this cohort, as classified by the testing battery, corresponds to the levels of cognitive dysfunction stated in previous studies with larger cohorts of dialysis patients [5], [7]. The results presented by the MMSE equally match previous characterizations of CKD patient cohorts, where the level of cognitive dysfunction was measured at 30% when only using the MMSE as a diagnostic measure [4], [6]. The prevalence of cognitive dysfunction in this patient cohort appears, therefore, to be similar to previous findings and allows the assumption that it is representative for this population. Correlation analysis showed a strong relationship between MoCA results and the detailed neuropsychological testing, especially for memory and executive functions, which may suggest good diagnostic ability in these areas. There remains, nevertheless, a limitation for interpretation of correlation between tests, due to a partial overlap between tasks that may affect association analysis.

The profile of cognitive deficits found in our patient population, including significant impairment in executive functions, processing speed, word fluency and short-term verbal and non-verbal memory capacity, stands in accordance to previous findings [3], [41] and similar results have been associated with vascular disease as a potential cause of cognitive impairment in HD patients [15], [42]. Given the high prevalence of executive dysfunction in CKD patients and our findings that performance in the MoCA was predominantly dependent on executive ability (as has been described before [43]), we believe that this is one of the strengths of the MoCA in comparison to other generally used cognitive screening instruments. In this regard, the focus of the MoCA on executive functions is believed to be a reason why it is far superior to the MMSE in particular clinical populations, given that the MMSE lacks the assessment of such cognitive domains and has a tendency to produce ceiling effects [43], [44].

This may be particularly important considering that the majority of previous studies with CKD patients have included the MMSE as the preferred cognitive screening test [42] or even the only cognitive instrument [45], [46]. Methodologically, the fact that the MoCA and the MMSE subtests partially overlap may limit considerations of their differential discriminant validity, but it should be noted that the original rationale behind MoCA, through the inclusion of a wider range of cognitive domains than the MMSE, especially considering the executive functions, already entails some advantage in terms of sensitivity and specificity.

Based on our current results, and as others have suggested [8], the MMSE may be inadequate for this population and may underestimate the extent of cognitive impairment. Nevertheless, a recent study showed that the MMSE was able to detect progression of cognitive impairment in HD patients [47], but may be less suited for early detection of mild cognitive deficits in other populations [48]. In a similar fashion, another screening test, the Kidney Disease Quality of Life Cognitive Function (KDQOL-CF), was found to be inadequate for assessing cognitive function in HD patients, due particularly to the lack of executive tasks [49].

A procedural advantage of the MoCA over the MMSE may also be the availability of alternative versions [25], which enables longitudinal testing while avoiding practice effects. Longitudinal testing is especially interesting in HD patients, as fluctuations in cognitive performance during the hemodialysis cycle have been identified [20], [50].

Concerning predictive clinical variables, we were able to show that high comorbidity rates were associated with lower performance on the MoCA, which opens the question of the etiological or mediator role that different comorbidities play in cognitive impairment in such a heterogeneous group.

Other interesting findings were that although levels of fatigue and sleepiness were higher in the patient group, which is in line with statements from earlier studies that fatigue is a common problem in HD patients [3], [51], we did not find fatigue or sleepiness to influence cognitive performance. It is possible that conducting the assessment on a dialysis-free day avoided post-dialytic fatigue and enabled a more objective assessment of cognitive performance. In contrast, a significant association was found between lower performance and higher levels of depressive symptoms, which supports assumptions that depression may be a relevant co-factor for poor cognitive performance and should also be screened for in CKD patients [52][54]. This is especially important when taking into account the prevalence of depression of up to 25% in HD patients [51] and the number of associated problems, including lower quality of life and higher hospitalization and mortality rates [54].

Further strengths of our study include the detailed neuropsychological testing, which enabled a comprehensive evaluation of cognition and the interpretation of concurrent validity, as well as the inclusion of a healthy control group that served as reference for cognitive performance. The MoCA has recently been suggested for cognitive screening in a small cohort of HD patients showing similar results for MoCA with an average of 24 points before dialysis [20], yet the emphasis was put on testing environment and variation in performance during the HD cycle and only the MMSE was used as a reference. This is therefore a valuable addition, as there is no precedent data on the psychometric characteristics of MoCA in comparison to detailed cognitive analysis and clinical characterization of a moderate size sample of HD patients. Limitations are, nevertheless, the relatively small sample size, which makes it difficult to generalize our findings. Although our results allow the assumption of cognitive impairment in HD patients below the cut-off value of 24 points in the MoCA, a clear distinction between MCI and dementia cannot be made in this study, due to the exclusion of patients with dementia. Equally, one must mention again the concordance of tests used in the screening tests and the detailed test battery that may influence correlation analyses in form of a positive bias. Our decision to enter education as a covariate rather than using the education correction for MoCA values, for which there is no normative data for a German population, may be seen as inadequate as there is a slight difference in educational levels between groups. Furthermore, data on subjective cognitive impairment, and clinical data were limited, the latter especially for the control sample, reducing our ability to assess variables, such as cardiovascular risk factors and hemodialysis parameters, in more detail. Further research is warranted to confirm these findings in a larger patient sample, possibly including non-dialysis CKD patients to further define indications for cognitive screening with the MoCA.

Cognitive impairment is a highly relevant clinical factor for disease progression in HD patients, possibly also affecting daily-life activities, thereby impeding adherence to therapeutic regimes and compromising quality of life. With the aims of improvement of individual outcome and optimizing the utilization of medical care resources, a brief cognitive screening test for HD patients is an essential addition to clinical practice. We presume that the MoCA, granted its validity and psychometric characteristics, is very suitable for this purpose, as it represents a multi-dimensional screening test that not only includes relevant tasks for the assessment of the HD population, but also offers the possibility of longitudinal measurements with available alternate versions.

In conclusion, the MoCA is an adequate screening tool for a brief bedside evaluation of global cognitive performance in HD patients and has the potential to assist in the daily clinical care of HD patients.

Supporting Information

File S1.

Supplemental files. List S1. Order of test administration. Table S1. Description of neuropsychological test battery. Table S2. Test results of MoCA subtests.

https://doi.org/10.1371/journal.pone.0106700.s001

(DOCX)

Acknowledgments

We sincerely thank all our patients and control participants for their enduring collaboration and interest in this research.

Author Contributions

Conceived and designed the experiments: FT-R AC KK TG FE JF JBS KR. Performed the experiments: FT-R AC BH RF AV TK KK TG FE JF KR. Analyzed the data: FT-R AC KK KR. Contributed reagents/materials/analysis tools: FT-R AC BH RF AV TK KK TG FE JF JBS KR. Wrote the paper: FT-R AC KR.

References

  1. 1. Kurella Tamura M, Wadley V, Yaffe K, McClure LA, Howard G, et al. (2008) Kidney function and cognitive impairment in US adults: the Reasons for Geographic and Racial Differences in Stroke (REGARDS) Study. Am J Kidney Dis 52: 227–234.
  2. 2. Elias MF, Elias PK, Seliger SL, Narsipur SS, Dore GA, et al. (2009) Chronic kidney disease, creatinine and cognitive functioning. Nephrol Dial Transplant 24: 2446–2452.
  3. 3. Sánchez-Román S, Ostrosky-Solís F, Morales-Buenrostro LE, Nogués-Vizcaíno MG, Alberú J, et al. (2011) Neurocognitive profile of an adult sample with chronic kidney disease. J Int Neuropsychol Soc 17: 80–90.
  4. 4. Sehgal AR, Grey SF, DeOreo PB, Whitehouse PJ (1997) Prevalence, recognition, and implications of mental impairment among hemodialysis patients. Am J Kidney Dis 30: 41–49.
  5. 5. Griva K, Stygall J, Hankins M, Davenport A, Harrison M, et al. (2010) Cognitive impairment and 7-year mortality in dialysis patients. Am J Kidney Dis 56: 693–703.
  6. 6. Kurella M, Chertow GM, Luan J, Yaffe K (2004) Cognitive impairment in chronic kidney disease. J Am Geriatr Soc 52: 1863–1869.
  7. 7. Murray AM, Tupper DE, Knopman DS, Gilbertson DT, Pederson SL, et al. (2006) Cognitive impairment in hemodialysis patients is common. Neurology 67: 216–223.
  8. 8. Bugnicourt J-M, Godefroy O, Chillon J-M, Choukroun G, Massy ZA (2013) Cognitive disorders and dementia in CKD: the neglected kidney-brain axis. J Am Soc Nephrol 24: 353–363.
  9. 9. Murray AM, Knopman DS (2010) Cognitive impairment in CKD: no longer an occult burden. Am J Kidney Dis 56: 615–618.
  10. 10. Kurella Tamura M, Yaffe K (2011) Dementia and cognitive impairment in ESRD: diagnostic and therapeutic strategies. Kidney Int 79: 14–22.
  11. 11. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, et al. (2005) The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc 53: 695–699.
  12. 12. Kessler J, Markowitsch HJ, Denzler P (2000) Mini-Mental-Status-Test (MMST) German Adaptation. Göttingen: Beltz Test GMBH.
  13. 13. Folstein MF, Folstein SE, McHugh PR (1975) “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12: 189–19.
  14. 14. Pereira AA, Weiner DE, Scott T, Chandra P, Bluestein R, et al. (2007) Subcortical cognitive impairment in dialysis patients. Hemodial Int 11: 309–314.
  15. 15. Post JB, Jegede AB, Morin K, Spungen AM, Langhoff E, et al. (2010) Cognitive profile of chronic kidney disease and hemodialysis patients without dementia. Nephron Clin Pract 116: c247–55.
  16. 16. Freitas S, Simões MR, Alves L, Santana I (2011) Montreal Cognitive Assessment: Validation Study for Mild Cognitive Impairment and Alzheimer Disease. Alzheimer Dis Assoc Disord 00: 1–7.
  17. 17. Wong A, Xiong YY, Kwan PWL, Chan AYY, Lam WWM, et al. (2009) The validity, reliability and clinical utility of the Hong Kong Montreal Cognitive Assessment (HK-MoCA) in patients with cerebral small vessel disease. Dement Geriatr Cogn Disord 28: 81–87.
  18. 18. McLennan SN, Mathias JL, Brennan LC, Stewart S (2011) Validity of the montreal cognitive assessment (MoCA) as a screening test for mild cognitive impairment (MCI) in a cardiovascular population. J Geriatr Psychiatry Neurol 24: 33–38.
  19. 19. Ahmed S, de Jager C, Wilcock G (2011) A comparison of screening tools for the assessment of Mild Cognitive Impairment: Preliminary findings. Neurocase
  20. 20. Tholen S, Schmaderer C, Kusmenkov E, Chmielewski S, Förstl H, et al. (2014) Variability of Cognitive Performance during Hemodialysis: Standardization of Cognitive Assessment. Dement Geriatr Cogn Disord 38: 31–38.
  21. 21. Perk J, De Backer G, Gohlke H, Graham I, Reiner Z, et al. (2012) “European Guidelines on cardiovascular disease prevention in clinical practice (version 2012)” The Fifth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice. Eur Hear J 33:: 2126–2126.
  22. 22. Charlson ME, Pompei P, Ales KL, MacKenzie CR (1987) A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 40: 373–383.
  23. 23. Beddhu S, Bruns FJ, Saul M, Seddon P, Zeidel M (2000) A simple comorbidity scale predicts clinical outcomes and costs in dialysis patients. Am J Med 108:: 609–613.
  24. 24. Costa AS, Tiffin-Richards FE, Holschbach B, Frank RD, Vassiliadou A, et al. (2014) Clinical Predictors of Individual Cognitive Fluctuations in Patients Undergoing Hemodialysis. Am J Kidney Dis pii: S0272.
  25. 25. Costa AS, Fimm B, Friesen P, Soundjock H, Rottschy C, et al. (2012) Alternate-form reliability of the montreal cognitive assessment screening test in a clinical setting. Dement Geriatr Cogn Disord 33: 379–384.
  26. 26. Niemann H, Sturm W, Thöne-Otto A, Willmes-von-Hinkeldey K (2008) California Verbal Learning Test - German adaptation. Pearson As. Frankfurt.
  27. 27. Ingram F, Soukoup VM, Ingram PTF (1997) The Medical College of Georgia Complex Figures: reliability and preliminary normative data using an intentional learning paradigm in older adults. Neuropsychiatry, Neuropsychol Behav Neurol 10:: 144–146.
  28. 28. Zimmermann P, Fimm B (2012) Testbatterie zur Aufmerksamkeitsprüfung. Version 2.3. Herzogenrath: Psytest.
  29. 29. Wagner S, Helmreich I, Dahmen N, Lieb K, Tadic A (2011) Reliability of three alternate forms of the trail making tests a and B. Arch Clin Neuropsychol 26: 314–321.
  30. 30. Aschenbrenner S, Tucha O, Lange KW (2000) Regensburg Word Fluency Test [Regensburger Wortflüssigkeits-Test (RWT)]. Göttingen: Hogrefe.
  31. 31. Von Aste M, Neubauer A, Horn R (2006) Wechsler Intelligenztest für Erwachsene (WIE). Deutschsprachige Bearbeitung und Adaptation des WAIS-III von David Wechsler. Frankfurt: Harcourt Test Services.
  32. 32. Bäumler G (1985) Farbe-Wort-Interferenztest. Göttingen: Hogrefe.
  33. 33. Aebi C (2002) Valiedirung der neuropsychologischen Testbatterie CERAD-NP: eine Multi-Center Studie [Validation of the CERAD-NP neuropsychological test batery: a multi-center study Basel University.
  34. 34. Warrington E, James M (1992) Testbatterie für Visuelle Objekt- und Raumwahrnehmung (VOSP). Frankfurt: Harcourt Test Services.
  35. 35. Johns M (1991) A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep
  36. 36. Radbruch L, Sabatowski R, Elsner F, Everts J, Mendoza T, et al. (2003) Validation of the German Version of the Brief Fatigue Inventory. J Pain Symptom Manage 25: 449–45.
  37. 37. Herrmann-Lingen C, Buss U, Snaith RP (1995) Hospital Anxiety and Depression Scale - deutsche Version (HADS-D). Bern: Verlag Hans-Huber.
  38. 38. Cohen J (1988) Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ, England: Lawrence Erlbaum Associates, Inc.
  39. 39. Luis CA, Keegan AP, Mullan M (2009) Cross validation of the Montreal Cognitive Assessment in community dwelling older adults residing in the Southeastern US. Int J Geriatr Psychiatry
  40. 40. Zhao J, Tang H, Sun J, Wang B, Chen S, et al. (2012) Analysis of cognitive dysfunction with silent cerebral infarction: a prospective study in Chinese patients. Metab Brain Dis 27: 17–22.
  41. 41. Yaffe K, Ackerson L, Kurella Tamura M, Le Blanc P, Kusek JW, et al. (2010) Chronic kidney disease and cognitive function in older adults: findings from the chronic renal insufficiency cohort cognitive study. J Am Geriatr Soc 58: 338–345.
  42. 42. Sarnak MJ, Tighiouart H, Scott TM, Lou KV, Sorensen EP, et al. (2013) Frequency of and risk factors for poor cognitive performance in hemodialysis patients. Neurology 80: 471–480.
  43. 43. Zadikoff C, Fox SH, Tang-Wai DF, Thomsen T, de Bie RM, et al. (2008) A comparison of the mini mental state exam to the Montreal cognitive assessment in identifying cognitive deficits in Parkinson's disease. Mov Disord 23: 297–299.
  44. 44. Gill DJ, Freshman A, Blender JA, Ravina B (2008) The Montreal cognitive assessment as a screening tool for cognitive impairment in Parkinson's disease. Mov Disord 23: 1043–1046.
  45. 45. Wang F, Zhang L, Liu L, Wang H (2010) Level of kidney function correlates with cognitive decline. Am J Nephrol 32: 117–121.
  46. 46. Helmer C, Stengel B, Metzger M, Froissart M, Massy Z-A, et al. (2011) Chronic kidney disease, cognitive decline, and incident dementia: The 3C Study. Neurology 77: 2043–2051.
  47. 47. Bossola M, Antocicco M, Di Stasio E, Ciciarelli C, Luciani G, et al. (2011) Mini Mental State Examination over time in chronic hemodialysis patients. J Psychosom Res 71: 50–54
  48. 48. Lessig S, Nie D, Xu R, Corey-Bloom J (2012) Changes on brief cognitive instruments over time in Parkinson's disease. Mov Disord 27: 1125–1128.
  49. 49. Sorensen EP, Sarnak MJ, Tighiouart H, Scott T, Giang LM, et al. (2012) The Kidney Disease Quality of Life Cognitive Function Subscale and Cognitive Performance in Maintenance Hemodialysis Patients. Am J Kidney Dis 1–10.
  50. 50. Williams MA, Sklar AH, Burright RG, Donovick PJ (2004) Temporal effects of dialysis on cognitive functioning in patients with ESRD. Am J Kidney Dis 43: 705–711.
  51. 51. Bossola M, Luciani G, Tazza L (2009) Fatigue and its correlates in chronic hemodialysis patients. Blood Purif 28: 245–252.
  52. 52. Madero M, Gul A, Sarnak MJ (n.d.) Cognitive function in chronic kidney disease. Semin Dial 21: 29–37.
  53. 53. Watnick S, Kirwin P, Mahnensmith R, Concato J (2003) The prevalence and treatment of depression among patients starting dialysis. Am J Kidney Dis 41: 105–110.
  54. 54. Agganis BT, Weiner DE, Giang LM, Scott T, Tighiouart H, et al. (2010) Depression and cognitive function in maintenance hemodialysis patients. Am J Kidney Dis 56: 704–712.