Next Article in Journal
Low Body Mass Index Levels and Idiopathic Scoliosis in Korean Children: A Cross-Sectional Study
Next Article in Special Issue
Impact of Graft Size Matching on the Early Post-Transplant Complications and Patients Survival in Children after Living Donor Liver Transplantations
Previous Article in Journal
Bone Health and Its Positive Relationships with Body Composition in Malaysian Schoolchildren: Findings from a Cross-Sectional Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identification of Impaired Executive Functioning after Pediatric Liver Transplantation Using Two Short and Easily Applicable Tests: Cognitive Functioning Module PedsQL and Children’s Color Trail Test

1
Division of Pediatric Gastroenterology and Hepatology, Department of Pediatric Kidney, Liver and Metabolic Diseases, Hannover Medical School, 30625 Hannover, Germany
2
Institute of Social Psychology, Goethe University Frankfurt, 60323 Frankfurt, Germany
3
Pediatric Pulmonology and Neonatology, Hannover Medical School, 30625 Hannover, Germany
*
Author to whom correspondence should be addressed.
Children 2021, 8(7), 571; https://doi.org/10.3390/children8070571
Submission received: 8 June 2021 / Revised: 28 June 2021 / Accepted: 29 June 2021 / Published: 2 July 2021

Abstract

:
We aimed to assess executive functioning in children after liver transplantation compared with healthy controls and in relation to real-life school performance using the PedsQLTM Cognitive Functioning Scale (CogPedsQL) and the Childrens’ Color Trail Test (CCTT). One hundred and fifty five children (78f, median age 10.4 (1.2–18.3) years) underwent testing with CogPedsQL and/or CCTT 4.9 (0.1–17.0) years after transplantation. Results were compared to those of 296 healthy children (165f, median age 10.0 (2.0–18.0) years). Liver transplanted children displayed significantly reduced scores for cogPedsQL and CCTT1&2 compared to healthy controls. Overall, school performance was lower in patients compared to controls. In both patients and controls, results of CCTT2 and CogPedsQL correlated strongly with school performance. In contrast to controls, school performance in patients correlated with the level of maternal but not paternal primary education degree (r = −0.21, p = 0.03). None of the patient CCTT or CogPedsQL test results correlated with parental school education. Conclusion: CogPedsQL and CCTT 1&2 were easily applicable in children after OLT and revealed reduced executive functioning compared to controls. Results reflect real life school performance. The association of parental education with school performance is reduced in transplanted children, which possibly indicates the overriding impact of transplant-associated morbidity on cognitive outcomes.

1. Introduction

Outcomes of pediatric liver transplantation have improved markedly over the past decades, with long-term survival rates around 90% [1]. With improved results quo ad vitam, the focus of long-term follow-up has now shifted to questions beyond mortality and started to address morbidity, quality of life and social inclusion after transplantation. This includes neurocognitive development and education achievements. Impairment of cognitive functioning in children after liver transplantation has been reported repeatedly [2,3,4,5,6,7,8]. Developmental delay has been described in 25–35% of children after liver transplantation [2,3]. Reduced scores for mathematics and language achievements have been reported in one third of transplanted children with normal intelligence quotient (IQ) [4]. Children after liver transplantation appear to have lower working memory abilities [7], reduced mathematic skills [5,7], lower verbal intelligence scores and worse performance in receptive language tasks [9] when compared to either a normative sample [5,7] or to children with cystic fibrosis [8,9]. Developmental delay and cognitive impairment can result from effects of the underlying primary disease [10,11,12], from transplant-associated complications [12] and from side effects of the necessary medication [5,12].
The majority of published reports on mental development, verbal performance, the general intelligence quotient (IQ) or on concentration abilities in transplanted children have used extensive psychometric testing, such as Bayley Scales, Wechsler intelligence scales or Behaviour Rating Inventories of Executive Function (BRIEF) [5,6,7,9,13,14]. While these tests offer comprehensive and differentiated understanding of a child’s impairment and cognitive functioning, they are lengthy in execution and—in the context of pediatric liver transplantation—are primarily used in research settings. Given the frequency of cognitive problems in the pediatric transplant population, a tool that offers fast and easily applicable assessment of cognitive impairment thus appears desirable. The present study presents two such instruments and provides evidence for their validity.
The PedsQL Cognitive Functioning scale (cogPedsQL) was first evaluated in children after liver transplantation in 2011 by Varni et al. [15]. This addition to the established PedsQL questionnaire on health-related quality of life consists of six questions on aspects of cognitive functioning such as selective attention, sustained attention, working memory and cognitive flexibility. It has demonstrated good discriminant validity and reliability both in children after liver transplantation and in pediatric cancer survivors [16]. The cogPedsQL comprises a patient self-report questionnaire and a corresponding parent-proxy-report. Using the cogPedsQL in liver transplanted children and their corresponding parents, cognitive functioning was found to be comparable to that of long-term cancer survivors [15], but below that of a normative population [8,15].
Second, the Children’s Color Trail Test (CCTT) is a variant of the Trail Making Test, where children are asked to connect numbers in ascending order as fast as they can. In the Children’s Color Trail Test CCTT, children connect numbers in ascending order in part 1, and alternate between numbers in two different colors while connecting the numbers in part 2. Using colors rather than letters for alternating attention in the second part allows cross-cultural application. Part 1 tests attention, psychomotor speed, perceptual tracking and sequencing. Part 2 also examines alternating attention, mental flexibility and response inhibition. Both the original Trail Making Test and color-trails versions such as the CCTT have detected reduced executive functioning in children with reduced academic performance, but without overtly known neurological disease [17], in children with diagnosed learning abilities, attention deficits or mild neurological conditions [18] and in HIV-positive children with a history of encephalitis [19]. One of the advantages of the CCTT is that it is comparatively quick to administer.
Given the importance of executive functioning for daily life, successful schooling and long-term quality of life, we wanted to explore the applicability of CCTT and cogPedsQL as screening instruments for reduced executive functioning in a pediatric liver transplant population. We hypothesized that the PedsQL Cognitive Functioning Module and CCTT1&2 will reveal reduced performance in children after liver transplantation compared to healthy control children. In order to assess the relevance of test results for everyday life, we also aimed to compare test performance with school performance in children of school age. External factors that might affect test results such as socio-economic and parental educational background were equally examined.
To address these questions and hypotheses, we conducted a cross-sectional study on executive functioning in liver transplanted children and in healthy control children using two tests: the Children’s Color Trail Test (CCTT), and the PedsQL Cognitive Functioning Module in a new standardized German Translation.

2. Materials and Methods

Patients: 155 children (78 girls, 77 boys) aged 1.2 to 18.3 (median 10.4) years who had undergone liver transplantation 0.1–17.0 (median 4.9) years before study entry were recruited in the outpatient clinic. No exclusions were made on the basis of primary diagnosis. Demographical data are summarized in Table 1. Parents of all children were asked to complete a proxy assessment of the Cog-PedsQL. Children aged 5 years and older completed the cognitive function module of the Pediatric Quality of Life Questionnaire PedsQL (Cog-PedsQL). Children aged 8 years and older also undertook the Children Color Trail Test (CCTT).
Controls: 296 healthy children (165 girls, 131 boys, aged 2.0–18.0 (Median 10.0) years) served as controls. Children below school-age were recruited from the University Hospital Day Care for staff children, which is open to all members of staff. Children of school age were recruited from a local primary and comprehensive school (“Integrierte Gesamtschule”). The number of control children was targeted at providing a European normative data set both for the new German transplantation of the Cog-PedsQL and for the CCTT.
Patients and controls had a comparable language background, with a slightly higher proportion of children with German as the primary language in the control group (88.2% vs. 81.3%, Chi square p = 0.064) (Table 2).
Comparison of parental education showed a similar proportion of parents without any formal degree in both groups (around 2%). There were higher rates of university entrance level diploma holders (“Abitur”) and university degree holders in the control parents compared with patients’ parents. Employment status was not documented.
Children’s Color Trail Test (PAR Incorporated, Lutz, USA): The Children’s Color trail test comprises 2 subtests (CCTT1 and 2). For CCTT1, children are presented with a sheet containing the numbers 1 to 15 in red and yellow circles. Children are asked to link these numbers in the correct ascending order using a pencil, working as fast as they can. The total time needed to complete the task is recorded in seconds. For the CCTT2, numbers from 2 to 15 appear twice, once in a red and once in a yellow circle. The task consists of linking the circles using the correct number sequence 1–15, while switching the color at each step, again as fast as possible. Possible errors include sequence errors in CCTT1 and both number and color sequence errors in CCTT2. Errors are pointed out by the examiner and corrected immediately, thus leading to an increase in time required to complete the task. The total time needed is recorded in seconds (raw data). In order to enable comparison of test results across age groups, PAR Inc. provides normalising calculations based on a normative population of US children. These calculations allocate a centile, a T-score and a Standard Score to any given raw time based on the age of the child. Centiles, T-score and Standard Score were calculated to describe the normative populations with a median at 50th centile, a median T-score of 50 and a median Standard Score of 100. For clarity, only Standard Scores were used for our analysis. Using the tables provided by PAR Inc., we allocated Standard Scores to the raw test results obtained by both patients and controls. CCTT tests were administered by 4 examiners who had received thorough training in test administration and followed a standardized protocol for test administration. Care was taken to ensure that CCTT was performed in quiet, undisturbed surroundings. CCTT administration took between five and seven minutes in total.
PedsQL Cognitive Functioning Module (PedsQLTM, Copyright ©1998 JW Varni, Ph.D. All rights reserved): Since the Cog-PedsQL was only available in English at the outset of our study, we undertook a standardized translation into German with the support of MAPI Research Trust, Lyon, France (https://eprovide.mapi-trust.org (accessed on 21 May 2012)). The Cog-PedsQL comprises 6 questions on the ability to concentrate in everyday life (Table A1 in Appendix A). Answers are recorded using a 5-step Likert scale. Children aged 5–7 are offered a simplified 3-step Likert scale using smiley faces. For children aged 2–4, only a parent-proxy questionnaire is used. Answers to the individual questions are scored and an average for the test is calculated. The highest possible score obtainable in the questionnaire is 100; the lowest possible score is 0. Only questionnaires where at least 4 questions had been answered were considered as valid for evaluation.
School performance: School performance was assessed by a questionnaire asking parents for an overall mark according to the German school marking system (1 = very good, 2 = good, 3 = satisfactory, 4 = fair/pass, 5 = poor, 6 = very poor). In addition, type of primary and secondary schooling, age at school entry and necessity to repeat grades were documented in a parental questionnaire.
Statistical analysis: All statistical analyses were performed using IB SPSS Statistics 25. Continuous variables are presented as mean or median as appropriate plus standard deviation. The feasibility of the cog-PedsQL was assessed by the response rate based on the number of eligible participants, by the percentage of missing values for individual items and by the frequency of complete or partial response. Crohnbach’s alpha was used to assess internal consistency reliability of the translated CogPedsQL scales.
Results of the CogPedsQL and CCTT1&2 were compared between patients vs. controls or children vs. parents using paired or unpaired student’s t-test as appropriate. Effect size of significant differences between the means was determined using Cohen’s d [20]. Calculations were performed using the online calculator from https://statistikguru.de/rechner/cohens-d.html (accessed on 13 May 2021). Correlation of CogPedsQL and CCTT-results with demographic or socioeconomic factors was assessed by Pearsson’s r.

3. Results

3.1. Feasibility and Reliability of CCTT1 & 2 and CogPedsQL

Feasibility for CCTT was 100%. All children eligible for CCTT 1&2 were able to understand test instructions and completed the test.
CogPedsQL showed very good feasibility, with percentages for missing individual items of only 0.6% (children) and 0.7% (parents) respectively. 97% of participating children completed all 6 single items of the CogPedsQL questionnaire, while an additional 2.7% completed at least 5 items. Parental results were comparable, with 96.7% completion of all 6 individual items and an additional 2.8% completion of 5 items. Of 384 children eligible to complete the CogPedsQL, 15 refused participation. Fourteen of these were in the 5–7 age group, highlighting the difficulties of recruiting younger children.
Parental response rate was 95% and was mainly influenced by parental availability during hospital or school visits. Crohnbach’s alpha as a measure for internal consistency reliability was 0.74 for the children’s CogPedsQL and exceeded 0.9 for the parental CogPedsQL.

3.2. Children’s Color Trail Test in Patients and Controls

Results for CCTT1&2 are summarized in Table 3. In patients, mean Standard Scores were 81.5 (54–120) for CCTT1 and 87.8 (54–115) for CCTT2. Analysis according to age group (8–12 vs. 13–16 years) revealed significantly better results in the older patients for CCTT1, but not for CCTT2. This difference between age groups was not present in the control children.
Transplanted children scored significantly lower than healthy controls both in CCTT 1 and 2, with an average effect size of d = −0.84 (Table 3). Test results in patients appear to follow a bimodal distribution, with CCTT2 results that indicate “no impairment” of executive functioning displaying a near normal distribution. However, there appears to be a second peak in the “impairment” range (Figure 1a), in contrast to the control results. Impairment is predominantly mild (Figure 1b).

3.3. CogPeds-QL

Valid test results of CogPedsQL were available from 121 patients and 147 parents of transplanted children. Mean patient score was 66.8 (range 8.3–100), while mean parent-proxy report score was 65.2 (range 4.2–100). Paired comparison of children’s and parents’ results was possible in 116 patients. Overall, patients trended to judge their executive functioning better than their respective parents (mean CogPedsQL score 67.3 vs. 63.8, p = 0.11), although this difference became significant only in the 8–12-year-olds (59.2 vs. 55.9, p < 0.01).
Patients scored significantly lower than controls with medium effect size in the children’s reports (d = −0.39), but strong effect size in the parent-proxy reports (d = −0.73). However, this difference could not be found in all age groups (see Table 4). Parent-proxy scores were almost identical between patients and controls in the toddler/preschool group (2–4 years old). In contrast, children’s scores did not differ significantly in the teenage age group (13–18 years).

3.4. Influence of Age and Socio-Economic Factors on Test Results

CogPedsQL self report scores for 5–7 year olds were significantly lower than those of all other age groups (50.5 in patients, 61.6 in control children (p = 0.046, d = −0.49)). This difference is not reflected in the corresponding parent-proxy reports (Table 4). Corresponding to the lower CogPedsQL results in the 5–7 age group, age at testing shows a significant correlation with children’s CogPedsQL (r = 0.27, p < 0.01), which disappears if the results for 5–7 year olds are eliminated from the analysis (r = 0.02, p = 0.91).
CCTT1 showed a weak, but positive correlation with age at testing (r = 0.13, p = 0.028), but no correlation of age with CCTT2 or parental CogPedsQL could be demonstrated.
Socio-economic background appears to be associated with test performance in control children. CogPedsQL scores show weak, but consistent and statistically significant correlation with parental education in control children (Table 5). This association is much less pronounced in transplanted children, where only maternal tertiary education status is associated with CogPedsQL results.

3.5. Results of Children’s Color Trail Test and CogPedsQL Are Reflected in School Performance

A hundred and one patients were attending school at the time of our study. Thirty-one were in primary school, and 7 attended a special needs school. More patients than controls had entered school belatedly at age 7 years rather than at the usual 6 years (patients vs. controls 6 years 62% vs. 78.5%; 7 years 33.3 vs. 13.3%, p < 0.01 respectively). Twenty-eight patients (26.4%) had had to repeat a grade, the majority of which (72%) were in primary school.
Of 63 patients in secondary schooling (10 years and above), 7 (11.1%) attended basic level secondary schools, 29 (46.0%) attended mid-level schools and 15 (23.8%) attended higher level secondary education (Gymnasium) leading to a university entrance diploma. Twelve (19.0%) attended secondary schools offering several degree levels. These proportions are markedly shifted compared to the general population in Germany, with a higher proportion attending mid-level schooling and a lower proportion achieving university entrance level in the patients (Figure 2a).
School performance was rated as overall mark by the parents. There was a marked difference in school performance between patients and controls (Figure 2b). Only 4.7 % of patients were rated to achieve “very good” results, compared to 23.2% of controls. Rates for good/satisfactory/fair/poor and very poor were 35.9%/41.5%/14.2%/2.8%/0% in the patients and 56%/17%/3.7%/0%/0% in the controls (p < 0.001).
In both patients and control children, results of CCTT2 and cogPedsQL correlated significantly with school performance (CCTT2 r = −0.29/−0.19 in patients/controls respectively, children’s CogPedsQL r = −0.32/−0.27, parental CogPedsQL r = −0.32/−0.57 respectively, negative values for correlations as school performance is inversely marked).
At the same time, school performance of control children showed a medium effect size correlation with their parents’ education status (Table 6). In patients, only maternal secondary education status correlated with school performance (r = −0.21, p = 0.03).

4. Discussion

We examined cognitive functioning in children after liver transplantation by using two simple and short tests that can be used in everyday clinical practice. The Cognitive Functioning Module of the PedsQL (cogPedsQL) tests the ability to concentrate and maintain concentration (cognitive fatigue), while the CCTT examines executive functioning such as attention, psychomotor speed, perceptual tracking, sequencing, alternating attention, mental flexibility and response inhibition.
We found reduced scores for both the cogPedsQL and CCTT in liver transplanted children when compared to a healthy control sample.
The Cognitive Functioning Module of the PedsQL was first published in the context of pediatric liver transplantation by Varni et al. in 2011 [15], who found reduced CogPedsQL scores in 215 liver transplanted children and their parents compared to a corresponding normative sample [15]. Varni et al. also obtained the 72-item Behaviour Rating Inventory of Executive Function (BRIEF) on their liver transplant cohort. They could show strong and significant correlations of cogPedsQL results with all BRIEF subscales, supporting the validity of the cogPedsQL as a measure for cognitive fatigue and executive functioning. More recently, Ohnemus et al. used the cogPedsQL in a longitudinal assessment of health-related quality of life (HRQOL) in children and adolescents after liver transplantation [8]. They also documented reduced cognitive functioning as measured by the cogPedsQL when comparing liver transplanted children with a healthy normative sample.
The validated German translation of the cogPedsQL was created by our group in cooperation with MAPI research trust specifically for this study. It has since been used by Petersen et al. as an integral part of the PedsQL fatigue scale, with similar results for the transplanted children [22]. Results for cogPedsQL in our study appear lower than in Varni’s and Ohnemus’ publication using the English original. Similarly, healthy control cogPedsQL results in our study are lower than, for instance, those in the normative US sample used in the study by Petersen et al. [22]. While the new German translation followed a standardized, evaluated process to ensure comparability with the English original, it is conceivable that the translation per se causes a systematic shift in answers. Also, cross-cultural differences that are independent of language might have an impact on the way individual questions are understood and answered. Differences in results according to country of origin despite the use of the same language have previously been described for the generic PedsQL [23]. This observation underlines the importance of matching, language-identic control cohorts. Our study presents the first German-speaking pediatric control cohort for the cognitive functioning module of the PedsQL.
The CCTT as such has not yet been applied in children after liver transplantation. However, a trail making test was used in long-term survivors after pLTx as part of the Delis-Kaplan Executive Function System (D-KEFS) battery [24]. Here, reduced scores were found in the transplanted children compared with their healthy siblings. We chose the CCTT because it is fairly quick to administer. Also, CCTT appears less influenced by primary language than the Trail Making Test [25]. Its results appear to be independent of gender [25], but need to be normalized for age.
For CCTT, the importance of an adequate local normative sample for comparison has also been demonstrated [26], as there appear to be more differences based on sociocultural background than previously anticipated. Our normative sample was comparable with the group of transplanted children in its composition and diversity with regards to language and migration background. Our data represent the first study of CCTT in liver transplanted children, as well as delivering normative data for a European population.
In our study, results of both tests correlated with school performance, thus supporting the relevance of test results for everyday life. We found school performance in general to be lower in transplanted children compared with healthy controls. Some inaccuracy must be assumed, since instead of objective itemized scoring of academic performance, we used global parental assessment as a rather crude measure for school performance. However, the fact that significantly more of our patients receive basic level and mid-level secondary education than is currently seen in the general population in Germany supports the results of parental assessment. The rate of children attending a special needs school in our cohort (7%) is lower than published rates of 10–34% [4,7,27]; however, different school systems make it difficult to compare results directly.
Some caveats need to be applied when using the tests in daily clinical practice:
For cogPedsQL, we saw significant differences between the different age groups in the patient cohort. In 5–7-year-olds, the 5-point Likert scale for answering the cogPedsQL questions is replaced by a 3-point smiley face scale (smiley/neutral/grumpy face). The smiley face signifies to “never” have any problems. It is conceivable that a negative bias is introduced by the reduction to 3 options of answering a question. This interpretation is supported by the fact that reduced scores in the 5–7-year-olds were also observed in the control group. Based on these results, we would caution against using the cogPedsQL in the 5–7 years age-group in order to avoid overestimation of cognitive fatigue.
A similar caution applies to the use of the cogPedsQL in the 2–4-year-olds. Parents frequently reported difficulties in filling in the questionnaire for this age group, as some of the items appeared difficult to assess in 2–4-year-olds. This might lead to an over-positive assessment of cognitive abilities in this age-group. Some of the difficulties in concentration observed in this age group might still be judged as age-appropriate by the parents, potentially leading to over-estimation. This notion is supported by the fact that parent-proxy reports of patients scored highest in the 2–4-year-olds and in fact were not significantly different from control values.
CogPedsQL results in controls were correlated with parental education status, which we used as surrogate parameter for socioeconomic background. This finding highlights the strongest source of potential bias in our study, namely the somewhat uneven distribution of socioeconomic levels between controls and transplant cohort. We tried to minimize that source of bias by our choice of school and day care centre for control recruitment; however, there still is a higher proportion of university entrance level diploma holders and university degree holders among parents of the control group. One explanation might be that consent for study participation among controls was influenced by higher socioeconomic status. The perceived association of test results and parental education background raises the question of validity for the difference in test performance between patients and controls. Multivariate regression identified both maternal education level and patient vs. control status as independent predictors of PedsQL results, albeit with considerably higher beta coefficient for health status. We therefore believe that PedsQL can be used as a valid instrument to compare transplanted and healthy children, if interpretation is made in light of variable socioeconomic backgrounds.
Similar to test performance, school performance of control children correlated significantly with their parents’ education status. This effect was much less pronounced in patients. Correlation of academic achievement and socio-economic status has been repeatedly reported for Germany as well as for other European countries (20). Why these effects were not observed in the transplant cohort remains an open question. Published results on a link between socioeconomic status and cognitive abilities in children with liver disease or liver transplants are equivocal. Most studies comparing patients and controls matched controls according to age, gender and ethnicity [15,28,29], but not to socioeconomic background. One study described higher household educational levels to be a protective factor for mental development at 2 years of age [27], while others could not delineate differences in cognitive abilities in liver transplanted children according to socioeconomic status [24,30,31]. We have previously shown that age at transplantation and length of stay in intensive care are the main predictors of cognitive outcome in children after liver transplantation [32]. We therefore interpret the observed lack of association with socio-economic background in this analysis as a result from overriding influences of somatic factors.

5. Conclusions

In summary, we describe the cognitive functioning module of the PedsQL and the CCTT as two easily applicable tests that can detect impaired executive functioning in children after liver transplantation. Test results correlate with school performance, indicating their relevance for daily life. The influence of parental education on school performance is reduced in transplanted children, which possibly indicates the overriding impact of transplant-associated morbidity on educational outcomes. We deliver the first application of the German translation of the cogPedsQL, including data for a normative control group. We also deliver control data for the CCTT from a European cohort. Our data support the fact that cogPedsQL and CCTT can be used in clinical practice to identify children who might benefit from more detailed neuropsychological assessment and academic support.

Author Contributions

Conceptualization, U.B. and I.G.; methodology, R.v.D., I.G. and C.J.; validation, I.G. and R.v.D.; formal analysis, I.G. and C.J.; investigation, resources, R.v.D., E.D.P. and U.B.; data curation, I.G.; writing—original draft preparation, I.G.; writing—review and editing, I.G., U.B., R.v.D., C.J. and E.D.P.; visualization, I.G.; supervision, U.B.; project administration, I.G.; funding acquisition, U.B. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by an unrestricted grant by Astellas Pharma.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Hannover Medical School (Statement N° 5978, approval date 10 March 2015).

Informed Consent Statement

Written informed consent was obtained from all parents of patients and control children, and from patients and control children aged 12 years and above.

Data Availability Statement

Data are available from the corresponding author on request.

Acknowledgments

We are grateful to Malte Kanter, Deniz Azamli, Katarina Migal and Annika Zingel for their support with the administration of questionnaires to patients and control children. Malte Kanter and Deniz Azamli deserve special praise for their organisational support. We also are very grateful to the staff, children and parents of the Campuskinder day care at Hannover Medical School and of the IGS Roderbruch school for their continued support and contribution to the control cohort.

Conflicts of Interest

This study was supported by an unrestricted grant by Astellas Pharma. Astellas pharma had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. The original PedsQL modul on cognitive functioning was provided by MAPI research trust for a structured translation. No funds were received for the translation. MAPI research trust did not participate in or influence data analysis or interpretation.

Appendix A

Table A1. PedsQL TM cognitive functioning module.
Table A1. PedsQL TM cognitive functioning module.
Children’s Questionnaire
In the past one month, how much of a problem has this been for you…
Hattest Du in den vergangenen 4 Wochen folgende Probleme oder Schwierigkeiten?
 1. It is hard for me to keep my attention on things.
Es fiel mir schwer, mich auf eine Sache zu konzentrieren.
 2. It is hard for me to remember what people tell me.
Es fiel mir schwer, mich an Dinge zu erinnern, die andere mir erzählt haben.
 3. It is hard for me to remember what I just heard.
Es fiel mir schwer, mir Dinge zu merken, die ich gerade gehört hatte.
 4. It is hard for me to think quickly.
Es fiel mir schwer, schnell zu denken.
 5. I have trouble remembering what I was just thinking.
Ich hatte Schwierigkeiten, mich an das zu erinnern, woran ich gerade gedacht hatte.
 6. I have trouble remembering more than one thing at a time.
Ich hatte Schwierigkeiten, mir mehr als eine Sache gleichzeitig zu merken.
Parents’ Questionnaire
In the past one month, how much of a problem has this been for your child….
Hatte Ihr Kind in den vergangenen 4 Wochen folgende Probleme oder Schwierigkeiten?
Mein Kind hatte…
 1. Difficulty keeping his/her attention on things.
Schwierigkeiten, sich auf eine Sache zu konzentrieren.
 2. Difficulty remembering what people tell him/her
Schwierigkeiten, sich an Dinge zu erinnern, die andere ihm erzählt hatten.
 3. Difficulty remembering what he/she just heard
Schwierigkeiten, sich Dinge zu merken, die es gerade gehört hatte.
 4. Difficulty thinking quickly
Schwierigkeiten, schnell zu denken.
 5. Trouble remembering what he/she was just thinking
Schwierigkeiten, sich an das zu erinnern, woran es gerade gedacht hatte.
 6. Trouble remembering more than one thing at a time.
Schwierigkeiten, sich mehr als eine Sache gleichzeitig zu merken.
All questions could be answered on a 5-point Likert scale using the following options: never, almost never, sometimes, often, almost always (nie, fast nie, manchmal, häufig, fast immer). Copyright information for the PedsQL: PedsQLTM, Copyright 1998 JV Varni, Ph.D. All rights reserved. Contact information and permission to use: Mapi Research Trust, Lyon, France. https://eprovide.mapi-trust.org and www.pedsql.org (accessed on 21 May 2012).

References

  1. Otte, J.B. Pediatric liver transplantation: Personal perspectives on historical achievements and future challenges. Liver Transpl. 2016, 22, 1284–1294. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Stewart, S.M.; Uauy, R.; Waller, D.A.; Kennard, B.D.; Benser, M.; Andrews, W.S. Mental and motor development, social competence, and growth one year after successful pediatric liver transplantation. J. Pediatr. 1989, 114, 574–581. [Google Scholar] [CrossRef]
  3. Berquist, R.K.; Berquist, W.E.; Esquivel, C.O.; Cox, K.L.; Wayman, K.I.; Litt, I.F. Non-adherence to post-transplant care: Prevalence, risk factors and outcomes in adolescent liver transplant recipients. Pediatr. Transplant. 2008, 12, 194–200. [Google Scholar] [CrossRef] [PubMed]
  4. Kennard, B.D.; Stewart, S.M.; Phelan-McAuliffe, D.; Waller, D.A.; Bannister, M.; Fioravani, V.; Andrews, W.S. Academic outcome in long-term survivors of pediatric liver transplantation. J. Dev. Behav. Pediatr. 1999, 20, 17–23. [Google Scholar] [CrossRef] [PubMed]
  5. Gilmour, S.; Adkins, R.; Liddell, G.A.; Jhangri, G.; Robertson, C.M. Assessment of psychoeducational outcomes after pediatric liver transplant. Am. J. Transplant. 2009, 9, 294–300. [Google Scholar] [CrossRef] [PubMed]
  6. Adeback, P.; Nemeth, A.; Fischler, B. Cognitive and emotional outcome after pediatric liver transplantation. Pediatr. Transplant. 2003, 7, 385–389. [Google Scholar] [CrossRef]
  7. Sorensen, L.G.; Neighbors, K.; Martz, K.; Zelko, F.; Bucuvalas, J.C.; Alonso, E.M. Cognitive and academic outcomes after pediatric liver transplantation: Functional Outcomes Group (FOG) results. Am. J. Transplant. 2011, 11, 303–311. [Google Scholar] [CrossRef]
  8. Ohnemus, D.; Neighbors, K.; Rychlik, K.; Venick, R.S.; Bucuvalas, J.C.; Sundaram, S.S.; Ng, V.L.; Andrews, W.S.; Turmelle, Y.; Mazariegos, G.V.; et al. Health-Related Quality of Life and Cognitive Functioning in Pediatric Liver Transplant Recipients. Liver Transpl. 2020, 26, 45–56. [Google Scholar] [CrossRef]
  9. Krull, K.; Fuchs, C.; Yurk, H.; Boone, P.; Alonso, E. Neurocognitive outcome in pediatric liver transplant recipients. Pediatr. Transplant. 2003, 7, 111–118. [Google Scholar] [CrossRef]
  10. Caudle, S.E.; Katzenstein, J.M.; Karpen, S.J.; McLin, V.A. Language and motor skills are impaired in infants with biliary atresia before transplantation. J. Pediatr. 2010, 156, 936–940.e1. [Google Scholar] [CrossRef]
  11. Stewart, S.M.; Campbell, R.A.; McCallon, D.; Waller, D.A.; Andrews, W.S. Cognitive patterns in school-age children with end-stage liver disease. J. Dev. Behav. Pediatr. 1992, 13, 331–338. [Google Scholar] [CrossRef]
  12. Gilmour, S.M.; Sorensen, L.G.; Anand, R.; Yin, W.; Alonso, E.M. School outcomes in children registered in the studies for pediatric liver transplant (SPLIT) consortium. Liver Transpl. 2010, 16, 1041–1048. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Thevenin, D.M.; Baker, A.; Kato, T.; Tzakis, A.; Fernandez, M.; Dowling, M. Neuodevelopmental outcomes for children transplanted under the age of 3 years. Transplant Proc. 2006, 38, 1692–1693. [Google Scholar] [CrossRef]
  14. Schulz, K.H.; Wein, C.; Boeck, A.; Rogiers, X.; Burdelski, M. Cognitive performance of children who have undergone liver transplantation. Transplantation 2003, 75, 1236–1240. [Google Scholar] [CrossRef]
  15. Varni, J.W.; Limbers, C.A.; Sorensen, L.G.; Neighbors, K.; Martz, K.; Bucuvalas, J.C.; Alonso, E.M. PedsQL Cognitive Functioning Scale in pediatric liver transplant recipients: Feasibility, reliability, and validity. Qual. Life Res. 2011, 20, 913–921. [Google Scholar] [CrossRef] [Green Version]
  16. Varni, J.W.; Burwinkle, T.M.; Katz, E.R.; Meeske, K.; Dickinson, P. The PedsQL in pediatric cancer: Reliability and validity of the Pediatric Quality of Life Inventory Generic Core Scales, Multidimensional Fatigue Scale, and Cancer Module. Cancer 2002, 94, 2090–2106. [Google Scholar] [CrossRef]
  17. Reitan, R.M.; Wolfson, D. The Trail Making Test as an initial screening procedure for neuropsychological impairment in older children. Arch. Clin. Neuropsychol. 2004, 19, 281–288. [Google Scholar] [CrossRef]
  18. Williams, J.; Rickert, V.; Hogan, J.; Zolten, A.J.; Satz, P.; D’Elia, L.F.; Asarnow, R.F.; Zaucha, K.; Light, R. Children’s color trails. Arch. Clin. Neuropsychol. 1995, 10, 211–223. [Google Scholar] [CrossRef] [PubMed]
  19. Nichols, S.L.; Brummel, S.S.; Smith, R.A.; Garvie, P.A.; Hunter, S.J.; Malee, K.M.; Kammerer, B.L.; Wilkins, M.L.; Rutstein, R.; Tassiopoulos, K.; et al. Executive Functioning in Children and Adolescents With Perinatal HIV Infection. Pediatr. Infect. Dis. J. 2015, 34, 969–975. [Google Scholar] [CrossRef] [Green Version]
  20. Cohen, J. Statistical Power Analysis for the Behavioural Sciences, 2nd ed.; Lawrence Erlbaum Associates: Hillsdale, NJ, USA, 1988. [Google Scholar]
  21. Llorente, A.M.; Williams, J.; Satz, P.; D’Elia, L.F. Children’s Color Trails Test Professional Manual, 1st ed.; PAR Inc.: Lutz, FL, USA, 1998. [Google Scholar]
  22. Petersen, I.; Noelle, J.; Buchholz, A.; Kroencke, S.; Daseking, M.; Grabhorn, E. Fatigue in pediatric liver transplant recipients and its impact on their quality of life. Pediatr. Transplant. 2019, 23, e13331. [Google Scholar] [CrossRef] [PubMed]
  23. Buck, D. The PedsQL as a measure of parent-rated quality of life in healthy UK toddlers: Psychometric properties and cross-cultural comparisons. J. Child Health Care 2012, 16, 331–338. [Google Scholar] [CrossRef]
  24. Ee, L.C.; Lloyd, O.; Beale, K.; Fawcett, J.; Cleghorn, G.J. Academic potential and cognitive functioning of long-term survivors after childhood liver transplantation. Pediatr. Transplant. 2014, 18, 272–279. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Mok, N.; Tsang, L.; Lee, T.M.; Llorente, A.M. The impact of language on the equivalence of trail making tests: Findings from three pediatric cohorts with different language dominance. Appl. Neuropsychol. 2008, 15, 123–130. [Google Scholar] [CrossRef]
  26. Ferrett, H.L.; Thomas, K.G.F.; Tapert, S.F.; Carey, P.D.; Conradie, S.; Cuzen, N.L.; Stein, D.J.; Fein, G. The cross-cultural utility of foreign- and locally-derived normative data for three WHO-endorsed neuropsychological tests for South African adolescents. Metab. Brain Dis. 2014, 29, 395–408. [Google Scholar] [CrossRef] [Green Version]
  27. Ng, V.L.; Sorensen, L.G.; Alonso, E.M.; Fredericks, E.M.; Ye, W.; Moore, J.; Karpen, S.J.; Shneider, B.L.; Molleston, J.P.; Bezerra, J.A.; et al. Neurodevelopmental Outcome of Young Children with Biliary Atresia and Native Liver: Results from the ChiLDReN Study. J. Pediatr. 2018, 196, 139–147.e3. [Google Scholar] [CrossRef]
  28. Sorensen, L.G.; Neighbors, K.; Hardison, R.M.; Loomes, K.M.; Varni, J.W.; Ng, V.L.; Squires, R.H.; Alonso, E.M.; Bukauskas, K.; Schulte, M.; et al. Health Related Quality of Life and Neurocognitive Outcomes in the First Year after Pediatric Acute Liver Failure. J. Pediatr. 2018, 196, 129–138.e3. [Google Scholar] [CrossRef]
  29. Alonso, E.M.; Limbers, C.A.; Neighbors, K.; Martz, K.; Bucuvalas, J.C.; Webb, T.; Varni, J.W. Cross-sectional analysis of health-related quality of life in pediatric liver transplant recipients. J. Pediatr. 2010, 156, 270–276.e1. [Google Scholar] [CrossRef] [Green Version]
  30. Kaller, T.; Boeck, A.; Sander, K.; Richterich, A.; Burdelski, M.; Ganschow, R.; Schulz, K.H. Cognitive abilities, behaviour and quality of life in children after liver transplantation. Pediatr. Transplant. 2010, 14, 496–503. [Google Scholar] [CrossRef]
  31. Getsuwan, S.; Chuthapisith, J.; Treepongkaruna, S.; Butsriphum, N.; Prabpram, W.; Charoenthanakit, C.; Tanpowpong, P.; Lertudomphonwanit, C. Behavior Problems and Cognitive Function in Pediatric Liver Transplant Recipients. Transplant. Proc. 2021, 53, 649–655. [Google Scholar] [CrossRef] [PubMed]
  32. Goldschmidt, I.; van Dick, R.; Jacobi, C.; Junge, N.; Pfister, E.; Richter, N.; Baumann, U. Impact of Immunosuppression On Executive Functioning After Pediatric Liver Transplantation: An Observational Cohort Study. J. Pediatr. Gastroenterol. Nutr. 2019, 68, 480–487. [Google Scholar] [CrossRef] [PubMed]
Figure 1. (a) Results of CCTT2 are classified into categories according to their Standard Score [21]. Standard Score ≥ 107 equals above average performance, while Standard Scores of 92–106 and 85–91 are classed as average and below average respectively. Standard Scores below 85 are classed as “impaired”. Shaded bars depict patients, white bars depict controls. (b) “Impairment” can be further differentiated by Standard Score: 77–84 mildly impaired, 70–76 mild-to-moderately impaired, 62–69 moderately impaired, 55–61 moderately-to-severely impaired, 0–54 severely impaired. Shaded bars depict patients, white bars depict controls.
Figure 1. (a) Results of CCTT2 are classified into categories according to their Standard Score [21]. Standard Score ≥ 107 equals above average performance, while Standard Scores of 92–106 and 85–91 are classed as average and below average respectively. Standard Scores below 85 are classed as “impaired”. Shaded bars depict patients, white bars depict controls. (b) “Impairment” can be further differentiated by Standard Score: 77–84 mildly impaired, 70–76 mild-to-moderately impaired, 62–69 moderately impaired, 55–61 moderately-to-severely impaired, 0–54 severely impaired. Shaded bars depict patients, white bars depict controls.
Children 08 00571 g001
Figure 2. (a) Comparison of type of secondary schooling between transplanted patients and norms. Norm data in this figure are drawn from official German census data from 2016 including all children visiting secondary schooling in Germany. Patients are depicted by grey bars, and norm data is depicted by hatched bars. (b) School performance of patients (shaded bars) compared to controls (white bars) as rated by their parents.
Figure 2. (a) Comparison of type of secondary schooling between transplanted patients and norms. Norm data in this figure are drawn from official German census data from 2016 including all children visiting secondary schooling in Germany. Patients are depicted by grey bars, and norm data is depicted by hatched bars. (b) School performance of patients (shaded bars) compared to controls (white bars) as rated by their parents.
Children 08 00571 g002
Table 1. Demographic data of the study population.
Table 1. Demographic data of the study population.
n (%)/Median (Range)
SexPatientsBoys77 (49.7%)
Girls78 (50.3%)
Controls Boys131 (44.3%)
Girls165 (55.7%)
AgePatients 10.4 years (2.1–18.3)
Controls 10.0 years (2.0–18.0) n.s.
Primary disease
BA81 (52.3%)
Acute liver failure11 (7.1%)
Alpha-1-antitrypsin-deficiency9 (5.8%)
M. Wilson3 (1.9%)
AIH/PSC7 (4.5%)
PFIC7 (4.5%)
Alagille-Syndrome8 (5.2%)
Hepatoblastoma5 (3.2%)
Metabolic disease
Other (including: ARPKD (2), CF (6), neonatal hemochromatosis (2), Budd–Chiari syndrome (1), neonatal cholestasis of unknown reason (2), portal vein thrombosis (1), IFALD (1), glycogenosis (2), OTC deficiency (1), primary hyperoxaluria (1), choledochal cyst (1), and cryptogenic cirrhosis (4))24 (15.5%)
BA: extrahepatic biliary atresia, AIH: autoimmune hepatitis, PSC: primary sclerosing cholangitis, PFIC: progressive familial intrahepatic cholestasis, ARPKD: autosomal recessive polycystic kidney disease, IFALD: intestinal failure associated liver disease, CF: cystic fibrosis, OTC: ornithine-transcarbamylase.
Table 2. Socioeconomic and cultural background of study population.
Table 2. Socioeconomic and cultural background of study population.
Patients
n (%)
Controls
n (%)
p
(Chi Sqare)
Country of birth
Germany150 (96.8%)284 (95.9%)n.s.
Outside Germany 11 (0.6%)5 (1.6%)
Information missing4 (2.6%)7 (2.4%)
Native Language
German126 (81.3%)261 (88.2%)n.s.
Turkish4 (2.6 %)11 (3.7%)
Russian4 (2.6%)3 (1.0%)
Other 213 (8.3%)13 (4.4%)
Information missing8 (5.2%)8 (2.7%)
School Leaving Certificates
Mothers
None 2 (1.3%)4 (1.4%)
Basic level21 (13.5%)17 (5.7%)<0.01
Mid-level60 (38.7%)81 (27.4%)
University entrance level53 (34.2%)180 (60.8%)<0.01
Other10 (6.4%)5 (1.7%)
Information missing1 (0.6%)9 (3.0%)
Fathers
None 3 (1.9%)5 (1.7%)
Basic level32 (20.6%)16 (5.4%)<0.01
Mid-level41 (26.5%)61 (20.6%)
University entrance level57 (36.8%)180 (60.8%)<0.01
Other8 (5.2%)5 (1.7%)
Information missing1 (0.6%)29 (9.8.0%)
Highest Professional Degree in the Family
None7 (4.5%)10 (3.4%)
Apprenticeship40 (25.8%)47 (15.9%)<0.01
Vocational school39 (25.1%)46 (15.6%)<0.01
University of cooperative 17 (11.0%)41 (13.9%)
Education
University degree24 (15.5%)81 (27.4%)<0.01
PhD10 (6.5%)55 (18.6%)<0.01
Other6 (3.9%)1 (0.3%)
Information missing12 (7.7%)15 (5.1%)
1 other country of birth includes Azerbaijan for 1 patient and USA (n = 3), Israel and Uruguay n = 1 each for controls. 2 Other native languages include: patients: Portuguese and Urdu for n = 2 respectively and Kurdish, Albanian, Afghan, Vietnamese, Sinti, Moroccan, Polish, Azerbaijanian and Spanish for n = 1 resp.; controls: Kurdish (n = 6), Macedonian and Albanian (n = 2 resp.) as well as Cantonese, Serbian and Spanish (n = 1 resp.).
Table 3. Results of children’s color trail test (CCTT) in transplanted children and healthy controls.
Table 3. Results of children’s color trail test (CCTT) in transplanted children and healthy controls.
PatientsControlspCohen’s d
CCTT1
All81.5 ± 19.3
n = 84
95.3 ± 15.1
n = 191
<0.01−0.84
age 8–1277.1 ± 17.8
n = 40
94.2 ± 15.1
n = 115
<0.01−1.1
age 13–1685.5 ± 19.9
n = 44
96.9 ± 15.2
n = 76
<0.01−0.67
8–12 vs. 13–16
p = 0.04
d = −0.44
8–12 vs. 13–16
p = 0.22 n.s.
CCTT2
All 87.8 ± 15.6
n = 85
98.7 ± 11.9
n = 191
<0.01−0.83
age 8–1286.9 ± 16.3
n = 40
99.3 ± 11.3
n = 115
<0.01−0.97
age 13–1688.7 ± 15.1
n = 45
97.1 ± 12.7
n = 76
<0.01−0.62
8–12 vs. 13–16
p = 0.6 n.s.
8–12 vs. 13–16
p = 0.14 n.s.
Table 4. Results of PedsQL cognitive functioning module in transplanted children and healthy controls.
Table 4. Results of PedsQL cognitive functioning module in transplanted children and healthy controls.
Patients
cog-PedsQL Children
Controls
cog-PedsQL Children
p
Patients vs. Controls
Cohen’s d
PedsQL Children
All66.8 ± 20.5 (n = 121)73.9 ± 17.1 (n = 247)<0.01−0.39
age 5–750.5 ± 22.0 (n = 24)61.6 ± 22.6 (n = 54)0.046−0.49
age 8–1268.9 ± 19.5 (n = 42)78.1 ± 13.5 (n = 115)<0.01−0.60
age 13–1872.4 ± 16.8 (n = 55)76.4 ± 13.3 (n = 78)0.13 n.s.−0.27
5–7 vs. 8–12p < 0.01, d = −0.90p < 0.01, d = −0.98
5–7 vs. 13–18p < 0.01, d = −1.18p < 0.01, d = −0.84
8–12 vs. 13–180.34 n.s., d = −0.190.39 n.s., d = 0.13
Patients
Parent proxy cogPesQL
Controls
Parent proxy cog-PedsQL
p
Patients vs. Controls
PedsQL Parents
All65.2 ± 23.5 (n = 147)79.2 ± 16.6 (n = 279)<0.01−0.73
Age 2–474.7 ± 22.5 (n = 25)75.5 ± 14.2 (n = 29) *0.85 n.s.−0.04
age 5–761.9 ± 21.1 (n = 29)80.2 ± 15.7 (n = 55) *<0.01−1.03
age 8–1255.7 ± 22.8 (n = 39)80.7 ± 16.1 (n = 110) *<0.01−1.38
age 13–1869.3 ± 23.3 (n = 54)79.17 ± 18.2 (n = 74) *0.01−0.48
2–4 vs. 5–7p = 0.035, d = 0.59p = 0.18 n.s.
2–4 vs. 8–12p = 0.002, d = 0.84p = 0.11 n.s.
2–4 vs. 13–18p = 0.34 n.s.p = 0.33 n.s.
5–7 vs. 8–12p = 0.26 n.s.p = 0.83 n.s.
5–7 vs. 13–18p = 0.15 n.s.p = 0.74 n.s.
8–12 vs. 13–18p = 0.006, d = −0.59p = 0.55 n.s.
Patients
Paired cog-PedsQL
Children vs. Parents
Controls
Paired cog-PedsQL
Children vs. Parents
All67.3 ± 20.3 vs. 63.8 ± 22.7
(n = 116) p = 0.11, n.s.
74.3 ± 16.9 vs. 79.9 ± 16.7
(n = 231) p < 0.01, d = −0.33
age 5–751.2 ± 22.2 vs. 65.9 ± 16.1
(n = 23) p = 0.012, d = 0.76
61.7 ± 22.4 vs. 79.2 ± 16.0
(n = 50) p < 0.01, d = −0.89
age 8–1269.2 ± 19.9 vs. 55.9 ± 23.1
(n = 38) p < 0.01, d = 0.62
78.6 ± 13.0 vs. 80.5 ± 16.1
(n = 109) p = 0.26 n.s.
age 13–1872.9 ± 16.4 vs. 69.3 ± 23.5
(n = 53) p = 0.16, n.s.
76.4 ± 13.4 vs. 79.3 ± 18.1
(n = 72) p = 0.19, n.s.
* In 11 control children, age was not documented.
Table 5. Correlation of executive functioning and parental formal education background–Pearson’s rho correlation coefficient.
Table 5. Correlation of executive functioning and parental formal education background–Pearson’s rho correlation coefficient.
MotherFather
Level of Secondary EducationLevel of Tertiary EducationLevel of Secondary EducationLevel of Tertiary Education
CCTT1
Patients0.10.050.190.25
Controls0.020.000.00−0.05
CCTT2
Patients0.09−0.020.060.05
Controls0.040.110.120.17
cogPedsQL Children
Patients0.090.27 **0.110.12
Controls0.16 **0.14 *0.14 *0.16 *
cogPedsQL Parents
Patients0.050.18 *0.050.07
Controls0.26 **0.19 **0.24 **0.22 **
* p < 0.05 ** p ≤ 0.01.
Table 6. Correlation of school performance and parental formal education background–Pearson’s rho correlation coefficient. School marks range from 1: very good to 6: very poor, i.e., lower numbers signify better performance.
Table 6. Correlation of school performance and parental formal education background–Pearson’s rho correlation coefficient. School marks range from 1: very good to 6: very poor, i.e., lower numbers signify better performance.
MotherFather
Level of Secondary EducationLevel of Tertiary EducationLevel of Secondary EducationLevel of Tertiary Education
School performance
Patients−0.21 *−0.03−0.11−0.05
Controls−0.26 **−0.26 **−0.26 **−0.21 **
* p < 0.05 ** p ≤ 0.01.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Goldschmidt, I.; van Dick, R.; Jacobi, C.; Pfister, E.D.; Baumann, U. Identification of Impaired Executive Functioning after Pediatric Liver Transplantation Using Two Short and Easily Applicable Tests: Cognitive Functioning Module PedsQL and Children’s Color Trail Test. Children 2021, 8, 571. https://doi.org/10.3390/children8070571

AMA Style

Goldschmidt I, van Dick R, Jacobi C, Pfister ED, Baumann U. Identification of Impaired Executive Functioning after Pediatric Liver Transplantation Using Two Short and Easily Applicable Tests: Cognitive Functioning Module PedsQL and Children’s Color Trail Test. Children. 2021; 8(7):571. https://doi.org/10.3390/children8070571

Chicago/Turabian Style

Goldschmidt, Imeke, Rolf van Dick, Christoph Jacobi, Eva Doreen Pfister, and Ulrich Baumann. 2021. "Identification of Impaired Executive Functioning after Pediatric Liver Transplantation Using Two Short and Easily Applicable Tests: Cognitive Functioning Module PedsQL and Children’s Color Trail Test" Children 8, no. 7: 571. https://doi.org/10.3390/children8070571

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop