Simple Summary
Hepatocellular carcinoma (HCC) is the most common primary liver cancer, and despite best efforts to stratify patients recurrence remains a major issue. Our study attempted to identify what variables are involved in recurrence of HCC after resection and if they be used to stratify an individual patient’s risk of recurrence. We developed a simple-to-implement RESected Tumor Outcome and Recurrence (RESTORE) index comprising three commonly assessed variables: alpha-fetoprotein level, vascular invasion, and tumor burden. The RESTORE index was highly predictive of HCC recurrence risk after resection. The RESTORE index will help identify patients who would potentially benefit from more intensive post-resection surveillance or adjuvant therapeutics.
Abstract: Importance
Although many variables have been associated with increased risk of hepatocellular carcinoma (HCC) recurrence after resection, no simple-to-implement risk score has been developed to determine this post-resection risk. Objective: We aimed to identify risk factors for HCC recurrence and develop a risk score for predicting recurrence of HCC in patients who undergo resection with curative intent. Design: Single-center retrospective analysis Setting: Single-center tertiary care referral hospital (University of San Francisco, California). Participants: Patients who underwent resection with curative intent for HCC between January 2005 and May 2019 with complete pathologic findings and recorded follow up. Main Outcomes and Measures: Univariate and multivariate Cox regression analysis were used to identify independent risk factors for HCC recurrence. A multivariable Cox proportional-hazard regression model with listwise deletion was used to create a risk score. Results: A total of 179 patients were included in the study; 129 (72.9%) were men, and the median (IQR) age was 63 (57–67) years. Median alpha-fetoprotein (AFP) was 12.3 ng/mL at time of resection. Most patients (82%) had a single tumor nodule, and the mean aggregate nodule size was 6.75 cm; 28.4% had evidence of vascular invasion. On multivariable Cox proportional-hazards regression, AFP ≥1000 ng/mL, multinodularity, and vascular invasion were independently associated with HCC recurrence. The RESTORE index was created using stratified pre-operative AFP, vascular invasion, and the presence of a single lesion within or beyond Milan Criteria versus multiple lesions. The RESTORE index ranged from 0–9 (highest patient score was 8) and was highly predictive of HCC recurrence (C statistic 0.70). RESTORE could stratify 5-year post-resection HCC recurrence risk, ranging from less than 25% with a score of 0 to more than 80% with a score of 5–8. Conclusions and Relevance: The RESTORE index that we developed and validated is a simple-to-implement and novel risk score for patients undergoing resection for HCC and may help identify those who would benefit most from intensive surveillance strategies or adjuvant therapies.
1. Introduction
Hepatocellular carcinoma (HCC) is the most common primary liver cancer and the fourth most common cause of cancer-related death worldwide [1,2,3]. Treatment includes locoregional therapies such as trans-arterial chemoembolization and ablation, as well as curative therapies such as surgical resection and liver transplant [4]. Expanded transplantation criteria and rising HCC incidence have made it a leading indication for transplant listing, although organ availability continues to be a limiting factor [5,6].
Resection remains a cornerstone of treatment for patients with early-stage HCC who are unlikely to gain survival benefit from transplants, and for patients who are not considered for transplants for reasons related both to their tumor and to their medical comorbidities and socioeconomic circumstances. However, resection for HCC also carries a high risk of recurrence with annual rates of ≥10%, and for some patient populations, rates as high has 80% by five years [7,8,9].
The American Joint Commission on Cancer (AJCC) and the Barcelona Clinic Liver Cancer (BCLC) staging systems are the two most widely used staging systems for HCC, and both recommend resection only for early-stage (BCLC-0 and BCLC-A) tumors [10,11]. Although risk factors for recurrence have been identified, including microvascular invasion, alpha-fetoprotein (AFP) levels, and tumor grade, no simple-to-implement risk score is available that could help guide organ allocation away from those patients likely to experience HCC recurrence or to identify patients likely to benefit from intensive surveillance strategies or adjuvant therapies. To address this gap, we sought to develop an easy-to-implement recurrence risk score, the RESected Tumor Outcome and REcurrence (RESTORE) index, for patients undergoing curative resection for HCC.
2. Methods
2.1. Study Design and Patient Population
This single-center retrospective study was approved by our institutional review board. The study included adult patients (age ≥ 18 years) with pre-operatively diagnosed HCC who underwent resection with curative intent between January 2005 and May 2019. Patients undergoing re-resection for recurrent HCC were excluded.
2.2. Data Source and Variables
Data were collected from the electronic medical record and included the following variables: age, sex, race, size, and number of HCC lesions found on pre-operative radiologic examination and on pathological examination of resection specimens, preoperative locoregional therapy, and causes of liver disease.
Recurrence was defined by either radiologically identified recurrence (new LiRADS 5 lesion) or Extrahepatic/LIRAD <5 lesions that lead to the initiation of new therapy (either locoregional, re-resection, transplant, or systemic therapy). Biopsy was routinely performed for recurrence confirmation in the setting of non-LIRAD 5 liver lesions or extrahepatic disease.
Pathology reports of resected livers were reviewed to determine histologic grades based on modified Edmondson criteria, capsular involvement, the presence of vascular invasion, the size and number of viable HCC lesions, R0 vs. R1 margin status, fibrosis, steatosis, and the inflammatory grade of the non-tumor liver. Fibrosis and the inflammatory grade of the non-tumor liver were characterized per the Batts–Ludwig system [12]. Steatosis was characterized per the Brunt system [13].
Previously defined transplant criteria (Milan and UCSF) were used as they are applied to patients with HCC being evaluated for transplant candidacy. Patients were defined as within Milan criteria if they had a single tumor ≤5 cm or three or less tumors ≤3 cm, no evidence of macrovascular invasion, and no evidence of metastasis [1]. Patients were defined as being within UCSF criteria if they had a single tumor ≤6.5 cm or three or less tumors ≤4.5 cm, or a total tumor diameter ≤8 cm [5].
2.3. Statistical Analysis and Generation of the RESTORE Index
Univariate and multivariable regression hazard ratios (HRs) for predictors of post-resection HCC recurrence were determined by Cox proportional-hazards regression models and reported with 95% confidence intervals (Cis). Recurrence probabilities were estimated by the Kaplan–Meier method and compared using the log-rank test. Hypothesis tests were two-sided, and the significance threshold was set to 0.05. Predictors of 5-year recurrence, determined using a combination of literature reviews, clinical judgments, and unadjusted analyses, were included in a multivariable Cox proportional-hazards regression model. Listwise deletion was used, as all analysis variables had <5% missing data.
A regression coefficient-based approach was used to develop a points-based scoring system from the selected predictors in the model (Sullivan et al. 2004). Points associated with the presence of a given level of a risk factor were determined by scaling the regression coefficient by the AFP 21–99 category coefficient and rounding to the nearest integer. A Kaplan–Meier cumulative incidence plot stratified by quartiles of the risk score was generated, and differences in these risk strata were assessed using Cox models.
2.4. Evaluation of Risk Score Performance
Model performance was evaluated in the validation set using Uno’s c-statistic for survival data [14], along with net reclassification improvement (NRI) and integrated discrimination improvement (IDI) [15,16,17,18,19].
Having previously derived and validated a prognostic scoring system—the RETREAT score—to assess for post-transplant HCC recurrence to help guide management [20,21], we compared its performance to that of the RESTORE index. In brief, the RETREAT score is a prognostic score composed of AFP at the time of liver transplant, the presence or absence of microvascular invasion, and the largest viable tumor diameter plus the number of viable tumors. We also compared the performance of the RESTORE index to that of the Tumor Burden Score (TBS), which is a system initially established for colorectal liver metastases that has been validated in HCC [22,23]. The TBS was defined as in the initial publication, where TBS2 = (maximum tumor diameter)2 + (number of tumors)2. Performance of these scores for predicting 5-year recurrence within Milan criteria was also assessed. The mean c-statistic, NRI, and IDI from 2000 bootstrap replications were reported. A c-statistic of 1 corresponds to perfect discrimination, whereas a value of 0.5 corresponds to no discrimination ability. A c-statistic of 0.7 or higher was considered acceptable. NRI quantifies how well the new risk score reclassifies individuals in terms of estimated risk predictions, as compared to the original RETREAT score. IDI is based on integrated sensitivity and specificity and is equivalent to the difference in discrimination slopes of the two models. Pencina et al. state that the concordance index, NRI, and IDI offer complementary information and recommend reporting all three measures when characterizing the performance of the final model [17].
Statistical analyses were performed using SAS version 9.4 and R version 4.0.2. The “survIDINRI” package in R was used to perform model validation.
3. Results
3.1. Baseline Characteristics of Study Cohort
A total of 179 patients who underwent HCC resection with curative intent and met inclusion/exclusion criteria were included in the final analytic cohort. Baseline characteristics of the cohort are summarized in Table 1. Median age was 63 (IQR 57–67), most patients were male (72.9%), 41.8% were reported as White, 37.9% Asian, 12.4% Black/African-American, and 7.9% as Other. At the time of resection, 33.5% of patients had HBV, 34.1% had HCV, and 36.3% had cirrhosis. Preoperative locoregional therapy (LRT) had been given in 19.6% of patients. Median pre-operative AFP was 12.3 ng/mL (IQR 3.7, 183.7).
Table 1.
Demographic and Clinical Characteristics of Patients with HCC.
Pre-operative radiological evaluation indicated that 82.1% of patients had a single nodule. The mean aggregate nodule size was 6.47 (95% CI 5.76, 7.17). The mean composite score of the largest viable tumor size and number of viable nodules was 7.8 (95% CI 6.82, 8.77).
When evaluating patients against previously validated transplant criteria (Milan and UCSF) (Table 2), just over half (n = 92, 51.4%) of patients were within Milan criteria based on pre-operative imaging, with 14.5% (n = 26) of patients falling outside of Milan criteria but within UCSF criteria [5]. These closely paralleled the final pathological assessment, with 48.6% (n = 87) of patients within Milan criteria and 12.8% (n = 23) of patients outside Milan criteria but within UCSF criteria. Some patients were upstaged on final pathological evaluation, with 34.1% (n = 61) of patients outside of UCSF criteria on pre-operative imaging and 38.5% (n = 69) on pathology.
Table 2.
Transplant Criteria of Patients with HCC.
Pathological examination showed that 36.3% of the cohort had a Batts–Ludwig fibrosis score of 4, followed by 26.3% with a fibrosis score of 0. Over half (58.1%) of patients had Brunt steatosis scores of 0, followed by 27.4% with a score of 1. Almost a third (30.2%) of patients had a necroinflammation score of 0, with 33.5% and 29.6% having scores of 1 and 2/3 respectively. According to the final pathologic analysis, evidence of vascular invasion was present in 28.1% of patients and evidence of capsular involvement was present 38.5%, but 91% had an R0 resection.
3.2. Post-Resection Outcomes
Median post-resection follow-up time was 1312 days (95% CI 1028, 1511). Overall proportion of recurrence was 52%, and median time to recurrence was 615 days (IQR 211-1301). Overall, 63.4% (n = 59) of patients who experienced recurrence recurred within 1 year, while, cumulatively, 81.7% (n = 76) recurred within 2 years of resection. Most recurrences were intrahepatic (77.4%), whereas the proportion of recurrences within Milan criteria vs. outside Milan criteria were similar (49.5% vs. 50.5% respectively).
3.3. Recurrence Prediction
According to Cox proportional-hazard regression, univariate predictors of post-resection recurrence were AFP, number of tumor nodules, largest nodule size, vascular invasion, and capsular involvement (Table 3). There was a significantly increased risk of recurrence with an increasing nodule number, with all patients with three or more nodules experiencing recurrence. For each cm increase in the size of the largest tumor nodule, there was a 3.9% increased risk of recurrence, and for each cm increase in the aggregate nodule size, there was a 5.6% increased risk of recurrence.
Table 3.
Univariate and Multivariate Predictors of Recurrence.
In our univariate Cox proportional-hazard model, Asian ethnicity and Batts–Ludwig fibrosis stage 1 (versus fibrosis stage 0) were associated with a lower risk of recurrence. When evaluated with Milan and UCSF criteria [1,5], pre-operative radiologic findings of patients being beyond Milan but within UCSF criteria had an increased risk of recurrence, but those being beyond UCSF criteria did not. On pathological examination, however, being outside Milan criteria and within UCSF, and being beyond UCSF criteria, were significantly associated with increased recurrence risk. Age, gender, etiology of liver disease, pre-operative albumin, pre-operative bilirubin, pre-operative ALBI grade [24], pathological diagnosis of cirrhosis, steatosis, inflammation, tumor grade, and pre-operative (LRT) were not significantly associated with recurrence.
3.4. Construction of RESTORE Index and Recurrence Estimation
A multivariable Cox proportional-hazard regression model using listwise deletion was used to create a simplified RESTORE index (Table 4). Compared to patients with pre-operative AFP ≤20, those with AFP ≥100 had nearly twice the risk of 5-year recurrence. Compared to patients without vascular invasion, those with micro/macro-vascular invasion had nearly three times the risk, and compared to those with a single lesion within the Milan criteria, patients with multiple lesions had about 3.4 times the risk.
Table 4.
Multivariate predictors of recurrence used in RESTORE index.
A Kaplan–Meier cumulative incidence plot stratified by low, medium, and high risk and their associated point values of the risk score (Figure 1) shows that the cumulative incidence of 5-year recurrence had a clearly defined difference in incidence between strata (Stratum 2 vs. 1: HR 2.66, 95% CI 1.25–5.67, p = 0.01; Stratum 3 vs. 1: HR 10.42, 95% CI 4.8–22.6, p < 0.001).
Figure 1.
Recurrence by RESTORE index strata (low risk: 0; moderate risk: 1–4, high risk: 5–8).
The classification of pre-operative tumor burdens as within or outside of Milan criteria is an important decision point for directing patients with HCC to resection or transplantation. Patients who were within Milan criteria before resection (as seen on pre-operative radiologic examination) were roughly half as likely to experience recurrence as patients whose resection was beyond Milan criteria (HR 0.52, 95% CI 0.34–0.81, p = 0.003).
As shown in Figure 2, patients with the highest RESTORE index (≥5) were more likely to experience HCC recurrence than all others (p < 0.001). In terms of pre-operative characteristics, only pre-operative transplant criteria (within Milan criteria vs. beyond Milan and within UCSF criteria vs. beyond UCSF) were associated with a high RESTORE index. The radiological variables—number of nodules, largest nodule, aggregate nodule size, number of nodules + largest nodule, and pre-operative AFP—were not significantly associated with a high RESTORE index.
Figure 2.
Recurrence by RESTORE index (high risk: 5–8 vs. low/moderate risk: 0–4).
The RESTORE risk score demonstrated discrimination ability comparable to that of the RETREAT score for overall 5-year recurrence (c = 0.70 vs. 0.69) and for 5-year recurrence within Milan (c = 0.65 vs. 0.64). Neither the RESTORE score nor the RETREAT score had adequate discrimination performance for 5-year Milan recurrence, but RESTORE had acceptable discrimination performance for overall 5-year recurrence. RESTORE produced risk estimates that were at least as accurate as the RETREAT score, but the differences were not significant (NRI 0.11, 95% CI −0.12 to 0.31, p = 0.30; IDI 0.00, 95% CI −0.08 to 0.07, p = 0.98). However, the RESTORE risk score had better discriminatory ability than the Tumor Burden Score for overall 5-year recurrence (c = 0.70 vs. 0.63).
4. Discussion
As the incidence and mortality of HCC has risen in the US and worldwide, the importance of identifying optimal treatment algorithms has greater relevance than ever. Although cancer staging guidelines such as the AJCC and BCLC are key in determining patient prognosis, they may not accurately capture the heterogenous outcomes after HCC resection for patients within the same technical stage [25,26,27]. Ongoing debate surrounds the allocation of livers for transplantation and the extent and efficacy of curative resection [28]. To address the need for better prediction of HCC outcomes, we derived the RESTORE index using three variables highly predictive of HCC recurrence: AFP, microvascular invasion, and the number of tumors (versus single lesions within the Milan criteria) (C statistic 0.70). The RESTORE index was able to clearly stratify 5-year HCC recurrence risk for patients with the lowest score, median score, and highest score. The RESTORE index also had slightly higher discriminatory ability than the RETREAT index in predicting 5-year HCC recurrence. The concordance index of RESTORE was similar to or better than others published on internal validation data [24,29,30]. Additionally, the RESTORE index covers both early and late recurrence periods.
Importantly, the RESTORE index, with its three variables, requires no advanced algorithms to calculate in the clinical setting and can therefore be used by clinicians to help stratify and optimize post-resection surveillance because the patterns of HCC recurrence differ by RESTORE strata with respect to both risk and timing. Most patients in the highest risk strata (score ≥5) who experienced recurrence had that recurrence within 2 years, whereas for patients in the medium risk strata (score 1–4), the predominant period of increased risk was within 3 years (Figure 1). There is some evidence that increased surveillance is associated with increased survival for those patients who experience HCC recurrence [31]. Therefore, one possible surveillance strategy for patients with a high RESTORE risk score (≥5) would be to perform surveillance imaging with the standard modalities (e.g., contrast-enhanced CT or MRI of the abdomen plus AFP) every three months for two years, followed by every six months thereafter. Patients with a moderate RESTORE risk score (1–4) could undergo surveillance every three months for one year, followed by every six months. Finally, patients with the lowest RESTORE score (0) could undergo HCC surveillance every six months. Further studies should address the cost-effectiveness and survival benefit of surveillance for HCC recurrence, specifically within the context of the RESTORE index.
Adjuvant therapy has not been adopted as the standard of care for patients with HCC who undergo resection with curative intent. Some therapies used in the advanced HCC setting, such as sorafenib [32], showed no benefit in the adjuvant setting, but others, such as immunotherapy [33] and radio-immunotherapy [34], are still being evaluated. As additional therapeutics are developed for HCC, the RESTORE index would be a good metric to identify patients who might derive the most benefit from aggressive adjuvant therapy.
Multifocal tumors are a strong predictor of recurrence but are difficult to assess on pre-operative evaluation. In our study, of 32 patients found to have multifocal tumors based on pathologic examination, 14 (43.75%) were initially thought to have unifocal tumors based on pre-operative imaging. Furthermore, given the advances in radiological predictors of microvascular invasion (a key predictor of recurrence), imaging can be used to stratify which patients are candidates for surgery as opposed to other interventions [35]. The early detection of recurrence is important for management of these patients, as some may benefit from potential salvage liver transplants in the setting of recurrence. UNOS allows for biopsy-proven T1 recurrences to be listed without a 6-month delay in many circumstances. At some centers, patients thought to be at extremely high risk of recurrence are evaluated as potential recipients for living donor livers post-operatively, before any chance of recurrence.
Tumor grade has not proven a reliable predictor of recurrence. Other histologic features have been reported, as part of the Recurrence Risk Assessment Score (RRAS), to be more reliable predictors of recurrence [36]. This might serve as a surrogate for vascular invasion on pre-resection biopsy within this proposed scoring system, though additional research is needed. Novel biomarkers such as DCP and AFP-L3% have been shown to correlate with micro-vascular invasion and post-surgical outcomes [37,38,39]. Elevated DCP and AFP-L3% have been associated with high-risk explant pathology and worse survival after liver transplantation [39,40,41,42]. These could be used to further refine the scoring model, especially in the pre-operative setting. Their inclusion in the current study is limited by the lack of uniform availability in our patient population.
There are several limitations to our study. One weakness is that pathological examination of a resection specimen is necessary to exclude (and in most cases to identify) microvascular invasion, precluding its use in the pre-operative setting. Furthermore, as a retrospective cohort study there is uncaptured selection bias from having excluded patients who were deferred from operative intervention at all, or those who underwent liver transplantation. However, important strengths of our study include its ease of implementation and its ability to clearly differentiate patients with high and low risk of recurrence.
5. Conclusions
In conclusion, we have developed a novel risk index (RESTORE) that is simple to implement in order to predict a patient’s risk of post-resection HCC recurrence. This index may help improve post-resection surveillance strategies and optimize selection of patients for adjuvant therapies and future trials.
Further work is needed to confirm our study findings, preferably in a multi-center manner. With the advancement of imaging modalities and our ability to assess for microvascular invasion pre-operatively, this index could also be applied and validated in a pre-operative manner.
Author Contributions
Conceptualization, D.H., R.G., N.M. and S.S.; methodology, D.H., R.G., N.M., A.S. and S.S.; validation, D.H. and A.S.; formal Analysis, D.H. and A.S.; data curation, D.H., N.M., R.G. and S.S.; writing—original draft preparation, D.H.; writing—review and editing, D.H., A.S., R.G., N.M. and S.S.; project Administration, D.H. All authors have read and agreed to the published version of the manuscript.
Funding
Daniel Hoffman received funding from National Institutes of Health (NIH) FAVOR T32 Training Grant, grant number 2T32AI125222-06A1. AS is part of the Biostatistics Core that is supported by the UCSF Department of Surgery and Liver Center P30 DK026743.
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of UCSF (IRB 12-09018).
Informed Consent Statement
Patient consent was waived because the research was deemed to pose no more than minimal risk to study subjects.
Data Availability Statement
The data presented in the study are available on reasonable request from corresponding author.
Acknowledgments
The authors would like to thank P.D. for assistance in manuscript review and editing. We would like to thank S.C. for additional statistical support.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Mazzaferro, V.; Rondinara, G.F.; Rossi, G.; Regalia, E.; De Carlis, L.; Caccamo, L.; Doci, R.; Sansalone, C.V.; Belli, L.S.; Armiraglio, E. Milan multicenter experience in liver transplantation for hepatocellular carcinoma. Transplant. Proc. 1994, 26, 3557–3560. [Google Scholar] [PubMed]
- Altekruse, S.F.; McGlynn, K.A.; Reichman, M.E. Hepatocellular carcinoma incidence, mortality, and survival trends in the United States from 1975 to 2005. J. Clin. Oncol. 2009, 27, 1485–1491. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Fitzmaurice, C.; Allen, C.; Barber, R.M.; Barregard, L.; Bhutta, Z.A.; Brenner, H.; Dicker, D.J.; Chimed-Orchir, O.; Dandona, R.; Dandona, L.; et al. Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life-years for 32 cancer groups, 1990 to 2015: A systematic analysis for the global burden of disease study. JAMA Oncol. 2017, 3, 524–548. [Google Scholar] [PubMed]
- Villanueva, A. Hepatocellular Carcinoma. N. Engl. J. Med. 2019, 380, 1450–1462. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yao, F.Y.; Ferrell, L.; Bass, N.M.; Watson, J.J.; Bacchetti, P.; Venook, A.; Ascher, N.L.; Roberts, J.P. Liver transplantation for hepatocellular carcinoma: Expansion of the tumor size limits does not adversely impact survival. Hepatology 2001, 33, 1394–1403. [Google Scholar] [CrossRef] [Scilit]
- Mazzaferro, V.; Sposito, C.; Zhou, J.; Pinna, A.D.; De Carlis, L.; Fan, J.; Cescon, M.; Di Sandro, S.; Yi-Feng, H.; Lauterio, A.; et al. Metroticket 2.0 model for analysis of competing risks of death after liver transplantation for hepatocellular carcinoma. Gastroenterology 2018, 154, 128–139. [Google Scholar] [CrossRef] [Scilit]
- Shah, S.A.; Cleary, S.P.; Wei, A.C.; Yang, I.; Taylor, B.R.; Hemming, A.W.; Langer, B.; Grant, D.R.; Greig, P.D.; Gallinger, S. Recurrence after liver resection for hepatocellular carcinoma: Risk factors, treatment, and outcomes. Surgery 2007, 141, 330–339. [Google Scholar] [CrossRef] [Scilit]
- Sherman, M. Recurrence of hepatocellular carcinoma. N. Engl. J. Med. 2008, 359, 2045–2047. [Google Scholar] [CrossRef] [Scilit]
- Portolani, N.; Coniglio, A.; Ghidoni, S.; Giovanelli, M.; Benetti, A.; Tiberio, G.A.; Giulini, S.M. Early and late recurrence after liver resection for hepatocellular carcinoma: Prognostic and therapeutic implications. Ann. Surg. 2006, 2006, 229–235. [Google Scholar] [CrossRef] [Scilit]
- European Association for the Study of the Liver. Clinical practice guidelines: Management of hepatocellular carcinoma. J. Hepatol. 2018, 69, 182–236. [Google Scholar] [CrossRef] [Scilit]
- Amin, M.B.; Greene, F.L.; Edge, S.B.; Compton, C.C.; Gershenwald, J.E.; Brookland, R.K.; Meyer, L.; Gress, D.M.; Byrd, D.R.; Winchester, D.P. The eighth edition AJCC cancer staging manual: Continuing to buld a bridge from a population-based to a more “personalized” approach to cancer staging. CA Cancer J. Clin. 2017, 67, 93–99. [Google Scholar] [CrossRef] [Scilit]
- Batts, K.P.; Ludwig, J. Chronic hepatitis. An update on terminology and reporting. Am. J. Surg. Pathol. 1995, 19, 1409–1417. [Google Scholar] [CrossRef] [Scilit]
- Brunt, E.M.; Janney, C.G.; Di Bisceglie, A.M.; Neuschwander-Tetri, B.A.; Bacon, B.R. Nonalcoholic steatohepatitis: A proposal for grading and staging the histological lesions. Am. J. Gastroenterol. 1999, 94, 2467. [Google Scholar] [CrossRef]
- Uno, H.; Cai, T.; Pencina, M.; D’Agostino, R.; Wei, L. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat. Med. 2011, 30, 1105–1117. [Google Scholar] [CrossRef] [Scilit]
- Pencina, M.; D’Agostino, R., Sr.; D’Agostino, R., Jr.; Vasan, R. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat. Med. 2008, 27, 157–172. [Google Scholar] [CrossRef] [Scilit]
- Pencina, M.; D’Agostino, R.; Pencina, K.; Janssens, A.C.; Greenland, P. Interpreting incremental value of markers added to risk prediction models. Am. J. Epidemiol. 2012, 176, 473–481. [Google Scholar] [CrossRef] [Scilit]
- Pencina, M.; D’Agostino, R., Sr.; Demler, O.V. Novel metrics for evaluating improvement in discrimination: Net reclassification and integrated discrimination improvement for normal variables and nested models. Stat. Med. 2012, 31, 101–113. [Google Scholar] [CrossRef] [Scilit]
- Steyerberg, E.; Vickers, A.; Cook, N.; Gerds, T.; Gonen, M.; Obuchowski, N.; Pencina, M.; Kattan, M. Assessing the performance of prediction models: A framework for traditional and novel measures. Epidemiology 2010, 21, 128–138. [Google Scholar] [CrossRef] [Scilit]
- Uno, H.; Tian, L.; Cai, T.; Kohane, I.; Wei, L. A unified inference procedure for a class of measures to assess improvement in risk prediction systems with survival data. Stat. Med. 2013, 32, 2430–2442. [Google Scholar] [CrossRef] [Scilit]
- Mehta, N.; Heimbach, J.; Harnois, D.M.; Sapisochin, G.; Dodge, J.L.; Lee, D.; Burns, J.M.; Sanchez, W.; Greig, P.D.; Grant, D.R.; et al. Validation of a risk estimation of tumor recurrence after transplant (RETREAT) score for hepatocellular carcinoma recurrence after liver transplant. JAMA Oncol. 2017, 3, 493–500. [Google Scholar] [CrossRef] [Scilit]
- Mehta, N.; Dodge, J.L.; Roberts, J.P.; Yao, F.Y. Validation of the prognostic power of the RETREAT score for hepatocellular carcinoma recurrence using the UNOS database. Am. J. Transplant. 2018, 18, 1206–1213. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sasaki, K.; Morioka, D.; Conci, S.; Margonis, G.A.; Sawada, Y.; Ruzzenente, A.; Kumamoto, T.; Iacono, C.; Andreatos, N.; Guglielmi, A.; et al. The tumor burden score: A new ‘metro-ticket’ prognostic tool for colorectal liver metastases based on tumor size and number of tumors. Ann. Surg. 2018, 267, 132–141. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tsilimigras, D.I.; Moris, D.; Hyer, J.M.; Bagante, F.; Sahara, K.; Moro, A.; Paredes, A.Z.; Mehta, R.; Ratti, F.; Marques, H.P.; et al. Hepatocellular carcinoma tumour burden score to stratify prognosis after resection. Br. J. Surg. 2020, 7, 854–864. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chan, A.W.H.; Zhong, J.; Berhane, S.; Toyoda, H.; Cucchetti, A.; Shi, K.; Tada, T.; Chong, C.C.; Xiang, B.-D.; Li, L.-Q.; et al. Development of pre and post-operative models to predict early recurrence of hepatocellular carcinoma after surgical resection. J. Hepatol. 2018, 69, 1284–1293. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Guo, H.; Wu, T.; Lu, Q.; Li, M.; Guo, J.Y.; Shen, Y.; Wu, Z.; Nan, K.-J.; Lv, Y.; Zhang, X.-F. Surgical resection improves long-term survival of patients with hepatocellular carcinoma across different Barcelona Clinic Liver Cancer stages. Cancer Manag. Res. 2018, 10, 361–369. [Google Scholar] [CrossRef] [Scilit]
- Cho, Y.; Sinn, D.H.; Yu, S.J.; Gwak, G.Y.; Kim, J.H.; Yoo, Y.J.; Jun, D.W.; Kim, T.Y.; Lee, H.Y.; Cho, E.J.; et al. Survival analysis of single large (>5 cm) hepatocellular carcinoma patients: BCLC A versus, B. PLoS ONE 2016, 11, e0165722. [Google Scholar] [CrossRef] [Scilit]
- Pawlik, T.M.; Delman, K.A.; Vauthey, J.N.; Nagorney, D.M.; Ng, I.O.L.; Ikai, I.; Yamaoka, Y.; Belghiti, J.; Lauwers, G.Y.; Poon, R.T.; et al. Tumor size predicts vascular invasion and histologic grade: Implciations for selection of surgical treatment fo hepatocellular carcinoma. Liver Transplant. 2005, 11, 1086–1092. [Google Scholar] [CrossRef] [Scilit]
- Hoffman, D.; Mehta, N. Recurrence of hepatocellular carcinoma following liver transplantation. Expert Rev. Gastroenterol. Hepatol. 2021, 15, 91–102. [Google Scholar] [CrossRef] [Scilit]
- Ang, S.F.; Ng, E.S.; Li, H.; Ong, Y.H.; Choo, S.P.; Ngeow, J.; Toh, H.C.; Lim, K.H.; Yap, H.Y.; Tan, C.K.; et al. The Singapore Liver Cancer Recurrence (SLICER) Score for relapse prediction in patients with surgically resected hepatocellular carcinoma. PLoS ONE 2015, 10, e0118658. [Google Scholar]
- Xu, X.F.; Xing, H.; Han, J.; Li, Z.L.; Lau, W.Y.; Zhou, Y.H.; Gu, W.M.; Wang, H.; Chen, T.H.; Zeng, Y.Y.; et al. Risk Factors, Patterns, and Outcomes of Late Recurrence After Liver Resection for Hepatocellular Carcinoma: A Multicenter Study From China. JAMA Surg. 2019, 154, 209–217. [Google Scholar] [CrossRef] [Scilit]
- Lee, D.; Sapisochin, G.; Mehta, N.; Gorgen, A.; Musto, K.R.; Hajda, H.; Yao, F.Y.; Hodge, D.O.; Carter, R.E.; Harnois, D.M. Surveillance for HCC After Liver Transplantation: Increased Monitoring May Yield Aggressive Treatment Options and Improved Postrecurrence Survival. Transplantation 2020, 104, 2105–2112. [Google Scholar] [CrossRef] [Scilit]
- Bruix, J.; Takayama, T.; Mazzaferro, V.; Chau, G.-Y.; Yang, J.; Kudo, M.; Cai, J.; Poon, R.T.; Han, K.-H.; Tak, W.Y.; et al. Adjuvant Sorafenib for Hepatocellular Carcinoma After Resection or Ablation (STORM): A Phase 3, Randomised, Double-Blind, Placebo-Controlled Trial. Lancet Oncol. 2015, 16, 1344–1354. [Google Scholar] [CrossRef] [Scilit]
- Hack, S.P.; Spahn, J.; Chen, M.; Cheng, A.L.; Kaseb, A.; Kudo, M.; Lee, H.C.; Yopp, A.; Chow, P.; Qin, S. IMbrave 050: A Phase III trial of atezolizumab plus bevacizumab in high-risk hepatocellular carcinoma after curative resection or ablation. Future Oncol. 2020, 16, 975–989. [Google Scholar] [CrossRef] [Scilit]
- Chung, A.Y.; Ooi, L.L.; Machin, D.; Tan, S.B.; Goh, B.K.P.; Wong, J.S.; Chen, Y.M.; Li, P.C.N.; Gandhi, M.; Thng, C.H.; et al. Adjuvant hepatic intra-arterial iodine-131-lipiodol following curative resection of hepatocellular carcinoma: A prospective randomized trial. World J. Surg. 2013, 37, 1356–1361. [Google Scholar] [CrossRef] [Scilit]
- Renzulli, M.; Brocchi, S.; Cucchetti, A.; Mazzotti, F.; Mosconi, C.; Sportoetti, C.; Brandi, G.; Pinna, A.D.; Golfieri, R. Can Current Preoperative Imaging Be Used to Detect Microvascular Invasion of Hepatocellular Carcinoma. Radiology 2016, 279, 432–442. [Google Scholar] [CrossRef] [Scilit]
- Roberts, D.E.; Kakar, S.; Mehta, N.; Gill, R.M. A Point-based Histologic Scoring System for Hepatocellular Carcinoma Can Stratify Risk of Posttransplant Tumor Recurrence. Am. J. Surg. Pathol. 2018, 42, 855–865. [Google Scholar] [CrossRef] [Scilit]
- Suh, S.W.; Lee, K.W.; Lee, J.M.; You, T.; Choi, Y.; Kim, H.; Lee, H.W.; Yi, N.-J.; Suh, K.-S. Prediction of aggressiveness in early-stage hepatocellular carcinoma for selection of surgical resection. J. Hepatol. 2014, 60, 1219–1224. [Google Scholar] [CrossRef] [Scilit]
- Poté, N.; Cauchy, F.; Albuquerque, M.; Voitot, H.; Belghiti, J.; Castera, L.; Puy, H.; Bedossa, P.; Paradis, V. Performance of PIVKA-II for early hepatocellular carcinoma diagnosis and prediction of microvascular invasion. J. Hepatol. 2015, 62, 948–954. [Google Scholar] [CrossRef] [Scilit]
- Cheng, J.; Wang, W.; Zhang, Y.; Liu, X.; Li, M.; Wu, Z.; Liu, Z.; Lv, Y.; Wang, B. Prognostic role of pre-treatment serum AFP-L3% in hepatocellular carcinoma: Systematic review and meta-analysis. PLoS ONE 2014, 9, e87011. [Google Scholar] [CrossRef] [Scilit]
- Lee, J.H.; Cho, Y.; Kim, H.Y.; Cho, E.J.; Lee, D.H.; Yu, S.J.; Lee, J.W.; Yi, N.-J.; Lee, K.-W.; Kim, S.H.; et al. Serum Tumor Markers Provide Refined Prognostication in Selecting Liver Transplantation Candidate for Hepatocellular Carcinoma Patients Beyond the Milan Criteria. Annals of Surgery. Ann. Surg. 2016, 263, 842–850. [Google Scholar] [CrossRef] [Scilit]
- Chaiteerakij, R.; Zhang, X.; Addissie, B.D.; Mohamed, E.A.; Harmsen, W.S.; Theobald, P.J.; Peters, B.E.; Balsanek, J.G.; Ward, M.M.; Giama, N.H.; et al. Combinations of biomarkers and Milan criteria for predicting hepatocellular carcinoma recurrence after liver transplantation. Liver Transplant. 2015, 21, 599–606. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kotwani, P.; Chan, W.; Yao, F.; Mehta, N. DCP and AFP-L3 Are Complementary to AFP in Predicting High-Risk Explant Features: Results of a Prospective Study. Clin. Gastroenterol. Hepatol. 2021, 20, 701–703.e2. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).

