Next Article in Journal
Reproducibility of 2D and 3D Ramus Height Measurements in Facial Asymmetry
Previous Article in Journal
Mometasone Furoate in Non-Allergic Rhinitis: A Real-Life Italian Study
Previous Article in Special Issue
Evaluation of Subclinical Vascular Disease in Diabetic Kidney Disease: A Tool for Personalization of Management of a High-Risk Population
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Cardiovascular Risk Prediction Models and Scores in the Era of Personalized Medicine

by
Areti Sofogianni
1,
Nikolaos Stalikas
2,
Christina Antza
3 and
Konstantinos Tziomalos
1,*
1
First Propedeutic Department of Internal Medicine, Medical School, Aristotle University of Thessaloniki, AHEPA Hospital, 54636 Thessaloniki, Greece
2
Department of Cardiology, Medical School, Aristotle University of Thessaloniki, AHEPA Hospital, 54636 Thessaloniki, Greece
3
Third Department of Internal Medicine, Medical School, Aristotle University of Thessaloniki, Papageorgiou Hospital, 54636 Thessaloniki, Greece
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2022, 12(7), 1180; https://doi.org/10.3390/jpm12071180
Submission received: 14 June 2022 / Revised: 29 June 2022 / Accepted: 7 July 2022 / Published: 20 July 2022
(This article belongs to the Special Issue Cardiovascular Disease Prevention in the Era of Personalized Medicine)

Abstract

:
Cardiovascular disease (CVD) is the leading cause of death worldwide. Management of cardiovascular risk factors, particularly hypertension and dyslipidemia, has been shown to reduce cardiovascular morbidity and mortality. However, current guidelines recommend adjusting the intensity of blood pressure- and lipid-lowering treatment according to the cardiovascular risk of the patient. Therefore, cardiovascular risk prediction is a sine qua non for optimizing cardiovascular prevention strategies, particularly in patients without established CVD or type 2 diabetes mellitus (T2DM). As a result, several cardiovascular risk prediction equations have been developed. Nevertheless, it is still unclear which is the optimal prediction risk equation. In the present review, we summarize the current knowledge regarding the accuracy of the most widely used cardiovascular risk prediction equations. Notably, most of these risk scores have not been validated in external cohorts or were shown to over- or underestimate risk in populations other than those in which they derive. Accordingly, country-specific risk scores, where available, should be preferred for cardiovascular risk stratification.

1. Introduction

Cardiovascular disease (CVD) is the leading cause of death worldwide [1]. Management of cardiovascular risk factors, particularly hypertension and dyslipidemia has been shown to reduce cardiovascular morbidity and mortality [2,3]. However, current guidelines recommend adjusting the intensity of blood pressure- and lipid-lowering treatment according to the cardiovascular risk of the patient [4,5]. Therefore, cardiovascular risk prediction is a sine qua non for optimizing cardiovascular prevention strategies, particularly in patients without established CVD or type 2 diabetes mellitus (T2DM) [4,5]. As a result, several cardiovascular risk prediction equations have been developed. Nevertheless, it is still unclear which is the optimal prediction risk equation.
In the present review, we summarize the current knowledge regarding the accuracy of the most widely used cardiovascular risk prediction equations (Table 1).

2. Systematic Coronary Risk Evaluation (SCORE)

SCORE (Systematic Coronary Risk Evaluation) (Figure 1) predicts the 10-year risk of cardiovascular mortality and was developed from 12 European cohort studies (n = 205,178) with 7934 cardiovascular deaths [6,7]. SCORE takes into account the following parameters: age, sex, systolic blood pressure (SBP), total cholesterol (TC) and smoking [6,7]. The age range is 40 to 65 years old, and patients with established CVD or T2DM are excluded [6,7]. There are three versions of SCORE for low-, high- and very-high-risk countries, respectively, as well as country-specific versions [6,7].
A number of studies compared the predictive ability of SCORE with other risk equations. In the Hoorn Study (n = 1482), SCORE was more accurate than the Framingham and UK Prospective Diabetes Study risk equations in patients with normal glucose tolerance [8]. Notably, SCORE was equally precise for estimating risk in patients with normal glucose tolerance and impaired glucose tolerance, but less accurate in patients with T2DM [8]. In a smaller study from Spain (n = 608), both SCORE and Framingham overestimated cardiovascular risk, but the former was more accurate [9]. In another study (n = 1344), SCORE had better specificity than the risk chart developed by the European Society of Hypertension, but the latter was more sensitive [10]. In the Third National Health and Nutrition Examination Survey (n = 5999), the SCORE and the Framingham risk prediction equation discriminated cardiovascular mortality risk equally well [11]. In a large Dutch cohort study (n = 39,719), the SCORE and the Framingham risk prediction equation had similarly good discrimination, but were both inadequately calibrated [12]. In contrast, in the Atherosclerosis Risk In Communities (ARIC) Study (n = 14,343), the SCORE showed worse discrimination than the Framingham equation, possibly because this study was performed in the US [13].
A limited number of studies evaluated the concordance between the SCORE and markers of subclinical atherosclerosis or target-organ damage. In a cohort of 190 patients without symptoms of coronary heart disease (CHD), there was a strong correlation between SCORE and the results of coronary computed tomographic angiography [14]. In another study, the presence of carotid atherosclerotic plaques, urine albumin/creatinine ratio, left ventricular mass and pulse wave velocity predicted cardiovascular risk independently from SCORE and combining the two methods improved the accuracy of SCORE [15].
An important limitation of the SCORE is that it is not applicable in patients older than 65 years. Accordingly, a version of SCORE for older patients has been developed and was evaluated in the European Prospective Investigation of Cancer Norfolk study (n = 6590) [16]. Although this version of SCORE was accurate in predicting cardiovascular mortality, its discriminative action was inadequate [16]. More specifically, it overestimated cardiovascular mortality risk in subjects aged 65–69 years and in normotensive subjects, whereas it underestimated cardiovascular mortality risk in hypertensive patients and in subjects 70–79 years-old [16].
The major advantages of SCORE are that it is derived from large cohort studies conducted in several European countries and that there are many country-specific versions derived from local data, which are expected to be more accurate. The major disadvantages is that it includes only fatal cardiovascular events and might therefore underestimate the total cardiovascular risk.

3. Pooled Cohort Equations Calculator

The Pooled Cohort Equations Calculator, first published in the 2013 American College of Cardiology and American Heart Association guidelines, uses simple parameters such as sex, age, TC, high-density lipoprotein cholesterol (HDL-C), SBP, treatment for hypertension, history of T2DM and smoking status to predict the 10-year risk of a first hard cardiovascular event, defined as nonfatal myocardial infarction (MI), CHD death and fatal or nonfatal stroke [17]. The rationale for the development of this equation was to replace the widely used Framingham risk score because the latter was derived from only White populations and only evaluated the risk of CHD [17]. In contrast, the Pooled Cohort Equations Calculator was created using data from a wider range of studies in both White and African American populations [18,19,20,21,22].
The first validation of the Pooled Cohort Equations score was performed in 2014 from a cohort study, using data from a population similar with the one from which the score was derived [23]. The results showed that the observed and predicted 5-year cardiovascular risk for participants with 10-year predicted risk < 7.5% was similar, while for those at risk ≥ 7.5%, the Pooled Cohort Equations overestimated risk [23]. Ensuing studies including analyses from the Women’s Health Study, the Physicians’ Health Study, the Women’s Health Initiative Observational Study and the National Cardiovascular Data Registry Practice Innovation and Clinical Excellence registry were generally in accordance with this first publication, confirming that the Pooled Cohort Equations score overestimates cardiovascular risk, particularly in elderly subjects [24,25,26,27,28,29,30]. Results from a multi-ethnic cohort show that the observed overestimation is also highest among Chinese (especially for men) and lowest in White women and Hispanic men [31]. When the Pooled Cohort Equations score was evaluated in non-Hispanic White and Black people as well as in Mexican Americans, the prediction of 10-year atherosclerotic CVD mortality was accurate in non-Hispanic White and Black men, but not in women [32].
The Pooled Cohort Equations score was also evaluated for other outcomes, except cardiovascular mortality. It has been reported that this score could be a useful tool to predict and stratify 1-year risk of recurrent stroke and total cardiovascular events in patients with acute ischemic stroke or transient ischemic attack [33]. Compared with the Framingham risk score, the Pooled Cohort Equations score provided a better estimate of racial differences in vascular function and structure [34]. Moreover, a higher score using this equation was found to be associated with increased 24h variability of blood pressure [35] and also with worse health-related quality of life [36].
The major advantages of the Pooled Cohort Equations score is that it is based on more contemporary cohorts than other risk prediction equations and that it also allows risk prediction in non-White individuals. However, the major disadvantage is that it overestimates cardiovascular risk and might result in overtreatment of low-risk subjects.

4. Framingham Risk Score

The Framingham Risk score is one of the first predictive scores for CHD. It is based on the Framingham Heart study examinations of 1971 to 1974, which included participants from either the original Framingham study or from the initial investigation of the Framingham Offspring study [37,38]. Included subjects (n = 5345) were between 30 to 74 years old and free of CVD. All participants were followed-up for 12 years to ascertain the occurrence of CHD (angina pectoris, recognized and unrecognized MI, coronary insufficiency and CHD death). Hard CHD events included CHD death and MI. In 1998, Wilson et al. developed a sex-specific prediction algorithm to estimate 10-year CHD risk by relating the Fifth Report of the Joint National Committee on Detection, Evaluation and Treatment of High Blood Pressure blood pressure and National Cholesterol Education Program cholesterol categories with age, the presence of T2DM and smoking [39]. In 2008, D’ Agostino et al., based on a larger cohort of Framingham study, formulated a new sex-specific risk function tool that assessed not only the 10-year probability of CHD events, but also the risk for a first cardiovascular event (CHD, stroke, intermittent claudication and congestive heart failure) [40]. Although many concerns have been raised regarding the applicability and validity of this risk tool in different and diverse populations [41,42], many studies have validated it in other populations [43,44,45]. Other versions of Framingham risk score have also been developed, including the Lifetime Framingham CVD Risk Score at 50 years of age and the 30-year Framingham cardiovascular risk score [46,47].
Even though the Framingham risk score is of the first predictive scores for CHD, it has been outdated by the introduction of the Pooled Cohort Equations, which incorporates the Framingham study cohort. Therefore, the use of the Framingham risk score is not currently recommended.

5. Assign Risk Score

Assign risk score was formulated to estimate the 10-year risk of cardiovascular events in subjects without established CVD by adding social deprivation and family history to the risk factors including in the Framingham score (sex, age, T2DM, smoking, TC and SBP) [48,49,50]. It is based on the Scottish Heart Health Extended Cohort and is easily accessible online [48,49,50]. According to this score, patients with a score higher than 20% are considered to be at high risk [48,49,50]. The Assign score has been validated in comparison to Framingham and QRISK, and slightly outperformed the former [51,52]. Even though the Assign risk score might be useful in subjects living in Scotland, it has not been externally validated in other populations, and therefore should not be used outside Scotland.

6. QRISK3 Score

The QRISK3 score was developed in 2017 and updated the QRISK2 algorithm which was published in 2008 and was the standard of care risk tool for prediction of 10-year risk for cardiovascular events in England [53,54]. This sex-specific tool was derived from a cohort of 2.67 million people and includes all risk factors included in the QRISK2 model (age, ethnicity, social deprivation, SBP, body mass index, TC/HDL-C ratio, smoking, family history of CHD in a first-degree relative younger than 60 years, T2DM, treated hypertension, rheumatoid arthritis, atrial fibrillation and stage 4 or 5 chronic kidney disease) along with 8 additional risk variables which were identified as possible risk factors of CVD in other studies [53,55,56,57,58]. These variables are migraine, corticosteroid use, systemic lupus erythematosus, treatment with atypical antipsychotic medications, severe mental illness, erectile dysfunction, and variability of blood pressure [53]. This model can predict with high precision the 10-year risk of cardiovascular events in the English population aged between 25 to 84 years. Although the QRISK2 score tool was validated in non-English populations and appeared to be accurate [59,60,61], validation studies of the QRISK3 score are yet to be performed. Accordingly, the use of the QRISK3 score should be limited to the English population.

7. Prospective Cardiovascular Münster (PROCAM) Risk Score

The PROCAM risk score was developed to assess the 10-year risk of an acute CHD event (fatal or non-fatal) using 8 established CHD risk factors (age, SBP, low-density lipoprotein cholesterol and HDL-C, triglycerides, presence of T2DM, family history of MI and smoking status) [62]. This simple scoring system was based on a cohort of 5000 men 35–65 years old, registered in the PROCAM study [62,63]. In 2007, the PROCAM risk score was updated to be applicable not only in men, but also in women, deriving data from a larger cohort of PROCAM study, which included both genders [64]. Furthermore, Assman et al. in 2007 formulated a 10-year prediction risk score for stroke based on a smaller cohort of the PROCAM study, including five risk factors (sex, age, SBP, smoking status, and presence of T2DM) [64]. Similarly with the Assign risk score and the QRISK3 score, the PROCAM risk score has not been validated in non-German populations and therefore should not be used outside Germany, even though it might be useful in this country instead of the SCORE.

8. CUORE Risk Score

The CUORE risk score is the national cardiovascular risk score in Italy and predicts the 10-year risk for CHD and cerebrovascular events. This score was developed from 12 Italian cohorts of 25,000 men and women, 35–69 years-old, without established CVD. It encompasses 8 established risk factors for CVD (SBP, age, TC, HDL-C, presence of T2DM, treatment for hypertension, smoking) [65]. It was created in order to depict more accurately the 10-year CVD risk in the Italian population compared to other well-known European CVD risk scores such as the SCORE, which does not include T2DM as a risk factor. Again, the lack of external validation limits the use of the CUORE risk score in the Italian population.

9. Reynolds Risk Score

In 2007, Ridker et al. formulated the Reynolds Risk score by the data provided from a large US cohort study of 24,000 women free from CVD and T2DM with approximately 10-years follow up for CVD (incident MI, stroke, coronary revascularization, or cardiovascular death) [66]. This prediction model contained several established risk factors for CVD (age, sex, SBP, HbA1c if diabetic, smoking, TC and HDL-C) and also considered high-sensitivity C-reactive protein (hsCRP) and parental history of MI before the age of 60 years [45]. Compared with the Adult Treatment Panel III prediction scores, the Reynolds risk score reclassified 40–50% of women of intermediate-risk in lower or higher risk categories with a good fitting of predicted and actual events [45]. In 2008, the Reynolds risk score for men was created based on a US cohort study of 10,724 men [67]. The major disadvantage of the Reynolds risk score is that it is derived from only two cohort studies and its external validity is questionable. Moreover, it is unclear whether hsCRP is a risk factor for CVD and whether the incorporation of hsCRP in a predictive model increases its accuracy [68,69].

10. Imaging Markers

Several studies reported that evaluation of coronary artery calcification (CAC) is a useful tool in the primary prevention of CVD.In the Multi-Ethnic Study of Atherosclerosis (n = 6814 subjects without established CVD), each increase in CAC score by 1 standard deviation was associated with an increase in the incidence of coronary heart disease by 260% [70]. More importantly, a systematic review of four observational studies (n = 13,969 subjects without established CVD) showed that measurement of the CAC score reclassified 14–4% of intermediate-risk patients to the high- or low-risk category [71]. Despite these advantages of CAC score, this predictive modality also has important shortcomings including a relatively high cost, exposure to radiation, limited availability and a low predictive value in young subjects, who are unlikely to have CAC. Accordingly, measurement of the CAC score has not been yet incorporated in a risk prediction equation. Notably, CAC appears to be less useful in risk prediction in women than in men [72].
Carotid intima-media thickness is another marker of subclinical atherosclerosis that has been used for risk prediction. However, in a meta-analysis of 14 population-based cohorts (n = 45,828), the addition of cIMT measurement to the Framingham risk score yielded minimal improvement in the predictive ability of the latter score [73]. In contrast, measurement of the ankle-brachial index, a marker of peripheral arterial disease, might be more useful in cardiovascular risk stratification. Indeed, in a meta-analysis of 16 cohort studies (n = 48,294), the ABI reclassified risk category according to the Framingham risk score in 19 and 36% of men and women, respectively [74].

11. Circulating Biomarkers and Genetics

A number of serological markers have been evaluated for their association with cardiovascular risk and whether they improve risk stratification when added to risk engines that incorporate traditional cardiovascular risk factors. Among these markers, N-terminal-pro-B-type natriuretic peptide (NT-proBNP) is one of the most promising. In a meta-analysis of 40 prospective studies (n = 95,617 subjects without established CVD), the addition of NT-proBNP to predictive models incorporating conventional risk factors substantially improved risk improvement [75]. Troponin also appears to improve the accuracy of conventional risk scores, both in men and in women [76].
Several polygenic risk scores have also been developed that include genes associated with atherogenesis [77]. These risk scores appear to improve the performance of conventional risk prediction equations [77,78]. However, cost and availability are important limitations for the wider use of these genetic scores.

12. Conclusions

Several risk scores have been developed and are being used for cardiovascular risk prediction. However, most of these risk scores have not been validated in external cohorts or were shown to over- or underestimate risk in populations other than those in which they derive. Accordingly, country-specific risk scores, where available, should be preferred for cardiovascular risk stratification. In addition, risk scores should be regularly updated with contemporary epidemiological data. Finally, it should be further evaluated whether the addition of novel cardiovascular risk markers in these scores could improve risk stratification (Figure 2).

Author Contributions

Conceptualization, N.S.; methodology, C.A.; software, A.S. and K.T.; validation, K.T.; formal analysis, A.S. and K.T.; investigation, A.S.; resources, A.S. and C.A.; data curation, N.S.; writing original draft preparation A.S.; writing—review and editing, K.T. and A.S.; visualization, N.S.; supervision, K.T.; project administration, K.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data can be found at PubMed.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Townsend, N.; Nichols, M.; Scarborough, P.; Rayner, M. Cardiovascular disease in Europe—Epidemiological update 2015. Eur. Heart J. 2015, 36, 2696–2705. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Law, M.R.; Morris, J.K.; Wald, N.J. Use of blood pressure lowering drugs in the prevention of cardiovascular disease: Meta-analysis of 147 randomised trials in the context of expectations from prospective epidemiological studies. BMJ 2009, 338, b1665. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Cholesterol Treatment Trialists’ (CTT) Collaboration; Baigent, C.; Blackwell, L.; Emberson, J.; Holland, L.E.; Reith, C.; Bhala, N.; Peto, R.; Barnes, E.H.; Keech, A.; et al. Efficacy and safety of more intensive lowering of LDL cholesterol: A meta-analysis of data from 170,000 participants in 26 randomised trials. Lancet 2010, 376, 1670–1681. [Google Scholar] [PubMed] [Green Version]
  4. Williams, B.; Mancia, G.; Spiering, W.; Agabiti Rosei, E.; Azizi, M.; Burnier, M.; Clement, D.; Coca, A.; De Simone, G.; Dominiczak, A.; et al. 2018 Practice Guidelines for the management of arterial hypertension of the European Society of Hypertension and the European Society of Cardiology: ESH/ESC Task Force for the Management of Arterial Hypertension. J. Hypertens. 2018, 36, 2284–2309. [Google Scholar] [CrossRef] [Green Version]
  5. Mach, F.; Baigent, C.; Catapano, A.L.; Koskinas, K.C.; Casula, M.; Badimon, L.; Chapman, M.J.; De Backer, G.G.; Delgado, V.; Ference, B.A.; et al. 2019 ESC/EAS Guidelines for the management of dyslipidaemias: Lipid modification to reduce cardiovascular risk. Eur. Heart J. 2020, 41, 111–188. [Google Scholar] [CrossRef]
  6. Conroy, R.M.; Pyörälä, K.; Fitzgerald, A.P.; Sans, S.; Menotti, A.; De Backer, G.; De Bacquer, D.; Ducimetière, P.; Jousilahti, P.; Keil, U.; et al. Estimation of ten-year risk of fatal cardiovascular disease in Europe: The SCORE project. Eur. Heart J. 2003, 24, 987–1003. [Google Scholar] [CrossRef]
  7. Mortensen, M.B.; Falk, E. Limitations of the SCORE-guided European guidelines on cardiovascular disease prevention. Eur. Heart J. 2017, 38, 2259–2263. [Google Scholar] [CrossRef] [Green Version]
  8. van der Heijden, A.A.; Ortegon, M.M.; Niessen, L.W.; Nijpels, G.; Dekker, J.M. Prediction of coronary heart disease risk in a general, pre-diabetic, and diabetic population during 10 years of follow-up: Accuracy of the Framingham, SCORE, and UKPDS risk functions: The Hoorn Study. Diabetes Care 2009, 32, 2094–2098. [Google Scholar] [CrossRef] [Green Version]
  9. Cañón-Barroso, L.; Muro, E.C.; Herrera, N.D.; Ochoa, G.F.; Hueros, J.I.C.; Buitrago, F. Performance of the Framingham and SCORE cardiovascular risk prediction functions in a non-diabetic population of a Spanish health care centre: A validation study. Scand. J. Prim. Health Care 2010, 28, 242–248. [Google Scholar] [CrossRef]
  10. Sehestedt, T.; Jeppesen, J.; Hansen, T.; Rasmussen, S.; Wachtell, K.; Ibsen, H.; Torp-Pedersen, C.; Olsen, M.H. Risk stratification with the risk chart from the European Society of Hypertension compared with SCORE in the general population. J. Hypertens 2009, 27, 2351–2357. [Google Scholar] [CrossRef]
  11. Pandya, A.; Weinstein, M.C.; Gaziano, T.A. A comparative assessment of non-laboratory-based versus commonly used laboratory-based cardiovascular disease risk scores in the NHANES III population. PLoS ONE 2011, 6, e20416. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Scheltens, T.; Verschuren, W.M.; Boshuizen, H.C.; Hoes, A.W.; Zuithoff, N.P.; Bots, M.L.; Grobbee, D.E. Estimation of cardiovascular risk: A comparison between the Framingham and the SCORE model in people under 60 years of age. Eur. J. Cardiovasc. Prev. Cardiol. 2008, 15, 562–566. [Google Scholar] [CrossRef] [PubMed]
  13. Mainous, A.G., 3rd; Koopman, R.J.; Diaz, V.A.; Everett, C.J.; Wilson, P.W.; Tilley, B.C. A coronary heart disease risk score based on patient-reported information. Am. J. Cardiol. 2007, 99, 1236–1241. [Google Scholar] [CrossRef] [Green Version]
  14. Schneer, S.; Bachar, G.N.; Atar, E.; Koronowski, R.; Dicker, D. Evaluation of framingham and systematic coronary risk evaluation scores by coronary computed tomographic angiography in asymptomatic adults. Am. J. Cardiol. 2013, 111, 700–704. [Google Scholar] [CrossRef]
  15. Sehestedt, T.; Jeppesen, J.; Hansen, T.W.; Wachtell, K.; Ibsen, H.; Torp-Petersen, C.; Hildebrandt, P.; Olsen, M.H. Risk prediction is improved by adding markers of subclinical organ damage to SCORE. Eur. Heart J. 2010, 31, 883–891. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Verweij, L.; Peters, R.J.G.; Scholte Op Reimer, W.J.M.; Boekholdt, S.M.; Luben, R.M.; Wareham, N.J.; Khaw, K.T.; Latour, C.H.M.; Jorstad, H.T. Validation of the Systematic COronary Risk Evaluation—Older Persons (SCORE-OP) in the EPIC-Norfolk prospective population study. Int. J. Cardiol. 2019, 293, 226–230. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Goff, D.C., Jr.; Lloyd-Jones, D.M.; Bennett, G.; Coady, S.; D’Agostino, R.B.; Gibbons, R.; Greenland, P.; Lackland, D.T.; Levy, D.; O’Donnell, C.J.; et al. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J. Am. Coll Cardiol. 2014, 63, 2935–2959. [Google Scholar] [CrossRef] [Green Version]
  18. The ARIC Investigators. The Atherosclerosis Risk in Communities (ARIC) Study: Design and objectives. Am. J. Epidemiol. 1989, 129, 687–702. [Google Scholar] [CrossRef]
  19. Fried, L.P.; Borhani, N.O.; Enright, P.; Furberg, C.D.; Gardin, J.M.; Kronmal, R.A.; Kuller, L.H.; Manolio, T.A.; Mittelmark, M.B.; Newman, A.; et al. The Cardiovascular Health Study: Design and rationale. Ann. Epidemiol. 1991, 1, 263–276. [Google Scholar] [CrossRef]
  20. Friedman, G.D.; Cutter, G.R.; Donahue, R.P.; Hughes, G.H.; Hulley, S.B.; Jacobs, D.R., Jr.; Liu, K.; Savage, P.J. CARDIA: Study design, recruitment, and some characteristics of the examined subjects. J. Clin. Epidemiol. 1988, 41, 1105–1116. [Google Scholar] [CrossRef]
  21. Dawber, T.R.; Kannel, W.B.; Lyell, L.P. An approach to longitudinal studies in a community: The Framingham Study. Ann. N. Y. Acad. Sci. 1963, 107, 539–556. [Google Scholar] [CrossRef] [PubMed]
  22. Kannel, W.B.; Feinleib, M.; McNamara, P.M.; Garrison, R.J.; Castelli, W.P. An investigation of coronary heart disease in families. The Framingham offspring study. Am. J. Epidemiol. 1979, 110, 281–290. [Google Scholar] [CrossRef] [PubMed]
  23. Muntner, P.; Colantonio, L.; Cushman, M.; Goff, D.C.; Howard, G.; Howard, V.J.; Kissela, B.; Levitan, E.; Lloyd-Jones, D.; Safford, M.M. Validation of the atherosclerotic cardiovascular disease Pooled Cohort risk equations. JAMA 2014, 311, 1406–1415. [Google Scholar] [CrossRef] [PubMed]
  24. DeFilippis, A.P.; Young, R.; Carrubba, C.J.; McEvoy, M.J.W.; Budoff, M.J.; Blumenthal, R.S.; Kronmal, R.A.; McClelland, R.L.; Nasir, K.; Blaha, M.J. An analysis of calibration and discrimination among multiple cardiovascular risk scores in a modern multiethnic cohort. Ann. Intern. Med. 2015, 162, 266–275. [Google Scholar] [CrossRef] [Green Version]
  25. Emdin, C.A.; Khera, A.V.; Natarajan, P.; Klarin, D.; Baber, U.; Mehran, R.; Rader, D.J.; Fuster, V.; Kathiresan, S. Evaluation of the Pooled Cohort Equations for Prediction of Cardiovascular Risk in a Contemporary Prospective Cohort. Am. J. Cardiol. 2017, 119, 881–885. [Google Scholar] [CrossRef]
  26. Rospleszcz, S.; Thorand, B.; Gala, T.D.L.H.; Meisinger, C.; Holle, R.; Koenig, W.; Mansmann, U.; Peters, A. Temporal trends in cardiovascular risk factors and performance of the Framingham Risk Score and the Pooled Cohort Equations. J. Epidemiol. Comm. Health 2019, 73, 19–25. [Google Scholar] [CrossRef] [Green Version]
  27. Mora, S.; Wenger, N.K.; Cook, N.R.; Liu, J.; Howard, B.V.; Limacher, M.C.; Liu, S.; Margolis, K.; Martin, L.W.; Paynter, N.P.; et al. Evaluation of the Pooled Cohort Risk Equations for Cardiovascular Risk Prediction in a Multiethnic Cohort from the Women’s Health Initiative. JAMA Intern. Med. 2018, 178, 1231–1240. [Google Scholar] [CrossRef]
  28. Nanna, M.G.; Peterson, E.D.; Wojdyla, D.; Navar, A.M. The Accuracy of Cardiovascular Pooled Cohort Risk Estimates in U.S. Older Adults. J. Gen. Intern. Med. 2019, 35, 1701–1708. [Google Scholar] [CrossRef]
  29. Ridker, P.M.; Cook, N.R. Statins: New American guidelines for prevention of cardiovascular disease. Lancet 2013, 382, 1762–1765. [Google Scholar] [CrossRef]
  30. Maddox, T.M.; Borden, W.B.; Tang, F.; Virani, S.S.; Oetgen, W.J.; Mullen, J.B.; Chan, P.S.; Casale, P.N.; Douglas, P.S.; Masoudi, F.A.; et al. Implications of the 2013 ACC/AHA cholesterol guidelines for adults in contemporary cardiovascular practice: Insights from the NCDR PINNACLE registry. J. Am. Coll. Cardiol. 2014, 64, 2183–2192. [Google Scholar] [CrossRef] [Green Version]
  31. DeFilippis, A.P.; Young, R.; McEvoy, J.W.; Michos, E.D.; Sandfort, V.; Kronmal, R.A.; McClelland, R.L.; Blaha, M.J. Risk score overestimation: The impact of individual cardiovascular risk factors and preventive therapies on the performance of the American Heart Association-American College of Cardiology-Atherosclerotic Cardiovascular Disease risk score in a modern multi-ethnic cohort. Eur. Heart J. 2017, 38, 598–608. [Google Scholar] [PubMed]
  32. Zhang, Z.; Gillespie, C.; Bowman, B.; Yang, Q. Prediction of atherosclerotic cardiovascular disease mortality in a nationally representative cohort using a set of risk factors from pooled cohort risk equations. PLoS ONE 2017, 12, e0175822. [Google Scholar] [CrossRef] [PubMed]
  33. Li, H.; Zhang, R.; Liu, G.; Liu, L.; Wang, Y.; Wang, Y. External Validation of Pooled Cohort Risk Equations to Predict 1-Year Clinical Outcome in Ischemic Stroke Patients. Med. Sci. Monit. 2017, 23, 4415–4421. [Google Scholar] [CrossRef] [Green Version]
  34. Topel, M.L.; Shen, J.; Morris, A.A.; Al Mheid, I.; Sher, S.; Dunbar, S.B.; Vaccarino, V.; Sperling, L.S.; Gibbons, G.H.; Martin, G.S.; et al. Comparisons of the Framingham and Pooled Cohort Equation Risk Scores for Detecting Subclinical Vascular Disease in Blacks Versus Whites. Am. J. Cardiol. 2018, 121, 564–569. [Google Scholar] [CrossRef]
  35. Celik, M.; Yuksel, U.C.; Yildirim, E.; Gursoy, E.; Koklu, M.; Yasar, S.; Gormel, S.; Gungor, M.; Bugan, B.; Barcin, C. The relationship between blood pressure variability and Pooled Cohort Risk Assessment Equations 10-year cardiovascular risk score. Blood Press Monit. 2016, 21, 282–287. [Google Scholar] [CrossRef]
  36. Nooe, A.; Edwards, M.K.; Addoh, O.; Loprinzi, P.D. Convergent validity of the ACC/AHA pooled cohort equations in associating with health-related quality of life among adults in the United States. Health Promot. Perspect. 2017, 7, 42–46. [Google Scholar] [CrossRef] [PubMed]
  37. Anderson, K.M.; Wilson, P.W.; Odell, P.M.; Kannel, W.B. An updated coronary risk profile. A statement for health professionals. Circulation 1991, 83, 356–362. [Google Scholar] [CrossRef] [Green Version]
  38. Wilson, P.W.F.; D’Agostino, R.B.; Levy, D.; Belanger, A.M.; Silbershatz, H.; Kannel, W.B. Prediction of coronary heart disease using risk factor categories. Circulation 1998, 97, 1837–1847. [Google Scholar] [CrossRef] [Green Version]
  39. D’Agostino, R.B.S.; Grundy, S.; Sullivan, L.M.; Wilson, P.; CHD Risk Prediction Group. Validation of the Framingham Coronary Heart Disease Prediction Scores: Results of a Multiple Ethnic Groups Investigation. JAMA 2001, 286, 180–187. [Google Scholar] [CrossRef]
  40. D’Agostino, R.B.; Vasan, R.S.; Pencina, M.J.; Wolf, P.A.; Cobain, M.; Massaro, J.M.; Kannel, W.B. General cardiovascular risk profile for use in primary care: The Framingham heart study. Circulation 2008, 117, 743–753. [Google Scholar] [CrossRef] [Green Version]
  41. Hense, H.-W.; Schulte, H.; Löwel, H.; Assmann, G.; Keil, U. Framingham risk function overestimates risk of coronary heart disease in men and women from Germany—results from the MONICA Augsburg and the PROCAM cohorts. Eur. Heart J. 2003, 24, 937–945. [Google Scholar] [CrossRef]
  42. Brindle, P.; Jonathan, E.; Lampe, F.; Walker, M.; Whincup, P.; Fahey, T.; Ebrahim, S. Predictive accuracy of the Framingham coronary risk score in British men: Prospective cohort study. BMJ 2003, 327, 1267. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Marrugat, J.; D’Agostino, R.; Sullivan, L.; Elosua, R.; Wilson, P.; Ordovas, J.; Solanas, P.; Cordón, F.; Ramos, R.; Sala, J.; et al. An adaptation of the Framingham coronary heart disease risk function to European Mediterranean areas. J. Epidemiol. Community Health 2003, 57, 634–638. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Liu, J.; Hong, Y.; D’Agostino, S.R.B.; Wu, Z.; Wang, W.; Sun, J.; Wilson, P.W.F.; Kannel, W.B.; Zhao, D. Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese Multi-Provincial Cohort Study. JAMA 2004, 291, 2591–2599. [Google Scholar] [CrossRef] [PubMed]
  45. Ridker, P.M.; Buring, J.E.; Rifai, N.; Cook, N.R. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: The Reynolds Risk Score. JAMA 2007, 297, 611–619. [Google Scholar] [CrossRef]
  46. Lloyd-Jones, D.M.; Leip, E.P.; Larson, M.; D’Agostino, R.B.; Beiser, A.; Wilson, P.W.; Wolf, P.A.; Levy, D. Prediction of lifetime risk for cardiovascular disease by risk factor burden at 50 years of age. Circulation 2006, 113, 791–798. [Google Scholar] [CrossRef]
  47. Pencina, M.J.; D’Agostino, R.B.; Larson, M.G.; Massaro, J.M.; Vasan, R.S. Predicting the 30-year risk of cardiovascular disease: The Framingham Heart Study. Circulation 2009, 119, 3078–3084. [Google Scholar] [CrossRef] [Green Version]
  48. Tunstall-Pedoe, H.; Woodward, M.; Tavendale, R.; Brook, R.A.; McCluskey, M.K. Comparison of the prediction by 27 different factors of coronary heart disease and death in men and women of the Scottish heart health study: Cohort study. BMJ 1997, 315, 722–729. [Google Scholar] [CrossRef] [Green Version]
  49. Woodward, M.; Brindle, P.; Tunsfall-Pedoe, H. Adding social deprivation and family history to cardiovascular risk assessment: The ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC). Heart 2007, 93, 172–176. [Google Scholar] [CrossRef] [Green Version]
  50. Home—ASSIGN Score—Prioritising Prevention of Cardiovascular Disease. Available online: http://www.assign-score.com/ (accessed on 14 June 2022).
  51. De La Iglesia, B.; Potter, J.F.; Poulter, N.R.; Robins, M.M.; Skinner, J. Performance of the ASSIGN cardiovascular disease risk score on a UK cohort of patients from general practice. Heart 2011, 97, 491–499. [Google Scholar] [CrossRef]
  52. Hippisley-Cox, J.; Coupland, C.; Vinogradova, Y.; Robson, J.; May, M.; Brindle, P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: Prospective open cohort study. BMJ 2007, 335, 136. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Hippisley-Cox, J.; Coupland, C.; Brindle, P. Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: Prospective cohort study. BMJ 2017, 357, j2099. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Department of Health. Putting Prevention First—NHS Health Check: Vascular Risk Assessment and Management Best Practice Guidance; Department of Health: London, UK, 2008.
  55. Thompson, I.M.; Tangen, C.M.; Goodman, P.J.; Moinpour, C.; Coltman, C.A. Erectile Dysfunction and Subsequent Cardiovascular Disease. JAMA 2005, 294, 2996–3002. [Google Scholar] [CrossRef] [Green Version]
  56. Shamloul, R.; Ghanem, H. Erectile dysfunction. Lancet 2013, 381, 153–165. [Google Scholar] [CrossRef]
  57. Kurth, T.; Winter, A.C.; Eliassen, A.H.; Dushkes, R.; Mukamal, K.J.; Rimm, E.B.; Willett, W.C.; Manson, J.E.; Rexrode, K. Migraine and risk of cardiovascular disease in women: Prospective cohort study. BMJ 2016, 353, i2610. [Google Scholar] [CrossRef] [Green Version]
  58. Rothwell, P.M.; Howard, S.C.; Dolan, E.; O’Brien, E.; Dobson, J.E.; Dahlöf, B.; Sever, P.S.; Poulter, N.R. Prognostic significance of visit-to-visit variability, maximum systolic blood pressure, and episodic hypertension. Lancet 2010, 375, 895–905. [Google Scholar] [CrossRef]
  59. Collins, G.S.; Altman, D.G. An independent and external validation of QRISK2 cardiovascular disease risk score: A prospective open cohort study. BMJ 2010, 340, c2442. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  60. Collins, G.S.; Altman, D.G. Predicting the 10 year risk of cardiovascular disease in the United Kingdom: Independent and external validation of an updated version of QRISK2. BMJ 2012, 344, e4181. [Google Scholar] [CrossRef] [Green Version]
  61. Hippisley-Cox, J.; Coupland, C.; Vinogradova, Y.; Robson, J.; Minhas, R.; Sheikh, A.; Brindle, P. Predicting cardiovascular risk in England and Wales: Prospective derivation and validation of QRISK2. BMJ 2008, 336, 1475–1482. [Google Scholar] [CrossRef] [Green Version]
  62. Assmann, G.; Cullen, P.; Schulte, H. Simple scoring scheme for calculating the risk of acute coronary events based on the 10-year follow-up of the Prospective Cardiovascular Münster (PROCAM) study. Circulation 2002, 105, 310–315. [Google Scholar] [CrossRef] [Green Version]
  63. Assmann, G.; Cullen, P.; Schulte, H. The Munster Heart Study (PROCAM). Results of follow-up at 8 years. Eur. Heart J. 1998, 19 (Suppl. A), A2–A11. [Google Scholar] [PubMed]
  64. Assmann, G.; Schulte, H.; Cullen, P.; Seedorf, U. Assessing risk of myocardial infarction and stroke: New data from the Prospective Cardiovascular Münster (PROCAM) study. Eur. J. Clin. Investig. 2007, 37, 925–932. [Google Scholar] [CrossRef] [PubMed]
  65. Giampaoli, S.; Palmieri, L.; Donfrancesco, C.; Panico, S.; Vanuzzo, D.; Pilotto, L.; Ferrario, M.; Cesana, G.; Mattiello, A.; The CUORE Project Research Group. Cardiovascular risk assessment in Italy: The CUORE Project risk score and risk chart. Ital. J. Public Health 2007, 5, 102–109. [Google Scholar]
  66. Ridker, P.M.; Cook, N.R.; Lee, I.-M.; Gordon, D.; Gaziano, J.M.; Manson, J.E.; Hennekens, C.H.; Buring, J.E. A randomized trial of low-dose aspirin in the primary prevention of cardiovascular disease in women. N. Engl. J. Med. 2005, 352, 1293–1304. [Google Scholar] [CrossRef]
  67. Ridker, P.M.; Paynter, N.P.; Rifai, N.; Gaziano, J.M.; Cook, N.R. C-reactive protein and parental history improve global cardiovascular risk prediction: The Reynolds risk score for men. Circulation 2008, 118, 2243–2251. [Google Scholar] [CrossRef] [Green Version]
  68. C Reactive Protein Coronary Heart Disease Genetics Collaboration (CCGC). Association between C reactive protein and coronary heart disease: Mendelian randomisation analysis based on individual participant data. BMJ 2011, 342, d548. [Google Scholar] [CrossRef] [Green Version]
  69. Emerging Risk Factors Collaboration; Kaptoge, S.; Di Angelantonio, E.; Pennells, L.; Wood, A.M.; White, I.R.; Gao, P.; Walker, M.; Thompson, A.; Sarwar, N.; et al. C-reactive protein, fibrinogen, and cardiovascular disease prediction. N. Engl. J. Med. 2012, 367, 1310–1320. [Google Scholar]
  70. Yeboah, J.; McClelland, R.L.; Polonsky, T.S.; Burke, G.L.; Sibley, C.T.; O’Leary, D.; Carr, J.; Goff, D.C.; Greenland, P.; Herrington, D.M. Comparison of novel risk markers for improvement in cardiovascular risk assessment in intermediate-risk individuals. JAMA 2012, 308, 788–795. [Google Scholar] [CrossRef] [Green Version]
  71. Peters, S.A.E.; Den Ruijter, H.M.; Bots, M.L.; Moons, K.G.M. Improvements in risk stratification for the occurrence of cardiovascular disease by imaging subclinical atherosclerosis: A systematic review. Heart 2012, 98, 177–184. [Google Scholar] [CrossRef]
  72. Nakao, Y.M.; Miyamoto, Y.; Higashi, M.; Noguchi, T.; Ohishi, M.; Kubota, I.; Tsutsui, H.; Kawasaki, T.; Furukawa, Y.; Yoshimura, M.; et al. Sex differences in impact of coronary artery calcification to predict coronary artery disease. Heart 2018, 104, 1118–1124. [Google Scholar] [CrossRef]
  73. Den Ruijter, H.M.; Peters, S.A.; Anderson, T.J. Common carotid intima-media thickness measurements in cardiovascular risk prediction: A meta-analysis. JAMA 2012, 308, 796–803. [Google Scholar] [CrossRef] [PubMed]
  74. Ankle Brachial Index Collaboration; Fowkes, F.G.; Murray, G.D.; Butcher, I.; Heald, C.L.; Lee, R.J.; Chambless, L.E.; Folsom, A.R.; Hirsch, A.T.; Dramaix, M.; et al. Ankle brachial index combined with Framingham Risk Score to predict cardiovascular events and mortality: A meta-analysis. JAMA 2008, 300, 197–208. [Google Scholar] [PubMed] [Green Version]
  75. Willeit, P.; Kaptoge, S.; Welsh, P.; Butterworth, A.S.; Chowdhury, R.; Spackman, S.A.; Pennells, L.; Gao, P.; Burgess, S.; Freitag, D.F.; et al. Natriuretic peptides and integrated risk assessment for cardiovascular disease: An individual-participant-data meta-analysis. Lancet Diabetes Endocrinol. 2016, 4, 840–849. [Google Scholar] [CrossRef] [Green Version]
  76. Zhu, F.; Arshi, B.; Leening, M.J.; Aribas, E.; Ikram, M.A.; Boersma, E.; Kavousi, M. Sex-Specific Added Value of Cardiac Biomarkers for 10-Year Cardiovascular Risk Prediction. Eur. J. Prev. Cardiol. 2022. [Google Scholar] [CrossRef]
  77. Neumann, J.T.; Riaz, M.; Bakshi, A.; Polekhina, G.; Thao, L.T.; Nelson, M.R.; Woods, R.L.; Abraham, G.; Inouye, M.; Reid, C.M.; et al. Prognostic Value of a Polygenic Risk Score for Coronary Heart Disease in Individuals Aged 70 Years and Older. Circ. Genom. Precis. Med. 2022, 15, e003429. [Google Scholar] [CrossRef]
  78. Elliott, J.; Bodinier, B.; Bond, T.A.; Chadeau-Hyam, M.; Evangelou, E.; Moons, K.G.M.; Dehghan, A.; Muller, D.; Elliott, P.; Tzoulaki, I. Predictive Accuracy of a Polygenic Risk Score-Enhanced Prediction Model vs a Clinical Risk Score for Coronary Artery Disease. JAMA 2020, 323, 636–645. [Google Scholar] [CrossRef]
Figure 1. Key advantages and pitfalls of most relevant risk scores (hsCRP: high-sensitivity C-reactive protein; CVD: cardiovascular disease).
Figure 1. Key advantages and pitfalls of most relevant risk scores (hsCRP: high-sensitivity C-reactive protein; CVD: cardiovascular disease).
Jpm 12 01180 g001
Figure 2. Key aspects of cardiovascular risk prediction.
Figure 2. Key aspects of cardiovascular risk prediction.
Jpm 12 01180 g002
Table 1. Key characteristics of the most widely used risk prediction equations (SBP: systolic blood pressure; TC: total cholesterol; HDL-C: high-density lipoprotein cholesterol; T2DM: type 2 diabetes mellitus; MI: myocardial infarction; CHD: coronary heart disease; CVD: cardiovascular disease; LDL-C: low-density lipoprotein cholesterol; hsCRP: high-sensitivity C-reactive protein).
Table 1. Key characteristics of the most widely used risk prediction equations (SBP: systolic blood pressure; TC: total cholesterol; HDL-C: high-density lipoprotein cholesterol; T2DM: type 2 diabetes mellitus; MI: myocardial infarction; CHD: coronary heart disease; CVD: cardiovascular disease; LDL-C: low-density lipoprotein cholesterol; hsCRP: high-sensitivity C-reactive protein).
Risk EquationParameters Used to Estimate RiskPredicted Outcome
Systematic Coronary Risk EvaluationAge, sex, SBP, TC and smoking status10-year risk of cardiovascular mortality
Pooled Cohort Equations CalculatorAge, sex, SBP, treatment for hypertension, TC, HDL-C, history of T2DM and smoking status10-year risk of a nonfatal MI, CHD death and fatal or nonfatal stroke
Framingham Risk ScoreAge, sex, SBP, TC, T2DM and smoking10-year risk of a nonfatal MI and CHD death
Assign risk scoreAge, sex, SBP, TC, T2DM, smoking, social deprivation and family history of CVD10-year risk of cardiovascular events
QRISK3 scoreAge, sex, SBP, TC/HDL-C ratio, T2DM, smoking status, ethnicity, social deprivation, body mass index, family history of CHD in a first-degree relative younger than 60 years, treated hypertension, rheumatoid arthritis, atrial fibrillation, stage 4 or 5 chronic kidney disease, migraine, corticosteroid use, systemic lupus erythematosus, treatment with atypical antipsychotic medications, severe mental illness, erectile dysfunction and variability of blood pressure10-year risk of cardiovascular events
Prospective Cardiovascular Münster risk scoreAge, SBP, LDL-C, HDL-C, triglycerides, presence of T2DM, family history of MI and smoking status10-year risk of fatal or nonfatal CHD event
CUORE risk scoreAge, sex, SBP, TC, HDL-C, presence of T2DM, treatment for hypertension and smoking status10-year risk of CHD and cerebrovascular events
Reynolds Risk scoreAge, sex, SBP, TC, HDL-C, HbA1c if diabetic, smoking, hsCRP and parental history of MI before the age of 60 years10-year risk of cardiovascular events
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Sofogianni, A.; Stalikas, N.; Antza, C.; Tziomalos, K. Cardiovascular Risk Prediction Models and Scores in the Era of Personalized Medicine. J. Pers. Med. 2022, 12, 1180. https://doi.org/10.3390/jpm12071180

AMA Style

Sofogianni A, Stalikas N, Antza C, Tziomalos K. Cardiovascular Risk Prediction Models and Scores in the Era of Personalized Medicine. Journal of Personalized Medicine. 2022; 12(7):1180. https://doi.org/10.3390/jpm12071180

Chicago/Turabian Style

Sofogianni, Areti, Nikolaos Stalikas, Christina Antza, and Konstantinos Tziomalos. 2022. "Cardiovascular Risk Prediction Models and Scores in the Era of Personalized Medicine" Journal of Personalized Medicine 12, no. 7: 1180. https://doi.org/10.3390/jpm12071180

APA Style

Sofogianni, A., Stalikas, N., Antza, C., & Tziomalos, K. (2022). Cardiovascular Risk Prediction Models and Scores in the Era of Personalized Medicine. Journal of Personalized Medicine, 12(7), 1180. https://doi.org/10.3390/jpm12071180

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop