Next Article in Journal
Airway Abnormalities in Adult Mucopolysaccharidosis and Development of Salford Mucopolysaccharidosis Airway Score
Next Article in Special Issue
Impact of Morphotype on Image Quality and Diagnostic Performance of Ultra-Low-Dose Chest CT
Previous Article in Journal
Second-Line Bismuth-Containing Quadruple Therapy for Helicobacterpylori Infection: A 12-Year Study of Annual Eradication Rates
Previous Article in Special Issue
Interstitial Lung Abnormalities Detected by CT in Asbestos-Exposed Subjects Are More Likely Associated to Age
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Compressed Sensing Real-Time Cine Reduces CMR Arrhythmia-Related Artifacts

1
University of Lille, Inserm, CHU Lille, Institut Pasteur Lille, U1011—European Genomic Institute for Diabetes (EGID), F-59000 Lille, France
2
CHU Lille, Department of Cardiovascular Radiology, F-59000 Lille, France
3
MR Product Innovation and Definition, Magnetic Resonance, Siemens Healthcare GmbH, 91052 Erlangen, Germany
4
Scientific Partnerships, Siemens Healthcare France, 93200 Saint-Denis, France
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2021, 10(15), 3274; https://doi.org/10.3390/jcm10153274
Submission received: 22 June 2021 / Revised: 21 July 2021 / Accepted: 21 July 2021 / Published: 24 July 2021

Abstract

:
Background and objective: Cardiac magnetic resonance (CMR) is a key tool for cardiac work-up. However, arrhythmia can be responsible for arrhythmia-related artifacts (ARA) and increased scan time using segmented sequences. The aim of this study is to evaluate the effect of cardiac arrhythmia on image quality in a comparison of a compressed sensing real-time (CSrt) cine sequence with the reference prospectively gated segmented balanced steady-state free precession (Cineref) technique regarding ARA. Methods: A total of 71 consecutive adult patients (41 males; mean age = 59.5 ± 20.1 years (95% CI: 54.7–64.2 years)) referred for CMR examination with concomitant irregular heart rate (defined by an RR interval coefficient of variation >10%) during scanning were prospectively enrolled. For each patient, two cine sequences were systematically acquired: first, the reference prospectively triggered multi-breath-hold Cineref sequence including a short-axis stack, one four-chamber slice, and a couple of two-chamber slices; second, an additional single breath-hold CSrt sequence providing the same slices as the reference technique. Two radiologists independently assessed ARA and image quality (overall, acquisition, and edge sharpness) for both techniques. Results: The mean heart rate was 71.8 ± 19.0 (SD) beat per minute (bpm) (95% CI: 67.4–76.3 bpm) and its coefficient of variation was 25.0 ± 9.4 (SD) % (95% CI: 22.8–27.2%). Acquisition was significantly faster with CSrt than with Cineref (Cineref: 556.7 ± 145.4 (SD) s (95% CI: 496.7–616.7 s); CSrt: 23.9 ± 7.9 (SD) s (95% CI: 20.6–27.1 s); p < 0.0001). A total of 599 pairs of cine slices were evaluated (median: 8 (range: 6–14) slices per patient). The mean proportion of ARA-impaired slices per patient was 85.9 ± 22.7 (SD) % using Cineref, but this was figure was zero using CSrt (p < 0.0001). The European CMR registry artifact score was lower with CSrt (median: 1 (range: 0–5)) than with Cineref (median: 3 (range: 0–3); p < 0.0001). Subjective image quality was higher in CSrt than in Cineref (median: 3 (range: 1–3) versus 2 (range: 1–4), respectively; p < 0.0001). In line, edge sharpness was higher on CSrt cine than on Cineref images (0.054 ± 0.016 pixel−1 (95% CI: 0.050–0.057 pixel−1) versus 0.042 ± 0.022 pixel−1 (95% CI: 0.037–0.047 pixel−1), respectively; p = 0.0001). Conclusion: Compressed sensing real-time cine drastically reduces arrhythmia-related artifacts and thus improves cine image quality in patients with arrhythmia.

1. Introduction

Cardiac magnetic resonance (CMR) is a major imaging modality for the assessment of left and right ventricular volumes and mass [1,2,3]. Moreover, it provides effective morphologic and kinetic assessment, including of the right ventricle which is not easily evaluated with ultrasounds due to its retrosternal location [4]. Multi-breath-hold segmented balanced steady state free precession (bSSFP) sequences are considered superior to gradient-echo imaging since they provide better endocardium delineation and reproducibility in a shorter scan time [5]. Retrospective electrocardiogram (ECG) gating requires the heart rate (HR) to be a regular periodic phenomenon as pieces of data are continuously acquired on multiple cardiac cycles, time-labelled and merged for the reconstruction of a whole cine slice, which is a weighted representation of successive heartbeats. It allows adapting the length of the acquisition window to the duration of the heartbeat during the continuous acquisition. This enables capturing of the complete cardiac cycle in segmented acquisitions. Typically, k-space interpolation or filtering is applied to retrospectively gate the acquired data to a reference heartbeat [6,7]. In the case of arrhythmia, artifacts occur since reconstruction is performed using incoming data from different frames of the cardiac cycle. Arrhythmia rejection algorithms can be applied with retrospective gating but may end in exceedingly long breath-holds. These arrhythmia-related artifacts (ARA) may be limited using prospectively triggered sequences by setting the acquisition window shorter than the briefest measured RR interval (time laps between two consecutive R peaks) [8]. However, this requires decreasing the number of k-space lines acquired per cardiac frame in order to preserve the widely accepted temporal resolution of 20 phases per cardiac cycle and misses to display the diastolic phases [9,10]. As a result of these adjustments, longer breath-holds and scan time are observed while the last phases of the cardiac cycle are not sampled.
Decreasing the amount of measured data is a simple way to reduce acquisition time. In recent years, compressed sensing was established as a powerful method to drastically reduce scan time [11,12,13,14]. This is achieved by highly undersampling k-space with a random sampling pattern. After Fourier transform, these acquired data result in noise-like, incoherent artifacts. These artifacts are compensated for in the final image with a non-linear iterative reconstruction exploiting the fact that medical images have a sparse representation. In combination with parallel imaging, acceleration rates can be achieved with CS that enable real-time cardiac cine imaging based on a balanced bSSFP readout with spatiotemporal resolution in a similar range to the reference (Cineref) acquisitions [15].
Various CMR studies have evaluated real-time CS cine sequences in 1.5 and 3 Tesla magnetic resonance scanners showing promising results for the assessment of left and right ventricles, including in patients with atrial fibrillation [16,17,18,19,20,21]. However, image quality was not specifically assessed in patients with irregular HR. Based on the assumption that real-time CS cine (CSrt) could reduce ARA, our study aimed at evaluating its image quality as compared to the reference multi-breath-hold segmented bSSFP cine (Cineref) in patients suffering from cardiac arrhythmia.

2. Materials and Methods

2.1. Study Population

From January 2019 to December 2019, 71 adult patients referred to our cardiovascular radiology department for CMR with concomitant arrhythmia during scanning were enrolled. Irregular HR was defined when the coefficient of variation of RR intervals (CVRR) was greater than 10% while scanning. The CVRR was calculated as the ratio of the standard deviation to the mean of RR intervals’ durations which were obtained from digital imaging and communications in medicine (DICOM) fields. Patients under 18 years old, grown-up congenital heart disease, stress CMR, patients undergoing ECG retrogated CMR and patients with sinus rhythm were excluded. A graphic illustration of the study design is provided in Figure S1 (Supplementary Materials). The protocol was approved by our institutional ethics committee and patients gave informed consent. The study was approved by the French National Agency for the Safety of Medicines and Health Devices (ANSM; ID-RCB: 2017-A00852-51).

2.2. Imaging Protocol

CMR studies were performed on a 1.5 T scanner (MAGNETOM Aera, Siemens Healthcare, Erlangen, Germany). Every patient underwent two series of cine images: first, the reference prospectively triggered and segmented multi-breath-hold Cineref sequence; second, the prototype single-breath-hold real-time single-shot CSrt cine sequence. Both acquisitions included one left ventricular (LV) and one right ventricular (RV) two-chamber slice, one four-chamber slice and a LV short-axis stack covering both ventricles with an 8 mm slice thickness and a 2 mm gap. Regarding the prospectively gated Cineref sequence, 20 phases of the cardiac cycle were acquired and the number of views per frame was set to reach this sampling rate. In single-shot CSrt cine imaging, the data acquisition was performed in a single heartbeat. The acquisition was triggered by the R peak on the ECG. With adaptive triggering, the acquisition was stopped with the next R peak, which allowed capturing the complete cardiac cycle. However, for multi-slice acquisition it could lead to a variation in the number of cardiac phases acquired between different slices as the temporal resolution was fixed. Temporal interpolation was applied to generate an additional dataset with a fixed number of cardiac phases (n = 20). This dataset was used to quantify cardiac function using a dedicated post-processing software that required a fixed number of cardiac phases. To evaluate the CSrt sequence in clinical conditions, 40 iterations were used to perform image recovery to maintain an acceptable reconstruction time. An additional phase contrast imaging (PCI) flow sequence was acquired on the aortic root. Segmented Cineref and CSrt cine sequences parameters are available in Table 1.

2.3. Cine Images Quality Assessment

Image quality was evaluated in both groups using four indicators. First, the subjective overall image quality was evaluated using a subjective 4-point Likert scale (1: non diagnostic; 2: poor; 3: good; 4: excellent). Secondly, an objective image quality assessment was carried out based on standardized criteria adapted from the European CMR registry “LV-Function cine SSFP” section (referred to below as “EuroCMR score”) [22] (p. 3). Higher scores referred to more frequent artifact occurrence (Table 2).
Third, the proportion of short-axis slices affected by ARA in each stack of both sequences was calculated, referred to as ARA rate. ARA were defined as a blurring of all or a part of the LV wall borders [22].
Finally, the edge sharpness (ε) of the boundary between myocardium and blood pool, which is the spatial frequency (in pixel−1) reflecting the spatial resolution, was measured on paired Cineref and CSrt four-chamber slices at end-diastole, accordingly to the literature [23,24]. Additional measurement at end-systole was performed. The edge spread function (ESF), which is the response of the imaging system to a high contrast boundary, was measured on MATLAB (version R2015a, The MathWorks, Natick, MA, USA), by drawing a signal profile line perpendicularly across the edge between the interventricular septum and the LV blood pool (Figure 1a,b) [25]. Then, ε was calculated as the reciprocal of the distance separating the points corresponding to 20% and 80% of the difference between local minimum and maximum signal intensities (Figure 1c,d).

2.4. Conditions of Image Analysis

Images from both sequences were anonymized before transfer to a clinical workstation (Sygno.via VB30A, Siemens Healthcare, Erlangen, Germany). A radiologist with 4 years of experience (PEA) performed the image quality assessment according to the above-cited indicators. Image sets were randomly evaluated in each group. The same observer (PEA) first performed the quality assessment of the reference Cineref images and at least one month later evaluated the CSrt images. For each patient, arrhythmia was quantified by calculating the CVRR. An additional assessment was performed by a radiologist with 8 years of experience (BL) from 30 randomly selected patients to evaluate the interobserver agreement and performed the same assessment regarding subjective quality, EuroCMR score and ARA rates. In the case of mismatch between the two readers, a radiologist with 15 years of experience (FP) performed the quality assessment with the two others to reach consensual scores which were used instead of those set by the first and less experienced observer. Mismatches were defined by discrepancies greater than or equal to 2 points regarding subjective quality score and EuroCMR score, or by a 20% difference in ARA rates. The edge sharpness assessment was automated and was not evaluated for interobserver agreement. Finally, semi-automated segmentation of LV endocardium and epicardium, and manual segmentation RV endocardium were performed on the same workstation with both cine sequences for each patient. LV stroke volume was also measured on PCI sequence.

2.5. Statistics Analysis

Categorical data were represented as numbers (percentages), continuous variables as mean ± standard deviation (SD) (95% confidence interval (CI)) in case of normal distribution and median (range: minimum–maximum) in other cases. Sequences were compared using the Wilcoxon signed-rank test regarding the overall subjective quality score and the modified EuroCMR score. Paired Student’s t-test was used for ARA rates, edge sharpness comparisons, and ventricular functional parameters comparison. An analysis of variance (ANOVA) was used to compare LV stroke volumes assessed by cine segmentation and PCI flow sequence. Intraclass correlation coefficient and kappa test were applied to assess the interobserver agreement [26]. Values of p < 0.05 were considered statistically significant. Statistical analysis was performed using MedCalc software (version 14.8.1.0, MedCalc Software, Ostend, Belgium).

3. Results

3.1. Population Description

The mean age of the population was 59.5 ± 20.1 (SD) years (95% CI: 54.7–64.2 years) with a male predominance (n = 41/71; 57.7%, women: n = 30/71; 42.3%). Patients were referred for initial work-up or follow-up of coronary artery disease (n = 17; 23.9%), heart rhythm disorder (n = 14; 19.7%), dilated cardiomyopathy (n = 11; 15.5%), infiltrative cardiomyopathy (n = 8; 11.3%), heart valve disease (n = 7; 9.9%), myocarditis (n = 6; 8.5%), hypertrophic cardiomyopathy (n = 5; 7.0%), and heart failure (n = 3; 4.2%). The mean HR was 71.8 ± 19.0 beats per minute (bpm) (95% CI: 67.4–76.3 bpm) and 38.0% of the patients (n = 27/71) demonstrated a mean HR above 75 bpm, meaning the 49 ms temporal resolution of the CSrt cine provided less than 16 frames of the cardiac cycle per slice. The mean CVRR was 25.0 ± 9.4% (95% CI: 22.8–27.2%). Arrhythmia was caused by atrial fibrillation (n = 42/71; 59.2%), ventricular hyperexcitability (n = 17/71; 23.9%), and conduction disorders (n = 12/71; 16.9%). Demographic data are summarized in Table 3. Biventricular functional assessment of the population is reported in Table 4.

3.2. Cine Acquisitions

A total of 599 short-axis cine slices were acquired with each sequence. A median number of 8 (range: 6–14) cine slices was acquired twice for each patient, depending on cardiac morphology. To acquire the same slices, CSrt was significantly faster than Cineref (Cineref: 556.7 ± 145.4 (SD) s (95% CI: 496.7–616.7 s); CSrt: 23.9 ± 7.9 (SD) s (95% CI: 20.6–27.1 s); p < 0.0001).

3.3. Objective European CMR Standardized Criteria-Based Quality Score

The EuroCMR score for the CSrt cine (median: 1 (range: 0–5)) was significantly better than for the Cineref sequence (median: 3 (range: 0–3); p < 0.0001) (Table 5) (Figure 2; Video S1 (Supplementary Materials)). Interobserver agreements were 0.94 and 0.89 regarding Cineref and CSrt, respectively. No mismatch was encountered between the readers.

3.4. Subjective Overall Quality Score

The subjective quality score was significantly better (p < 0.0001) for the CSrt sequence with a median score of 3 (range: 1–3). A 0.85 interobserver agreement was reached. The Cineref sequence provided a median score of 2 (range: 1–4; p < 0.0001) with an intraclass coefficient of 0.82 (Table 6). No mismatch was encountered between the readers. The Cineref sequence provided 23 non-diagnostic acquisitions compromising functional and morphological assessments versus only 10 stacks with the CSrt cine (Figure 2; Video S1 (Supplementary Materials)).

3.5. Arrhythmia-Related Artifacts Rate

ARA using Cineref sequence were assessed on n = 514/599 (85.8%) cine slices from n = 70/71 (98.6%) patients, with a 0.90 interobserver agreement. One mismatch was encountered between the readers (PEA: n = 8/14, 57.1%; BL: n = 12/14, 85.7%; FP: n = 12/14, 85.7%). The mean proportion of impaired slices per patient was in 85.9 ± 22.7 (SD) %. No ARA could be depicted using the CSrt sequence.

3.6. Edge Sharpness

The CSrt sequence provided a higher edge sharpness coefficient at end-diastole (εCSrt = 0.051 ± 0.016 pixel−1 (95% CI: 0.048–0.055 pixel−1)) than the CinerefCineref = 0.040 ± 0.018 pixel−1 (95% CI: 0.036–0.044 pixel−1)) (p = 0.0001). A similar finding was observed at end-systole (εCSrt = 0.054 ± 0.016 pixel−1 (95% CI: 0.050–0.057 pixel−1); εCineref = 0.042 ± 0.022 pixel−1 (95% CI: 0.037–0.047 pixel−1); p = 0.0001).

4. Discussion

This prospective monocentric study based on a 71-patient cohort is, to our knowledge, the widest and most comprehensive study to evaluate the CSrt sequence in patients with irregular HR. Previous studies in non-selected patients confirmed that real-time CS cine imaging is a reliable alternative to segmented multi-breath-hold SSFP for the assessment of both ventricles’ volumes and function in addition to reducing acquisition time [16,17,18,19,20]. Our study demonstrates a dramatic drop in ARA and a significant improvement of subjective and objective image quality with CSrt in patients suffering from heart rhythm disorders. However, no CSrt set was rated as excellent because of the smooth boundaries rendered by the interpolation process which are mandatory for post-processing. Indeed, since the temporal resolution of the CS sequence is fixed, a variable number of frames will be acquired from one cycle to another in the case of arrhythmia. For segmentation to be achieved, post-processing tools require all cine slices to display the same number of frames per cycle. Consequently, a standardization is performed to display 20 frames per cycle on all slices.
We previously showed on a small sub-group of 25 patients suffering from arrhythmia that CSrt and Cineref sequences allowed similar image quality [20]. However, the present study does not only suggest equivalent scores but significantly better objective and subjective image quality scores with the CSrt cine. Of note, this sequence still provided non-null EuroCMR scores since the slices were identically located on both sequences; accordingly, most of the wrap-around or metallic artifacts were reproduced on the CSrt acquisition.
Our results are in line with the previous study by Goebel et al. on 20 patients with atrial fibrillation [21]. This study focused on a subjective semi-quantitative 4-point quality score and the evaluation of the variation of the myocardial signal intensity which is the reciprocal of the signal-to-noise ratio (SNR). However, this last parameter, or its reciprocal, is considered as hardly suitable for non-linear iterative reconstructions. Moreover, CS is built to suppress pieces of the image signal, while SNR is suited for fully sampled data [27]. Besides our study being specifically designed to evaluate the image quality using additional quantitative and objective metrics, we also performed a clinically integrated evaluation in a larger population.
The higher edge sharpness of CSrt images reflected the faster signal variation along a distance and a better delineation of the image boundaries. We evaluated the edge sharpness both at end-diastole, when the myocardium is supposed to be relatively still, and at end-systole. This metric, regardless of the non-linearity of the reconstruction process, is more suitable than the SNR or its reciprocal to evaluate image quality [27]. The ESF and its inverse value ε measure the imaging system ability to restitute high contrast transition in images. This parameter, the derivative (the line spread function) and its Fourier transform (the so-called task-based modulation transfer function or task transfer function) are currently considered for image quality assessment in the field of non-linear image reconstructions [24,25,28].
Regarding volumetric evaluation in patients suffering from arrhythmia, CSrt provided significantly lower LV end-diastolic volume (−3.6 ± 7.2 mL) than measured on Cineref, which was already observed in previous studies [16,20]. As for RV, there was a significant underestimation of all evaluated functional parameters. Nevertheless, these variations compared to the conventional Cineref should be considered with caution in a population with arrhythmia. Indeed, irregular heartbeats induce variable ventricular preloads and contractions, making the real reference values impossible to determine. Moreover, since CSrt demonstrated a better image quality than Cineref that was impaired by ARA, one may consider the segmentation to be more reliable on CSrt.
Besides the image quality improvement, the single breath-hold CSrt sequence allowed a dramatic reduction in scan time. Not only was acquisition faster, but the ARA reduction avoided repeating the acquisition of non-diagnostic slices [20]. The workflow improvement being a major issue in the field of CMR, this real-time sequence is very promising and may improve cost-effectiveness [29].

Limitations

Although the overall subjective image quality was improved with CSrt cine, 10 stacks were still considered as non-diagnostic. Indeed, iterative reconstructions occasionally failed or were not completely achieved on this prototype sequence. Nevertheless, such failures are now rare since the release of the final version of the sequence. Moreover, ECG-related issues occurred when R peaks were occasionally missed, which made the system consider two consecutive heartbeats as one single cycle. The corresponding slices then display a double heart cycle which could not be used for post-processing and was ranked as non-diagnostic. Special attention should be paid to skin preparation before ECG electrode placement.
Other fast real-time sequences, such as radial acquisition, have previously been reported [30,31]. Our study does not compare CSrt to other types of real-time sequences. To our knowledge, no such evaluation has been published and further study would be required for comparison.
A methodological limitation of our study is the impossibility to perform blinded evaluation of the sequences since CSrt cine displayed smoother boundaries than Cineref sequence. Consequently, observers could recognize the type of sequence they were evaluating. However, paired CSrt and Cineref stacks from the same patients were separated, randomized, and assessed during different sessions.
Regarding the sampling of heart cycles for the assessment of ventricular volumes and mass, the fixed temporal resolution leads to variable sampling rates from shorter cycler to longer ones. As a consequence, in the case of HR faster than 60 bpm, the recommended 20 frames per cycle could not be acquired [9,10]. However, in the field of analog-to-digital signal conversion, a 16-time oversampling is reputed sufficient for the signal restitution to be accurate, corresponding to a 75 bpm HR [32]. High CVRR in HR may be encountered, and some slices may display undersampled heart cycles. In our study, 38% of the patients demonstrated a mean HR above 75 bpm for whom the undersampling of the cardiac cycle should be considered cautiously during interpretation, especially for volume segmentations. Nevertheless, it must be balanced by the reduction of ARA provided by CSrt.

5. Conclusions

In addition to reducing acquisition time, CSrt sequence drastically reduces arrhythmia-related artifacts and improves image quality in patients with irregular heart rate. This rapid imaging technique allows practitioners, in daily practice, to improve quality, workflow and accessibility of CMR for patients with challenging cardiac conditions.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/jcm10153274/s1, Figure S1: Study design. Video S1: Viability assessment in a 77-year-old man with premature ventricular contractions caused by ischemic scars.

Author Contributions

B.L.: study conception and design, data collection, interpretation and analysis, drafting of the manuscript, critical revision for important intellectual content; P.-E.A.: data collection, interpretation and analysis, drafting of the manuscript; C.V.G.: data collection and interpretation, critical revision for important intellectual content; A.C.: study conception, critical revision for important intellectual content; J.H.: data collection and interpretation, critical revision for important intellectual content; A.S.: data collection and interpretation, critical revision for important intellectual content; M.S.: study conception and design, critical revision for important intellectual content; C.F.: study conception and design, critical revision for important intellectual content; S.T.: study conception and design, critical revision for important intellectual content; D.M.: study conception, critical revision for important intellectual content; F.P.: study conception and design, data collection, interpretation and analysis, drafting of the manuscript, critical revision for important intellectual content. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was approved by the research ethics committee of Lille University Hospital.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on reasonable request from the corresponding author, subject to approval by the research ethics committee of Lille University Hospital.

Conflicts of Interest

B.L.; P.-E.A.; C.V.G.; A.C.; J.H.; A.S.; D.M.; F.P. have no competing interest. They are employed by an institution engaged in a contractual collaboration with Siemens Healthineers. M.S.; C.F.; S.T. are employees of Siemens Healthineers.

References

  1. Pennell, D.J.; Sechtem, U.P.; Higgins, C.B.; Manning, W.J.; Pohost, G.M.; Rademakers, F.E.; van Rossum, A.C.; Shaw, L.J.; Yucel, E.K.; Society for Cardiovascular Magnetic Resonance; et al. Clinical indications for cardiovascular magnetic resonance (CMR): Consensus Panel report. Eur. Heart J. 2004, 25, 1940–1965. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Maceira, A.M.; Prasad, S.K.; Khan, M.; Pennell, D.J. Normalized left ventricular systolic and diastolic function by steady state free precession cardiovascular magnetic resonance. J Cardiovasc. Magn. Reson. 2006, 8, 417–426. [Google Scholar] [CrossRef]
  3. Maceira, A.M.; Prasad, S.K.; Khan, M.; Pennell, D.J. Reference right ventricular systolic and diastolic function normalized to age, gender and body surface area from steady-state free precession cardiovascular magnetic resonance. Eur. Heart J. 2006, 27, 2879–2888. [Google Scholar] [CrossRef] [Green Version]
  4. Grothues, F.; Moon, J.C.; Bellenger, N.G.; Smith, G.S.; Klein, H.U.; Pennell, D.J. Interstudy reproducibility of right ventricular volumes, function, and mass with cardiovascular magnetic resonance. Am. Heart J. 2004, 147, 218–223. [Google Scholar] [CrossRef]
  5. Plein, S.; Bloomer, T.N.; Ridgway, J.P.; Jones, T.R.; Bainbridge, G.J.; Sivananthan, M.U. Steady-state free precession magnetic resonance imaging of the heart: Comparison with segmented k-space gradient-echo imaging. J. Magn. Reson. Imaging 2001, 14, 230–236. [Google Scholar] [CrossRef]
  6. Lenz, G.W.; Haacke, E.M.; White, R.D. Retrospective cardiac gating: A review of technical aspects and future directions. Magn. Reson. Imaging 1989, 7, 445–455. [Google Scholar] [CrossRef]
  7. Madore, B.; Hoge, W.S.; Chao, T.-C.; Zientara, G.P.; Chu, R. Retrospectively gated cardiac cine imaging with temporal and spatial acceleration. Magn. Reson. Imaging 2011, 29, 457–469. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Nacif, M.S.; Zavodni, A.; Kawel, N.; Choi, E.-Y.; Lima, J.A.C.; Bluemke, D.A. Cardiac magnetic resonance imaging and its electrocardiographs (ECG): Tips and tricks. Int. J. Cardiovasc. Imaging 2012, 28, 1465–1475. [Google Scholar] [CrossRef]
  9. Roussakis, A.; Baras, P.; Seimenis, I.; Andreou, J.; Danias, P.G. Relationship of number of phases per cardiac cycle and accuracy of measurement of left ventricular volumes, ejection fraction, and mass. J. Cardiovasc. Magn. Reson. Off. J. Soc. Cardiovasc. Magn. Reson. 2004, 6, 837–844. [Google Scholar] [CrossRef] [PubMed]
  10. Miller, S.; Simonetti, O.P.; Carr, J.; Kramer, U.; Finn, J.P. MR imaging of the heart with cine true fast imaging with steady-state precession: Influence of spatial and temporal resolutions on left ventricular functional parameters. Radiology 2002, 223, 263–269. [Google Scholar] [CrossRef] [PubMed]
  11. Donoho, D.L. Compressed sensing. IEEE Trans. Inf. Theory 2006, 52, 1289–1306. [Google Scholar] [CrossRef]
  12. Candès, E.J.; Romberg, J.K.; Tao, T. Stable signal recovery from incomplete and inaccurate measurements. Commun. Pure Appl. Math. 2006, 59, 1207–1223. [Google Scholar] [CrossRef] [Green Version]
  13. Lustig, M.; Donoho, D.; Pauly, J.M. Sparse MRI: The application of compressed sensing for rapid MR imaging. Magn. Reson. Med. 2007, 58, 1182–1195. [Google Scholar] [CrossRef] [PubMed]
  14. Lustig, M.; Santos, J.M.; Lee, J.; Donoho, D.L.; Pauly, J.M. Application of compressed sensing for rapid MR imaging. In Proceedings of the 1st Signal Processing with Adaptive Sparse Structured Representations Workshop (SPARS 2005), Rennes, France, 16–18 November 2005; pp. 1–3. [Google Scholar]
  15. Feng, L.; Srichai, M.B.; Lim, R.P.; Harrison, A.; King, W.; Adluru, G.; Dibella, E.V.R.; Sodickson, D.K.; Otazo, R.; Kim, D. Highly accelerated real-time cardiac cine MRI using k-t SPARSE-SENSE. Magn. Reson. Med. 2013, 70, 64–74. [Google Scholar] [CrossRef] [Green Version]
  16. Vincenti, G.; Monney, P.; Chaptinel, J.; Rutz, T.; Coppo, S.; Zenge, M.O.; Schmidt, M.; Nadar, M.S.; Piccini, D.; Chèvre, P.; et al. Compressed sensing single-breath-hold CMR for fast quantification of LV function, volumes, and mass. JACC Cardiovasc. Imaging 2014, 7, 882–892. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Goebel, J.; Nensa, F.; Schemuth, H.P.; Maderwald, S.; Gratz, M.; Quick, H.H.; Schlosser, T.; Nassenstein, K. Compressed sensing cine imaging with high spatial or high temporal resolution for analysis of left ventricular function. J. Magn. Reson. Imaging 2016, 44, 366–374. [Google Scholar] [CrossRef] [PubMed]
  18. Haubenreisser, H.; Henzler, T.; Budjan, J.; Sudarski, S.; Zenge, M.O.; Schmidt, M.; Nadar, M.S.; Borggrefe, M.; Schoenberg, S.O.; Papavassiliu, T. Right ventricular imaging in 25 seconds: Evaluating the use of sparse sampling CINE with iterative reconstruction for volumetric analysis of the right ventricle. Investig. Radiol. 2016, 51, 379–386. [Google Scholar] [CrossRef]
  19. Kido, T.; Kido, T.; Nakamura, M.; Watanabe, K.; Schmidt, M.; Forman, C.; Mochizuki, T. Compressed sensing real-time cine cardiovascular magnetic resonance: Accurate assessment of left ventricular function in a single-breath-hold. J. Cardiovasc. Magn. Reson. 2016, 18, 50–60. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Vermersch, M.; Longère, B.; Coisne, A.; Schmidt, M.; Forman, C.; Monnet, A.; Pagniez, J.; Silvestri, V.; Simeone, A.; Cheasty, E.; et al. Compressed sensing real-time cine imaging for assessment of ventricular function, volumes and mass in clinical practice. Eur. Radiol. 2020, 30, 609–619. [Google Scholar] [CrossRef]
  21. Goebel, J.; Nensa, F.; Schemuth, H.P.; Maderwald, S.; Quick, H.H.; Schlosser, T.; Nassenstein, K. Real-Time SPARSE-SENSE cine MR imaging in atrial fibrillation: A feasibility study. Acta Radiol. 2017, 58, 922–928. [Google Scholar] [CrossRef]
  22. Klinke, V.; Muzzarelli, S.; Lauriers, N.; Locca, D.; Vincenti, G.; Monney, P.; Lu, C.; Nothnagel, D.; Pilz, G.; Lombardi, M.; et al. Quality assessment of cardiovascular magnetic resonance in the setting of the European CMR registry: Description and validation of standardized criteria. J. Cardiovasc. Magn. Reson. 2013, 15, 55. [Google Scholar] [CrossRef] [Green Version]
  23. Larson, A.C.; Kellman, P.; Arai, A.; Hirsch, G.A.; McVeigh, E.; Li, D.; Simonetti, O.P. Preliminary investigation of respiratory self-gating for free-breathing segmented cine MRI. Magn. Reson. Med. 2005, 53, 159–168. [Google Scholar] [CrossRef] [Green Version]
  24. Wetzl, J.; Schmidt, M.; Pontana, F.; Longère, B.; Lugauer, F.; Maier, A.; Hornegger, J.; Forman, C. Single-breath-hold 3-D CINE imaging of the left ventricle using cartesian sampling. Magn. Reson. Mater. Phys. Biol. Med. 2017, 31, 19–31. [Google Scholar] [CrossRef]
  25. Richard, S.; Husarik, D.B.; Yadava, G.; Murphy, S.N.; Samei, E. Towards task-based assessment of CT performance: System and object MTF across different reconstruction algorithms. Med. Phys. 2012, 39, 4115–4122. [Google Scholar] [CrossRef] [PubMed]
  26. Benchoufi, M.; Matzner-Lober, E.; Molinari, N.; Jannot, A.-S.; Soyer, P. Interobserver agreement issues in radiology. Diagn. Interv. Imaging 2020, 101, 639–641. [Google Scholar] [CrossRef]
  27. Graff, C.G.; Sidky, E.Y. Compressive sensing in medical imaging. Appl. Opt. 2015, 54, C23–C44. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Li, T.; Feng, H.; Xu, Z. A New analytical edge spread function fitting model for modulation transfer function measurement. Chin. Opt. Lett. 2011, 9, 031101. [Google Scholar] [CrossRef]
  29. Lurz, P.; Muthurangu, V.; Schievano, S.; Nordmeyer, J.; Bonhoeffer, P.; Taylor, A.M.; Hansen, M.S. Feasibility and reproducibility of biventricular volumetric assessment of cardiac function during exercise using real-time radial k-t SENSE magnetic resonance imaging. J. Magn. Reson. Imaging JMRI 2009, 29, 1062–1070. [Google Scholar] [CrossRef] [PubMed]
  30. Voit, D.; Zhang, S.; Unterberg-Buchwald, C.; Sohns, J.M.; Lotz, J.; Frahm, J. Real-time cardiovascular magnetic resonance at 1.5 T using balanced SSFP and 40 ms resolution. J. Cardiovasc. Magn. Reson. Off. J. Soc. Cardiovasc. Magn. Reson. 2013, 15, 79–86. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Zhang, S.; Uecker, M.; Voit, D.; Merboldt, K.-D.; Frahm, J. Real-time cardiovascular magnetic resonance at high temporal resolution: Radial FLASH with nonlinear inverse reconstruction. J. Cardiovasc. Magn. Reson. Off. J. Soc. Cardiovasc. Magn. Reson. 2010, 12, 39–45. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Fraden, J. Handbook of Modern Sensors—Physics, Designs and Applications, 3rd ed.; Springer: New York, NY, USA, 2004. [Google Scholar]
Figure 1. Example of edge sharpness assessment at end-diastole for a 56-year-old male patient suffering from atrial fibrillation. The same four-chamber view at end-diastole is acquired with (a) the Cineref sequence and (b) the CSrt sequence. An orthogonal profile line was drawn at mid-cavity across the border between the septal myocardium and the left ventricular blood pool (blue line) on a four-chamber view. It provided intensity profiles (blue curves) along the line for (c) Cineref and (d) CSrt cine. The edge sharpness was the inverse of the distance d (in pixels) between the positions corresponding to 20% and 80% (red stars) of the difference between the maximum and minimum signal intensities (blue crosses). The edge sharpness was expressed in pixel−1. This measurement was performed at end-diastole and end-systole for both sequences. Note that the peaks (arrows heads) added to the Cineref signal profile curve (c) correspond to the doubling of the interventricular septum border (arrows) on the cine view (a). The same assessment was performed on both sequences at end-diastole and end-systole for the 71 enrolled patients. Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; εCineref, edge sharpness measured on Cineref sequence; εCSrt, edge sharpness measured on CSrt cine; I, signal intensity; Imin, minimal signal intensity; Imax, maximal signal intensity; d, distance along the profile line.
Figure 1. Example of edge sharpness assessment at end-diastole for a 56-year-old male patient suffering from atrial fibrillation. The same four-chamber view at end-diastole is acquired with (a) the Cineref sequence and (b) the CSrt sequence. An orthogonal profile line was drawn at mid-cavity across the border between the septal myocardium and the left ventricular blood pool (blue line) on a four-chamber view. It provided intensity profiles (blue curves) along the line for (c) Cineref and (d) CSrt cine. The edge sharpness was the inverse of the distance d (in pixels) between the positions corresponding to 20% and 80% (red stars) of the difference between the maximum and minimum signal intensities (blue crosses). The edge sharpness was expressed in pixel−1. This measurement was performed at end-diastole and end-systole for both sequences. Note that the peaks (arrows heads) added to the Cineref signal profile curve (c) correspond to the doubling of the interventricular septum border (arrows) on the cine view (a). The same assessment was performed on both sequences at end-diastole and end-systole for the 71 enrolled patients. Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; εCineref, edge sharpness measured on Cineref sequence; εCSrt, edge sharpness measured on CSrt cine; I, signal intensity; Imin, minimal signal intensity; Imax, maximal signal intensity; d, distance along the profile line.
Jcm 10 03274 g001
Figure 2. Examples of comparisons between Cineref and CSrt sequences in three patients suffering from arrhythmia. Mid-cavity short-axis views acquired with (a,c,e) Cineref and (b,d,f) CSrt. The three patients were (a,b) a 74-year-old man suffering from atrial fibrillation, (c,d) a 37-year-old woman screened for a genetically proven arrhythmogenic right ventricular cardiomyopathy, (e,f) a 63-year-old woman scanned for a second-degree atrioventricular block. The image quality assessment demonstrated: (a) Likert scale = 1/4, EuroCMR score = 3/10, εCineref = 0.051 pixel−1; (b) Likert scale = 3/4, EuroCMR score = 0/10, εCSrt = 0.067 pixel−1; (c) Likert scale = 1/4, EuroCMR score = 3/10, εCineref = 0.015 pixel−1; (d) Likert scale = 3/4, EuroCMR score = 1/10, εCSrt = 0.050 pixel−1; (e) Likert scale = 1/4, EuroCMR score = 3/10, εCineref = 0.023 pixel−1; (f) Likert scale = 3/4, EuroCMR score = 0/10, εCSrt = 0.035 pixel−1. Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; εCineref, edge sharpness measured on Cineref; εCSrt, edge sharpness measured on CSrt cine; EuroCMR, European cardiac magnetic resonance registry.
Figure 2. Examples of comparisons between Cineref and CSrt sequences in three patients suffering from arrhythmia. Mid-cavity short-axis views acquired with (a,c,e) Cineref and (b,d,f) CSrt. The three patients were (a,b) a 74-year-old man suffering from atrial fibrillation, (c,d) a 37-year-old woman screened for a genetically proven arrhythmogenic right ventricular cardiomyopathy, (e,f) a 63-year-old woman scanned for a second-degree atrioventricular block. The image quality assessment demonstrated: (a) Likert scale = 1/4, EuroCMR score = 3/10, εCineref = 0.051 pixel−1; (b) Likert scale = 3/4, EuroCMR score = 0/10, εCSrt = 0.067 pixel−1; (c) Likert scale = 1/4, EuroCMR score = 3/10, εCineref = 0.015 pixel−1; (d) Likert scale = 3/4, EuroCMR score = 1/10, εCSrt = 0.050 pixel−1; (e) Likert scale = 1/4, EuroCMR score = 3/10, εCineref = 0.023 pixel−1; (f) Likert scale = 3/4, EuroCMR score = 0/10, εCSrt = 0.035 pixel−1. Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; εCineref, edge sharpness measured on Cineref; εCSrt, edge sharpness measured on CSrt cine; EuroCMR, European cardiac magnetic resonance registry.
Jcm 10 03274 g002aJcm 10 03274 g002b
Table 1. Imaging parameters of the reference prospectively triggered steady-state free-precession cine imaging and real-time compressed sensing cine imaging.
Table 1. Imaging parameters of the reference prospectively triggered steady-state free-precession cine imaging and real-time compressed sensing cine imaging.
ParametersCinerefCSrt
Repetition time—ms3.162.70
Echo time—ms1.231.14
Flip angle—degrees5760
Field of view—mm2375 × 280360 × 270
Matrix—pixels2288 × 216224 × 168
Spatial resolution—mm21.3 × 1.31.6 × 1.6
Temporal resolution—ms41.249
Slice thickness/gap—mm8/28/2
Bandwidth—Hz/pixel915900
ECG modeProspective triggeringAdaptative triggering
Number of measured cardiac phases per cycle20 a17.0 ± 3.2
Number of reconstructed cardiac frames per cycle—n20 a20 b
Number of views per frame—n13.0 ± 4.8 c18 a
Cycles of iterative reconstruction—nNA40
Acceleration factor211
Data are expressed as mean ± standard deviation in the absence of any indication. a Constant value. b Interpolation was performed to provide a constant frame rate of 20 cardiac phases per cycle for post-processing. c The number of views per frame was set according to the shorter RR interval in order to acquire 20 cardiac phases. Prospective triggering allows data sampling during a fixed acquisition window after each R peak while adaptative triggering allow data sampling until the next R peak occurs. Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; ECG, electrocardiogram; n, data represented as numbers; NA, not applicable.
Table 2. “LV-Function cine SSFP” section of the standardized objective quality criteria score based on the European CMR registry. Adapted from [22] (p. 3).
Table 2. “LV-Function cine SSFP” section of the standardized objective quality criteria score based on the European CMR registry. Adapted from [22] (p. 3).
Items0123Maximum Score
1. LV coverageFull-No apexBase or ≥1 slice missing5
2. Wrap aroundNo1 slice2 slices≥3 slices3
3. Respiratory ghostNo1 slice2 slices≥3 slices
4. Cardiac ghostNo1 slice2 slices≥3 slices
5. Blurring/ARANo1 slice2 slices≥3 slices
6. Metallic artifactsNo1 slice2 slices≥3 slices
7. Shimming artifactsNo1 slice2 slices≥3 slices
8. Signal loss (coil inactive)Activated-Not activated 2
9. Orientation of stackCorrect-Incorrect-2
10. Slice thickness≤10 mm11–15 mm->15 mm3
11. Gap≤3 mm3–4 mm->4 mm3
12. Correct LV long axes≥2 mm1-None3
Score 21
Modified score (items 1 to 8) 10
Every acquisition using both sequences marked a null score concerning the four last items. Indeed, acquisitions were repeated every time slice orientation was not appropriated (item 9 = 0); all acquisitions (Cineref and CSrt) were performed using the same slice thickness and gap which were 8 mm (item 10 = 0) and 2 mm (item 11 = 0), respectively, and both horizontal and vertical long-axis slices were systematically acquired (item 12 = 0). Criteria in italics were not applied, and only bold criteria were used for objective quality assessment in our study, providing a maximum score of 10 points. The more artifacts there were, the higher the score was. Abbreviations: LV, left ventricle; SSFP, steady-state free precession; CMR, cardiac magnetic resonance; Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; ARA, arrhythmia-related artifacts.
Table 3. Study population characteristics.
Table 3. Study population characteristics.
Mean ± SD (95% CI)Minimum ValueMaximum Value
Age—years59.5 ± 20.1 (54.7–64.2)1887
Height—cm 171.6 ± 9.1 (169.4–173.7)140188
Weight—kg 79.3 ± 19.5 (74.7–83.9)26131
Body mass index—kg/m226.8 ± 6.1 (25.4–28.3)13.347.0
Maximal heart rate—bpm85.9 ± 21.6 (80.8–91.0)50139
Minimal heart rate—bpm55.6 ± 18.7 (55.6–64.4)31107
Mean heart rate—bpm71.8 ± 19.0 (67.4–76.3)42116
Arrhythmia (CVRR)—%25.0 ± 9.4 (22.8–27.2)10.250.9
Abbreviations: CVRR, coefficient of variation of RR interval; bpm, beat per minute; SD, standard deviation; 95% CI, 95% confidence interval.
Table 4. Biventricular functional assessment of the study population.
Table 4. Biventricular functional assessment of the study population.
Cineref CSrt DifferencePCI p
LVEF—%47.7 ± 19.0
(39.9–55.6)
47.3 ± 18.9
(39.5–55.1)
−0.4 ± 1.9
(−1.2 to 0.4)
-0.30 a
LVEDV—mL193.2 ± 102.0
(151.1–235.3)
189.6 ± 101.9
(147.6–231.6)
−3.6 ± 7.2
(−6.5 to −0.6)
-0.02 a
LVESV—mL114.2 ± 99.8
(73.0–155.4)
113.3 ± 98.8
(72.5–154.1)
−0.9 ± 6.8
(−3.7 to 1.9)
-0.51 a
LVSV—mL79.0 ± 29.4
(66.9–91.1)
76.3 ± 28.7
(64.5–88.2)
-76.7 ± 30.1 (64.3–89.1)0.94 b
LVM—g145.2 ± 48.0
(125.4–165.1)
148.0 ± 50.1
(127.3–168.6)
2.7 ± 8.8
(−0.9 to 6.3)
-0.13 a
RVEF—%50.9 ± 11.9
(46.0–55.8)
51.8 ± 11.9
(46.9–56.7)
0.9 ± 1.8
(0.1 to 1.7)
-0.02 a
RVEDV—mL153.7 ± 52.1
(132.2–175.2)
148.4 ± 47.5
(128.8–168.0)
−5.3 ± 7.6
(−8.5 to −2.2)
-0.02 a
RVESV—mL77.5 ± 38.0
(61.8–93.1)
73.8 ± 36.1
(58.9–88.7)
−3.7 ± 5.8
(−6.1 to −1.3)
-0.004 a
RVSV—mL76.2 ± 27.3
(65.0–87.5)
74.6 ± 24.1
(64.6–84.5)
−1.7 ± 4.5
(−3.5 to 0.2)
Insufficient data0.08 a
Data are presented as mean ± SD (95% CI). The significance of statistic tests is defined by values of p < 0.05. a Student’s t-test; b Analysis of variance. Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; PCI, phase contrast imaging sequence; SD, standard deviation; 95% CI, 95% confidence interval; LV, left ventricular; RV, right ventricular; EF, ejection fraction; EDV, end-diastolic volume; ESV, end-systolic volume; SV, stroke volume; LVM, left ventricular mass.
Table 5. Objective image quality with EuroCMR criteria scores: comparison between Cineref and CSrt image sets.
Table 5. Objective image quality with EuroCMR criteria scores: comparison between Cineref and CSrt image sets.
Objective European CMR Criteria ScoresCSrt
01–34–67–10TotalMedian (Range)
Cineref0110021 (0–5)
1–325422069
4–600000
7–1000000
Total26432071
Median (range)3 (0–3)p < 0.0001
The significance of Wilcoxon signed-rank test is defined by values of p < 0.05. Red values represent patients for whom CSrt score was equivalent to or better than that of Cineref for n = 68/71 patients (95.8%). Abbreviations: CMR, cardiac magnetic resonance; Cineref, reference segmented cine; CSrt, real-time compressed sensing cine; EuroCMR, European CMR registry.
Table 6. Subjective overall image quality scores: comparison between Cineref and CSrt image sets.
Table 6. Subjective overall image quality scores: comparison between Cineref and CSrt image sets.
Subjective Overall Quality ScoresCSrt
1234TotalMedian (Range)
Cineref153150233 (1–3)
25621032
30213015
400101
Total101150071
Median (range)2 (1–4)p < 0.0001
The significance of Wilcoxon signed-rank test is defined by values of p < 0.05. Red values represent patients for whom CSrt score was equivalent to or better than that of Cineref for n = 64/71 patients (90.1%). Abbreviations: Cineref, reference segmented cine; CSrt, real-time compressed sensing cine.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Longère, B.; Allard, P.-E.; Gkizas, C.V.; Coisne, A.; Hennicaux, J.; Simeone, A.; Schmidt, M.; Forman, C.; Toupin, S.; Montaigne, D.; et al. Compressed Sensing Real-Time Cine Reduces CMR Arrhythmia-Related Artifacts. J. Clin. Med. 2021, 10, 3274. https://doi.org/10.3390/jcm10153274

AMA Style

Longère B, Allard P-E, Gkizas CV, Coisne A, Hennicaux J, Simeone A, Schmidt M, Forman C, Toupin S, Montaigne D, et al. Compressed Sensing Real-Time Cine Reduces CMR Arrhythmia-Related Artifacts. Journal of Clinical Medicine. 2021; 10(15):3274. https://doi.org/10.3390/jcm10153274

Chicago/Turabian Style

Longère, Benjamin, Paul-Edouard Allard, Christos V Gkizas, Augustin Coisne, Justin Hennicaux, Arianna Simeone, Michaela Schmidt, Christoph Forman, Solenn Toupin, David Montaigne, and et al. 2021. "Compressed Sensing Real-Time Cine Reduces CMR Arrhythmia-Related Artifacts" Journal of Clinical Medicine 10, no. 15: 3274. https://doi.org/10.3390/jcm10153274

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop