Abstract
(1) Background: Resting tremor is a motor manifestation present in most Parkinson’s disease (PD) patients. For its assessment, several scales have been created, but mobile applications could help in objectively assessing resting tremor in PD patients in person and/or remotely in a more ecological scenario. (2) Methods: a systematic review following the PRISMA recommendations was conducted in scientific databases (PubMed, Medline, Science Direct, Academic Search Premier, and Web of Science) and in the main mobile application markets (Google Play, iOS App Store, and Windows Store) to determine the applications available for the assessment of resting tremor in patients with PD using only the measurement components of the phone itself (accelerometers and gyroscopes). (3) Results: 14 articles that used mobile apps to assess resting tremor in PD were included, and 13 apps were identified in the mobile application markets for the same purpose. The risk of bias and of applicability concerns of the articles analyzed was low. Mobile applications found in the app markets met an average of 85.09% of the recommendations for the development of medical mobile applications. (4) Conclusions: the use of mobile applications for the evaluation of resting tremor in PD patients has great potential, but validation studies for this purpose are scarce.
1. Introduction
Parkinson’s disease (PD) is a neurodegenerative pathology characterized by a chronic, progressive, and irreversible evolutionary course in which there is a selective degeneration of the dopaminergic neurons of the substantia nigra of the midbrain [,]. This fact results in the four characteristic motor manifestations of the disease: bradykinesia, resting tremor, muscle rigidity, and postural instability []. Moreover, PD also exhibits non-motor alterations such as digestive disorders, sleep disturbances, and behavioral and cognitive changes that can precede motor symptoms for years [,].
Among the movement disorders present in PD is resting tremor, defined as an involuntary, rhythmic, and oscillatory movement of a body segment in the absence of movement [,]. It is usually an initial manifestation in 50% of cases, and it is present in 70–85% of all patients with PD []. Resting tremor is usually found in the distal area of the extremities and has a frequency between 3 and 6 Hz []. To assess tremor, there are several scales, although most of those available focus on intentional tremor []. Among those that focus on resting tremor, the Fahn–Tolosa–Marín Tremor Scale scores the tremor’s location, severity, and functional disability produced by it as being the most used both in the clinic and in research []. The Bain and Findley Clinical Tremor Scale scores the severity of tremors from 1 to 10 in different areas of the body []. Likewise, within section III of the Unified Parkinson’s Disease Rating Scale (UPDRS) there are items for resting tremor that asses the amplitude (measured in centimeters, with a tremor above 3 cm being severe) and the total time that tremor appears during the examination (measured as the percentage of time that it appears, with a tremor considered severe if it appears above 75% of the time of the examination) []. However, all these scales have a subjective component of assessment; there is a lack of objective tools that help to identify the worsening of a resting tremor, as well as to be able to weigh the effects of pharmacological and/or rehabilitation treatment in PD.
In the last years, the development of information and digital technology has allowed a change in the health paradigm and a new way of relating to health [,]. Among these advances, mHealth (information and communication technologies using mobile phones and/or tablets for medical purposes) stands out for both patients and professionals []. For patients with PD, the use of mobile applications has allowed them to immediately and inexpensively access a community of people with whom to interact, to obtain more information about their disease, to receive help to remember to take their medication, as well as access to other tools that facilitate their daily activities. For professionals, the use of mobile applications can allow a more agile and objective assessment of certain parameters, the planning and recommendation of treatment, and the follow-up of patients with PD quickly and accurately, overcoming the barriers of distance and time [,].
Specifically, the presence of tremor in the different stages of PD is a prognostic factor of functional impairment []. Therefore, having an easily applicable monitoring evaluation such as an app could facilitate the therapeutic needs of the patient in the evolutionary process of the disease. Consequently, it could be assumed that the use of mobile applications could allow an objective assessment of resting tremor in PD.
To our knowledge, two previous systematic reviews have been published regarding the use of mobile applications in PD [,]. Both studied the use of apps aimed at both treatment and assessment globally in PD. The present review focused on articles in scientific databases and on mobile applications available in the app market at the time. Another main difference between the previous systematic reviews and the present work is that our research focused on addressing the use of mobile applications using only the measurement components of the phone itself (a phone´s accelerometer and gyroscope) in patients with PD. In contrast to previous studies, we only included studies in which resting tremor was measured without voluntary activity of the patient (we did not include assessments through Archimedes’ spiral). Finally, we also analyzed the studies from the point of view of diagnostic reliability and application according to the recommendations for the development of medical mobile applications.
Therefore, the purpose of this work was to analyze the available evidence on mobile applications as well as the mobile apps available in the app markets, using only the measurement components of the phone itself, for the assessment of resting tremor in patients with PD.
2. Materials and Methods
2.1. Design
A systematic review was carried out following the recommendations of the PRISMA statement (Preferred Reporting Items for Systematic reviews and Meta-Analyses) for the development of systematic reviews and meta-analyses [].
2.2. Search Strategy
An information search was conducted in electronic databases and other sources of information specific to the field of mobile applications (app markets) following the methodology of previous work on this subject [,].
Two independent reviewers carried out bibliographic searches in the following databases: PubMed, Medline, Science Direct, Academic Search Premier, and Web of Science, as well as a cross-search through references found in articles from these sources. In the case of a discrepancy, it was resolved by a third independent investigator.
The search strategy used in the databases and the search filters are detailed in Table 1.
Table 1.
Database search strategy.
2.3. Eligibility Criteria
Articles published between 2011 and 2021 in Spanish and English were considered. The lower limit of 2011 was chosen since the first reference in relation to the development of a mobile application in PD was described in that year [].
The criteria for inclusion of articles for the systematic review were: (a) Patients diagnosed with idiopathic PD according to the criteria of the Brain Bank []. (b) Original studies published in electronic databases with patients, regardless of their methodological design. (c) Apps that used the measurement components of the phone itself (accelerometers and gyroscopes). (d) Assessment of resting tremor. (e) Articles in English or Spanish.
In parallel to the search in biomedical databases, a search was carried out for mobile applications related to resting tremor in PD in the main markets of mobile applications of Android (Google Play), iOS (App Store), and Windows Phone (Windows Store) systems.
In the absence of a strict protocol for searching mobile applications, it was conducted following the methodology of a previous systematic review on mobile applications in neurorehabilitation []. In the first phase, applications related to resting tremor from the bibliographic search were included. Subsequently, applications from the app markets were added. From all the apps, data were collected on the name, the operating system, the price, the type of user the app addressed, its logo, and a brief description of use.
2.4. Extracting Information and Managing Data
The following data were extracted: number and characteristics of participants; measurement protocol; outcome results; name and main features of the apps such as operating system; type of user; and a brief description.
2.5. Assessing the Quality of Evidence
To evaluate the methodological quality of the included articles, the QUADAS-2 scale was administered for a diagnostic test. This scale determines the risk of bias and clinical applicability of a study test, assigning a high, low, or unclear probability of risk of bias across four domains. As a result, a table and graph are presented in which the risk of bias and the applicability of the scale are visualized [].
To quantify the level of risk of bias, a high, low, or unclear probability is assigned to four domains of the scale (patient selection, index test, baseline test, and flow times). This score is guided by questions to help judge the risk of bias dichotomously (affirmative/negative).
Similarly, for the clinical applicability of the tool, the domains of patient selection, index test, and reference test are scored. In this section of the scale, there are no guiding questions, but a question is always formulated to be solved. In the case of applicability in patient selection, it would be questioned whether there is a concern that the application of the diagnostic test being evaluated did not match the review topic.
To evaluate the quality of mobile applications found in the app markets, a critical analysis was carried out based on the “Recommendations for the design, use and evaluation of health apps” published by the “Junta de Andalucía” (Spain) in 2012. Aspects of design and relevance, quality and security of information, provision of services, and confidentiality and privacy were evaluated. All applications included in this review were assessed according to these quality criteria [].
3. Results
A total of 185 articles were screened that were identified in the databases consulted. After removing duplicates and screening by title and abstract based on eligibility criteria, a total of 14 articles were included [,,,,,,,,,,,,,]. The screening process is presented in the flowchart in Figure 1.
Figure 1.
Flowchart of the bibliographic search.
3.1. Participants
A total of 510 individuals participated in the 14 studies included in this systematic review: 287 patients diagnosed with PD, 53 diagnosed with essential tremor, 1 diagnosed with Holmes Tremor, 7 undiagnosed, 12 patients that showed an undiagnosed tremor, 15 patients with dopamine transport deficit, 123 healthy participants, and 2 subjects without tremor.
3.2. Apps in Databases
Fourteen studies were analyzed in which nine mobile applications were presented to detect resting tremor in people with PD. The main characteristics of the articles included in the systematic review are presented in Table 2.
Table 2.
Characteristics of the studies included in the review.
The methodological design of all articles found was observational: nine were specificity/sensitivity articles, two were diagnostic concordance studies [,], and three were descriptive observational [,,].
Ten articles used mobile applications marketed for or pending commercialization [,,,,,,,,,]. Only Chen et al. [] in 2020 used the same mobile application that Lipsmeier et al. [] used in 2018 in their study to create a sophisticated and accurate computer model, with a study design very similar to that of Lipsmeier et al. []. The remaining articles were based on applications exclusively designed for such scientific studies [,,,].
Two of the articles included in our systematic review described in detail the computer process for obtaining the data [,]. Chronowski et al. [] presented the computer model used to analyze the data of the application, concluding that despite the good accuracy it could not yet be used as a diagnostic tool because it showed 85% diagnostic accuracy, which the authors considered insufficient. Chen et al. [] used data from two previous experiments in which participants carried a smartphone in a special case that was attached to the upper limb to collect data of resting tremor with the application “Roche PD Mobile Application v1”. Then, they designed the computer model to analyze this data, concluding that the most significant variables to discriminate between patients with PD and healthy participants were resting tremor and dexterity.
Despite the importance of medication in the control of resting tremor, nine of the articles did not detail whether they performed the measurements in periods “on” or “off” medication [,,,,,,,,,,]. Both Kostikis et al. [] and Barrantes et al. [] performed the measurements in periods “on” medication and only Kassavetis et al. [] did so in the “off” period of the medication.
Only two authors compared mobile apps with another objective tool for detecting resting tremor [,]. Araujo et al. [] compared an app with needle electromyography in key upper limb muscles, and Brummelen et al. [] compared the results of two mobile applications with an accelerometer under laboratory conditions. In both articles, a good correlation was found between the measurements of the mobile applications and the indicated diagnostic tools.
In seven of the articles, the aim was to determine the presence of PD compared to healthy participants with the detection of resting tremor by a mobile application [,,,,,]. Barrantes et al. [] and Woods et al. [] proposed mobile applications to differentiate between PD and essential tremor according to the difference in amplitude between these two types of tremor.
Although most articles used the UPDRS scale to measure the initial health status in patients, only four articles additionally correlated the results obtained through the mobile applications and the items intended for the assessment of tremor in the UPDRS (section III). In all of them, a significant correlation was found for resting tremor [,,,].
In relation to the resting tremor assessment protocol, six authors evaluated it by tying the mobile phone to the patient’s hand for 30 s in a relaxed position [,,,,,]. The rest of the authors evaluated it by letting the tool rest on the palm of the hand [,,], actively holding it in the hand [,,], or using the smartphone but without specifying how [,]. Only three articles recorded daytime tremor, including activities of daily living (ADLs), with good results in distinguishing between healthy participants and patients with resting tremor [,,].
3.3. App Markets
In the search carried out in the main mobile application markets (Google Play Store, iOS App Store, and Windows App Store), 13 apps available for the evaluation of resting tremor in PD were selected, of which 4 were available in the Google Play Store and 9 in the iOS App Store, while 1 was available on both platforms. Figure 2 shows the search process. Table 3 presents the operating system, the type of user, the cost, the language, and a brief description of use of each of the apps.
Figure 2.
Flowchart of the search for mobile applications in app markets.
Table 3.
Main features of apps for the assessment of resting tremor in PD.
Of the 13 apps found, 9 were free and 4 were not; taking into account the type of user at whom they were aimed, 2 of them were intended for use by patients, 5 by professionals, and 6 by both professionals and patients.
Of the 13 applications analyzed, 7 were designed exclusively to measure tremor quantitatively, while the remaining 6 apps also allowed the evaluation of other symptoms such as balance, oral tremor, gait, bradykinesia, and cognitive symptoms. Of all the articles analyzed, only the mobile application described by Araujo et al. [] from the bibliographic search was available in the application markets, specifically for the iOS system, to measure tremor in amplitude, frequency, and power both by professionals and by the patients themselves.
3.4. Quality of Evidence
The results regarding the methodological quality of the articles and their risk of bias are detailed in Figure 3 and Table 4. Overall, the risk of bias presented in the included articles was low. However, regarding the index test (the diagnostic tool that was evaluated), it should be noted that in most cases there was an uncertain risk of bias. This is due to the lack of information in the articles about the threshold to determine the positivity or negativity of the test. The lack of information on whether the authors knew the results of the reference test before knowing the results of the index test is also remarkable, and that is considered to increase the chances of bias.
Figure 3.
Risk of bias of the articles analyzed.
Table 4.
Risk of bias of selected articles.
The quality of the apps found was measured by “The recommendations of the Junta de Andalucía for the design of health applications” []. Table 5 shows the main characteristics of the apps in terms of design and relevance, the quality and security of information, the provision of services, and confidentiality and privacy. The average percentage of compliance of the included apps, according to the criteria described, was 85.09%.
Table 5.
Main quality characteristics of the apps analyzed.
4. Discussion
To achieve the objective of this review, a total of 14 articles [,,,,,,,,,,,,,] were analyzed in which 9 mobile applications were presented. Further, 13 applications available in the app markets were identified.
Six articles used tremor evaluation through apps as a diagnostic tool in people with PD, people with essential tremor, and healthy participants [,,,,,]. However, none of these studies aimed to validate the app as a diagnostic instrument for tremor but only as a screening tool among people with or without the presence of tremor. In this sense, only two studies compared the measurements made through mobile applications (“LiftPulse”, “iSeismometer”, “StudyMyTremor”, “Make Helsinki app”, “Centre for Human Drug Research app”) with an objective validation tool, namely, needle electromyography and an accelerometer in laboratory conditions, finding a good correlation between both measurements [,]. Nevertheless, of the five applications studied by these authors, only “StudyMyTremor” is currently available on the market.
To determine the suitability of the apps as instruments to monitor the health status of people with PD, the concordance of two apps (“Roche PD Mobile Application v1”and “Sentient Tracking of Parkinson’s”) with UPDRS was studied [,,,]. The authors used this scale as a reference measure because it is the most used in the clinical field even though other scales such as the Fahn–Tolosa–Marín Scale have shown to be more sensitive to changes in tremor associated with exogenous factors such as the use of medication [,]. These apps showed a good correlation with UPDRS when both measuring instruments were applied in the same way for tremor recording. Only in the study by Woods et al. [], tasks evaluated through the app were modified regarding those proposed in the UPDRS scale, including distraction tasks, and with different focuses of attention. Data provided by both instruments showed that resting tremor behaved differently when the patient was asked to perform tasks involving cognitive processes, with the results differing in patients with PD and ET.
Although most of the authors proposed a very similar protocol regarding the assessment of tremor (patient seated with their arms along their body in a relaxed position), variability was observed in terms of the smartphone location. Some authors tied the smartphone to the patient’s hand allowing it to be relaxed [,,,,,], while others asked patients to actively grasp the smartphone [,,] or hold it on the palm of their hand with the forearm in supination [,,]. This lack of homogeneity in the assessment generates doubts about the results of these measurements, since only patients who were assessed with the smartphone tied to their hand would be truly at rest. Moreover, in our systematic review, 9 of the 14 articles did not specify whether patients were in on/off periods of medication [,,,,,,,,]. The data need to be taken with caution, since the absence of information on the methodology of the included studies makes comparison between them difficult.
Two previous systematic reviews about the use of apps in PD were identified [,]. One of them studied apps available in different operating systems (iOS and Android) []. The other review classified the types of apps and their usefulness for assessment and/or treatment in PD []. However, the aim of the current review was to analyze the use of apps only in resting tremor in PD patients. The review by Linares-del Rey et al. [] included five articles on the measurement of resting tremor and eight apps in the app markets. In this review, three of these articles were included, and the remaining two were excluded because they were conferences [,,]. In the review by Estévez-Martín et al. [] that only analyzed the app markets, 25 applications for measuring tremor at rest were found. This difference in the applications found between the present review and the ones carried out by Linares-del Rey et al. [] and Estévez-Martín et al. [] is because the present study did not include applications that measured tremor during a specific task, such as writing or drawing (Archimedes’ spiral), to assess resting tremor. Another main difference between the previous systematic reviews and the present one is that our research was focused on addressing the use of mobile applications using only the measurement components of the phone itself (the phone´s accelerometer and gyroscope) in patients with PD.
The methodological quality of the articles included in this review showed a low risk of bias. However, the risk of bias in the index test (the one being validated) was mostly uncertain. This was because in most articles it was unknown whether the authors knew the result of the reference test before performing the validation of their tool. It was also unknown how much time elapsed between the two assessments, which also increases the risk of bias. Regarding the applicability, a low risk was found except for the reference test, since many articles do not correlate the score obtained through mobile applications with the UPDRS. To our knowledge, there are no previous reviews that have studied the risk of bias from research on apps in the assessment of resting tremor in PD. However, in the review conducted by Linares del Rey et al. [] the JADAD scale was included to assess the methodological quality of the studies found, regardless of their aim, although this scale could only be administered to 17 of the 26 articles due to the type of study (research protocols). Having used different tools to assess the methodological quality, it is not possible to make a comparison between the articles included in both reviews. Therefore, in the present review we decided to use the QUADAS-2 scale to assess the quality of the studies, since they were observational studies, and this scale is specifically designed to assess the quality of diagnostic tools included in a systematic review.
As for the applications found in the app markets, 13 available apps were identified, in contrast to the review by Linares del Rey et al. [] in which, of the 8 apps found that focused on the assessment of resting tremor, only 2 (“StudyMyTremor” and “Tremor12”) remain on the market. Moreover, 5 of the 23 applications in the review by Estévez-Martín et al. [] remain on the market (“cloudUPDRS”, “StudyMyTremor”, “Tremor12”, “Tremor Measurer”, and “Parkinson’s Lifekit”). This indicates that the market for mobile applications as an instrument for measuring health status is volatile. This lack of maintenance of the apps on the servers also makes it difficult to transfer the scientific evidence to clinical use.
Most authors highlight a lack of quality standards that allow users to determine the most suitable apps for their choice [,,]. That is why, in this systematic review, we relied on the recommendations of the Junta de Andalucía of 2012 for the design, use, and evaluation of health apps []. There are other quality criteria such as those of Belloch-Ortí [] created for the choice of multimedia resources in terms of qualitative criteria of general description, typology, requirements, technical characteristics, and aesthetic aspects. However, the criteria of the Junta de Andalucía were chosen since they are specifically designed for mobile applications in health. In general, the apps fulfilled their function and were easy to handle; only two apps (“Tremor Measurer” and “Tremor Measurer lite”) from the same developer were considered unintuitive and did not present clear guidelines. In addition, there were six apps (“ParkinsonAI”, “Tremor Measurement”, “Patana AI”, “StudyMyTremor”, “Tremor Measurer Lite”, and “TREMOR12”) whose developers had not shared the privacy policy with the sales platform, although the user can request it after downloading. This finding indicates a high risk in terms of data protection. Finally, there is only one application (“Patana AI”) that lacks revisions or updates, so its use may be discouraged due to the lack of review of the contents. It should be noted that most of the apps found would not have been validated in their a clinical context, nor approved by health agencies as proposed by Meulendijk et al. []. The only application found in the app market that was also found in the literature search in the study by Araujo et al. [] was “StudyMyTremor”.
The results of this systematic review highlight the gap between research and commercial fields. While the papers analyzed include different methodologies for the design and evaluation of mobile applications, the available applications for assessing resting tremor in patients with PD have great variability in their quality characteristics and their validation process (if they exist). For this reason, future research should consider our findings to improve the relationship between the development of a mobile application and its validation in order to provide reliable and valid instruments to patients and health professionals. Firstly, research is needed to validate an app as a diagnostic instrument for resting tremor in patients with PD, comparing its results with objective instruments such as electromyography, accelerometers, inertial sensors, etc. Secondly, a comparison between the results obtained by an app and sensitive clinical scales such as the Fahn–Tolosa–Marín Scale and Bain and Findley Clinical Tremor Scale is needed due to their wide and easy use in clinical contexts. Thirdly, the protocol of evaluation should be better stablished because although most of the authors proposed a protocol with the patient seated with their arms along their body in a relaxed position, the smartphone location must be better defined; the smartphone should be located and tied to the patient’s hand, allowing it to be relaxed since resting tremor is present when no action is required. Fourthly, if medication effects are being tested by an app, data must be recorded in “on” and “off” periods of medication to have a complete characterization of resting tremor in patients with PD. However, if data are being taken as rehabilitation results, the results should be mainly taken in the “on” phase of the medication cycle, as this is the period during which patients perform most of their activities of daily living. Fifthly, the few applications that have proven to be valid and reliable are not available on the market except two (“StudyMyTremor” and “Tremor12”), indicating that app markets are too volatile and separated from the research field. Sixthly, the apps used should follow quality standards to determine their choice, paying special attention to aspects related to data protection, possible updates, and usability. Future studies must consider patients’ perceptions about using apps for resting tremor assessment since none of the mobile applications found in the app markets passed this examination; moreover, in the study by Motolese et al. 2020 [] not all the participants were satisfied with the app when asked about it. So, future studies should address this issue. Given all this, it is necessary that scientists and the commercial industry make an effort to validate the apps available on the market or favor the development of apps that demonstrate their reliability and validity prior to making them available to patients and professionals to minimize errors and associated risks.
The present systematic review has several limitations. Firstly, the uncertain risk shown by the QUADAS-2 scale in some items calls for caution when recommending the use of certain apps in the assessment of resting tremor in PD. Secondly, due to the constant change in the application markets and their updates, some applications present in this review may not be available in the future or could be used with other devices such as tablets or smartwatches. Finally, the limitation of the language of the articles included (English and Spanish), as well as those derived from the inclusion criteria, could have meant that not all mobile applications of interest were included at the time of the search.
5. Conclusions
The present systematic review identified 14 articles that used mobile apps to assess resting tremor in PD patients. In addition, 13 apps were identified in the mobile application markets for the same specific purpose. The risk of bias and the risk of applicability concern of the articles analyzed were low. The mobile applications found in the app markets met an average of 85.09% of the recommendations for the development of medical mobile applications.
Mobile apps that are easy to manage and offer objective data could be beneficial for detecting and monitoring changes in resting tremor in PD patients. This could allow an easier and more precise monitorization of pharmacological and rehabilitation approaches for patients with PD. Therefore, the use of mobile applications for evaluating resting tremor in PD patients seems to have great potential. However, validation studies are necessary to recommend their use prior to their commercialization.
Author Contributions
Conceptualization, P.M.-d.-E. and R.C.-d.-l.-C.; methodology, P.M.-d.-E., R.M.O.-G., and R.C.-d.-l.-C.; writing—original draft preparation, P.M.-d.-E. and P.M.-C.; writing—review and editing, P.M.-d.-E., P.M.-C., R.M.O.-G., S.S., and R.C.-d.-l.-C.; supervision, P.M.-C. and R.C.-d.-l.-C. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Kalia, L.V.; Lang, A.E. Parkinson’s disease. Lancet 2015, 386, 896–912. [Google Scholar] [CrossRef]
- Obeso, J.A.; Stamelou, M.; Goetz, C.G.; Poewe, W.; Lang, A.E.; Weintraub, D.; Burn, D.; Halliday, G.M.; Bezard, E.; Przedborski, S.; et al. Past, present, and future of Parkinson’s disease: A special essay on the 200th Anniversary of the Shaking Palsy. Mov. Disord. 2017, 32, 1264–1310. [Google Scholar] [CrossRef]
- Sveinbjornsdottir, S. The clinical symptoms of Parkinson’s disease. J. Neurochem. 2016, 139, 318–324. [Google Scholar] [CrossRef] [PubMed]
- Gövert, F.; Becktepe, J.; Deuschl, G. The new tremor classification of the International Parkinson and Movement Disorder Society: Update on frequent tremors. Nervenarzt 2018, 89, 376–385. [Google Scholar] [CrossRef]
- Hallett, M. Parkinson’s disease tremor: Pathophysiology. Park. Relat. Disord. 2012, 18, 85–86. [Google Scholar] [CrossRef] [PubMed]
- Elble, R.; Bain, P.; Forjaz, M.J.; Haubenberger, D.; Testa, C.; Goetz, C.G.; Leentjens, A.F.G.; Martinez-Martin, P.; Traon, A.P.; Post, B.; et al. Task force report: Scales for screening and evaluating tremor: Critique and recommendations. Mov. Disord. 2013, 28, 1793–1800. [Google Scholar] [CrossRef] [PubMed]
- Ondo, W.; Hashem, V.; LeWitt, P.A.; Pahwa, R.; Shih, L.; Tarsy, D.; Zesiewicz, T.; Elble, R. Comparison of the Fahn-Tolosa-Marin Clinical Rating Scale and the Essential Tremor Rating Assessment Scale. Mov. Disord. Clin. Pract. 2017, 5, 60–65. [Google Scholar] [CrossRef]
- Forjaz, M.J.; Ayala, A.; Testa, C.M.; Bain, P.G.; Elble, R.; Haubenberger, D.; Rodriguez-Blazquez, C.; Deuschl, G.; Martínez-Martín, P. Proposing a Parkinson’s disease-specific tremor scale from the MDS-UPDRS. Mov. Disord. 2015, 30, 1139–1143. [Google Scholar] [CrossRef]
- Shaw, T.; McGregor, D.; Brunner, M.; Keep, M.; Janssen, A.; Barnet, S. What is eHealth? Development of a Conceptual Model for eHealth: Qualitative Study with Key Informants. J. Med. Internet Res. 2017, 19, e324. [Google Scholar] [CrossRef]
- Sociedad Digital en España: 2020–2021. Available online: https://www.fundaciontelefonica.com/cultura-digital/publicaciones/sociedad-digital-en-espana-2020-2021/730/ (accessed on 20 March 2022).
- La Revolución del mHealth en Salud: De las Apps al Dato de Salud Integrado. Available online: https://www.ehcos.com/la-revolucion-del-mhealth-en-salud/ (accessed on 20 March 2022).
- Linares-del Rey, M.; Vela-Desojo, L.; Cano-de la Cuerda, R. Mobile phone applications in Parkinson’s disease: A systematic review. Neurología 2017, 34, 38–54. [Google Scholar] [CrossRef] [PubMed]
- Sánchez-Rodríguez, M.T.; Collado-Vázquez, S.; Martín-Casas, P.; Cano-de la-Cuerda, R. Neurorehabilitation and apps: A systematic review of mobile applications. Neurología 2015, 33, 313–326. [Google Scholar] [CrossRef] [PubMed]
- Velseboer, D.C.; Broeders, M.; Post, B.; van Geloven, N.; Speelman, J.D.; Schmand, B.; de Haan, R.J.; de Bie, R.M.; CARPA Study Group. Prognostic factors of motor impairment, disability, and quality of life in newly diagnosed PD. Neurology 2013, 80, 627–633. [Google Scholar] [CrossRef] [PubMed]
- Estévez-Martín, S.; Cambronero, M.E.; García-Ruiz, Y.; Llana, L. Mobile Applications for People with Parkinson’s Disease: A Systematic Search in App Stores and Content Review. J. Univers. Comput. Sci. 2019, 5, 740–763. [Google Scholar]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Int. J. Surg. 2021, 372, 71. [Google Scholar] [CrossRef]
- Hughes, A.J.; Daniel, S.E.; Kilford, L.; Lees, A.J. Accuracy of clinical diagnosis of idiopathic Parkinson’s disease: A clinic-pathological study of 100 cases. J. Neurol. Neurosurg. Psychiatr. 1992, 55, 181–184. [Google Scholar] [CrossRef] [PubMed]
- Whiting, P.F.; Rutjes, A.W.S.; Westwood, M.E.; Mallett, S.; Deeks, J.J.; Reitsma, J.B.; Leeflang, M.M.G.; Sterne, J.A.C.; Bossuyt, P.M.M.; QUADAS-2 Group. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann. Intern. Med. 2011, 155, 529–536. [Google Scholar] [CrossRef]
- Recomendaciones para el Diseño, Uso y Evaluación de Apps de Salud. Available online: http://www.calidadappsalud.com/recomendaciones/ (accessed on 24 March 2022).
- Araújo, R.; Tábuas-Pereira, M.; Almendra, L.; Ribeiro, J.; Arenga, M.; Negrão, L.; Matos, A.; Morgadinho, A.; Januário, C. Tremor Frequency Assessment by iPhone® Applications: Correlation with EMG Analysis. J. Park. Dis. 2016, 6, 717–721. [Google Scholar] [CrossRef]
- Barrantes, S.; Egea, A.J.S.; Rojas, H.A.G.; Martí, M.J.; Compta, Y.; Valldeoriola, F.; Mezquita, E.S.; Tolosa, E.; Valls-Solè, J. Differential diagnosis between Parkinson’s disease and essential tremor using the smartphone’s accelerometer. PLoS ONE. 2017, 12, 0183843. [Google Scholar] [CrossRef]
- Van Brummelen, E.M.J.; Ziagkos, D.; De Boon, W.M.I.; Hart, E.P.; Doll, R.J.; Huttunen, T.; Kolehmainen, P.; Groeneveld, G.J. Quantification of tremor using consumer product accelerometry is feasible in patients with essential tremor and Parkinson’s disease: A comparative study. J. Clin. Mov. Disord. 2020, 7, 4–7. [Google Scholar] [CrossRef] [PubMed]
- Chen, O.Y.; Lipsmeier, F.; Phan, H.; Prince, J.; Taylor, K.I.; Gossens, C.; Lindemann, M.; de Vos, M. Building a Machine-Learning Framework to Remotely Assess Parkinson’s Disease Using Smartphones. IEEE Trans. Biomed. Eng. 2020, 67, 3491–3500. [Google Scholar] [CrossRef] [PubMed]
- Chronowski, M.; Kłaczyński, M.; Dec-Cwiek, M.; Porębska, K.; Sawczyńska, K. Speech and Tremor Tester—Monitoring of Neurodegenerative Diseases using Smartphone Technology. Diagnostyka 2020, 2, 31–39. [Google Scholar] [CrossRef]
- Fraiwan, L.; Khnouf, R.; Mashagbeh, A.R. Parkinson’s disease hand tremor detection system for mobile application. J. Med. Eng. Technol. 2016, 40, 127–134. [Google Scholar] [CrossRef] [PubMed]
- Garcia-Magarino, I.; Medrano, C.; Plaza, I.; Olivan, B. A smartphone-based system for detecting hand tremors in unconstrained environments. Pers. Ubiquitous Comput. 2016, 20, 959–971. [Google Scholar] [CrossRef]
- Kassavetis, P.; Saifee, T.A.; Roussos, G.; Drougkas, L.; Kojovic, M.; Rothwell, J.C.; Edwards, M.J.; Bhatia, K.P. Developing a Tool for Remote Digital Assessment of Parkinson’s Disease. Mov. Disord. Clin. Pract. 2015, 3, 59–64. [Google Scholar] [CrossRef] [PubMed]
- Kostikis, N.; Hristu-Varsakelis, D.; Arnaoutoglou, M.; Kotsavasiloglou, C. A Smartphone-Based Tool for Assessing Parkinsonian Hand Tremor. IEEE J. Biomed. Health Inform. 2015, 19, 1835–1842. [Google Scholar] [CrossRef]
- Kuosmanen, E.; Wolling, F.; Vega, J.; Kan, V.; Nishiyama, Y.; Harper, S.; Van Laerhoven, K.; Hosio, S.; Ferreira, D. Smartphone-Based Monitoring of Parkinson Disease: Quasi-Experimental Study to Quantify Hand Tremor Severity and Medication Effectiveness. JMIR Mhealth Uhealth 2020, 8, 21543. [Google Scholar] [CrossRef]
- Lipsmeier, F.; Taylor, K.I.; Kilchenmann, T.; Wolf, D.; Scotland, A.; Schjodt-Eriksen, J.; Cheng, W.-Y.; Fernandez-Garcia, I.; Siebourg-Polster, J.; Jin, L.; et al. Evaluation of Smartphone-Based Testing to Generate Exploratory Outcome Measures in a Phase 1 Parkinson’s Disease Clinical Trial. Mov. Disord. 2018, 33, 1287–1297. [Google Scholar] [CrossRef]
- Motolese, F.; Magliozzi, A.; Puttini, F.; Rossi, M.; Capone, F.; Karlinski, K.; Stark-Inbar, A.; Yekutieli, Z.; Di Lazzaro, V.; Marano, M. Parkinson’s Disease Remote Patient Monitoring During the COVID-19 Lockdown. Front. Neurol. 2020, 11, 567413. [Google Scholar] [CrossRef] [PubMed]
- Pan, D.; Dhall, R.; Lieberman, A.; Petitti, D.B. A mobile cloud-based Parkinson’s disease assessment system for home-based monitoring. JMIR Mhealth Uhealth 2015, 3, 29. [Google Scholar] [CrossRef]
- Woods, A.M.; Nowostawski, M.; Franz, E.A.; Purvis, M. Parkinson’s disease and essential tremor classification on mobile device. Pervasive Mob. Comput. 2014, 13, 1–12. [Google Scholar] [CrossRef]
- Tosin, M.H.S.; Goetz, C.G.; Luo, S.; Choi, D.; Stebbins, G.T. Item Response Theory Analysis of the MDS-UPDRS Motor Examination: Tremor vs. Nontremor Items. Mov. Disord. 2020, 35, 1587–1595. [Google Scholar] [CrossRef] [PubMed]
- Raciti, L.; Nicoletti, A.; Mostile, G.; Bonomo, R.; Dibilio, V.; Donzuso, G.; Sciacca, G.; Cicero, C.E.; Luca, A.; Zappia, M. Accuracy of MDS-UPDRS section IV for detecting motor fluctuations in Parkinson’s disease. Neurol. Sci. 2019, 40, 1271–1273. [Google Scholar] [CrossRef] [PubMed]
- Zayas-García, S.; Cano-De-La-Cuerda, R. Mobile applications related to multiple sclerosis: A systematic review. Rev. Neurol. 2018, 67, 473–483. [Google Scholar] [PubMed]
- Mobile Medical Applications. Guidance for Industry and Food and Drug Administration Staff. Available online: http://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/UCM263366.pdf (accessed on 24 March 2022).
- Belloch Ortí, C. Evaluación de las Aplicaciones Multimedia: Criterios de Calidad. Available online: https://www.uv.es/bellochc/pdf/pwtic4.pdf (accessed on 24 April 2022).
- Meulendijk, M.; Meulendijks, J.; Paul, A.; Edwin, N.; Mattijs, E. What concerns users of medical apps? Exploring non functional requirements of medical mobile applications. In Proceedings of the European Conference on Information Systems (ECIS), Tel Aviv, Israel, 9–11 June 2014. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).








