Next Article in Journal
Land Cover Patterns of Urban Lots and Their Contribution to Ecological Functions
Previous Article in Journal
Exploring Characteristics of Regenerative Business Models through a Delphi-Inspired Approach
Previous Article in Special Issue
Cultivating Sustainability: Quebec’s Living Labs as Ecological Catalysts
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Perspective

Digital Twins for Supporting Ageing Well: Approaches in Current Research and Innovation in Europe and Japan

1
Information Systems and New Media, University of Siegen, 57072 Siegen, Germany
2
Smart Aging Research Centre, Tohoku University, Sendai 980-8577, Japan
3
AIST AI Research Centre, AIST Tokyo Waterfront, 3-4-7-Aomi Koto-ku, Tokyo 135-0064, Japan
4
Sarah Janböcke ODR GmbH on Behalf of Smart Aging Research Centre, Tohoku University, 45219 Essen, Germany
5
IMT Atlantique, Bretagne—Pays de la Loire, École Mines-Télécom, 44300 Nantes, France
6
IRCCS INRCA, 60124 Ancona, Italy
7
Dipartimento di Ingegneria Industriale e Scienze Matematiche, Università Politecnica delle Marche, 60121 Ancona, Italy
*
Author to whom correspondence should be addressed.
Sustainability 2024, 16(7), 3064; https://doi.org/10.3390/su16073064
Submission received: 7 February 2024 / Revised: 13 March 2024 / Accepted: 19 March 2024 / Published: 7 April 2024

Abstract

:
One of the central social challenges of the 21st century is society’s aging. AI provides numerous possibilities for meeting this challenge. In this context, the concept of digital twins, based on Cyber-Physical Systems, offers an exciting prospect. The e-VITA project, in which a virtual coaching system for elderly people is being created, allows the same to be assessed as a model for development. This white paper collects and presents relevant findings from research areas around digital twin technologies. Furthermore, we address ethical issues. This paper shows that the concept of digital twins can be usefully applied to older adults. However, it also shows that the required technologies must be further developed and that ethical issues must be discussed in an appropriate framework. Finally, the paper explains how the e-VITA project could pave the way towards developing a Digital Twin for Ageing.

1. Introduction

1.1. Content and Structure of the Paper

With the project “e-VITA” (“EU-Japan Virtual Coach For Smart Aging”), we as a consortium aim to make a significant contribution to the development of AI for the aging society. In doing so, we are following a preventive approach, corresponding to the concept of “Active and Healthy Aging” of the WHO. A central concern of ours is to make AI accessible for older people (60+) and to let this steadily growing group of people benefit from its potential. In concrete terms, the e-VITA project is about developing a virtual coach for older adults, designed to support wellbeing maintenance. Among other things, the coaching system includes diverse applications for smartphones or tablets, various instruments for recording personal data, such as sensors, and a selection of embodiments (further information about the e-VITA project can be found in Section 5.1).
We are intensively studying innovative technologies in the research area around AI for the aging society. As our research and development processes have progressed, it has become apparent that the coaching system parallels the technology of so-called digital twins (DTs), which enable the digital representation of physical systems. We believe that technologies of this kind offer a promising approach to the concept of Active and Healthy Aging. At the same time, we know that transferring the concept of DT, which originated in the industry field, to people raises several ethical questions. The focus questions are: Under what conditions can the concept of digital twins be transferred to older adults? Which aspects must be considered?
The present white paper explores these questions. It provides a compact and understandable description of DT technology, how a DT for Ageing (DTA) could be designed, which ethical aspects need to be considered, and how the work done in the e-VITA project could pave the way towards developing a DTA. The paper is structured as follows. Below, the problem to which DTAs offer an answer is described: the aging of society. Following this, we introduce terms that are relevant to the discussion of the questions raised, including explanations of the terms “Industry 4.0”, “Society 5.0”, and “Digital Twins for Ageing”. In addition, we give an overview of the current state of research around digital twins for wellbeing. Then, selected findings from the research areas, (1) digital human activity recognition, (2) personalized communication via intelligent conversational agents, (3) markers determining the detection of health, and (4) measurement systems for data acquisition, are compiled. In a further step, we present reflections on ethical issues. Finally, we introduce the e-VITA project and the extent to which the project findings offer indications for developing DTAs. The paper then closes with reflections on the outlook.

1.2. Ageing Society and the Role of Cyber-Physical Systems

Demographic aging is a process that is taking place worldwide. Two trends are decisive for this: the increase in life expectancy on the one hand and the decline in birth rates on the other. The resulting changes in the population structure can be considered one of the most significant challenges for society in the twenty-first century. The challenge is to meet the growing need for care appropriately. Already, today, there is a considerable imbalance between people with care needs and people who can perform care activities. Care deficits are the result.
A critical approach commonly applied to address the challenge of the nursing shortage is the use of technology. There is an arguable tendency to advocate technological solutions without due recognition of alternatives. This article also emphasizes the advantages and opportunities of using technology in (health)care, but it should be mentioned that other solutions must also be considered, such as improvements in working conditions. All-in-all, change must be recognized as fundamentally socio-technical.
Although demographic change can be observed in all industrialized nations, one country in particular stands out: Japan. The process is taking place very rapidly here. The Japanese government is meeting this challenge (among others) with the strategy of creating a “Society 5.0”, “a society in which future generations can live in abundance while satisfying the needs of the present generation”. To achieve such a society, the Japanese government’s sixth “Science, Technology, and Innovation Basic Plan” (2021) envisages “to reform the economic and social systems […] in a manner that addresses the declining birth rate and aging population and changes in the economy and society” [1]. In concrete terms, the idea is to apply the concept of Cyber-Physical Systems (CPS) to society and its members. The approach of developing digital versions of physical systems originates from the industrial sphere. Here, with the help of artificial intelligence, both individual machines and entire companies are digitally mapped nowadays. The terms “4th industrial revolution” or “Industry 4.0” are also used in this context. In principle, the concept of DTs can be applied to all systems, including living ones such as people or societies. This is currently taking place in Japan, and it is conceivable that other countries will follow.

2. Digital Twins

2.1. “Industry 4.0” in Germany and “Society 5.0” in Japan

Digitalization gathered momentum in the 2010s when computing capabilities increased and became powerful enough to process enormous amounts of data from a growing number of sensors installed that collect data about our everyday lives. Humans can no longer analyze this so-called Big Data, but artificial intelligence can now find patterns and draw conclusions. In 2014, Germany was one of the first countries to introduce a dedicated strategy to address digitalization (“High-Tech Strategy”). The strategy covers many fields, like digital economy and society, sustainable management and energy, innovation within the world of work, healthy living, smart mobility, and civil security [2]. Although healthy living was part of the strategy, the digital transformation started first in the industry, which is the economy’s most powerful sector and has sufficient resources. Soon, the term ‘Industry 4.0’ emerged, meaning the 4th Industrial Revolution. This revolution is based on linking physical systems with cyber systems, which use sensors and other network technology to provide connectivity. Together, they constitute Cyber-Physical Systems (CPS). Every asset, from simple machines to entire factories and their value chains, can be represented by an exact digital model with all its functions, the DT [3]. Using the DT, data about the functioning of the physical system are collected and analyzed with AI. This procedure allows the creation of a matching simulation of the real system’s functioning, thus enabling better optimization than possible without the DT. A machine, for example, is equipped with several sensors that collect data concerning, for instance, vibrations. The AI system can now detect if some continuous measurements are outside the expected ranges [3]. As a result, the necessity for maintenance can be detected at an early stage. Such “predictive maintenance” reduces machine downtime and is being applied in new business models in which customers pay for the number of parts produced (“Pay Per Use”).
DTs can help to simulate processes, make predictions, and avoid malfunctions, for all systems, including living ones such as people or entire societies. With the concept of Society 5.0, the Japanese government is following this approach. The government’s sixth “Science, Technology, and Innovation Basic Plan” states the following in this regard: “In Society 5.0, every element of society will be built as a digital twin in cyberspace, restructured in terms of systems, business design, urban and regional development, etc., and then reflected in physical space to transform society”.

2.2. Human Digital Twins: State of Research

DT technology uses recent advances in AI. Deep learning techniques, increased computer capability, and cloud computing provide possibilities for platforms and architectures that enable increased accuracy in modeling the functioning and structure of real-world objects in a digital environment. Traditional applications range from models describing jet engines or buildings to more complex entities like factory plants and cities for monitoring and optimization purposes. A DT is an abstraction of any object or process used to achieve a particular goal, and it helps model the operations and functions needed to achieve the goal. From this perspective, it can be said that DTs have been available as long as modeling of the natural world has been conducted in science and society. A new aspect is that DTs transform the power of modeling to a virtual world, where virtual and augmented reality transforms the experience of the natural world, i.e., the model is not only an abstraction of the external world which the user can modify and manipulate, but it is part of the user experience, immersed in physical reality.
The increased power of cloud and data analytics techniques allows simulation of the world beyond the traditional representation of objects, operations, and processes toward modeling and predicting the functioning of complex systems. Interest in DT technology is rapidly growing from typical manufacturing tasks towards areas of humanities, social science, and policy making. Virtual, augmented, extended, and immersive reality applications provide a vast repertoire of tools and platforms to apply the DT concept to various environments and settings. For instance, DT models have been used for fitness management, healthcare, and physical activities. The Singapore Project studies urban planning and policy-making with “city digital twins”, while DTs as human workers are also discussed [4,5,6].
Concerning DTs of humans (HDT), it is clear that an exact simulation of the entire “system” is not yet possible. However, DTs can already store a lot of descriptive data about a person, e.g., sex, age, and weight, as well as medical data, medical history, etc. Since the concept of a human DT is relatively new, there is no uniform definition. Miller and Spatz (2022) [7] suggest defining a human DT as “an integrated model which facilitates the description, prediction, or visualization of one or more characteristics of a human or class of humans as they perform within a real-world environment”. They divide the attributes that can be modeled into the following categories: (1) physical, (2) physiological, (3) perceptual performance, (4) cognitive performance, (5) personality characteristics, (6) emotional state, (7) ethical stance, and (8) behavior. Depending on the purpose of an HDT system, different categories have priority. These different conceptual priorities are also apparent in the wide range of terms that are (non-uniformly) used in HDT research, e.g., WDT for wellbeing digital twin or, as in this paper, DTA for digital twin for ageing. Boulos and Zhang speak of different types of human DTs [8]. They elaborate that twins of the whole human body exist, twins of only one body system or function, twins of single organs, and twins designed for specific diseases or disorders. Further, they speak of “composite digital twins” that integrate two or more types of those described and “reference digital twins” or “proto-twins” that serve as templates or archetypes for building more complex, individualized digital twins of each type.
Meanwhile, DT technology is considered an exciting and promising approach for the healthcare field. A key phrase in this context is that of personalized medicine, which focuses on making medical treatments more effective. This is achieved by paying more attention to variables that differ from person to person (such as genetic makeup, lifestyle, and environmental factors). It is not uncommon today to use data collecting and processing technologies to monitor and improve health status. Speaking about this fact, Boulos and Zhang mention activity trackers, diet monitors, and telemedicine services, for example [8]. With the help of DTs, individual personal data of this kind can be combined into larger aggregates, i.e., digital copies of persons, at least in parts. This would not only make treatment for existing problems more effective, but it would also allow prognoses to be made and preventative interventions to be initiated in a targeted manner. Lehrach (2016) even suggests that HDT will be used to compare the expected success of different treatment options and to select the most promising method [9].
In the area of DTs for wellbeing, several applications are presented, including applications for the detection of liver disease [10], ischemic heart disease detection [11], fitness management [4], blood circulation analysis [12], and trauma management [13], for example. Ferdousi et al. (2021) also report on the progress in industrial production of corresponding products. The products/services they list include the following: (1) a 3D Heart Twin from Siemens, (2) a simulation to assist in sensualizing data from multiple sources to generate a DT of a hospital for testing alternatives from GE wellbeing, (3) a patient-centered treatment using DTs of patients from IBM, (4) a 3D model of a live heart from Dassault Systèmes, (5) a testbed (5G connectivity) from NHS, (6) a comprehensive modeling system for treatment simulations from Digitwins and (7) AI-enabled cardiac models from Phillips. The authors note that many prominent companies compete in HDT development [14].

2.3. Digital Twins for Ageing

The term “Digital Twins for Ageing” refers to DTs designed as digital copies of elderly people to help this target group maintain a high quality of life. Even though it is common in science and politics today to view the life phase of (old) age from a positive, resource-oriented perspective, old age also brings complex challenges. Havighurst’s (1972) model of age-specific developmental tasks, which has shaped the social sciences’ understanding of lifelong development since its publication in the mid-20th century to the present day, holds, for example, that people in the life phase of “later maturity” (61+) typically face the developmental tasks of adapting to decreasing strength and health, coping with retirement, and adjusting to a lower income and establishing satisfactory living quarters [15].
It is plausible to assume that using digital copies will help older adults cope more easily with the challenges typical of their stage of life. The Japanese government expects that AI will make it possible to reduce burdens, predict the onset or worsening of illnesses at an early stage, and enable people to remain in their own homes. Ultimately, these new possibilities are also intended to reduce medical and social costs. Data that are considered helpful to collect for these purposes include realtime personal physiological data (e.g., body weight, heart rate, GPS info, glucose level, blood pressure, temperature, and respiration rate), medical data, and environmental information. Based on the detection of overweight, high blood pressure, and a worrisome cardiogram that today’s smartwatches can already record, it should be possible to recognize a person’s body’s pathological condition and recommend a visit to the doctor, for instance. Today, a DT of a heart can help optimize treatment or find the best location for a cardiac pacemaker.

3. Components for Creating DTA

3.1. Human Activity Recognition and Digital Twins for Smart Homes

Human Activity Recognition (HAR) is the process of monitoring and analyzing the behavior of one or more people to infer their activity. In a smart home context, HAR is about monitoring the daily activities of residents based on a network of devices installed in the home. Thanks to this monitoring, a smart home can offer personalized home assistance services to improve its residents’ quality of life, autonomy, and wellbeing, especially for older adults or people with impairments. With the development of the Internet of Things and the rise of powerful and inexpensive smart devices, smart homes based on ambient sensors have become viable technical solutions for providing various services, such as comfort, automation, security, and aging. Activities of daily living (ADLs) are performed as part of daily living to ensure self-care. The information gathered by the smart home helps detect potential drifts, anomalies, and threats to older adults’ health, comfort, or happiness, as Soulas (2016) [16] proposed. Beyond the hardware, those services also need algorithms to exploit the potential. However, optimizing HAR in smart homes is a crucial and challenging problem because human activity is complex and varies from one resident to another. Each resident has a different lifestyle, different habits, and abilities. The wide range of ADLs and the variability and flexibility of how they can be performed requires an evolutionary and adaptive approach.
As Bouchabou et al. (2021) [17] note, HAR, in general, has recently progressed in the development of new deep learning algorithms for end-to-end classification, such as convolutional neural networks [18] or fully connected networks [19]. It also benefits from recent sequence learning algorithms, such as long-short-term memory [20]. However, recognizing ADLs in a smart home is a difficult task. Thus, algorithms must analyze sparse and irregular time series to generalize to different situations across houses, equipment, household members, or habits. Training machine learning algorithms to be deployed in test cases on such heterogeneous data is a significant challenge. To address the gap between training data and use case data, generating more realtime data could be a solution.
Thanks to the DT concept, it would be possible to realize this. DTs of this type are termed Digital Twins for Smart Homes (DTHS) in the following. For HAR, a DT could be a digital copy of a target house with the same sensors installed. In this digital environment, one or more avatars could perform ADLs by modeling the complex behaviors of residents. In this way, the DTSH could be used to refine the final algorithms before deployment in the target house. DTSH could also be used to generate data from numerous houses, household configurations, and resident habits, providing the possibility of faster simulations and automatic labeling without the cost of sensors. In addition, DTSH can be used to assess the correct positioning and selection of sensors to recognize a predefined list of activities of interest.
The objective, therefore, could be to create DTSH that can reproduce real homes and the composite activities of residents using programs, i.e., sequences of actions and atomic interactions, and then to play these activities and generate time series of synthetic data similar to those produced by an IoT network in the natural environment. The ability to quickly and efficiently produce a DTSH of the human user’s environment can help develop customized assistive solutions. Simulators, such as OpenSSH [21], focus on the interactive simulation of people in houses equipped with home automation sensors, with the limit that it requires a human actor to label activities progressively. Gazebo [22] and V-REP [23] are used for modeling sensors and computer vision systems for robotics. Another notable project is Habitat 2.0 [24], a highly photorealistic and efficient 3D platform that trains simulated robots in interactive environments. VirtualHome [25] is a simulator that has multiagent functionality, thus allowing the scripting of actions to be attributed to the avatar(s) and the reproduction of scenarios. In addition, whole properties can be replicated, including walls, furniture, and objects. The practical and technical aspects of creating DTSH using off-the-shelf available sensors and software need to be investigated to address the high variability of house and household configurations. A DTSH can, on the one hand, be built using a priori information (e.g., architectural plans, comments, and contributions from inhabitants), but on the other hand, sensory input data can also be used (e.g., home automation, IoT, robot sensors, etc.). The corresponding smart house can be scanned with a depth camera (handheld or on a robot), and then a SLAM (Simultaneous Localization and Mapping) algorithm, commonly used for robot navigation [26], can create a dense 3D point cloud of it. Modeling software such as Blender or Gazebo could then build CAD (computer-aided design) models of the house and its objects from the point cloud data. Detecting the categories of objects of interest (e.g., tables, chairs, etc.) and their position could have several advantages in a DTSH context. The YOLO-v3 (You Only Look Once) algorithm [27] enables object detection and recognition and can, therefore, deduce the semantics of scanned furniture and objects.

3.2. Personalized Communication Using Smart Conversational Agents

Virtual agents are widely used in interaction studies, ranging from animated characters on the screen to realistic human simulations. Replication of the whole human in a digital world is still more like science fiction, but development is progressing rapidly in animation and augmented reality. Research in modeling human behavior is being conducted, including various aspects of natural communication skills and their imitation. This involves not only auditory information for automatic speech recognition [28,29] and speaker analysis (also called Computational Paralinguistics [30], but also the use of visual information like multimodal face [31,32], hand gesturing [33], and body movements [34,35], as well as other sensor information like tactile, olfactory, and gustatory [36], as well as artificial neurons [37] and the whole cognition [38].
Virtual agent technology has long been efficiently used to create virtual agents, avatars, and bots for various interactive applications. Such Embodied Conversational Agents can be personalized concerning their appearance but also concerning their interaction capabilities, including multimodal aspects such as gesturing, facial expressions, laughter, etc., to investigate the impact of various communicative signals on the fluency and satisfaction of the human-agent interaction. Similarly, in social robotics, personalized interactions are designed and developed to include multimodality in the advanced dialogue models to address various communicative needs of the users. For instance, Yaghoubzadeh et al. (2013) discusses virtual agents as daily assistants for older adults [39], and Sakai et al. (2012) present a listener robot agent for older adults [40].
Embodied conversational agents, intelligent virtual agents, and social robotics developed for various applications are examples of extensive research combining the virtual world, AI, and communication technologies to create intelligent social agents that could act as companions, counselors, or instructors in real-world applications. Overviews of the research topics, technologies, as well as opportunities and challenges for building applications, are provided by Jokinen and Wilcock (2017) [41] and Wan et al. (2020) [37].
Also, the teleoperation of humanoid robots includes advanced research issues related to integrating human cognitive skills and expertise with the capabilities of humanoid robots. Applications range from robots acting as physical avatars of human workers to robots assisting humans in tasks requiring high accuracy (telesurgery) or communicative capabilities (telenursing). An overview of the technological and methodological advances is provided by Darvish et al., 2023 [42]. The authors also extensively discuss potential applications. A spoken dialogue system allows users to interact with a virtual coach conversationally by taking turns in a dialogue to accomplish a task or engage in a conversation. This type of interaction is potentially more accessible and intuitive for older persons than navigating menus and drop-down boxes on a traditional user interface or typing in text and manipulating objects on a small mobile device [43]. On the other hand, personalized interactive systems are also prone to high expectations of fluent human-like conversational capabilities and various issues in speech-based applications, especially for elderly users, as Young and Mihailidis (2010) [44] elaborated.
With advanced speech technology, personalized interactive systems are expected to be further developed to become more reliable and robust in their speech recognition and generation capabilities. Progress has been made in recognizing speech from various age groups (young, middle-aged, and elderly users) and users with different emotional and physiological characteristics. For example, Luz et al. (2021) present an approach to the automatic detection of Alzheimer’s type dementia based on characteristics of spontaneous spoken language dialogue [45], and Cummins et al. (2023) identify different speech markers related to the onset and progress of MDD (major depressive disorder) across speakers of three different languages [46]. Baird et al. (2021) evaluated speech-based markers to analyze stress [47], and Grabowski et al. (2019) surveyed the tools enabled by modern technology for emotional expression research for clinical treatment strategies [48].
Investigations related to effective computing technology are also widely conducted. Many studies deal with mapping facial and paralinguistic parameters to basic emotions. Parada-Cabaleiro (2023) discuss advances in emotion classification, pointing out that “the basic six” (fear, anger, disgust, happiness, surprise, and sadness) may not be feasible when dealing with the wide range of human affective states [49]. When using automatic classifications on real-life data, it is helpful to analyze the confusion between the categories to deal with the intrinsic ambiguities of emotions. In this line, studies on recognizing the user’s state of health, like having a cold [50], have been conducted, while Borna et al. (2023) review pain detection based on automatic voice analysis [51]. Other research studies the emotional and physiological reactions of users when interacting with an artificial agent. Consequently, the results are used to design and improve the agent’s interaction strategies toward more natural and engaging communication capabilities [52], which can also be helpful in therapy situations [53].
Personalized, automated AI agents have significant potential for assisting humans and supporting daily life activities. However, in the social domain, where humans and their communication are in the focus for developing effective socio-conversational systems and technological applications, this kind of research and development also brings forward various challenging issues related to ethics and trust, which are widely discussed (see for example [54,55]). The same AI technologies can also be applied for the more ambitious task of building digital twins of the users in social health and elder-care domains, and thus ethical questions such as how to best use the digital twins, what kind of functional capabilities are needed, what kind of expectations they raise in the users, etc. need to be carefully considered when developing digital twins.

3.3. Markers Determining the Detection of Health

The use of the concept of a DT in the health sector comes along with the revolution posed by the personalized medicine (PM) approach, as the final aim of any DT is the provision of a plethora of helpful information to depict the person’s profile and, thus, to design patient-centric interventions. In 2005, the EU Council defined PM as “a medical model using the characterization of individuals’ phenotypes and genotypes (e.g., molecular profiling, medical imaging, lifestyle data) for tailoring the right therapeutic strategy for the right person at the right time, and to determine the predisposition to disease and to deliver timely and targeted prevention” [56]. Prevention, early detection of diseases, and monitoring their progression are the main objectives of the PM approach, in addition to supporting health professionals in making precise diagnoses. By designing and developing DTs for health, it would be possible to put the aims promoted by the PM concept into practice, allowing the identification and reproduction of clinical subtypes of patients, for example, to understand the underlying mechanisms of pathologies, the intercorrelations between the environment and the individuals or to discover innovative pathways for supporting the intrinsic capacity in a preventive perspective.
In the case of aging, DTs may represent a critical factor in making the mechanisms underlying the complexity of aging processes more transparent. For this reason, some authors have suggested addressing the challenge posed by applying DT technologies for the health management of older patients for precision and personalized medicine, along with the realization of real innovative healthcare solutions based on combining clinical needs with the virtual world [57].
A DTA will need high-quality and voluminous data collected from the spectrum of health measurements. Medical imaging technologies can provide one stream of data for the DT. The significant categories of imaging include Magnetic Resonance Imaging (MRI), Computed Tomography (CT), X-ray, Positron Emission Tomography (PET), and ultrasound imaging. MRI has a wealth of research supporting evaluations for aging, especially regarding the brain, and large MRI databanks have been established worldwide [58]. PET imaging has been shown to track the progress of Alzheimer’s disease [59]. CT scanning has also been used in the context of brain aging. It can show changes associated with the normal aging of the brain [60]. The taking of X-rays is a routine and low-cost procedure. It has been shown that X-ray imaging can function as a biomarker for the assessment of cardiovascular aging, using a deep learning analysis [61]. Further, in the context of digital twins for hearts, Philips uses ultrasound [62].
Considering that nowadays health analysis takes place at a molecular and cellular level, it is to be expected that genomics tests and cellular-level screening will provide a platform for DT technology. Such tests are already becoming personalized, with direct-to-consumer sales and analysis. Given the complexity of aging, explanations of the leading networks and mechanisms underlying this process are of enormous relevance to the scientific communities. Despite the advances determined by the availability of high-throughput data, the capability of interpreting such evidence remains a significant challenge for research in the field [63]. Although aging-related physiological changes are well-known, their molecular correlates must be thoroughly investigated [64].

3.4. Measurement Systems for Data Acquisition

Measurement systems to monitor health and wellbeing will be essential in developing DTAs. Data can be acquired by sensors installed in the living environment and worn by the user to extract information that covers all aspects of the user’s health and quality of life. Nowadays, the number of sensors and systems for monitoring user health and wellbeing in the market is vast, with a growing preference for low-cost, non-invasive, and user-friendly sensors [65]. In addition, mobile sensors are preferred, responding to changes that may occur in the environment. Sensors installed in the environment and wearable sensors are the most used to extract user-related features and parameters. Since seniors spend most of their time in their immediate living environment (more than 90%) [66], remote monitoring with sensors installed in the living environment is more frequently applied to measurement without being invasive for the user. Intelligent environments are usually equipped with PIR sensors (Passive InfraRed sensors) combined with door, light, and energy consumption monitoring sensors to understand user behavior inside the home, respecting the user’s privacy [67]. Through the acquisition of these data, it is possible to identify the activities carried out by the user during the day and to extract more detailed information such as ADL (activity of daily living) which, in an extended period, can provide information regarding the variations of user habits and, thus, can be declined with a progression of a disease or an improvement of lifestyle.
Data extracted from wearable sensors could provide a dynamic source of information for developing DTA. Wearable sensors can provide continuous data and signals regarding health status and user activities inside and outside the living environment. Smartwatches, wrist or chest bands, smartphones, etc., are increasingly used to monitor physiological parameters, e.g., heart rate, sleep patterns, level of stress, etc., and activity of the user, e.g., number of steps or distance traveled. Regarding these sensors, it is necessary to consider their measurement properties, which obviously influence the outputs in terms of accuracy [65].

4. Identification of Ethical Issues

It is beyond question that transferring the concept of DTs—originally embedded in industrial contexts—to older adults can bring many advantages for the members of this group. Nevertheless, from an ethical point of view, the endeavor is not without problems. We have already pointed out that humans are more complex than machines, but this is not the (only) point that needs to be discussed. An exceptional context is given regarding the digital mapping of older adults. On the one hand, it concerns a group of people who tend to have increased vulnerability, and on the other hand, the talk is about continuously collecting and processing data of private individuals. In the following, an attempt will be made to identify and explain different ethical issues related to the endeavor, wherein there are certainly some overlaps.

4.1. Strong Focus on Human Performance

Machines are digitally mapped to optimize production processes. It could be assumed that the concept of CPS is transferred to people expecting to increase their productivity. Ultimately, the expectation could be to make the whole of society more efficient. In this context, the question arises of whose objectives are at stake. Developing technologies for older people usually involves different parties, such as scientific disciplines, marketing companies, political actors, and service providers. While it is obvious that companies are primarily interested in increasing the productivity of machines, optimizing the productivity of society would instead be considered a strategic goal of government policy. Indeed, the establishment of new technologies for older people also has other political objectives than increasing their productivity: for example, contributing to their health and quality of life. However, ultimately, the two objectives are inter-related. It is at least not unreasonable to ask whether the aim is the wellbeing of the members of society or to profit from their workforce; it could even be called exploitation.
In principle, the interest in a healthy and productive society is legitimate. It is essential for the functioning of a society with apportionment-financed social security systems that the individual members should contribute to the functioning of their system. However, focusing unduly on the performance of individuals can also have a negative impact on social life. If the performance principle alone provides orientation, competition and outperforming are daily occurrences. At the same time, feelings of solidarity, which are crucial for the functioning of a society, can only be present to a minimal extent. Indeed, modern societies have the problem of being elbow societies. The problem is that transferring a concept designed for optimizing production processes to people or society could promote a strong focus on the idea of performance. This would be utterly contrary to the idea of an inclusive society.

4.2. Becoming “Glass Citizens”

Obviously, the problem also relates to ethical aspects concerning privacy and data protection. One characteristic of Industry 4.0 is the processing of large amounts of data. The state of the machine(s) in question, all processes taking place, and all relevant information from the surrounding systems are continuously digitally recorded and mapped. This makes the machine and the work processes transparent. When considering collecting and depicting data about older adults, the inquiry arises as to whom the information is rendering transparent. It can be assumed that sophisticated AI applications will make it increasingly difficult to understand and correctly interpret the data. It will hardly be possible for older people without the appropriate specialist knowledge. For this reason, the visualization of data for use by older people is an essential design issue.
In general, the collection and processing of data play an increasingly significant role in various domains of social life, particularly in healthcare. Consequently, the system’s constituent elements, namely, individuals, are becoming increasingly visible in this context. In other words, by using (digital) services, they become transparent citizens, also called “glass citizens”. Social sciences have been critically examining this topic for decades. Foucault’s panopticon (see “Discipline and Punish. The Birth of the Prison”, 1975) can be cited as an example. Deleuze’s continuation of Foucault’s reflections concerning digitalization (“Postscript on the Societies of Control”, 1990) should also be named in this context.

4.3. (No) Freedom of Choice

Less evident than the first two ethical aspects is the risk that freedom of choice will eventually be eliminated. This applies not only to the use of technologies such as DTs but also to all technologies that prove to be helpful in the maintenance of health or in the implementation of political strategies. Of course, it is a clear advantage that technology can contribute to maintaining health. Many people consider the new possibilities enriching and want to use them; numerous studies have already proved this. From an ethical point of view, there is nothing to be objected to in the fact that people use technology if they want to. Nor is there a conflict with them disclosing their data and allowing it to be processed. However, there are certainly also people who do not want to use technologies of this kind. Negative attitudes may also be displayed in the case of DTs. Be it that individuals do not want to disclose their data, be it that they do not want to be technically imaged (perhaps they feel restricted in some way) or be it because they do not want to know exactly how they would have to organize their everyday lives to stay healthy. Perhaps some people prefer to indulge their weaknesses instead of behaving excellently.
The scientific discourse on age and technology has repeatedly pointed out that there should never be coercion to use certain technologies and that technical products are developed only for those who want to use them. The question of freedom of choice could nevertheless arise in the future, for example, even in cases where services could be provided technologically with lower financial costs than by human hands. It is conceivable that cost savings will be used as an argument for using technology in future times. The issue needs to be discussed urgently. At this point, it should be explicitly stated that any form of coercion would contradict the right to the free development of the personality, regardless of whether direct or indirect sanctions are applied to a refusal of use. People must not be forced to use technology in any conceivable case.

4.4. Transhumanist Approach

Another aspect should also be considered when reflecting on the topic from an ethical point of view. A closer look reveals that a transfer of the concept of DTs to humans is moving in the direction of transhumanist approaches. To make this understandable, a few words should first be said about transhumanism or the idea behind it. The term transhumanism has several meanings. It means (1) a scientistic–futuristic-oriented community, which has its origin in Silicon Valley, (2) a technology-enthusiastic philosophical direction, which also has followers in the academic world, and (3) a stage of mankind, which is to be brought by the unrestricted use of technologies, hence the advocates of the approach. At its core, transhumanism aims to use technology to optimize the human organism with its cognitive, emotional, and moral capacities. Proponents of transhumanism affirm the unrestricted use of technology to advance evolution and optimize humanity purposefully.
The DT approach is about collecting and evaluating data on (among others) vital parameters, detecting (potential) health problems at an early stage, and implementing appropriate interventions. This is intended to maintain health, expand opportunities, and increase quality of life. In other words, the aim is to become “improved” people who, as far as possible, no longer have any illnesses. Even if it is impossible to map the brain with all its information—as some proponents of transhumanist thinking aim—the approach is at least to image everything that is realistically possible to bring improvements.
Indeed, from a technical point of view, realizing the visions associated with transhumanism is impossible in several respects. It may not be possible in 50 years, either. But what about in 100 years? What about 500? Thinking centuries ahead is not common in scientific discourses around age and technology. The main reason for this is most likely because conjecture is the only possibility. The further it must be thought into the future, the more difficult it becomes. There are countless possibilities of what can happen, what developments will take place, and what events will influence them.
On the other hand, the discipline of technology assessments is becoming increasingly meaningful. Even if it is “estimating” and running scenarios, it is still essential that it is done. The fact is that there is an increasing use of technology, and there is also the trend of humans and machines merging more and more. At the same time, alienation from nature is taking place. From a philosophical point of view, one can ask whether humanity has a duty to optimize itself through technology. This is not self-evident and must be discussed; DTs are an example that illustrates this very clearly.

5. “E-VITA” as Starting Point for the Development of DTAs

5.1. Project Description

“E-VITA: EU-Japan Virtual Coach for Smart Aging” is an EU–Japan joint project under Horizon 2020 and MIC funding. In four EU countries (Germany, Belgium, France, and Italy) and Japan, 22 partners are researching new technologies and methods to assist older adults. In Germany, the project is coordinated by the University of Siegen, chair for Information Systems and New Media, and in Japan by Tohoku University, Smart Aging Research Centre (SARC). The project aims to create an innovative coaching system based on the needs and wishes of older adults. The virtual coach will provide personalized recommendations and interventions to improve the quality of life of aging adults. At the same time, it is intended to enable SMEs and NGOs to explore the feasibility of a new ecosystem. It can be assumed that empowering older adults to manage their activities better will positively impact their wellbeing. Socio-technological support is expected to enable them to age “actively and healthily”, enhancing their quality of life.

5.2. From a Virtual Coach to a DTA

It must be explicitly mentioned that the virtual coach, developed in e-VITA, is not a DT but rather an assistant for elderly people and, thus, more of a “counterpart” than a twin. It is designed to provide dialogues with the user. Nevertheless, it became apparent during the progress of the project that there are clear parallels between the two technologies and that the coach’s development could—at least, to some extent—pave the way for developing a DTA. Even though the virtual coach is not designed for the systematic collection of data, as would have to be the case for a DTA, it is a rough approximation of such a technology. The “user profile” contains much information about the user. Physiological data, as well as data on activities, behavior patterns, and preferences, are collected. Furthermore, the coaching system developed in e-VITA uses the knowledge gained from ambient sensors in the users’ homes to understand the inhabitants’ activities and provide the most relevant advice possible.
The different components needed to create a DTA are described in Section 3. As part of developing the virtual coaching system, each area is addressed in e-VITA. However, even if e-VITA, with its holistic approach, strongly focuses on older adults’ needs, to build a fully working DT-environment that suits complex social systems like a Society 5.0 concept, research must exceed beyond the project. An important point for further research is that ethical aspects are seriously considered. The consortium partners agree on this. Ethical issues that play a specific role in DTA development and use have already been identified in Section 4. In the following section, considerations are given to handling the ethical issues.
The first problem identified in the section on ethical questions was that a strong performance orientation is inherent in transferring the concept of digital twins to people. Fortunately, however, the problem of performance orientation predominating within society has already been recognized by politics, also at the EU level and in Japan. A significant problem that has been (and still is) associated with the orientation on the performance principle is the social exclusion of people with disabilities. To stop this, the Convention on the Rights of Persons with Disabilities came into force. Since then, considerable progress has been made, but inclusion is still far from being realized. Implementing the idea would require perseverance, leisure, courage, and creativity. Abandoning the performance principle and enabling all people to participate in society would mean creating barrier-free conditions, in the physical world and social consciousness. From an ethical point of view, applying a concept like digital twins to people can only be legitimate if the focus is on the individual’s wellbeing and not on their ability to perform.
Politics has also intervened regarding the second of the aspects outlined, which concerns privacy and data protection. There have been some changes at the European level in the recent past, and some more are on the horizon. One milestone was undoubtedly reached when the GDPR came into force. In Japan, the GDPR does not apply, but the APPI does, and some adjustments have been made in the recent past. The understanding of data protection is very similar. In Article 5, the GDPR lays down various principles of data protection that must be observed when collecting and processing personal data: “lawfulness”, “fairness”, “purpose limitation”, “data minimization”, “accuracy”, “storage limitation”, “integrity and confidentiality”, “accountability”, and “transparency”. The requirement for transparency is one of the significant changes the GDPR brought, compared to the Data Protection Directive from 1995. One problem with implementing the principle of transparency now lies in how digital services present their information when collecting, processing, and storing personal data. Privacy statements are filled with legal phrases and usually have little relevance for users. In practice, there is still a need for improvement, particularly regarding the requirement for transparency. According to this, for a GDPR/APPI-compliant application of the concept of digital twins to humans, it must, firstly, be guaranteed that collected data are only shared when it is necessary or at least helpful, secondly, only to persons determined in advance, and, thirdly, only those vital parameters may be collected for which informed consent has been given.
Regarding the third aspect, freedom of choice, it is clear that a social system in which citizens are forced to use certain technologies or disclose personal data to minimize the financial burden would not be compatible with current human rights. People must be free to decide whether to use technology and what data they share. Against this background, explicit legal regulations could be helpful.
Finally, the fourth aspect (“transhumanist approach”) is worthy of consideration, even if currently speculative. Today, many interventions in the human organism are conceivable, even at the genetic material level, so that future generations will be even healthier. It can be discussed under the term “transhumanism” or simply under the words “expansion of possibilities through technological progress”, but it is essential to discuss in general what exactly we (do not) want, across disciplines and nations.

6. Outlook

Whether it is possible to transfer the DT concept to humans can be answered affirmatively. There are already numerous approaches to this in the research areas around public health and wellbeing. The integration of DT technology into the healthcare system is considered promising. Accordingly, well-known companies are already making efforts to develop HDT in the industrial sector. Insofar as the concept of DTs can be applied to persons, it can also be applied to elderly persons. The thought of making aging more comfortable with the help of CPS is an obvious one. During the development of a virtual coach for older adults within the e-VITA project, several insights were gained regarding considerations for developing DTA. Alongside the ongoing development of essential technical components, focusing on the ethical considerations elucidated in the article is particularly important. However, it could be shown that the use of DTA would not only improve the wellbeing of older adults on an individual level, but its systematic use could also make a valuable contribution at the level of society. What is unique about the idea of systematic use of Digital Twins for Ageing (DTA) is that it would not only have to be considered a compensatory solution for the shortage of qualified nurses but also a preventive one. Two main aims can be named: (1) to enable more and higher quality care by using technology and (2) to keep the amount of care needed low even though the population is aging. These aims could, for example, be achieved by early detection of problems such as the onset of disease. Although this approach is promising, there will be some challenges to overcome in terms of designing and developing technology as well as ethical considerations.

Funding

This article has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement N. 101016453 (e-VITA project). The Japanese consortium received funding from the Japanese Ministry of Internal Affairs and Communication (MIC), Grant no. JPJ000595. Special acknowledgement to the members of the e-VITA consortium and Tohoku University, Smart-Aging Research Center, for their support. This publication reflects only the view of the authors, and the European Commission and the MIC is not responsible for any use that may be made of the information it contains.

Data Availability Statement

No new data were created or analyzed in this study. Data sharing is not applicable to this article.

Acknowledgments

We thank Dave Randall, a senior professor at the University of Siegen, for his comments, which significantly improved the manuscript.

Conflicts of Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Government of Japan: “Science, Technology, and Innovation Basic Plan”. 2021. Available online: https://www8.cao.go.jp/cstp/english/sti_basic_plan.pdf (accessed on 26 March 2021).
  2. Federal Ministry of Education and Research Germany (BMBF): The New High-Tech Strategy—Innovations for Germany. Innovation Policy Issues Division, Berlin. 2024. Available online: https://Ec.Europa.Eu/Futurium/En/System/Files/Ged/Hts_broschuere_engl_bf_1.Pdf (accessed on 26 March 2021).
  3. Hill, R.; Devitt, J.; Anjum, A.; Ali, M. Towards In-Transit Analytics for Industry 4.0. In Proceedings of the 2017 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), Exeter, UK, 21–23 June 2017; pp. 810–817. [Google Scholar]
  4. Barricelli, B.R.; Casiraghi, E.; Gliozzo, J.; Petrini, A.; Valtolina, S. Human Digital Twin for Fitness Management. IEEE Access 2020, 8, 26637–26664. [Google Scholar] [CrossRef]
  5. Gámez Díaz, R.; Yu, Q.; Ding, Y.; Laamarti, F.; El Saddik, A. Digital Twin Coaching for Physical Activities: A Survey. Sensors 2020, 20, 5936. [Google Scholar] [CrossRef] [PubMed]
  6. Papyshev, G.; Yarime, M. Exploring City Digital Twins as Policy Tools: A Task-Based Approach to Generating Synthetic Data on Urban Mobility. Data Policy 2021, 3, e16. [Google Scholar] [CrossRef]
  7. Miller, M.E.; Spatz, E. A Unified View of a Human Digital Twin. Hum.-Intell. Syst. Integr. 2022, 4, 23–33. [Google Scholar] [CrossRef]
  8. Kamel Boulos, M.N.; Zhang, P. Digital Twins: From Personalised Medicine to Precision Public Health. J. Pers. Med. 2021, 11, 745. [Google Scholar] [CrossRef] [PubMed]
  9. Lehrach, H. The Future of Health Care: Deep Data, Smart Sensors, Virtual Patients and the Internet-of-Humans. 2016. Available online: https://docs.wixstatic.com/ugd/2b9f87_40d29af47a9742498cbbbd484e0174e0.pdf (accessed on 2 July 2021).
  10. Rao, D.J.; Mane, S. Digital Twin Approach to Clinical DSS with Explainable AI 2019. arXiv 2019, arXiv:1910.13520. [Google Scholar]
  11. Martinez-Velazquez, R.; Gamez, R.; El Saddik, A. Cardio Twin: A Digital Twin of the Human Heart Running on the Edge. In Proceedings of the 2019 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Istanbul, Turkey, 26–28 June 2019; pp. 1–6. [Google Scholar]
  12. Chakshu, N.K.; Sazonov, I.; Nithiarasu, P. Towards Enabling a Cardiovascular Digital Twin for Human Systemic Circulation Using Inverse Analysis. Biomech. Model. Mechanobiol. 2021, 20, 449–465. [Google Scholar] [CrossRef] [PubMed]
  13. Croatti, A.; Gabellini, M.; Montagna, S.; Ricci, A. On the Integration of Agents and Digital Twins in Healthcare. J. Med. Syst. 2020, 44, 161. [Google Scholar] [CrossRef] [PubMed]
  14. Ferdousi, R.; Laamarti, F.; Hossain, M.A.; Yang, C.; El Saddik, A. Digital Twins for Well-Being: An Overview. Digit. Twin 2021, 1, 7. [Google Scholar] [CrossRef]
  15. Havighurst, R.J. Developmental Tasks and Education, 3rd ed.; Longman: New York, NY, USA; London, UK, 1972; ISBN 978-0679300540. [Google Scholar]
  16. Soulas, J. Activity Monitoring through Home Automation Devices; Télécom Bretagne, Université de Bretagne Occidentale: Brest, France, 2016. [Google Scholar]
  17. Bouchabou, D.; Nguyen, S.M.; Lohr, C.; LeDuc, B.; Kanellos, I. A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learning. Sensors 2021, 21, 6037. [Google Scholar] [CrossRef] [PubMed]
  18. Tan, T.-H.; Gochoo, M.; Huang, S.-C.; Liu, Y.-H.; Liu, S.-H.; Huang, Y.-F. Multi-Resident Activity Recognition in a Smart Home Using RGB Activity Image and DCNN. IEEE Sens. J. 2018, 18, 9718–9727. [Google Scholar] [CrossRef]
  19. Bouchabou, D.; Nguyen, S.M.; Lohr, C.; LeDuc, B.; Kanellos, I. Fully Convolutional Network Bootstrapped by Word Encoding and Embedding for Activity Recognition in Smart Homes. In Proceedings of the Deep Learning for Human Activity Recognition, Kyoto, Japan, 8 January 2021; Li, X., Wu, M., Chen, Z., Zhang, L., Eds.; Springer: Singapore, 2021; pp. 111–125. [Google Scholar]
  20. Liciotti, D.; Bernardini, M.; Romeo, L.; Frontoni, E. A Sequential Deep Learning Application for Recognising Human Activities in Smart Homes. Neurocomputing 2020, 396, 501–513. [Google Scholar] [CrossRef]
  21. Alshammari, N.; Alshammari, T.; Sedky, M.; Champion, J.; Bauer, C. OpenSHS: Open Smart Home Simulator. Sensors 2017, 17, 1003. [Google Scholar] [CrossRef] [PubMed]
  22. Agüero, C.E.; Koenig, N.; Chen, I.; Boyer, H.; Peters, S.; Hsu, J.; Gerkey, B.; Paepcke, S.; Rivero, J.L.; Manzo, J.; et al. Inside the Virtual Robotics Challenge: Simulating Real-Time Robotic Disaster Response. IEEE Trans. Autom. Sci. Eng. 2015, 12, 494–506. [Google Scholar] [CrossRef]
  23. Rohmer, E.; Singh, S.P.N.; Freese, M. V-REP: A Versatile and Scalable Robot Simulation Framework. In Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan, 3–7 November 2013; pp. 1321–1326. [Google Scholar]
  24. Szot, A.; Clegg, A.; Undersander, E.; Wijmans, E.; Zhao, Y.; Turner, J.; Maestre, N.; Mukadam, M.; Chaplot, D.; Maksymets, O.; et al. Habitat 2.0: Training Home Assistants to Rearrange Their Habitat. arXiv 2021, arXiv:2106.14405. [Google Scholar]
  25. Puig, X.; Ra, K.; Boben, M.; Li, J.; Wang, T.; Fidler, S.; Torralba, A. VirtualHome: Simulating Household Activities via Programs. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; pp. 8494–8502. [Google Scholar]
  26. Labbé, M.; Michaud, F. RTAB-Map as an Open-Source Lidar and Visual Simultaneous Localization and Mapping Library for Large-Scale and Long-Term Online Operation. J. Field Robot. 2019, 36, 416–446. [Google Scholar] [CrossRef]
  27. Redmon, J.; Farhadi, A. YOLOv3: An Incremental Improvement. arXiv 2018, arXiv:1804.02767. [Google Scholar]
  28. Eyben, F.; Weninger, F.; Gross, F.; Schuller, B. Recent Developments in openSMILE, the Munich Open-Source Multimedia Feature Extractor. In Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, Spain, 21–25 October 2013; Association for Computing Machinery: New York, NY, USA, 2013; pp. 835–838. [Google Scholar]
  29. Domenici, N.; Sanguineti, V.; Morerio, P.; Campus, C.; Bue, A.D.; Gori, M.; Murino, V. Computational Modeling of Human Multisensory Spatial Representation by a Neural Architecture. PLoS ONE 2023, 18, e0280987. [Google Scholar] [CrossRef] [PubMed]
  30. Schuller, B.W.; Zhang, Y.; Weninger, F. Three Recent Trends in Paralinguistics on the Way to Omniscient Machine Intelligence. J. Multimodal User Interfaces 2018, 12, 273–283. [Google Scholar] [CrossRef]
  31. Baltrušaitis, T.; Robinson, P.; Morency, L.-P. OpenFace: An Open Source Facial Behavior Analysis Toolkit. In Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA, 7–10 March 2016; pp. 1–10. [Google Scholar]
  32. Cohn, J.F.; De la Torre, F. Automated Face Analysis for Affective Computing. In The Oxford Handbook of Affective Computing; Oxford Library of Psychology; Oxford University Press: New York, NY, USA, 2015; pp. 131–150. ISBN 978-0-19-994223-7. [Google Scholar]
  33. Wang, M.; Yan, Z.; Wang, T.; Cai, P.; Gao, S.; Zeng, Y.; Wan, C.; Wang, H.; Pan, L.; Yu, J.; et al. Gesture Recognition Using a Bioinspired Learning Architecture That Integrates Visual Data with Somatosensory Data from Stretchable Sensors. Nat. Electron. 2020, 3, 563–570. [Google Scholar] [CrossRef]
  34. Cao, Z.; Simon, T.; Wei, S.-E.; Sheikh, Y. Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017, Honolulu, HI, USA, 21–26 July 2017; pp. 7291–7299. [Google Scholar]
  35. Sanghvi, J.; Castellano, G.; Leite, I.; Pereira, A.; McOwan, P.W.; Paiva, A. Automatic Analysis of Affective Postures and Body Motion to Detect Engagement with a Game Companion. In Proceedings of the 6th International Conference on Human-Robot Interaction, Lausanne, Switzerland, 8–11 March 2011; Association for Computing Machinery: New York, NY, USA, 2011; pp. 305–312. [Google Scholar]
  36. Tan, H.; Zhou, Y.; Tao, Q.; Rosen, J.; van Dijken, S. Bioinspired Multisensory Neural Network with Crossmodal Integration and Recognition. Nat. Commun. 2021, 12, 1120. [Google Scholar] [CrossRef] [PubMed]
  37. Wan, C.; Cai, P.; Guo, X.; Wang, M.; Matsuhisa, N.; Yang, L.; Lv, Z.; Luo, Y.; Loh, X.J.; Chen, X. An Artificial Sensory Neuron with Visual-Haptic Fusion. Nat. Commun. 2020, 11, 4602. [Google Scholar] [CrossRef] [PubMed]
  38. Ritter, P.; Schirner, M.; McIntosh, A.R.; Jirsa, V.K. The Virtual Brain Integrates Computational Modeling and Multimodal Neuroimaging. Brain Connect. 2013, 3, 121–145. [Google Scholar] [CrossRef] [PubMed]
  39. Yaghoubzadeh, R.; Kramer, M.; Pitsch, K.; Kopp, S. Virtual Agents as Daily Assistants for Elderly or Cognitively Impaired People. In Proceedings of the Intelligent Virtual Agents, Edinburgh, UK, 29–31 August 2013; Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H., Eds.; Springer: Berlin/Heidelberg, Germany, 2013; pp. 79–91. [Google Scholar]
  40. Sakai, Y.; Nonaka, Y.; Yasuda, K.; Nakano, Y.I. Listener Agent for Elderly People with Dementia. In Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, Boston, MA, USA, 5–8 March 2012; Association for Computing Machinery: New York, NY, USA, 2012; pp. 199–200. [Google Scholar]
  41. Jokinen, K.; Wilcock, G. (Eds.) Dialogues with Social Robots: Enablements, Analyses, and Evaluation; Lecture Notes in Electrical Engineering; Springer: Singapore, 2017; Volume 427, ISBN 978-981-10-2584-6. [Google Scholar]
  42. Darvish, K.; Penco, L.; Ramos, J.; Cisneros, R.; Pratt, J.; Yoshida, E.; Ivaldi, S.; Pucci, D. Teleoperation of Humanoid Robots: A Survey. IEEE Trans. Robot. 2023, 39, 1706–1727. [Google Scholar] [CrossRef]
  43. Bickmore, T.W.; Caruso, L.; Clough-Gorr, K.; Heeren, T. ‘It’s Just like You Talk to a Friend’ Relational Agents for Older Adults. Interact. Comput. 2005, 17, 711–735. [Google Scholar] [CrossRef]
  44. Young, V.; Mihailidis, A. Difficulties in Automatic Speech Recognition of Dysarthric Speakers and Implications for Speech-Based Applications Used by the Elderly: A Literature Review. Assist. Technol. 2010, 22, 99–112. [Google Scholar] [CrossRef] [PubMed]
  45. Luz, S.; Haider, F.; De La Fuente Garcia, S.; Fromm, D.; MacWhinney, B. Editorial: Alzheimer’s Dementia Recognition through Spontaneous Speech. Front. Comput. Sci. 2021, 3, 780169. [Google Scholar] [CrossRef] [PubMed]
  46. Cummins, N.; Dineley, J.; Conde, P.; Matcham, F.; Siddi, S.; Lamers, F.; Carr, E.; Lavelle, G.; Leightley, D.; White, K.M.; et al. Multilingual Markers of Depression in Remotely Collected Speech Samples: A Preliminary Analysis. J. Affect. Disord. 2023, 341, 128–136. [Google Scholar] [CrossRef] [PubMed]
  47. Baird, A.; Triantafyllopoulos, A.; Zänkert, S.; Ottl, S.; Christ, L.; Stappen, L.; Konzok, J.; Sturmbauer, S.; Meßner, E.-M.; Kudielka, B.M.; et al. An Evaluation of Speech-Based Recognition of Emotional and Physiological Markers of Stress. Front. Comput. Sci. 2021, 3, 750284. [Google Scholar] [CrossRef]
  48. Grabowski, K.; Rynkiewicz, A.; Lassalle, A.; Baron-Cohen, S.; Schuller, B.; Cummins, N.; Baird, A.; Podgórska-Bednarz, J.; Pieniążek, A.; Łucka, I. Emotional Expression in Psychiatric Conditions: New Technology for Clinicians. Psychiatry Clin. Neurosci. 2019, 73, 50–62. [Google Scholar] [CrossRef]
  49. Parada-Cabaleiro, E.; Batliner, A.; Schmitt, M.; Schedl, M.; Costantini, G.; Schuller, B. Perception and Classification of Emotions in Nonsense Speech: Humans versus Machines. PLoS ONE 2023, 18, e0281079. [Google Scholar] [CrossRef] [PubMed]
  50. Deb, S.; Warule, P.; Nair, A.; Sultan, H.; Dash, R.; Krajewski, J. Detection of Common Cold from Speech Signals Using Deep Neural Network. Circuits Syst. Signal Process. 2023, 42, 1707–1722. [Google Scholar] [CrossRef] [PubMed]
  51. Borna, S.; Haider, C.R.; Maita, K.C.; Torres, R.A.; Avila, F.R.; Garcia, J.P.; De Sario Velasquez, G.D.; McLeod, C.J.; Bruce, C.J.; Carter, R.E.; et al. A Review of Voice-Based Pain Detection in Adults Using Artificial Intelligence. Bioengineering 2023, 10, 500. [Google Scholar] [CrossRef] [PubMed]
  52. Anzalone, S.M.; Boucenna, S.; Ivaldi, S.; Chetouani, M. Evaluating the Engagement with Social Robots. Int. J. Soc. Robot. 2015, 7, 465–478. [Google Scholar] [CrossRef]
  53. Esteban, P.G.; Baxter, P.; Belpaeme, T.; Billing, E.; Cai, H.; Cao, H.-L.; Coeckelbergh, M.; Costescu, C.; David, D.; Beir, A.D.; et al. How to Build a Supervised Autonomous System for Robot-Enhanced Therapy for Children with Autism Spectrum Disorder. Paladyn. J. Behav. Robot. 2017, 8, 18–38. [Google Scholar] [CrossRef]
  54. Gebhard, P.; Aylett, R.; Higashinaka, R.; Jokinen, K.; Tanaka, H.; Yoshino, K. Modeling Trust and Empathy for Socially Interactive Robots. In Multimodal Agents for Aging and Multicultural Societies: Communications of NII Shonan Meetings; Miehle, J., Minker, W., André, E., Yoshino, K., Eds.; Springer: Singapore, 2021; pp. 21–60. ISBN 9789811634765. [Google Scholar]
  55. Jokinen, K.; Wilcock, G. Do You Remember Me? Ethical Issues in Long-Term Social Robot Interactions. In Proceedings of the 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada, 8–12 August 2021; pp. 678–683. [Google Scholar]
  56. European Union: Official Journal of the European Union. Volume 58. 2015. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=OJ%3AC%3A2015%3A421%3AFULL (accessed on 4 February 2022).
  57. Liu, Y.; Zhang, L.; Yang, Y.; Zhou, L.; Ren, L.; Wang, F.; Liu, R.; Pang, Z.; Deen, M.J. A Novel Cloud-Based Framework for the Elderly Healthcare Services Using Digital Twin. IEEE Access 2019, 7, 49088–49101. [Google Scholar] [CrossRef]
  58. Taki, Y. Brain Aging Using Large Brain MRI Database. In Aging Mechanisms; Springer: Tokyo, Japan, 2015; pp. 291–302. ISBN 978-4-431-55762-3. [Google Scholar]
  59. Schöll, M.; Lockhart, S.N.; Schonhaut, D.R.; O’Neil, J.P.; Janabi, M.; Ossenkoppele, R.; Baker, S.L.; Vogel, J.W.; Faria, J.; Schwimmer, H.D.; et al. PET Imaging of Tau Deposition in the Aging Human Brain. Neuron 2016, 89, 971–982. [Google Scholar] [CrossRef] [PubMed]
  60. Meyer, J.S.; Takashima, S.; Terayama, Y.; Obara, K.; Muramatsu, K.; Weathers, S. CT Changes Associated with Normal Aging of the Human Brain. J. Neurol Sci. 1994, 123, 200–208. [Google Scholar] [CrossRef] [PubMed]
  61. Ieki, H.; Ito, K.; Saji, M.; Kawakami, R.; Nagatomo, Y.; Koyama, S.; Matsunaga, H.; Miyazawa, K.; Ozaki, K.; Onouchi, Y.; et al. Deep Learning-Based Chest X-Ray Age Serves as a Novel Biomarker for Cardiovascular Aging. bioRxiv 2021. [CrossRef]
  62. van Houten, H. How a Virtual Heart Could Save Your Real One. 2018. Available online: https://www.philips.com/a-w/about/news/archive/blogs/innovation-matters/20181112-how-a-virtual-heart-could-save-your-real-one.html (accessed on 4 February 2022).
  63. Dato, S.; Crocco, P.; Rambaldi Migliore, N.; Lescai, F. Omics in a Digital World: The Role of Bioinformatics in Providing New Insights Into Human Aging. Front. Genet. 2021, 12, 689824. [Google Scholar] [CrossRef] [PubMed]
  64. Lorusso, J.S.; Sviderskiy, O.A.; Labunskyy, V.M. Emerging Omics Approaches in Aging Research. Antioxid. Redox. Signal. 2018, 29, 985–1002. [Google Scholar] [CrossRef] [PubMed]
  65. Casaccia, S.; Revel, G.M.; Cosoli, G.; Scalise, L. Assessment of Domestic Well-Being: From Perception to Measurement. IEEE Instrum. Meas. Mag. 2021, 24, 58–67. [Google Scholar] [CrossRef]
  66. van Hoof, J.; Schellen, L.; Soebarto, V.; Wong, J.K.W.; Kazak, J.K. Ten Questions Concerning Thermal Comfort and Ageing. Build. Environ. 2017, 120, 123–133. [Google Scholar] [CrossRef]
  67. Monteriù, A.; Prist, M.R.; Frontoni, E.; Longhi, S.; Pietroni, F.; Casaccia, S.; Scalise, L.; Cenci, A.; Romeo, L.; Berta, R.; et al. A Smart Sensing Architecture for Domestic Monitoring: Methodological Approach and Experimental Validation. Sensors 2018, 18, 2310. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lehmann, J.; Granrath, L.; Browne, R.; Ogawa, T.; Kokubun, K.; Taki, Y.; Jokinen, K.; Janboecke, S.; Lohr, C.; Wieching, R.; et al. Digital Twins for Supporting Ageing Well: Approaches in Current Research and Innovation in Europe and Japan. Sustainability 2024, 16, 3064. https://doi.org/10.3390/su16073064

AMA Style

Lehmann J, Granrath L, Browne R, Ogawa T, Kokubun K, Taki Y, Jokinen K, Janboecke S, Lohr C, Wieching R, et al. Digital Twins for Supporting Ageing Well: Approaches in Current Research and Innovation in Europe and Japan. Sustainability. 2024; 16(7):3064. https://doi.org/10.3390/su16073064

Chicago/Turabian Style

Lehmann, Jasmin, Lorenz Granrath, Ryan Browne, Toshimi Ogawa, Keisuke Kokubun, Yasuyuki Taki, Kristiina Jokinen, Sarah Janboecke, Christophe Lohr, Rainer Wieching, and et al. 2024. "Digital Twins for Supporting Ageing Well: Approaches in Current Research and Innovation in Europe and Japan" Sustainability 16, no. 7: 3064. https://doi.org/10.3390/su16073064

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop