H2Al—The Human Health and Activity Laboratory †
Abstract
:1. Introduction
“Sweden will be best in the world at using the opportunities offered by digitalization and eHealth to make it easier for people to achieve good and equal health and welfare, and to develop and strengthen their own resources for increased independence and participation in the life of society.”
1.1. Scenarios
1.1.1. Digital Home Visits
1.1.2. Intelligent Alarms
1.2. Related Work
2. Design and Implementation
2.1. General Purpose
A person equipped with a wearable sensor kit, consisting of a mobile eye-tracker and sensors for EEG, ECG, EMG, GSR, respiration and other biometric data, conduct daily activities in the smart home environment. The person is continuously positioned using active and passive systems. The smart home environment is also equipped with video cameras and microphones which data is mixed and combined. Additional sensors, both worn and in the environment, will provide additional data, such as respiration, sleep apnea, status of objects and persons, etc. The data management system stores all data in synchronized (time-stamped) formats. An API is used to import and export data in real-time to additional systems. Data can also be imported and exported to and from the system in standardized formats. The data management system is then used to analyze the sequence of daily activities and activity patterns in the smart home using graphical and analytical tools.
2.2. DEPICT—iMotions
- Mobile eye-tracking as an output from mobile sensing of eye motion, gaze, etc.
- EEG (Electroencephalography) is an electrophysiological monitoring method to record electrical activity of the brain.
- ECG (Electrocardiogram) is the process of recording the electrical activity of the heart over a period of time using electrodes placed on the skin.
- EMG (Electromyogram) is an electrodiagnostic medicine technique for evaluating and recording the electrical activity produced by skeletal muscles.
- GSR (Galvanic skin response) is the change in the electrical properties of the skin, used for capturing the autonomic nerve responses (by the sweat gland function).
- Respiration as a metric of breathing performance and variation.
- A/V (audio and video) from multiple sources in the lab.
- Real-time import and export of data to/from other systems and sensor modules (API).
2.3. REMIND—SensorCentral
2.4. Platform Integration
2.5. Wearable Sensor Kits
2.6. Sensors in the Environment
2.7. Audio and Video Monitoring
- Eye-tracking video: The first video stream is captured by the glasses and fed into the iMotions platform for video analytics, for example using heat maps for predefined areas in the H2Al.
- Status video: The second video stream is captured from a computer and fed into the iMotions platform. This could be data visualized through the SensorCentral platform or a visualization similar to the Vayyar video as illustrated in Figure 5. This would allow researchers to also take position and posture into account when analyzing biometric data in iMotions.
- Multiplexed video: The third video stream is multiplexed from all video sources. Figure 2 (right) depicts a schematic overview of how the video sources are mixed, stored and utilized. A mixer (Blackmagic MultiView 16, MW16) produces one video stream of 1, 2 × 2, 3 × 3 or 4 × 4 video sources, which then is fed into the iMotions platform for synchronized storage with all biometric data. The multiplexed video can also be streamed to the monitors in the H2Al living room and the control room.
2.8. Virtual Sensors
3. Discussion
3.1. Why Multiple Sensors and Sensor Types?
3.2. International Collaboration
3.3. Identified Research Areas and Challenges
- Loneliness may be one of the primary factors for a reduced quality of life among elder persons, which challenges care systems with declining resources for social interaction.
- Distance to care facilities and qualified care is a great challenge foremost in the far north, but also in general, which needs to be overcome.
- Frailty as a result of sedentary behavior and loneliness increases the risks for injuries and death, for which measures needs to be taken.
- Complexity acts as a barrier for the digitalization of care and up-take of new technologies.
- Immediate feedback for (self-care) activities is very important, to sustain activities, for which gamification techniques may be important.
- Designing homes to support digital interventions.
- Identifying economical aspects related to quality of life and care involving family members.
- Compare and recommend technologies and processes for wider adoption.
3.4. Rapid and Continous Change
4. Conclusions
5. Future Work
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Harper, S. Economic and social implications of aging societies. Science 2014, 346, 587–591. [Google Scholar] [CrossRef] [PubMed]
- Action Plan for Cooperation on Implementing the Vision for eHealth 2025 (2017–2019), Approved by the Central Government in Sweden and the Swedish Association of Local Authorities and Regions on the 20th of January 2017. Article No. S2018.005. Available online: https://ehalsa2025.se/wp-content/uploads/2018/03/Handlingsplan-e-h%C3%A4lsa-engelsk-version.pdf (accessed on 23 May 2018).
- Amiribesheli, M.; Benmansour, A.; Bouchachia, A. A review of smart homes in healthcare. J. Ambient Intell. Humaniz. Comput. 2015, 6, 495–517. [Google Scholar] [CrossRef]
- Kaye, J. Making Pervasive Computing Technology Pervasive for Health & Wellness in Aging. Public Policy Aging Rep. 2017, 27, 53–61. [Google Scholar] [CrossRef] [PubMed]
- Malmberg, B.; Ernsth, M.; Larsson, B.; Zarit, S.H. Angels of the night: Evening and night patrols for homebound elders in Sweden. Gerontol. J. 2003, 43, 761–765. [Google Scholar] [CrossRef] [PubMed]
- Rashidi, P.; Mihailidis, A. A survey on ambient-assisted living tools for older adults. IEEE J. Biomed. Health Inform. 2013, 17, 579–590. [Google Scholar] [CrossRef] [PubMed]
- Poland, M.P.; Nugent, C.D.; Wang, H.; Chen, L. Smart home research: Projects and issues. Int. J. Ambient Comput. Intell. 2009, 1, 32–45. [Google Scholar] [CrossRef]
- Georgia Tech Aware Home Research Initiative. Available online: http://www.awarehome.gatech.edu/ (accessed on 5 September 2018).
- MIT PlaceLab. Available online: http://web.mit.edu/cron/group/house_n/placelab.html (accessed on 5 September 2018).
- Yamazaki, T. The ubiquitous home. Int. J. Smart Home 2007, 1, 17–22. [Google Scholar]
- De Ruyter, B.; Aarts, E.; Markopoulos, P.; Ijsselsteijn, W. Ambient intelligence research in homelab: Engineering the user experience. In Ambient Intelligence; Springer: Berlin, Germany, 2005; pp. 49–61. [Google Scholar]
- Skubic, M.; Alexander, G.; Popescu, M.; Rantz, M.; Keller, J. A smart home application to elder-care: Current status and lessons learned. Technol. Health Care 2009, 17, 183–201. [Google Scholar] [CrossRef] [PubMed]
- Toyota DreamHouse Papi. Available online: http://tronweb.super-nova.co.jp/toyotadreamhousepapi.html (accessed on 24 May 2018).
- Drexel SmartHouse. Available online: http://www.drexelsmarthouse.com/ (accessed on 24 May 2018).
- Eriksson, H.; Isaksson, A. Trygg om Natten: En studie av Kunders, Anhörigas och Personals Perspektiv på Införandet av ny Teknik Inom Nattpatrullens Arbete; Högskolan i Halmstad: Halmstad, Sweden, 2011. [Google Scholar]
- DEPICT. Available online: https://www.ltu.se/org/ets/Verksamhet/Laboratorium-och-utrustning/Depict-Lab (accessed on 24 May 2018).
- iMotions. Available online: https://imotions.com/ (accessed on 24 May 2018).
- Nugent, C.D.; Mulvenna, M.; Hong, X.; Devlin, S. Experiences in the development of a Smart Lab. Int. J. Biomed. Eng. Technol. 2009, 2, 319–331. [Google Scholar] [CrossRef]
- Lundström, J.; De Morais, W.O.; Menezes, M.; Gabrielli, C.; Bentes, J.; Sant’Anna, A.; Synnott, J.; Nugent, C. Halmstad Intelligent Home—Capabilities and Opportunities. In Internet of Things Technologies for HealthCare; Ahmed, M., Begum, S., Raad, W., Eds.; Springer: Cham, Switzerland, 2016; Volume 187. [Google Scholar]
- Espinilla, M.; Martínez, L.; Medina, J.; Nugent, C. The experience in the development of the UJAmI Smart lab. IEEE Access 2018, 6, 34631–34642. [Google Scholar] [CrossRef]
- Remind. Available online: https://www.remind-research.com/ (accessed on 24 May 2018).
- Rafferty, J.; Synnott, J.; Ennis, A.; Nugent, C.; McChesney, I.; Cleland, I. SensorCentral: A Research Oriented, Device Agnostic, Sensor Data Platform. In Proceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence UCAmI, Philadelphia, PA, USA, 7–10 November 2017; Springer: Berlin, Germany, 2017; pp. 97–108. [Google Scholar] [CrossRef]
- Tieto White Paper on Challenges Facing Welfare Technology. Available online: https://campaigns.tieto.com/sv/tietosmartcare#laddaner (accessed on 24 May 2018).
- SkyResponse. Available online: https://skyresponse.com/ (accessed on 24 May 2018).
- FIWARE. Available online: https://www.fiware.org/ (accessed on 24 May 2018).
- Rana, J.; Kristiansson, J.; Synnes, K. Enriching and simplifying communication by social prioritization. In Proceedings of the International Conference on Advances in Social Networks Analysis and Mining 2010 (ASONAM 2010), Odense, Denmark, 9–11 August 2010; pp. 336–340. [Google Scholar]
- Rana, J.; Kristiansson, J.; Hallberg, J.; Synnes, K. An architecture for mobile social networking applications. In Proceedings of the International Conference on Computational Intelligence, Communication Systems and Networks 2009 (CICSYN’09), Indore, India, 23–25 July 2009; pp. 241–246. [Google Scholar]
- Kikhia, B.; Gomez, M.; Jiménez, L.L.; Hallberg, J.; Karvonen, N.; Synnes, K. Analyzing body movements within the laban effort framework using a single accelerometer. Sens. J. 2014, 14, 5725–5741. [Google Scholar] [CrossRef] [PubMed]
- Kikhia, B.; Hallberg, J.; Synnes, K. Context-aware life-logging for persons with mild dementia. In Proceedings of the IEEE International Conference on Engineering in Medicine and Biology Society 2009 (EMBC 2009), Minneapolis, MN, USA, 3–6 September 2009; pp. 6183–6186. [Google Scholar]
- Drugge, M.; Nilsson, M.; Liljedahl, U.; Synnes, K.; Parnes, P. Methods for interrupting a wearable computer user. Int. Symp. Wearable Comput. 2004, 1, 150–157. [Google Scholar]
- Nugent, C.D.; Davies, R.J.; Hallberg, J.; Donnelly, M.P.; Synnes, K.; Poland, M.; Wallace, J.; Finlay, D.; Mulvenna, M.; Craig, D. HomeCI-A visual editor for healthcare professionals in the design of home based care. In Proceedings of the IEEE International Conference on Engineering in Medicine and Biology Society 2007 (EMBS 2007), Lyon, France, 22–26 August 2007; pp. 2787–2790. [Google Scholar]
- Nugent, C.D.; Hong, X.; Hallberg, J.; Finlay, D.; Synnes, K. Assessing the impact of individual sensor reliability within smart living environments. In Proceedings of the IEEE International Conference on Automation Science and Engineering (CASE 2008), Arlington, VA, USA, 23–26 August 2008; pp. 685–690. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Synnes, K.; Lilja, M.; Nyman, A.; Espinilla, M.; Cleland, I.; Comas, A.G.S.; Comas-Gonzalez, Z.; Hallberg, J.; Karvonen, N.; Morais, W.O.d.; et al. H2Al—The Human Health and Activity Laboratory. Proceedings 2018, 2, 1241. https://doi.org/10.3390/proceedings2191241
Synnes K, Lilja M, Nyman A, Espinilla M, Cleland I, Comas AGS, Comas-Gonzalez Z, Hallberg J, Karvonen N, Morais WOd, et al. H2Al—The Human Health and Activity Laboratory. Proceedings. 2018; 2(19):1241. https://doi.org/10.3390/proceedings2191241
Chicago/Turabian StyleSynnes, Kåre, Margareta Lilja, Anneli Nyman, Macarena Espinilla, Ian Cleland, Andres Gabriel Sanchez Comas, Zhoe Comas-Gonzalez, Josef Hallberg, Niklas Karvonen, Wagner Ourique de Morais, and et al. 2018. "H2Al—The Human Health and Activity Laboratory" Proceedings 2, no. 19: 1241. https://doi.org/10.3390/proceedings2191241
APA StyleSynnes, K., Lilja, M., Nyman, A., Espinilla, M., Cleland, I., Comas, A. G. S., Comas-Gonzalez, Z., Hallberg, J., Karvonen, N., Morais, W. O. d., Cruciani, F., & Nugent, C. (2018). H2Al—The Human Health and Activity Laboratory. Proceedings, 2(19), 1241. https://doi.org/10.3390/proceedings2191241