Next Article in Journal
Application and Comparison of the MODIS-Derived Enhanced Vegetation Index to VIIRS, Landsat 5 TM and Landsat 8 OLI Platforms: A Case Study in the Arid Colorado River Delta, Mexico
Next Article in Special Issue
Error Analysis of Magnetohydrodynamic Angular Rate Sensor Combing with Coriolis Effect at Low Frequency
Previous Article in Journal
Biological Oscillators in Nanonetworks—Opportunities and Challenges
Previous Article in Special Issue
Hybrid Transverse Polar Navigation for High-Precision and Long-Term INSs
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design of an Inertial-Sensor-Based Data Glove for Hand Function Evaluation

1
Department of Computer Science and Information Engineering, National Taipei University, New Taipei City 23741, Taiwan
2
College of Electrical Engineering and Computer Science, National Taipei University, New Taipei City 23741, Taiwan
3
Department of Physical Medicine and Rehabilitation, Chi-Mei Medical Center, Tainan 71004, Taiwan
4
Department of Electrical Engineering, Yuan Ze University, Taoyuan City 32003, Taiwan
5
Department of Physical Medicine & Rehabilitation, Taoyuan Chang Gung Memorial Hospital, Taoyuan City 333, Taiwan
6
Center for Healthy and Aging Research, Chang Gung University, Taoyuan City 33302, Taiwan
7
School of Medicine, Medical College, Chang Gung University, Taoyuan City 33302, Taiwan
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(5), 1545; https://doi.org/10.3390/s18051545
Submission received: 27 March 2018 / Revised: 9 May 2018 / Accepted: 10 May 2018 / Published: 13 May 2018
(This article belongs to the Special Issue Inertial Sensors and Systems 2018)

Abstract

:
Capturing hand motions for hand function evaluations is essential in the medical field. Various data gloves have been developed for rehabilitation and manual dexterity assessments. This study proposed a modular data glove with 9-axis inertial measurement units (IMUs) to obtain static and dynamic parameters during hand function evaluation. A sensor fusion algorithm is used to calculate the range of motion of joints. The data glove is designed to have low cost, easy wearability, and high reliability. Owing to the modular design, the IMU board is independent and extensible and can be used with various microcontrollers to realize more medical applications. This design greatly enhances the stability and maintainability of the glove.

1. Introduction

Capturing hand kinematics is necessary in medical applications, such as rehabilitation and hand function evaluation [1,2,3]. By capturing hand kinematics, physicians can accurately determine the recovery progress of stroke patients’ hand. Therefore, a practical and reliable device that can record several hand motion parameters in the rehabilitation field is needed.
Studies on hand kinematics capturing have used noncontact-based or wearable technology [2,3,4,5,6,7,8,9,10,11,12,13]. Noncontact-based approaches mainly use cameras or depth-based cameras to capture hand kinematics and analyze continuous hand movements through image processing [4,6,7]. The main drawbacks of noncontact-based systems are reported in the previous studies [14]. The major problem of noncontact-based systems is that it is restricted by the place where the camera placed and the lighting condition of the environment. Moreover, self-occlusion when the hand is in a non-observed condition also causes the inaccurate kinematics capturing. Therefore, wearable systems are more practical for capturing the hand kinematics precisely without environmental restrictions.
Data gloves are the most popular wearable systems. With technological advancements, various sensors, including mechanical sensors, resistive sensors, optical fiber sensors, and inertial measurement units (IMUs), have been incorporated into data gloves for capturing hand kinematics [2,3,5,8,9,10,11,12,13]. Physicians can observe finger motions through sensors attached on the fingers of the data glove. IMUs are the most practical sensors for data gloves [15] because they are light and can accurately capture slight changes in finger motions. IMUs can also provide original values, such as acceleration, angular velocity, and magnetic field. By applying a sensor fusion algorithm to these original values, the range of motion (ROM) that can be interpreted directly by physicians can be obtained [2,8].
Various data gloves have been proposed thus far. In 2014, Kortier et al. [2] and Moreira et al. [13] independently proposed data gloves with IMUs that contained an accelerometer, gyroscope, and magnetometer. Both data gloves could measure finger motion accurately; however, both used wired transmission and caused restrictions when subjects were performing hand function evaluation tasks. Moreover, these data gloves did not have a modular design. In 2016, Choi et al. proposed a low-cost data glove with 9-axis sensors [11]. However, they only conducted a static validation; a dynamic validation is required in the medical field. Without dynamic validation, the ROM measurement accuracy when the subject was conducting hand evaluation tasks could not be determined. In 2017, Fang et al. developed a data glove with an attitude measurement algorithm [8]. The authors conducted both static and dynamic validation to verify the accuracy of the algorithm; however, the hardware design of this data glove was not modular, and therefore, the glove could not be used if one of its sensors was damaged.
Therefore, although many studies have focused on data gloves, aspects such as the transmission method and modular design provide scope for improvement. To modify the design and avoid the drawbacks of previous studies, a hand function assessment system using a data glove with 6-axis IMUs was proposed in 2017 [16]. However, the sensor used in this study contained only an accelerometer and gyroscope and could only measure the ROM in a specific setting. Owing to the lack of a magnetometer, the error increases with time and causes inaccuracy in the heading angle. In addition, the system used Bluetooth as the transmission protocol. The Bluetooth module had a baud rate of 115,200 bps; this was insufficient for the large amount of data obtained from the 16 IMUs, thus reducing the system reliability. Moreover, there was only one IMU on the back of the hand, and therefore, the ROM of the metacarpophalangeal joints of the thumb and little finger could not be captured accurately.
To eliminate the aforementioned drawbacks of previous studies, a modular data glove with 9-axis IMU sensors has been presented to provide reliable acceleration, angular velocity, and ROM as the parameters of manual dexterity to physicians. The proposed data glove has a modular design that increases its expandability. Each module can operate independently, for instance, the mainboard provides various common data transmission protocols that can combine different types of biomedical sensors in the future. In addition, to enhance the independence of the sensor part, the IMU is soldered on a traditional printed circuit board (PCB) to form an IMU board. And the IMU board is connected with the flexible printed circuit board (FPCB) with a pin header. This novel approach not only enhances the maintainability of the data glove but also provides the function of communicating with various microcontrollers.

2. System Architecture and Hardware Design

2.1. System Overview

This study aims to implement a data glove with a modular design. This glove can be worn easily and can collect motion parameters while the subject is performing hand function assessment tasks. After receiving motion parameters from the data glove, the sensor fusion algorithm in the software calculates and converts the raw data into a ROM that can be interpreted directly by physicians. The design of the data glove includes the hardware and software design.
The hardware design includes three parts: (1) motion capture mainboard (MCM); (2) finger flexible composite board (FFCB) and IMU sensor board (IMU-SB); and (3) adapter board and host system. The MCM is powered by a Li-ion polymer battery and is worn on the subject’s forearm. The adapter board is the bridge between the MCM and the FFCB. A flat flexible cable is used to connect the MCM and the adapter board. Five FFCBs are attached on the five fingers of the data glove, and they are connected to the adapter board. Figure 1 shows the system architecture. MCM collects the raw data from the 17 IMUs on the five FFCBs and one IMU on the MCM and sends it to the host system via Bluetooth.
Figure 2 show the positions of the 18 IMUs in the proposed data glove. In Figure 2, positions 1–17 indicate sensor positions, and position 18 indicates the sensor on the forearm. To measure the ROM of the MCP joints more accurately, the sensors at positions 3, 10, 17 and 18 are used to reconstruct and capture the finger and hand motions in the three-dimensional space. The ROM of the MCP joint of the thumb can be calculated using the data from sensors 2 and 3. The ROM of the MCP joint of the index, middle, and ring fingers can be calculated using the data from sensors 6, 9 and 13. The ROM of the MCP joint of the little finger can be obtained using the data from sensors 16 and 17. Sensor 18, which is on the MCM, is used to collect the motion parameters of the forearm. The ROM of the wrist can be calculated using sensors 10 and 18.
Figure 3 shows the MCM, which is custom-made as the main core of the system. The size of the MCM is 43 mm × 43 mm. The MCM contains a microcontroller, an IMU, a Bluetooth module, and a 600-mAh Li-ion polymer battery as the power source. The microcontroller (MSP430F5438A, Texas Instruments, Dallas, TX, USA), which is the main component of the data glove, collects data via serial peripheral interface (SPI) bus, encapsulates the data into packets, and sends the packets to the host system via Bluetooth. Three extensible interfaces for the universal asynchronous receiver/transmitter (UART), SPI, and analog-to-digital converter are reserved for integrating other biomedical sensors in the future.
HL-MD08R (Hotlife Electronic Technology Co., Ltd., Taipei, Taiwan) was used as the transmitting module of the data glove. Figure 4 shows the HL-MD08R module. This device has a maximum baud rate of 921,600 bps; this is sufficient for transmitting packets from the data glove. In addition, HL-MD08R is soldered on the wireless adapter board, and this board is plugged into the UART port of the MCM. The UART interface has an extensible port that can support various wireless communicating modules in the future.
A 9-axis IMU (LSM9DS0, STMicroelectronics, Geneva, Switzerland) was used for motion capture in the proposed data glove. The IMU contains a 3-axis magnetometer, a 3-axis gyroscope, and a 3-axis accelerometer, and it can provide the 3-axis acceleration, 3-axis angular velocity, and 3-axis magnetic field. LSM9DS0 was soldered on a 10-mm × 10-mm IMU-SB. The IMU-SB has a modular design, and it can capture finger motions and independently operate with other types of microcontrollers to enable novel applications.

2.2. Mechanical Design of Data Glove

The modular design of the proposed data glove enhances the extensibility of its components, especially in terms of FFCB design. Figure 5a shows a side view of the FFCB design. The traditional method is to solder the IMU directly on an FPCB [12]; however, this approach increases the risk of split solder and instability of the IMU signal. In this study, the IMU was soldered on the traditional PCB to form an IMU-SB, and then, the IMU-SB was combined with FPCB to form the FFCB. This design enhances the stability and reliability of IMU signals. The failure rate of the IMUs can also be reduced by using this design. The connection between the MCU and the IMUs relies on the FPCB circuit. The power lines and signal lines of the circuits are on different layers to avoid split solder in the FPCB. The proposed data glove used a 1.27-mm pin header to connect the IMU-SB and the FPCB. If an IMU or a FPCB is broken, only the broken component is required to be changed. This design enhances the maintainability and extends the lifetime of the data glove. A golden finger is used on the tail of each FFCB, and it can be quickly and directly connected to the flip lock connector on the adapter board. This design reduces the number of connecting points between each component and avoids unstable signals that could cause incorrect data acquisition. At most four IMU-SBs can be mounted on each FFCB depending on the application. Figure 5b shows the FFCB obtained by combining the FPCB and IMU-SB.
Figure 6 shows the prototype of the data glove. The shell of the MCM is created using a 3D printer. Velcro is used to fasten the MCM to the forearm. The FFCBs and the adapter board are fastened to a cotton glove using 3M picture hanging strips (Command™ Narrow Picture Hanging Strips, 3M Company, St. Paul, MN, USA), which is firmer than traditional Velcro and can be removed easily.

3. Software Design

3.1. Flowchart of Software

The program on the host system was developed in C#. Figure 7 shows its flowchart. When the program begins, the graphical user interface (GUI) is created and initialized. Next, the COM port of the Bluetooth module is selected by the user, and then, a connection is established between the program and the data glove. After connecting successfully, the program on the host system starts to receive packets from the data glove and conducts sensor calibration and attitude calculation. The attitude is converted to the ROM, shown on the GUI, and recorded.

3.2. Sensor Calibration

To ensure the IMU sensor performance will meet its specifications, IMU calibration is necessary before executing the sensor fusion algorithm. In this study, the IMU is placed on the table to calibrate the accelerometer and gyroscope. The accelerometer offset Acc offset and gyroscope offset Gyro offset are both obtained by averaging 1000 raw data measurements from the accelerometer and gyroscope, respectively.
The magnetometer is calibrated differently from the accelerometer and gyroscope. The magnetometer is required to conduct an 8-shaped rotation to find the maximum and minimum values on each axis. Mag max and Mag min are the maximum and minimum values, respectively, of the axis. The magnetometer offset Mag offset is the average of Mag max and Mag min [17]. Figure 8 shows well-calibrated raw data from the magnetometer. After calibration, the center of the distribution of the raw data will be very close to (0, 0, 0). It means that the hard iron calibration had finished. It will also become a spherical distribution with radius of 400 mG, meaning that the soft iron calibration had finished.
After obtaining the accelerometer, gyroscope, and magnetometer offsets, the raw data from these three sensors are adjusted using these offsets, as shown in (1)–(3). The calibrated data, Acc , Gyro , and Mag , are inputted into the sensor fusion algorithm to obtain the attitudes:
Acc =   Acc Acc offset
Gyro = Gyro Gyro offset
Mag = Mag Mag offset

3.3. Sensor Fusion Algorithm

Several sensor fusion approaches have been proposed for various applications [18,19,20,21,22,23,24]. Kalman-based filters are the most common approaches in the previous studies; however, Kalman-filter is not always suitable for motion capturing [23]. It is time-consuming to use Kalman filter to measure the attitude of multiple sensors because of the complex computation of the algorithm. Therefore, our study used Madgwick’s sensor fusion algorithm [24], which is more efficient and requires less computing time. The attitude obtained from the gyroscope and that from the accelerometer and magnetometer were combined by the algorithm to obtain the final attitude.
The attitude obtained from the gyroscope is updated as shown in (4). The quaternion q represents the attitude of the IMU. q t is the attitude at the current time. q t 1 is the attitude at the previous time. ω t 1 is the angular velocity at the previous time. Δ t is the time difference between the previous time and the current time:
q t = q t 1 + 1 2 q t 1 × ω t 1 Δ t 1
The attitudes obtained from the accelerometer and magnetometer are updated as shown in (5). The gradient descent method is used to find the optimal solution of the attitude. μ is the step size of the gradient descent. f is the objective function, which represents the error between q t 1 and the output of accelerometer and magnetometer. f is the objective function gradient which is defined by the measurement of accelerometer and magnetometer at time t:
q t = q t 1 μ f f
Finally, Equations (4) and (5) are combined to obtain the final attitude, as given by (6). β is the gyroscope error. This equation optimizes the solution along with the direction which the error decreased. After optimization, the final attitude is obtained.
q t = q t 1 + 1 2 q t 1 × ω t 1 Δ t 1 β f f Δ t 1
After obtaining the quaternion of the current attitude by using the above algorithm, the ROM is calculated. Figure 9 shows the 3-axis direction of the IMU. The positive direction of the IMU’s x-axis is the same as the direction in which the finger points. The positive direction of the IMU’s y-axis is perpendicular to the direction in which the finger points. The positive direction of the IMU’s z-axis is perpendicular to and points out of the finger plane. The ROM is calculated by converting the quaternions of two adjacent IMUs to Euler angles and by obtaining the difference between the y-axis angles. The current attitude ( q 1 ,   q 2 ,   q 3 ,   q 4 ) is converted to the Euler angle of the IMU’s y-axis as shown in (7):
θ = sin 1 ( 2 q 2 q 4 + 2 q 1 q 3 )
In this research, at most four IMUs can be mounted on the FFCB. With the IMU on the back of the hand, three ROMs can be calculated. Figure 10 shows the position of the ROMs and IMUs. ROM1, obtained from IMU1 and IMU2, is the ROM of the distal interphalangeal joint. ROM2, obtained from IMU2 and IMU3, is the ROM of the proximal interphalangeal joint. ROM3, obtained from IMU3 and IMU4, is the ROM of the metacarpophalangeal joint.

4. Verification of Data Gloves

4.1. Verification of Raw Data

Because the attitude angle is calculated from the acceleration, angular velocity, and magnetic orientation, it is necessary to verify that the data obtained from the IMU is correct before calculating the attitude angle. In this study, a trusted IMU device (LPMS-B, LP-Research, Tokyo, Japan) was used to compare the raw data with the sensors used in this study. LPMS-B is an accepted standard in many laboratories [25,26], and its raw data output is reliable. The raw data is verified by fixing the MCM and LPMS-B on the same board and swinging the board randomly and continuously. The sampling rates of both the devices were set to 25 Hz. The scales of both the two sensors were set to ±4 g for accelerometer, ±8 g for gyroscope, and ±400 μT for the magnetometer. The host receives raw data from the MCM and LPMS-B simultaneously, thus enabling the verification of whether the data are consistent. Figure 11, Figure 12 and Figure 13 show the analysis results for the accelerometer, gyroscope, and magnetometer, respectively. Root mean square error (RMSE) is used to quantify the error. For accelerometer, RMSEs of x-axis, y-axis, and z-axis are respectively 6.78 × 10 2 g, 8.80 × 10 2 g and 8.34 × 10 2 g. For gyroscope, RMSEs of x-axis, y-axis and z-axis are 10.29 deg/s, 11.86 deg/s, 3.37 deg/s, respectively. For magnetometer, because the distortion of magnetic field of each sensor is different, the magnetic field of IMU was shifted to the same level as LPMS-B to obtain RMSEs. RMSEs of x-axis, y-axis, and z-axis are 36.95 mG, 32.40 mG, and 32.56 mG, respectively. The results show that the raw data outputted from the IMUs of our proposed system are accurate and have high level of confidence.
To ensure the magnetometer is well-calibrated, the distortions of x-axis, y-axis and z-axis of magnetometer have to be under an acceptable level. The sensor is rotated in repeated figure-eight path to calibrate, and then measuring and recording the distortion. Figure 14 shows the data of magnetometer before and after calibration. The figure plots the data on every two axes to show the result more clearly. The original data before calibration is plotted as red dots and the calibrated data is plotted as blue dots. The distortions of the original raw data are 180 mG, 25 mG, and −50 mG on x-axis, y-axis, and z-axis, respectively. Figure 14 also shows that by applying the calibrating method in Section 3.2, the centers of the calibrated data are all at (0, 0, 0) and the radius of the spheres are 400 mG, showing that the calibrated data of magnetometer is reliable.

4.2. Verification of Static Finger Angles

In this study, a self-made finger angle measurement platform is used for verifying the static finger angle, as shown in Figure 15. A folding ruler with an angle ruler is combined with a wood stick and wood block to form the measuring platform, and FFCB is fixed on the platform using 3M picture hanging strips. The measuring platform can then simulate the bending of the first knuckle to observe the angle change of the finger ROM1 in Figure 10.
For verifying ROM1, we used bending angles of 0°, 30°, 60°, 90°, and 120° and averaged 1000 measurements at each angle to verify the angle accuracy. Table 1 shows the average of the measured angles calculated using the software and RMSE obtained by comparing the average of the measured angles with the actual angles. The RMSE are all less than 0.2°, indicating that the sensor fusion algorithm used in our proposed system for calculating static ROM1 is stable and reaches a very good standard.

4.3. Verification of Dynamic Finger Angles

Dynamic verification uses the same measurement tools as static verification. The test method uses a servo motor to control a wood stick swinging back and forth within an angle interval. The servomotor (MG995, TowerPro, Taipei, Taiwan) was used for the dynamic verification. A program developed in Arduino was used to control the servomotor to the specific angle with pulse width modulation (PWM). In this experiment, three test intervals were set to 0°–30°, 0°–60°, and 0°–90°. The ROM changes every 2 s and recorded angles are compared with the reference angles given by the servomotor. This verification method is used to verify whether ROM1 calculated using the algorithm can maintain its accuracy and stability when the IMU sensors of the FFCB move in different ranges. Figure 16 shows the ROM1 waveforms calculated from the algorithm used for dynamic verification. This figure shows that the angles oscillate regularly in these three intervals; Table 2 shows the error percentages. The mean errors are 0.91°, −2.30°, −0.82° for dynamic angle ranges of 30°, 60°, and 90°, respectively.

4.4. Verification of Stability of Angle Measurement

To ensure the stability of the fusion algorithm, an experiment is conducted to verify the stability of the algorithm of ROM measurement. Reference angle is set on 30°, 60°, and 90° with servomotor and the measured ROM were recorded for 15 min. The experiment was only conducted in static situation to eliminate other potential factors during dynamic verification. Figure 17 presents the mean error of the measured ROM in every minute. The mean errors are all less than 3° during 15 min, showing that the stability of the algorithm.

4.5. Real-Time Visual Operation

To ensure the relative posture of each sensor, a real-time visualized Unity program was developed. The screenshot of the visualized program and posture of the data glove are depicted in Figure 18. Implementing visualization of the data from the data glove can help to ensure whether the system is calibrated well. If all of the sensors are calibrated well, the virtual hand will move perfectly and simultaneously with the real hand.

5. Discussion

This study proposed an inertial-sensor-based data glove. The glove mechanism was designed to have low cost, modularity, high expansibility, and complete system integration.
To verify the reliability and stability of the data gloves, three verification experiments were designed and conducted. First, the raw data were verified. The results showed high correlation between LPMS-B and the 9-axis IMUs used in this study; therefore, the output data of this IMU sensor can be trusted. Second, the static angle was verified. The results showed that the RMSE were all less than 1° at any static angle, indicating that the ROM calculated by the sensor fusion algorithm has high accuracy in the static state. Third, the data gloves were verified under dynamic conditions because they must be able to record the parameters of the finger’s continuous motion in most applications. The results show that the proposed data glove has the mean error of angle under ±3° in motion. This error might be attributed to the test tool itself, resulting in the inability to accurately change back and forth. Moreover, the reference angles can only be reported every 20 ms when the angle is at a certain static angle, but the transition state of the servomotor cannot be reported because of the PWM requires at least 500 ms to change the angle. However, in rehabilitation activities or hand function assessments, the mean error of angle under ±3° is acceptable to the physicians while the patients are conducting the rehabilitation tasks [27,28]. Therefore, our proposed data glove remains applicable in the medical domain. The last experiment is the verification of the stability. The result shows that the fusion algorithm is stable during a long period of time.
This designed data gloves are modular. The FPCB and IMU-SB are connected through a pin header to enable IMU-SBs to be replaced easily or for the number of IMU-SBs to be increased or decreased easily. However, this design remains inconvenient from the viewpoint of disassembly. Therefore, thinner and smaller PCBs and circuit board connectors will be used in the future, and these will be embedded in the gloves as a spring buckle. The integrated design of the IMU-SB, FPCB, and data glove should also be considered to enhance the stability and portability.
The microprocessor of the MCM currently simply collects IMU data and transmits it to the host system through wired or wireless transmission for parameter calculation. The packets transmitted by the glove contain the original IMU data that is very large. The data sampling rate of the algorithm is limited to 50 Hz owing to the transmission bandwidth. Therefore, the algorithm can be implemented in firmware in the future, and the original data output can be changed to quaternion attitude data to greatly reduce the amount of data and the load on the host system software. Another option is to increase the transmission bandwidth by using Wi-Fi transmission, instead of Bluetooth transmission.
Table 3 compares this study with several previous studies on data gloves. Kortier et al. developed data gloves that accurately captured dynamic changes in finger motions [2]. However, this glove could only transmit data through a USB interface, thus limiting its use. Choi et al. developed a data glove and algorithm for calculating the attitude angle effectively [11]. However, they did not provide the ROM, and they only performed static verification for their data glove. Fang et al. proposed a data glove for capturing finger motions and hand dynamics and displaying them on a screen [8]. However, this glove had many wires, leaving it susceptible to damage. None of the aforementioned three studies have used a modular design; therefore, if any damage was difficult to repair, the glove components could not be used for other applications. The data glove proposed in this study overcomes these problems by adopting a modular design, soldering the IMU to the traditional circuit board, and then combining with the FPCB via the pin header to form an FFCB. Because the IMU-SB is separated from the FPCB, the IMU can stably output data, and it does not suffer damage easily. If the IMU-SB or FPCB is damaged, it can be replaced independently. This design can extend the life of the various components of the data glove, and it enables the number of IMU sensors to be adjusted freely in the future. The independent design of the IMU-SB can also be combined with other microprocessors for extended applications. In addition, the MCM is designed independently and has a different communication interface on the board; therefore, it can operate independently or in combination with other sensors. This design of the data glove enables it to capture finger motions and greatly increases its future scalability.

6. Conclusions

This study proposed a data glove design for motion capture with eighteen 9-axis IMU sensors on the fingers, wrist, and forearm for measuring hand movement parameters. In addition to the acceleration, velocity, and rotation of hand movements, accurate bending angles of the knuckles of the fingers and the wrist can also be measured and calculated through attitude fusion algorithms. This study also conducted a complete verification of this data glove. The results of raw data, static, and dynamic verification, stability verification show that our proposed data glove has good accuracy and stability.
The proposed data glove has a modular design in which the MCM and the IMU-SB can both be used independently. This enables components to be replaced easily if they are damaged and enables various microprocessors to be combined with the system to extend its applications easily. The MCM also has an expansion interface through which various biomedical signal sensors can be combined in the future for more medical research applications.
In the future, clinical tests will be conducted, and the parameters obtained using this data glove will be correlated with physicians’ existing scales to enable physicians to more accurately analyze patients’ rehabilitation and hand function. A more automated magnetometer calibration algorithm could be added to the system to make the proposed data glove more suitable for use in hospital environments.

Author Contributions

Bor-Shing Lin conceived the study idea, designed the framework and system architecture in this study, and modified the manuscript. I-Jung Lee and Yi-Chiang Lo implemented the system, collected data, analyzed the collected data, and wrote the draft. Junghsi Lee provided technical supports. Jean-Lon Chen and Shu-Yu Yang provided conceptual advice, design of wearable device, and domain knowledge of sports physiology.

Acknowledgments

This research was partly supported by Ministry of Science and Technology in Taiwan, under grant MOST 106-2221-E-305-012. This research was also partly supported by University System of Taipei Joint Research Program, under grant USTP-NTPU-TMU-107-02. The work of Jean-Lon Chen was supported in part by the Ministry of Science and Technology, Taiwan, under grants MOST 104-2314-B-182-014 and 102-2314-B-182-014-MY2, in part by the School of Medicine, Chang Gung University, Healthy and Aging Research Center, and in part by the Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital, Taiwan under grants CMRPG5D0151-CMRPG5D0153, CMPRG5G0161, CMRPG5G0211, and CMRPG5E0081-CMRPG5E0083.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wang, Q.; Chen, W.; Markopoulos, P. Literature review on wearable systems in upper extremity rehabilitation. In Proceedings of the IEEE-EMBS International Conference on Biomedical and Health Informatics, Valencia, Spain, 1–4 June 2014. [Google Scholar]
  2. Kortier, H.G.; Sluiter, V.I.; Roetenberg, D.; Veltink, P.H. Assessment of hand kinematics using inertial and magnetic sensors. J. Neuroeng. Rehabil. 2014, 11, 1–14. [Google Scholar] [CrossRef] [PubMed]
  3. Carbonaro, N.; Mura, G.D.; Lorussi, F.; Paradiso, R.; DeRossi, D.; Tognetti, A. Exploiting wearable goniometer technology for motion sensing gloves. IEEE J. Biomed. Health Inform. 2014, 18, 1788–1795. [Google Scholar] [CrossRef] [PubMed]
  4. Liu, H. Exploring human hand capabilities into embedded multifingered object manipulation. IEEE Trans. Ind. Inform. 2011, 7, 389–398. [Google Scholar] [CrossRef]
  5. Park, Y.; Lee, J.; Bae, J. Development of a wearable sensing glove for measuring the motion of fingers using linear potentiometers and flexible wires. IEEE Trans. Ind. Inform. 2015, 11, 198–206. [Google Scholar] [CrossRef]
  6. Ye, M.; Yang, C.; Stankovic, V.; Stankovic, L.; Kerr, A. A Depth Camera Motion Analysis Framework for Tele-rehabilitation: Motion Capture and Person-Centric Kinematics Analysis. IEEE J. Sel. Top. Signal Process. 2016, 10, 877–887. [Google Scholar] [CrossRef] [Green Version]
  7. Metcalf, C.D.; Robinson, R.; Malpass, A.J.; Bogle, T.P.; Dell, T.A.; Harris, C.; Demain, S.H. Markerless motion capture and measurement of hand kinematics: Validation and application to home-based upper limb rehabilitation. IEEE Trans. Biomed. Eng. 2013, 60, 2184–2192. [Google Scholar] [CrossRef] [PubMed]
  8. Fang, B.; Sun, F.; Liu, H.; Guo, D. Development of a Wearable Device for Motion Capturing Based on Magnetic and Inertial Measurement Units. Sci. Program. 2017, 1–11. [Google Scholar] [CrossRef]
  9. Djurić-Jovičić, M.; Jovičić, N.S.; Roby-Brami, A.; Popović, M.B.; Kostić, V.S.; Djordjević, A.R. Quantification of finger-tapping angle based on wearable sensors. Sensors 2017, 17, 203. [Google Scholar] [CrossRef] [PubMed]
  10. Lemos, J.D.; Hernandez, A.M.; Soto-Romero, G. An Instrumented Glove to Assess Manual Dexterity in Simulation-Based Neurosurgical Education. Sensors 2017, 17, 988. [Google Scholar] [CrossRef] [PubMed]
  11. Choi, Y.; Yoo, K.; Kang, S.J.; Seo, B.; Kim, S.K. Development of a low-cost wearable sensing glove with multiple inertial sensors and a light and fast orientation estimation algorithm. J. Supercomput. 2016, 72, 1–14. [Google Scholar] [CrossRef]
  12. Kitano, K.; Ito, A.; Tsujiuchi, N.; Wakida, S. Estimation of joint center and measurement of finger motion by inertial sensors. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Orlando, FL, USA, 17–20 August 2016. [Google Scholar]
  13. Moreira, A.H.J.; Queirós, S.; Fonseca, J.; Rodrigues, P.L.; Rodrigues, N.F.; Vilaça, J.L. Real-time hand tracking for rehabilitation and character animation. In Proceedings of the IEEE 3nd International Conference on Serious Games and Applications for Health (SeGAH), Rio de Janeiro, Brazil, 14–16 May 2014. [Google Scholar]
  14. Erol, A.; Bebis, G.; Nicolescu, M.; Boyle, R.D.; Twombly, X. Vision-based hand pose estimation: A review. Comput. Vis. Image Underst. 2007, 108, 52–73. [Google Scholar] [CrossRef]
  15. Wang, Q.; Markopoulos, P.; Yu, B.; Chen, W.; Timmermans, A. Interactive wearable systems for upper body rehabilitation: A systematic review. J. Neuroeng. Rehabil. 2017, 14, 20. [Google Scholar] [CrossRef] [PubMed]
  16. Lin, B.-S.; Hsiao, P.-C.; Yang, S.-Y.; Su, C.-S.; Lee, I.-J. Data Glove System Embedded with Inertial Measurement Units for Hand Function Evaluation in Stroke Patients. IEEE Trans. Neural Syst. Rehabil. Eng. 2017, 25, 2204–2213. [Google Scholar] [CrossRef] [PubMed]
  17. Caruso, M.J. Applications of Magnetoresistive Sensors in Navigation Systems. Readings 1997, 72, 15–21. [Google Scholar] [CrossRef]
  18. Baraniello, V.R.; Cicala, M.; Corraro, F. An extension of integrated navigation algorithms to estimate elastic motions of very flexible aircrafts. In Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA, 6–13 March 2010. [Google Scholar]
  19. Wagner, J.F. Adapting the Principle of Integrated Navigation Systems to Measuring the Motion of Rigid Multibody Systems. Multibody Syst. Dyn. 2004, 11, 87–110. [Google Scholar] [CrossRef]
  20. Wagner, J.F.; Wieneke, T. Integrating satellite and inertial navigation—Conventional and new fusion approaches. Control Eng. Pract. 2003, 11, 543–550. [Google Scholar] [CrossRef]
  21. Lawrence, A. Modern Inertial Technology: Navigation, Guidance, and Control, 2nd ed.; Corr. 3. Printing; Springer: New York, NY, USA, 2001; ISBN 978-1-4684-0444-9. [Google Scholar]
  22. Titterton, D.H.; Weston, J.L. Strapdown Inertial Navigation Technology, 2nd ed.; Reprint; AIAA: Reston, VA, USA, 2009; ISBN 978-0-8634-1358-2. [Google Scholar]
  23. Wagner, J.F. About Motion Measurement in Sports Based on Gyroscopes and Accelerometers—An Engineering Point of View. Gyroscopy Navig. 2018, 9, 1–18. [Google Scholar] [CrossRef]
  24. Madgwick, S.O.H.; Harrison, A.J.L.; Vaidyanathan, R. Estimation of IMU and MARG orientation using a gradient descent algorithm. In Proceedings of the IEEE International Conference on Rehabilitation Robotics, Zurich, Switzerland, 29 June–1 July 2011. [Google Scholar]
  25. Sun, T.; Li, H.; Liu, Q.; Duan, L.; Li, M.; Wang, C.; Liu, Q.; Li, W.; Shang, W.; Wu, Z.; et al. Inertial Sensor-Based Motion Analysis of Lower Limbs for Rehabilitation Treatments. J. Healthc. Eng. 2017, 1–11. [Google Scholar] [CrossRef] [PubMed]
  26. Lin, Y.; Min, H.; Wei, H. Inertial measurement unit-based iterative pose compensation algorithm for low-cost modular manipulator. Adv. Mech. Eng. 2016, 8. [Google Scholar] [CrossRef]
  27. Wise, S.; Gardner, W.; Sabelman, E.; Valainis, E.; Wong, Y.; Glass, K.; Drace, J.; Rosen, J.M. Evaluation of a fiber optic glove for semi-automated goniometric measurements. J. Rehabil. Res. Dev. 1990, 27, 411. [Google Scholar] [CrossRef] [PubMed]
  28. Dipietro, L.; Sabatini, A.M.; Dario, P. Evaluation of an instrumented glove for hand-movement acquisition. J. Rehabil. Res. Dev. 2003, 40, 181. [Google Scholar] [CrossRef]
Figure 1. System architecture of data glove system.
Figure 1. System architecture of data glove system.
Sensors 18 01545 g001
Figure 2. IMU positions on the data glove.
Figure 2. IMU positions on the data glove.
Sensors 18 01545 g002
Figure 3. MCM components.
Figure 3. MCM components.
Sensors 18 01545 g003
Figure 4. Bluetooth module and wireless adapter board.
Figure 4. Bluetooth module and wireless adapter board.
Sensors 18 01545 g004
Figure 5. (a) Side view of FFCB and (b) FFCB.
Figure 5. (a) Side view of FFCB and (b) FFCB.
Sensors 18 01545 g005
Figure 6. Prototype of the data glove.
Figure 6. Prototype of the data glove.
Sensors 18 01545 g006
Figure 7. Flowchart of program on host system.
Figure 7. Flowchart of program on host system.
Sensors 18 01545 g007
Figure 8. Well-calibrated raw data from the magnetometer. The center of the distribution is at (0, 0, 0) and the radius is 400 mG.
Figure 8. Well-calibrated raw data from the magnetometer. The center of the distribution is at (0, 0, 0) and the radius is 400 mG.
Sensors 18 01545 g008
Figure 9. Direction of IMUs.
Figure 9. Direction of IMUs.
Sensors 18 01545 g009
Figure 10. Position of ROMs and IMUs.
Figure 10. Position of ROMs and IMUs.
Sensors 18 01545 g010
Figure 11. Validation results of accelerometer data.
Figure 11. Validation results of accelerometer data.
Sensors 18 01545 g011
Figure 12. Verification results of gyro data.
Figure 12. Verification results of gyro data.
Sensors 18 01545 g012
Figure 13. Verification results of magnetometer data.
Figure 13. Verification results of magnetometer data.
Sensors 18 01545 g013
Figure 14. The data of magnetometer before and after calibration.
Figure 14. The data of magnetometer before and after calibration.
Sensors 18 01545 g014
Figure 15. Self-made measurement platform for measuring finger angle.
Figure 15. Self-made measurement platform for measuring finger angle.
Sensors 18 01545 g015
Figure 16. Self-made measurement platform for measuring finger angle. The angles are set to change in different intervals: (a) interval 0°–30°; (b) interval 0°–60°; and (c) interval 0°–90°.
Figure 16. Self-made measurement platform for measuring finger angle. The angles are set to change in different intervals: (a) interval 0°–30°; (b) interval 0°–60°; and (c) interval 0°–90°.
Sensors 18 01545 g016
Figure 17. The mean error of the static angle for each minute.
Figure 17. The mean error of the static angle for each minute.
Sensors 18 01545 g017
Figure 18. The real-time Unity program for visualizing the hand’s movement.
Figure 18. The real-time Unity program for visualizing the hand’s movement.
Sensors 18 01545 g018
Table 1. Verification results of static angles.
Table 1. Verification results of static angles.
Reference Angle (°)0306090120
Average of Measured Angles (°)0.0930.0460.1788.37116.47
RMSE (°)0.150.050.100.190.09
Table 2. Dynamic verification errors.
Table 2. Dynamic verification errors.
Actual Swinging Angle Range (°)306090
Mean Error (°)0.91−2.30−0.82
Table 3. Comparison of our proposed data glove and other data gloves.
Table 3. Comparison of our proposed data glove and other data gloves.
SystemKortier et al. [2]Choi et al. [11]Fang et al. [8]Proposed System
Transmission interfaceUSBBluetoothBluetoothUSB/Bluetooth
ValidationDynamicStaticDynamicRaw data, Static, Dynamic
Easy to wearNoYesYesYes
Modular designNoNoNoYes
MaintainabilityNoNoNoYes
ExtensibilityNoNoNoYes

Share and Cite

MDPI and ACS Style

Lin, B.-S.; Lee, I.-J.; Yang, S.-Y.; Lo, Y.-C.; Lee, J.; Chen, J.-L. Design of an Inertial-Sensor-Based Data Glove for Hand Function Evaluation. Sensors 2018, 18, 1545. https://doi.org/10.3390/s18051545

AMA Style

Lin B-S, Lee I-J, Yang S-Y, Lo Y-C, Lee J, Chen J-L. Design of an Inertial-Sensor-Based Data Glove for Hand Function Evaluation. Sensors. 2018; 18(5):1545. https://doi.org/10.3390/s18051545

Chicago/Turabian Style

Lin, Bor-Shing, I-Jung Lee, Shu-Yu Yang, Yi-Chiang Lo, Junghsi Lee, and Jean-Lon Chen. 2018. "Design of an Inertial-Sensor-Based Data Glove for Hand Function Evaluation" Sensors 18, no. 5: 1545. https://doi.org/10.3390/s18051545

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop