Next Article in Journal
Dual Synthetic Jets Actuator and Its Applications—Part I: PIV Measurements and Comparison to Synthetic Jet Actuator
Next Article in Special Issue
Flying State Sensing and Estimation Method of Large-Scale Bionic Flapping Wing Flying Robot
Previous Article in Journal
Deep Reinforcement Learning for Stability Enhancement of a Variable Wind Speed DFIG System
Previous Article in Special Issue
Coupled Force–Position Control for Dynamic Contact Force Tracking in Uncertain Environment
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Design of an Intuitive Master for Improving Teleoperation Task Performance Using the Functional Separation of Actuators: Movement and Gravity Compensation

1
Robotics, University of Science and Technology (UST), Daejon 34113, Korea
2
Robotics R&D Department, Korea Institute of Industrial Technology (KITECH), Ansan 15588, Korea
*
Author to whom correspondence should be addressed.
Actuators 2022, 11(7), 204; https://doi.org/10.3390/act11070204
Submission received: 21 June 2022 / Revised: 12 July 2022 / Accepted: 19 July 2022 / Published: 21 July 2022
(This article belongs to the Special Issue Mechanism Design and Control for Robotics)

Abstract

:
Teleoperation, in which humans and robots work together to improve work performance, is growing explosively. However, the work performance of teleoperation is not yet excellent. Master–slave systems with different kinematics and workspaces need space-transformation control techniques. These techniques cause psychological fatigue to an operator with poor manipulation skills. In this study, we propose an intuitive master design that focuses on fatigue. Large workspaces reduce mental fatigue; however, they lead to physical fatigue problems. To solve this problem, we reflect the role of actuators in the design, through functional separation using movement and gravity compensation. This study proposes the design and prototype fabrication of an intuitive master K-handler to improve remote-work performance. The K-handler features six degrees of freedom (DoF), an anthropomorphic structure, and a lightweight nature. It has a reach long enough to cover the workspace of the human arm to reduce mental fatigue. In addition, gravity compensation, which can reduce the operator’s physical fatigue during operation, is possible in all workspace areas.

1. Introduction

Teleoperation is defined as an extension of human senses and work capabilities. A system that can expand the operation of a machine or another system from the space where the operator exists to a distant area is called a teleoperation system. This system allows humans to operate robots or mechanical devices from a long distance, as though they are working directly on-site, while securing the operator’s safety [1]. In the late 1940s, Raymond C. Goertz first proposed a mechanical teleoperation system called a master–slave system. Since then, various master–slave remote control systems have been developed by many researchers.
With the robot technology development, not only simple repetitive tasks but also complex and dangerous tasks performed by humans are being performed by robots [2]. However, the current robot technology level does not have the intelligence to allow robots to identify all faults and hazards in the field and act independently [3]. Owing to this intelligence limitation, human judgment is still important, and teleoperation makes this possible.
Unlike typical industrial robots that perform repetitive tasks according to predetermined programs in a static work environment, teleoperation systems can actively cope with changing situations [4]. Therefore, teleoperation is used in various fields, such as, inside nuclear power plants that are difficult to access, space, deep sea, and military areas.
A representative example of a robot’s inability to perform tasks autonomously is a disaster situation. The disaster-response work environment is a typical external environment without any operational pattern. Currently, most disaster-response systems depend on the workforce and construction equipment. This is a dangerous environment where secondary accidents, such as fires, occur. For this reason, research on robots that can work on behalf of humans in a disaster-prone environment is being conducted to protect workers from danger. However, in an unstructured environment, high-level work requires a high level of judgment intelligence for executively reacting to different situations; therefore telemanipulation is used because robots cannot perform any executive decisions independently.
The expectations for telemanipulation task performance are increasing owing to the expansion in the teleoperation market. In the past, most of the attention was focused on how slave robots would perform their tasks. The possibility of a teleoperation mission depends primarily on whether or not the slave robot can handle the task. Recently, research was conducted on master devices to improve maneuverability, control systems for realizing a sense of telepresence, and slave robots’ ability [5,6]. The critical point when applying teleoperation to various fields is not only the task capacity but also how to perform the mission effectively. Thus, the improvement of human–robot interaction (HRI), which is the operability of the master arm, is essential [7].
Methods of remotely controlling the target robot include directly manipulating each joint, such as with a joystick or lever, and using the kinematics of the robot, such as those of a master–slave system. Joysticks and levers are one of the easy ways to configure a teleoperation system, allowing simple operation [8]. However, there is a limit to performing complex joint movements or controlling slave robots with high DoF. This counter-intuitive manipulation method makes the operator feel a psychological burden, and training time is required to become used to it [9,10]. The master was developed in the form of a manipulator to solve this problem. These masters have a replica type that imitates a slave and a universal type that can be used for a general purpose.
Research on improving the master’s maneuverability to improve teleoperation task performance is actively underway. Recently, universal-type masters with dissimilar kinematics to those of slaves were mainly developed in multi DoF systems owing to the disadvantages of replica-type masters in terms of production and cost. Various types of commercial devices have also been released and used in many studies. However, although commercial devices are mainly desktop-sized and have low force and workspace capabilities, they have the advantage of being universally applicable to various slaves [11,12,13,14].
In addition, masters with a large workspace, in wearable robots used for specific applications, were also studied. These masters incorporate space relocation technologies or continuing hardware improvements to overcome their respective physical limitations to improve operability [15]. Locking a valve or screwing walls using tools is a straightforward task for humans. However, the teleoperation system takes a long time to perform tasks using conventional methods. Moreover, the master maneuverability to improve teleoperation task performance is still a challenge.
Our previous research investigated the teleoperation of special-purpose machinery with 14 DoF of a dual-arm mechanism for disaster response as illustrated in Figure 1 [16]. This heavy machinery can be easily and efficiently operated by unprofessional firefighters, compared to excavators, which were difficult to operate in a disaster environment. Therefore, the machinery was designed to perform complex and diverse tasks as a dual-arm type. The machinery required an intuitive master capable of force-reflection bilateral remote control for dual-arm collaboration.
Commercial master devices are challenging to employ in our applications because of the workspace or force capability limitations. Therefore, we proceeded with the study of the design of intuitive masters. In this study, we present the design direction of the intuitive master device using the functional separation of actuators and introduce the master that anyone can easily implement and produce inexpensively. The master is called a K-handler, which features six DoF, lightweight, and a large workspace, and is capable of haptic operations, force-reflection control, and gravity compensation as illustrated in Figure 2.
This paper is organized as follows: Section 2 discusses the need for intuitive masters. Specifically, the characteristics that a master should have are explained. Section 3 identifies the design requirements and presents design directions. Section 4 introduces the K-handler prototype and control architecture. Section 5 verifies the K-handler experimental results on workspace, gravity compensation, and teleoperation task performance. Section 6 is the conclusion of this paper.

2. Physical and Mental Factors to Hinder Intuitive Teleoperation

Various studies are being conducted to improve the task performance of teleoperation. However, it is difficult to expect a major improvement in task performance by simply applying the teleoperation technology to robot systems.
The task performance of teleoperation can be upgraded through an integrated improvement of all the master, slave, and control systems constituting teleoperation. Slave manipulators, which perform tasks in the field to improve teleoperation task performance, are being developed to be more powerful and capable of performing more diverse tasks, as with industrial robots. There are also many studies on control techniques to offset the difference in RoM from the dissimilar kinematics structures of the master and slave, or the sense of reality to convey more field information to the operator. Furthermore, we would like to study the master design to improve the task performance of teleoperation.
Teleoperation is when robots perform tasks on behalf of workers. Naturally, it is a human-in-the-loop system that requires frequent operator intervention, because it is difficult for robots to handle tasks autonomously. Therefore, interest in the convenience and operability of master devices began to grow, and many researchers have conducted research on intuitive masters.
In previous studies, the structure of the master tended to depend on the slave or the slave’s mission. In the beginning, replica-type masters were used to easily and efficiently control the slaves. The replica-type master is a simple way of controlling the slave as it appears. Using the replica-type master, the operator can manipulate the master–slave pose without their forward and inverse kinematics calculations. This method does not require complex control techniques, such as coordinate system transformation. However, as described above, the replica-type master is not advantageous in terms of control and cost, as it is developed in a complex structure with the multi DoF of the slave robot.
Recently, several universal masters that can be applied to multiple applications have been commercialized. Universal masters avoid complex structures and adopt task space control rather than joint space control to be applied to various slave robots with different mechanical designs, increasing usability and user friendliness. These devices are versatile; however, most of them are desktop-sized, with limited workspace and low force capacity. Other researchers tried to modify and combine these commercial devices or use coordinate system transformation, such as workspace mapping, to overcome physical limitations [17].

2.1. Intuitiveness in Master Devices

The word intuitive means to directly grasp an object impulsively. It can be said that, it is intuitive for a person to use a familiar manipulation method. Humans have always lived by moving their arms freely in the task space. For example, humans do not move while thinking about the angle between the elbow and shoulder to reach the object; instead, they move instinctively. In other words, humans do not move their arms through complicated calculations. We believe that the intuitiveness of manipulation in the master’s design is a significant factor in improving the task performance. Therefore, we would like to use the word “intuitive” in the design of the master to imply that ’as if a person naturally moves their arm’. If the operator can manipulate the master as if their arms were moving, the psychological burden could be significantly reduced.

2.2. Problems of Counter-Intuitive Operating Methods

Take excavators as an example of the problem of counter-intuitive control methods. The operator controls the speed of each joint using several levers or joysticks corresponding to each joint of the excavator. To operate an excavator consisting of rotating joints in combination with two or more joints, such as linear motion, the excavator is controlled using a combination of two or more levers, and takes considerable training time to become an expert [18]. Naturally, task performance is dependent on the operator’s proficiency. Even a skilled operator may experience a psychological load and make mistakes in long-term use [10].
People feel stressed when the control method is unfamiliar or they cannot operate the object properly, such as when driving a car for the first time. A psychological load is felt when a calculation process for spatial transformation or discontinuity is required. People may feel scared when they are new to manipulation or burdened from a mission failure. This counter-intuitive manipulation accumulates mental fatigue, such as stress, mental load, and fear, which will result in less time for performing tasks and more mistakes. As illustrated in Equation (1), mental fatigue can be expressed as a cumulative sum of stress, mental load, fear, etc.
mental fatigues = ( stress + mental load + fear + ) d t

2.3. Fatigue in Teleoperation

During telemanipulation, operators experience a mental load because of differences in handling methods, and they also experience physical fatigue from working with their arms raised [19]. We ensured that the master is intuitive for as long as task-space control is possible, and we looked at the master from the workspace-size perspective by focusing on the commercial desktop masters. Desktop masters with relatively small workspaces use some conversion techniques to control bigger slaves, which causes mental transformation and discontinuity, resulting in mental fatigue. However, having an extensive reach widens the work area, making it easier for physical fatigue to occur.
  • Physical Fatigue
Physical fatigue refers to a sense of incompetence that occurs in the muscles. In teleoperation, physical fatigue is tiredness that results when the operator manipulates a master. The operator mainly manipulates the master device using their hands, with their arms extended or raised. At this time, if the master robot cannot sufficiently compensate for the gravity generated by its weight, the operator becomes tired easily. In addition, the master’s frictional force, inertia, and interference act as a load on the operator. Fatigue accumulates when the master is used continuously, for a long time, by the operator. Physical fatigue is often problematic, and it increases with increasing workspace.
  • Mental Transforamtion
A teleoperation system using a replica-type master of the same structure and size as the slave does not require a coordinate system transformation. However, as mentioned above, the replica-type master is not efficient; therefore, the commonly available universal-type master is used. Universal masters have a different structure from that of the slave; therefore, the RoM of each joint and size of the reachable workspace are different. The position or force dimension differs between the operator’s arms, masters, and slaves, and the operator must mentally convert the position and direction of the force to match them. In addition, the difference in the workspace requires control techniques, such as mapping and spanning [20]. These control techniques cause transformation and distortion of the coordinate system, making the operator always consider and manipulate the mental transformation [21].
  • Discontinuity
Discontinuity refers to a movement, such as that of lifting off the computer mouse when it can no longer move at the edges of the mouse pad. When there is a limited master workspace for the operator, clutch action is needed to temporarily block and reconnect the connection of the position and force between the master and slave. When the clutch motion occurs, the position or force must be calculated relative to the previous position in a three-dimensional space, causing mental fatigue. Different workspaces in the master-to-slave operation result in discontinuity. The clutch system may be necessary because the master’s workspace is relatively smaller than the slave’s in teleoperation. However, from the mental fatigue perspective, minimizing the number of times of this discontinuity is a way of lowering the cognitive load. A large master’s workspace can reduce the number of discontinuities.

3. Design of K-Handler

We believe that intuitive masters should minimize mental fatigue as well as mental transformation and discontinuity. In other words, this master should be task-space controllable and have a large workspace. As humans can freely manage their arms from long empirical trial-and-error techniques, if operators can give commands to the master devices naturally as if they move their arms, it can reduce mental fatigue and improve teleoperation task performance. However, physical fatigue is also one of the problems that need to be solved. A good master must minimize interference with the operator, friction, and inertia and requires gravity compensation. The master we would like to propose is an intuitive master that even beginners can operate for a long time without any operational difficulties.
In the robot arm design, there is always a trade-off relationship with other variables, such as link length, actuator selection, inertia, RoM, etc. [22,23]. As mentioned above, intuitive masters should be designed to minimize mental fatigue. Furthermore, it was explained that designing a larger master’s workspace can increase intuitiveness. However, if the link length is designed to increase the master’s workspace, the actuators require a huge force, increasing the frictional force and inertia.
Eventually, the system size increases, RoM becomes limited, control response decreases, and cost increases. We set some design requirements that the master must satisfy to solve these problems, and we solved the contradictions derived from them using the functional separation and applied them to the design. The following are the design requirements of an intuitive master to increase teleoperation task performance.
The intuitive masters
  • Should have a large workspace.
  • Should be able to reduce physical fatigue.
  • Should not interfere with the operator’s movement.
  • Should be free from collision with the operator [24].
  • Should be capable of bilateral teleoperation.
To reduce mental transformation or discontinuous sections that cause mental fatigue, a larger workspace is required. Having a large workspace will lead to a gravity compensation problem. The gravity compensation system is needed to reduce physical fatigue when the master is used for a long time or with outstretched arms. To improve operability, the master must move smoothly to not interfere with the operator’s movement. To achieve that, friction, inertia, vibration, clearance, etc., of the master devices must be minimized, and the actuator must be backdrivable.
The master that interacts at the closest distance to operators should not make any collision, even if it is for safety. In addition, when operators and masters share a workspace, collisions create shaded areas of the workspace and damage the intuitiveness of manipulation. Finally, to improve the task performance of teleoperation, bilateral teleoperation must be possible, and a system that implements telepresence, such as haptic-, guiding-, and earthing systems, is needed [25,26].
It is not easy to satisfy all design requirements of the intuitive master described above. The relationship between each design requirement and design variable was analyzed as shown in Table 1. Considering this table, there is a contradiction in the selection of actuators. In manipulating a giant slave, the larger the master’s workspace, the more intuitive it is and the less mental fatigue it can cause. Under this condition, we select the variable α , as shown in Equation (2), as a value representing the ratio of the human arm’s workspace to the master’s workspace. If α is approximately equal to or greater than one, the master can cover the workspace of the human arm, which boosts intuitive manipulation.
α = ( workspace of master ) ( workspace of human arm )
The link length is extended to enlarge the master’s workspace, and a more powerful joint actuator is required. Similarly, to implement the gravity compensation function to reduce physical fatigue, it is necessary to use actuators with a high reduction gear ratio or high power. However, from design requirement No. 3, an actuator with a low reduction gear ratio should be used. Moreover, an actuator that exerts a large force may be restricted to a slim design.
The contradiction that occurred in this way was applied to the design of the master device by separating the motion and gravity compensation functions among the roles of the joint actuator, using the separation law of the TRIZ. The joint actuator only controls movement and does not require much force. In addition, if a separate gravity compensation device driven by wires is directly connected to the wrist, it can implement the gravity compensation function while having a large workspace, and it can be designed to have slim and low inertia.
The functional separation of the joint actuator in movement and gravity compensation described above is more efficient than otherwise. Using the two-link planar manipulator as an example, as illustrated in Figure 3, the maximum torque required for the gravity compensation of the robotic arm of a conventional serial mechanism is the sum of the gravity compensation torque l M g and movement torque τ movement , as shown in Equation (3).
τ 1 , max = l M g + τ movement
The link’s weight and the actuator were ignored. Conversely, if the wire is directly connected to the end where the load is concentrated to compensate for gravitational force, the maximum torque is r M g , where r is the radius of the pulley.
τ 2 , max = τ movement τ top , max = r M g
The gravity compensation torque is eliminated in the joint, and only the movement torque τ movement remains as shown in Equation (4). In general, l is approximately 70 cm long, assuming that it is a human arm length, and the radius of the top pulley is set to 2 cm, which is approximately 35 times different and is also efficient in terms of energy.
However, when the wrist is out of the center of the fixed top pulley, a restoring force acts toward the central axis of the pulley as illustrated in Figure 4. This restoring force is a function of the angle θ formed by the upper pulley’s central axis and the wire; θ is an acute angle, and M g s i n θ is significantly small compared to M g . This value is simply applied to the controller by using Equation (5).
τ θ = J T M g s i n θ
where τ θ denotes each joint torque and J denotes jacobian matrix. This is the result of ignoring the weight of each joint actuator and the link weight, and if the weight is reflected, there will be a more significant difference. The sum of forces that joints actuators must exert is M g s i n θ , smaller than M g in a typical way. The force required for the wire to achieve gravitational equilibrium is M g c o s θ . The wire system allows direct compensation to the wrist, reducing the link length effect, and making it efficient in a serial structure. Thus, applying a gravity compensation system by straightening the wire to the wrist through separating the function of the actuator into movement and gravity compensation, allows the master covering the human workspace to be articulated with small, low-power actuators.

4. Implementation of K-Handler

4.1. Prototype

Based on the design requirements and parameters described in the previous chapter, a six DoF prototype was realized. As illustrated in Figure 5, the K-handler consists of three upper joints responsible for translation and three lower joints accountable for the orientation of the wrist. The wire-driven gravity compensation device located at the top is directly connected to the wrist of the K-handler through a pulley. The coordinate system and RoM of each joint are listed in Figure 6 and Table 2. The upper DoF are made up of serial mechanisms. The rotational axes of the lower joints intersect at one point and are orthogonal to each other as shown in Figure 7. This means that the translation and orientation of the wrist are physically separated. The K-handler structure is similar to a human arm, providing an intuitive movement to the operator.
The K-handler consisted of six joints, including a small low-power DC motor, position sensor, and current sensing resistor, and its links were made of carbon pipes to reduce the weight. The joints were constructed using a 1.42 Nm DC motor for the three upper joints and a 0.25 Nm DC motor for the three wrist joints. The controllers are embedded inside the motor using an STM32F0 series small MCU. Each controller transmits and receives information on the position, current, and motor output at a speed of 1 Mbps using an RS485 communication. The end-effector is a modified handle of a Logitech commercial joystick. There are 10 pushbutton switches that provide functions, such as grasping, variable changing, and mode changing.

4.2. Control Architecture for Teleoperation

The K-handler is a master device designed to improve intuitiveness. The force reflection for telepresence is essential in teleoperation. The bilateral teleoperation system as shown in Figure 8 was implemented and tested in this study. The controller is implemented based on the Cartesian-space PD controller. It is a virtual spring and damper system (VSD) between the desired position and the current position. The position and velocity of the slave are converted to a motion information on the master coordinate system through a scale factor to become a desired position, and the current position and velocity error with the master generates F v s d 3 . The proposed VSD controller is derived as follows:
F v s d = k p m ( X s , m X m ) + k d m ( X ˙ s , m X ˙ m )
where k p m 3 is a virtual spring coefficient, and k d m 3 is a damping coefficient acting on the master; X s , m 3 is position of the slave converted to the coordinate system of the master; X m 3 is position of the master.
This VSD system allows the operator to feel the force of resistance through the master when the slave robot is unable to move due to an obstacle or when there is a speed difference between the master and the slave.
Here, the overall K-handler control architecture is shown in Figure 9. The K-handler is capable of bilateral teleoperation and transmits haptic force F h a p t i c 3 in direction of translation to the operator using the motion information of the slave. Master–slave systems with different kinematics are converted to each other’s coordinate systems through scale factors. The positional difference on the master coordinate system creates the virtual force F v s d , which is converted into joint torque.
In wrist orientation case, F r e s t o r i n g and F w i r e become zero. It is also possible to calculate the gravity compensation torque of the wire device through the position of the master itself. The τ top and τ θ mentioned in Equations (4) and (5) in the previous chapter can be obtained using the motion information of the K-handler. Through K-handler’s forward kinematics, the position of the wrist can be calculated to obtain theta, which is the angle between the wrist and the central axis of the fixed pulley. Then,
F r e s t o r i n g = M g s i n θ F w i r e = M g c o s θ
where F r e s t o r i n g 3 and F w i r e is scalar because the wire that has passed through the pulley is not directional. The F r e s t o r i n g and F w i r e give the static force required for K-handler gravity compensation. This F r e s t o r i n g is multiplied by the master’s Jacobian transpose matrix to calculate joints torque and acts as an input to the joint through motor drivers.

5. Verification of K-Handler

Three methods were verified to evaluate the intuitiveness and performance of the K-handler. First, we argued that the intuitive master in telemanipulation should be large enough to cover the human arm workspace, and we confirmed the size of the proposed K-handler’s workspace. Second, most masters with large workspaces have problems with gravitational compensation, which makes the system heavy and bulky. We tested whether our proposed wire-driven gravitation compensation device acting directly on the wrist with a large workspace can solve this problem at the same time. Third, to verify the K-handler’s teleoperation task performance, the teleoperation experiment was conducted to draw along the prepared circle via slave robot seven-DoF hydraulic manipulator UW. Ten subjects were experimented with to secure objectivity, and statistical analysis of the teleoperation task performance was conducted.

5.1. Workspace Analysis

Figure 10 illustrates the workspace of the K-handler for the right arm. A human model is projected for comparison with the human right arm workspace. As described above, the K-handler can cover the workspace of the human arm to reduce mental fatigue during remote work. The orientation of the wrist may operate as much as RoM within the workspace.

5.2. Gravity Compensation Validation

Figure 11 depicts the gravity compensation experiment. If most of the force against gravity is directly compensated through wires attached to the wrist, each joint only needs to be involved in the restoring force. In this experiment, the mass is 0.4 kg of the measured wrist part, and the angle θ can be calculated from K-handler’s forward kinematics. Since the angle θ is an acute angle, it is confirmed that this restoring force is significantly smaller than the M g of the conventional method, and the forces calculated in Equation (7) was input to K-handler. Since this experiment is not a teleoperation test, the external force F v s d produced by the slave position is zero, then compliance motion is possible. In order to find out K-handler’s ability to compensate for gravitational force of its weight, an experiment was conducted to release hand at negative and positive positions in the X, Y, and Z directions during free motion. The K-handler confirmed that gravity compensation is possible in all workspace areas.

5.3. Teleoperation Task Performance

This section presents the experimental results obtained for teleoperation task performances. The experimental setup, see Figure 12, consists of the K-handler and the 7DOF slave manipulator UW. The UW is a hydraulic manipulator with a maximum reach of 1.7 m and consists of a combination of linear and rotary actuators. The actuators are operated by servo valves. The control period of the master and slave is 4 ms and the pressure supplied to the UW is 140 bar. To overcome the difference in the workspace, the scale factor of the master for the slave is {2, 2, 2}, which is doubled in each axial direction.
This experiment performed ten turns clockwise to draw a circle with a radius of 0.2 m attached to a soft wall to verify the teleoperation task performance of the K-handler. To prove the intuitiveness of the K-handler, the experiment was conducted on a person who first encountered K-handler. In addition, in order to examine the effect of the gravity compensation function on the teleoperation task performance, F r e s t o r i n g and F w i r e were excluded from Figure 9, and further experiments were conducted and compared.
Figure 13 and Figure 14 show the position in 3D during ten turns of each experiment. The statistical analysis of position for comparing the teleoperation task performance in each experiment are shown in Figure 15 and Figure 16. Above all, even beginners could operate the system, and significant results could be confirmed depending on the presence or absence of a gravity compensation.
Figure 15 shows the distance of the end pointer from the center point of the circle. Figure 16 illustrates the depth to determine how far the end pointer deviates in the X-axis direction. When the master device relieves the force caused by gravity, it can be seen that more precise movement is possible and provides stability. In the experiments, the case with the gravitational compensation of the K-handler showed excellent results in the mean and deviation.
Based on the previous experiment, we expanded the experimental group to 10 subjects to secure more objectivity. The experiment was repeated, and a NASA task load index (TLX) survey was conducted at the end of each experiment. To prevent the subjects’ proficiency in the behavior of K-handler and UW from affecting the experiment, the order of gravity compensation functions was randomly conducted for each subject. Figure 17, Figure 18, Figure 19 and Figure 20 show statistical results for the experiments of 10 subjects. Statistically, it is not possible to show a quantitative degree of improvement by comparing only the average value. However, referring to Figure 17, Figure 18, Figure 19 and Figure 20, it can be said that the distribution of the UW end-effector positions is more accurate and stable when gravity compensation function is activated.
The NASA TLX survey was used to measure the load of teleoperation experiments. The results for the NASA TLX scores from the subjects are shown in Figure 21. After the experiment was conducted on six items, the experimenters scored between 0 and 100 based on their own criteria. The higher the score, the more difficult it is to perform the task. Although the subjects were new to the master–slave system using K-handler, we confirmed that the task load was significantly reduced in all items when there was a gravity compensation.

6. Conclusions

In this study, the design direction of the intuitive master device was presented, and the prototype K-handler was proposed. An intuitive master requires a large workplace to reduce mental fatigue. However, most master devices with long reach cause physical fatigue to the operator. Consequently, we designed a K-handler from the fatigue perspective. The functional separation of the actuators reduced the power required for the gravity compensation of the anthropomorphic workspace master. The joints could be constructed using small, low-power actuators. The K-handler is an exoskeleton type; however, it is not a wearable robot.
Moreover, there are no binding devices. Therefore, it is possible to ensure the operator’s safety from malfunctioning joint actuators. The K-handler requires an additional actuator to drive the wire for gravity compensation; however, the overall required torque is significantly reduced, which increases the overall efficiency. The K-handler is characterized by a lightweight and low inertia. Moreover, it has a reach long enough to cover the workspace of the human arm so that it can cover most of the operator’s arm and reduce the mental burden. In addition, gravity compensation is possible in all areas of the workspace, thereby, reducing the operator’s physical fatigue during teleoperation.
We confirmed the convenience of the K-handler and its potential in teleoperation applications. Through teleoperation task experiments, we confirmed that even untrained beginners could perform the task. In addition, we verified that the gravity compensation relieved the physical fatigue of the operator and allows them to manipulate the K-handler with smaller efforts. The NASA TLX scores confirmed that the gravity compensation feature reduces the work load.
Overall, the K-handler is an intuitive master device with a large workspace and can improve remote work performance with gravity compensation ability. Our research will expand into the extension of dual arms, application of special-purpose machinery, and interpretation of redundancy in future works. Furthermore, we would like to check the excellence of qualitative K-handler through a survey by dealing with various experimental groups.

Author Contributions

Conceptualization: J.C.; methodology: S.U.C., J.C., J.S. and J.K. (Jungyeong Kim); software: S.U.C., S.P., S.H. and J.K. (Jinhyeon Kim); validation: S.U.C., S.P., J.K. (Jungyeong Kim), J.S. and J.T.K.; formal analysis: S.U.C., J.T.K. and J.C.; investigation: S.U.C., S.H. and J.K. (Jinhyeon Kim); resources: S.U.C., S.H. and J.C.; data curation: S.U.C., J.K. (Jinhyeon Kim) and J.T.K.; writing-original draft preparation: S.U.C. and J.C.; writing-review and editing: S.U.C., J.K. (Jungyeong Kim), J.S. and J.C.; visualization: S.U.C., J.K. (Jungyeong Kim) and J.S.; supervision: J.C.; project administration: J.C.; funding acquisition: J.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Korea Institute of Industrial Technology under “Development of Soft Robotics Technology for HumanRobot Coexistence Care Robots (6/7): KITECH EH220002”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
K-handlerKitech-handler
DoFDegree-of-Freedom
RoMRange of Motion
HRIHuman–Robot Interaction
VSDVirtual Spring-Damper system

References

  1. Herbin, P.; Woźniak, M. Bilateral teleoperation system for a mini crane. Zeszyty Naukowe Akademii Morskiej w Szczecinie 2019, 57, 63–69. [Google Scholar]
  2. Zhang, J.; Fu, H.; Dong, Y.; Zhang, Y.; Yang, C.; Chen, Y. Novel 6-DOF wearable exoskeleton arm with pneumatic force-feedback for bilateral teleoperation. Chin. J. Mech. Eng. 2008, 21, 58–65. [Google Scholar] [CrossRef]
  3. Rakita, D.; Mutlu, B.; Gleicher, M. A motion retargeting method for effective mimicry-based teleoperation of robot arms. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, Vienna, Austria, 6–9 March 2017; pp. 361–370. [Google Scholar]
  4. Yang, C.J.; Zhang, J.F.; Chen, Y.; Dong, Y.M.; Zhang, Y. A review of exoskeleton-type systems and their key technologies. Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci. 2008, 222, 1599–1612. [Google Scholar] [CrossRef]
  5. Rahal, R.; Matarese, G.; Gabiccini, M.; Artoni, A.; Prattichizzo, D.; Giordano, P.R.; Pacchierotti, C. Caring about the human operator: Haptic shared control for enhanced user comfort in robotic telemanipulation. IEEE Trans. Haptics 2020, 13, 197–203. [Google Scholar] [CrossRef] [PubMed]
  6. Bianchi, M. A fabric-based approach for wearable haptics. Electronics 2016, 5, 44. [Google Scholar] [CrossRef] [Green Version]
  7. Ahn, J.; Kim, J.; Lee, H.; Hwang, M.; Kwon, D.S. A highly intuitive and ergonomic redundant joint master device for four-degrees of freedom flexible endoscopic surgery robot. Int. J. Med Robot. Comput. Assist. Surg. 2021, 17, 1–14. [Google Scholar] [CrossRef] [PubMed]
  8. Huang, L.; Yamada, H.; Ni, T.; Li, Y. A master–slave control method with gravity compensation for a hydraulic teleoperation construction robot. Adv. Mech. Eng. 2017, 9, 1687814017709701. [Google Scholar] [CrossRef] [Green Version]
  9. Rebelo, J.; Sednaoui, T.; Den, E.E.B.; Krueger, T.; Schiele, A. Bilateral robot teleoperation: A wearable arm exoskeleton featuring an intuitive user interface. IEEE Robot. Autom. Mag. 2014, 21, 62–69. [Google Scholar] [CrossRef]
  10. Gong, D.; Zhao, J.; Yu, J.; Zuo, G. Motion mapping of the heterogeneous master–slave system for intuitive telemanipulation. Int. J. Adv. Robot. Syst. 2018, 15, 1729881417748134. [Google Scholar] [CrossRef] [Green Version]
  11. Peer, A. A new admittance-type haptic interface for bimanual manipulations. IEEE/ASME Trans. Mechatron. 2008, 13, 416–428. [Google Scholar] [CrossRef]
  12. Peer, A.; Stanczyk, B.; Buss, M. Haptic telemanipulation with dissimilar kinematics. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada, 2–6 August 2005; pp. 3493–3498. [Google Scholar]
  13. Kron, A.; Schmidt, G.A. Bimanual haptic telepresence system-design issues and experimental results. In Proceedings of the Third IEEE International Conference on Humanoid Robots, Las Vegas, NV, USA, 21–31 October 2003; pp. 1–20. [Google Scholar]
  14. Gentile, M.; Mengoni, M.; Babini, M.; Germani, M. Design of a force feedback haptic device based on an anthropomorphic arm. In Proceedings of the IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, Suzhou, China, 8–10 July 2012; pp. 172–177. [Google Scholar]
  15. Mamdouh, M.; Ramadan, A.A. Development of a teleoperation system with a new workspace spanning technique. In Proceedings of the IEEE International Conference on Robotics and Biomimetics, Guangzhou, China, 11–14 December 2012; pp. 1570–1575. [Google Scholar]
  16. Kim, J.T.; Park, S.; Han, S.; Kim, J.; Kim, H.; Choi, Y.H.; Seo, J.; Chon, S.U.; Kim, J.; Cho, J. Development of Disaster-Responding Special-Purpose Machinery: Results of Experiments. Authorea Preprints. J. Field Robot. 2021. accepted. [Google Scholar]
  17. Ateş, G.; Brunetti, L.; Bonfè, M. Improved usability of a low-cost 5-DOF haptic device for robotic teleoperation. In ROMANSY 22—Robot Design, Dynamics and Control; Springer: Cham, Switzerland, 2019; Volume 22.3, pp. 213–221. [Google Scholar]
  18. Herbin, P.; Pajor, M. ExoArm 7-DOF (interactive 7-DOF motion controller of the operator arm) master device for control of loading crane. In Advances in Manufacturing; Springer: New York, NY, USA, 2018; pp. 439–449. [Google Scholar]
  19. Shao, S.; Zhou, Q.; Liu, Z. Mental workload characteristics of manipulator teleoperators with different spatial cognitive abilities. Int. J. Adv. Robot. Syst. 2019, 16, 1729881419888042. [Google Scholar] [CrossRef]
  20. Mamdouh, M.; Ramadan, A.A.; Abo-Ismail, A.A. Evaluation of a proposed workspace spanning technique for small haptic device based manipulator teleoperation. In Proceedings of the International Conference on Intelligent Robotics and Applications, Montreal, QC, Canada, 3–5 October 2012; Volume 22.3, pp. 161–170. [Google Scholar]
  21. Chen, Y.; Zhang, J.; Yang, C.; Niu, B. The workspace mapping with deficient-DOF space for the PUMA 560 robot and its exoskeleton arm by using orthogonal experiment design method. Robot. Comput.-Integr. Manuf. 2007, 23, 478–487. [Google Scholar] [CrossRef]
  22. Lee, D.; Seo, T. Lightweight multi-DOF manipulator with wire-driven gravity compensation mechanism. IEEE/ASME Trans. Mechatron. 2017, 22, 1308–1314. [Google Scholar] [CrossRef]
  23. Jung, Y.; Ramos, J. A Large Force Haptic Interface with Modular Linear Actuators. arXiv 2022, arXiv:2203.03516. [Google Scholar]
  24. Ohta, P.; Valle, L.; King, J.; Low, K.; Yi, J.; Atkeson, C.G.; Park, Y.L. Design of a lightweight soft robotic arm using pneumatic artificial muscles and inflatable sleeves. Soft Robot. 2018, 5, 204–215. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Fehlberg, M.A.; Gleeson, B.T.; Provancher, W.R. Active Handrest: A large workspace tool for precision manipulation. Int. J. Robot. Res. 2012, 31, 289–301. [Google Scholar] [CrossRef]
  26. Fani, S.; Ciotti, S.; Catalano, M.G.; Grioli, G.; Tognetti, A.; Valenza, G.; Ajoudani, A.; Bianchi, M. Simplifying telerobotics: Wearability and teleimpedance improves human–robot interactions in teleoperation. Robot. Autom. Mag. 2018, 25, 77–88. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The dual-arm manipulator for special-purpose disaster-response machinery from KITECH.
Figure 1. The dual-arm manipulator for special-purpose disaster-response machinery from KITECH.
Actuators 11 00204 g001
Figure 2. The prototype 3D model of K-handler.
Figure 2. The prototype 3D model of K-handler.
Actuators 11 00204 g002
Figure 3. Comparison of the maximum gravity compensation torque at and (a) 2 DoF planar manipulator and (b) 2 DoF planar manipulator with a wire-driven direct-gravity compensation system.
Figure 3. Comparison of the maximum gravity compensation torque at and (a) 2 DoF planar manipulator and (b) 2 DoF planar manipulator with a wire-driven direct-gravity compensation system.
Actuators 11 00204 g003
Figure 4. The restoring force that occurs when the end-effector is out of the pulley’s center axis.
Figure 4. The restoring force that occurs when the end-effector is out of the pulley’s center axis.
Actuators 11 00204 g004
Figure 5. The prototype of the K-handler.
Figure 5. The prototype of the K-handler.
Actuators 11 00204 g005
Figure 6. The coordinate system of the K-handler.
Figure 6. The coordinate system of the K-handler.
Actuators 11 00204 g006
Figure 7. The wrist orientations intersect at one point.
Figure 7. The wrist orientations intersect at one point.
Actuators 11 00204 g007
Figure 8. The bilateral teleoperation concept of K-handler.
Figure 8. The bilateral teleoperation concept of K-handler.
Actuators 11 00204 g008
Figure 9. The control architecture of the K-handler.
Figure 9. The control architecture of the K-handler.
Actuators 11 00204 g009
Figure 10. The workspace analysis of the K-handler.
Figure 10. The workspace analysis of the K-handler.
Actuators 11 00204 g010
Figure 11. The end-effector position of K-handler to verify the gravity compensation performance.
Figure 11. The end-effector position of K-handler to verify the gravity compensation performance.
Actuators 11 00204 g011
Figure 12. Teleoperation task performance experiments.
Figure 12. Teleoperation task performance experiments.
Actuators 11 00204 g012
Figure 13. End-point trajectory of the UW during experiments in 3D without gravity compensation of K-handler.
Figure 13. End-point trajectory of the UW during experiments in 3D without gravity compensation of K-handler.
Actuators 11 00204 g013
Figure 14. End-point trajectory of the UW during experiments in 3D with gravity compensation of K-handler.
Figure 14. End-point trajectory of the UW during experiments in 3D with gravity compensation of K-handler.
Actuators 11 00204 g014
Figure 15. The mean and deviation for the distance from center.
Figure 15. The mean and deviation for the distance from center.
Actuators 11 00204 g015
Figure 16. The mean and deviation for depth in the x-axis.
Figure 16. The mean and deviation for depth in the x-axis.
Actuators 11 00204 g016
Figure 17. Distribution of the UW end-effector distance from the center of 10 subjects without gravity compensation of K-handler.
Figure 17. Distribution of the UW end-effector distance from the center of 10 subjects without gravity compensation of K-handler.
Actuators 11 00204 g017
Figure 18. Distribution of the UW end-effector distance from the center of 10 subjects with gravity compensation of K-handler.
Figure 18. Distribution of the UW end-effector distance from the center of 10 subjects with gravity compensation of K-handler.
Actuators 11 00204 g018
Figure 19. Distribution of the UW end-effector depth in x-axis of 10 subjects without gravity compensation of K-handler.
Figure 19. Distribution of the UW end-effector depth in x-axis of 10 subjects without gravity compensation of K-handler.
Actuators 11 00204 g019
Figure 20. Distribution of the UW end-effector depth in x-axis of 10 subjects with gravity compensation of K-handler.
Figure 20. Distribution of the UW end-effector depth in x-axis of 10 subjects with gravity compensation of K-handler.
Actuators 11 00204 g020
Figure 21. NASA TLX score comparison.
Figure 21. NASA TLX score comparison.
Actuators 11 00204 g021
Table 1. Design table of K-handler requirements.
Table 1. Design table of K-handler requirements.
12345
size α 1 1--The greater the better.-
DoF6 or more--RedundancyRedundancy
ActuatorHigh power to weight ratio g ( θ ) 2Low friction, low inertia, backdrivability, low vibrationSlim designForce reflection and capability
1 α is workspace ratio from Equation (2). 2 Gravity compensational force.
Table 2. Specification of K-handler.
Table 2. Specification of K-handler.
JointRoM [ ]Length of the Link [m]Axis
J 1 120 θ 1 50 0.04Yaw
J 2 90 θ 2 80 0.352Pitch
J 3 170 θ 3 0 0.354Pitch
J 4 70 θ 4 70 -Pitch
J 5 70 θ 5 70 -Yaw
J 6 70 θ 6 70 -Roll
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chon, S.U.; Seo, J.; Kim, J.; Han, S.; Park, S.; Kim, J.T.; Kim, J.; Cho, J. Design of an Intuitive Master for Improving Teleoperation Task Performance Using the Functional Separation of Actuators: Movement and Gravity Compensation. Actuators 2022, 11, 204. https://doi.org/10.3390/act11070204

AMA Style

Chon SU, Seo J, Kim J, Han S, Park S, Kim JT, Kim J, Cho J. Design of an Intuitive Master for Improving Teleoperation Task Performance Using the Functional Separation of Actuators: Movement and Gravity Compensation. Actuators. 2022; 11(7):204. https://doi.org/10.3390/act11070204

Chicago/Turabian Style

Chon, Sang Uk, Jaehong Seo, Jungyeong Kim, Sangchul Han, Sangshin Park, Jin Tak Kim, Jinhyeon Kim, and Jungsan Cho. 2022. "Design of an Intuitive Master for Improving Teleoperation Task Performance Using the Functional Separation of Actuators: Movement and Gravity Compensation" Actuators 11, no. 7: 204. https://doi.org/10.3390/act11070204

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop