Search Results (338)

This paper presents tilt-and-pivot manipulation, a robotic technique for picking large, thin objects resting on hard supporting surfaces. The method employs in-hand dexterous manipulation by reorienting the gripper around the object’s contact point, allowing a finger to enter the gap between the object and the surface, without requiring relative sliding at the contact. This finally facilitates reliable pinch grasps on the object’s faces. We investigate the kinematic principles and planning strategies underlying tilt-and-pivot, discuss effector design considerations, and highlight the practical advantages of the strategy, which is applicable to a variety of low-profile objects. Experimental results, incorporating vision and force–torque sensing, demonstrate its effectiveness in bin-picking scenarios and its applicability to more complex object-handling tasks. Full article

In this paper, we present a VR-based control framework for multi-UAV (rotorcraft-type) aerial manipulation that enables simultaneous control of each UAV and its onboard five-degree-of-freedom (5-DoF) manipulator using virtual-reality controllers. Instead of relying on dense button mappings or predefined gestures, the framework maps natural VR-controller motions in real time to vehicle pose and arm joint commands. The UAVs respond smoothly to translational and rotational inputs, while the manipulators accurately replicate dexterous hand motions for precise grasping. Beyond single-platform operation, we extend the framework to cooperative dual-UAV manipulation, leveraging two-hand poses captured via VR controllers to coordinate two UAV-arm systems for payload transportation and obstacle traversal. Simulation experiments demonstrate accurate trajectory tracking and the potential for successful cooperative transport in cluttered environments, indicating the framework’s suitability for telemanipulation, search-and-rescue, and industrial tasks. Full article

Contemporary artificial intelligence excels at pattern recognition but lacks genuine understanding, temporal awareness, and ethical reasoning. Critics argue that AI systems manipulate statistical correlations without grasping concepts, time, or moral implications. This article presents Phase 2, a component of the emerging infrastructure called Sophimatics, a computational framework that translates philosophical categories into working algorithms through the integration of complex time. Our approach operationalizes Aristotelian substance theory, Augustinian temporal consciousness, Husserlian intentionality, and Hegelian dialectics within a unified temporal–semantic architecture. The system represents time as both chronological and experiential, allowing navigation between memory and imagination while maintaining conceptual coherence. Validation through a Data Protection Policy use case demonstrates significant improvements: confidence in decisions increased from 6.50 to 9.40 on a decimal scale, temporal awareness from 2.00 to 9.50, and regulatory compliance from 6.00 to 9.00 compared to traditional approaches. The framework successfully links philosophical authenticity with computational practicality, offering greater ethical consistency and contextual adaptability for AI systems that require temporal reasoning and ethical foundations. Full article

Tableware objects such as plates, bowls, and cups are usually textureless, uniform in color, and vary widely in shape, making it difficult to apply conventional pose estimation methods that rely on texture cues or object-specific CAD models. These limitations present a significant obstacle to robotic manipulation in restaurant environments, where reliable six-degree-of-freedom (6-DoF) pose estimation is essential for autonomous grasping and collection. To address this problem, we propose a model-free and texture-free 6-DoF pose estimation framework based on a transformer encoder architecture. This method uses only geometry-based features extracted from depth images, including surface vertices and rim normals, which provide strong structural priors. The pipeline begins with object detection and segmentation using a pretrained video foundation model, followed by the generation of uniformly partitioned grids from depth data. For each grid cell, centroid positions, and surface normals are computed and processed by a transformer-based model that jointly predicts object rotation and translation. Experiments with ten types of tableware demonstrate that the method achieves an average rotational error of 3.53 degrees and a translational error of 13.56 mm. Real-world deployment on a mobile robot platform with a manipulator further validated its ability to autonomously recognize and collect tableware, highlighting the practicality of the proposed geometry-driven approach for service robotics. Full article

This study presents the design and evaluation of a dexterous prosthetic hand featuring five fingers, ten independently actuated joints, and four passively driven joints. The hand’s dexterity is enabled by a novel rigid–flexible coupled finger mechanism that incorporates a 1-active–1-passive joint configuration, which can enhance the dexterity of traditional rigid actuators while achieving a human-like workspace. Each finger is designed with a specific degree of rotational freedom to mimic natural opening and closing motions. This study also elaborates on the mapping of eight-channel electromyography to finger grasping force through improved TCN, as well as the control algorithm for grasping flexible objects. A functional prototype of the prosthetic hand was fabricated, and a series of experiments involving adaptive grasping and handheld manipulation tasks were conducted to validate the effectiveness of the proposed mechanical structure and control strategy. The results demonstrate that the hand can stably grasp flexible objects of various shapes and sizes. This work provides a practical solution for prosthetic hand design, offering promising potential for developing lightweight, dexterous, and highly anthropomorphic robotic hands suitable for real-world applications. Full article

This article presents a deep reinforcement learning (DRL) approach for adaptive robotic grasping in dynamic environments. We developed UR5GraspingEnv, a PyBullet-based simulation environment integrated with OpenAI Gym, to train a UR5 robotic arm with a Robotiq 2F-85 gripper. Soft Actor-Critic (SAC) and Proximal Policy Optimization (PPO) were implemented to learn robust grasping policies for randomly positioned objects. A tailored reward function, combining distance penalties, grasp, and pose rewards, optimizes grasping and post-grasping tasks, enhanced by domain randomization. SAC achieves an 87% grasp success rate and 75% post-grasp success, outperforming PPO 82% and 68%, with stable convergence over 100,000 timesteps. The system addresses post-grasping manipulation and sim-to-real transfer challenges, advancing industrial and assistive applications. Results demonstrate the feasibility of learning stable and goal-driven policies for single-arm robotic manipulation using minimal supervision. Both PPO and SAC yield competitive performance, with SAC exhibiting superior adaptability in cluttered or edge cases. These findings suggest that DRL, when carefully designed and monitored, can support scalable learning in manipulation tasks. Full article

Virtual communication, involving the transmission of all human senses, is the next step in the development of telecommunications. Achieving this vision requires real-time data exchange with low latency, which in turn necessitates the implementation of the Tactile Internet (TI). TI will ensure the transmission of high-quality tactile data, especially when combined with audio and video signals, thus enabling more realistic interactions in virtual environments. In this context, advances in realism increasingly depend on the accurate simulation of the grasping process and hand–object interactions. To address this, in this paper, we methodically present the challenges of human–object interaction in virtual environments, together with a detailed review of the datasets used in grasping modeling and the integration of physics-based and machine learning approaches. Based on this review, we propose a multi-step framework that simulates grasping as a series of biomechanical, perceptual, and control processes. The proposed model aims to support realistic human interaction with virtual objects in immersive settings and to enable integration into applications such as remote manipulation, rehabilitation, and virtual learning. Full article

Continuum robots with outstanding compliance, dexterity, and lean bodies are successfully applied in medicine, aerospace engineering, the nuclear industry, rescue operations, construction, service, and manipulation. However, the inherent low stiffness characteristics of continuum bodies make it challenging to develop ultra-long and small-diameter continuum robots. To address this size–scale challenge of continuum robots, we developed an 8 m long continuum robot with a diameter of 23 mm by a tip actuation and growth mechanism. Meanwhile, we also realized the untethered design of the continuum robot, which greatly increased its usable space range, portability, and mobility. Demonstration experiments prove that the developed growing continuum robot has good flexibility and manipulability, as well as the ability to cross obstacles and search for targets. Its continuum body can transport liquids over long distances, providing water, medicine, and other rescue items for trapped individuals. The functionality of an untethered growing continuum robot (UGCR) can be expanded by installing multiple tools, such as a grasping tool at its tip to pick up objects in deep wells, pits, and other scenarios. In addition, we established a static model to predict the deformation of UGCR, and the prediction error of its tip position was within 2.6% of its length. We verified the motion performance of the continuum robot through a series of tests involving workspace, disturbance resistance, collision with obstacles, and load performance, thus proving its good anti-interference ability and collision stability. The main contribution of this work is to provide a technical reference for the development of ultra-long continuum robots based on the tip actuation and steering principle. Full article

Vision-based grasping for mobile manipulators poses significant challenges in machine perception, computational efficiency, and real-world deployment. This study presents a computationally lightweight, end-to-end grasp detection framework that integrates object detection, object pose estimation, and grasp point prediction for a mobile manipulator equipped with a parallel gripper. A transformation model is developed to map coordinates from the image frame to the robot frame, enabling accurate manipulation. To evaluate system performance, a benchmark and a dataset tailored to pick-and-pack grocery tasks are introduced. Experimental validation demonstrates an average execution time of under 5 s on an edge device, achieving a 100% success rate on Level 1 and 96% on Level 2 of the benchmark. Additionally, the system achieves an average compute-to-speed ratio of 0.0130, highlighting its energy efficiency. The proposed framework offers a practical, robust, and efficient solution for lightweight robotic applications in real-world environments. Full article

Robotic hands require reliable and precise sensing systems to achieve accurate object recognition and manipulation, particularly in environments where vision- or capacitive-based approaches face limitations such as poor lighting, dust, reflective surfaces, or non-metallic materials. This paper presents a novel radiofrequency (RF) pre-touch sensing system that enables robust localization and orientation estimation of objects prior to grasping. The system integrates a compact coplanar waveguide (CPW) probe with fully passive chipless RF resonator tags fabricated using a patented flexible and stretchable conductive ink through additive manufacturing. This approach provides a low-cost, durable, and highly adaptable solution that operates effectively across diverse object geometries and environmental conditions. The experimental results demonstrate that the proposed RF sensor maintains stable performance under varying distances, orientations, and inter-tag spacings, showing robustness where traditional methods may fail. By combining compact design, cost-effectiveness, and reliable near-field sensing independent of an object or lighting, this work establishes RF sensing as a practical and scalable alternative to optical and capacitive systems. The proposed method advances robotic perception by offering enhanced precision, resilience, and integration potential for industrial automation, warehouse handling, and collaborative robotics. Full article

Addressing key challenges in unstructured environments, including local optimum traps, limited real-time interaction, and convergence difficulties, this research pioneers a hybrid reinforcement learning approach that combines simulated annealing (SA) with proximal policy optimization (PPO) for robotic arm trajectory planning. The framework enables the accurate, collision-free grasping of randomly appearing objects in dynamic obstacles through three key innovations: a probabilistically enhanced simulation environment with a 20% obstacle generation rate; an optimized state-action space featuring 12-dimensional environment coding and 6-DoF joint control; and an SA-PPO algorithm that dynamically adjusts the learning rate to balance exploration and convergence. Experimental results show a 6.52% increase in success rate (98% vs. 92%) and a 7.14% reduction in steps per set compared to the baseline PPO. A real deployment on the AUBO-i5 robotic arm enables real machine grasping, validating a robust transfer from simulation to reality. This work establishes a new paradigm for adaptive robot manipulation in industrial scenarios requiring a real-time response to environmental uncertainty. Full article

Much as the information generated by our fingertips is used for fine-scale grasping and manipulation, closed-loop dexterous robotic manipulation requires rich tactile information to be generated by artificial fingertip sensors. In particular, fingertip shear sensing dominates modalities such as twisting, dragging, and slipping, but there is limited research exploring soft shear predictions from an increasingly popular single-material tactile technology: electrical impedance tomography (EIT). Here, we focus on the twisting of a screwdriver as a representative shear-based task in which the signals generated by EIT hardware can be analyzed. Since EIT’s analytical reconstructions are based upon conductivity distributions, we propose and investigate five reduced-order models which relate shear-based screwdriver twisting to the conductivity maps of a robot’s single-material sensorized fingertips. We show how the physical basis of our reduced-order approach means that insights can be deduced from noisy signals during the twisting tasks, with respective torque and diameter correlations of 0.96 and 0.97 to our reduced-order parameters. Additionally, unlike traditional reconstruction techniques, all necessary FEM model signals can be precalculated with our approach, promising a route towards future high-speed closed-loop implementations. Full article

Packing food into lunch boxes requires the correct portion to be selected. Food items such as fried chicken, eggs, and sausages are straightforward to manipulate when packing. In contrast, deformable objects like spaghetti can give challenges to lunch box packing due to their fragility and tendency to break apart, and the fluctuating weight of noodles. Furthermore, achieving the correct amount is crucial for lunch box packing. This research focuses on self-learned grasping by a robotic arm to enable the ability to autonomously predict and grasp deformable objects, specifically spaghetti, to achieve the correct amount within specified ranges. We utilize deep reinforcement learning as the core learning. We developed a custom environment and policy network along a real-world scenario that was simplified as in a food factory, incorporating multi-sensors to observe the environment and pipeline to work with a real robotic arm. Through the study and experiments, our results show that the robot can grasp the spaghetti within the desired ranges, although occasional failures were caused by the nature of the deformable object. Addressing the problem under varying environmental conditions such as data augmentation can partially help model prediction. The study highlights the potential of combining deep learning with robotic manipulation for complex deformable object tasks, offering insight for applications in automated food handling and other industries. Full article

This paper delves into the potential of an optimized differential system within an underactuated tendon-driven soft robotic gripper, a crucial component that enhances the grasping abilities by allowing fingers to secure objects adapting to different shapes and geometries. The original version of the differential system exhibited a certain degree of deformability, which introduced some functional advantages. In particular, its flexibility allowed for more delicate grasping operations by acting as a force reducer and enabling a more gradual application of contact forces, an essential feature when handling fragile objects. Nonetheless, while these benefits are noteworthy, a rigid differential remains more effective for achieving firm and secure grasps. The primary goal of this study is to analyze the differential’s performance through FEM simulations and deformation experiments, assessing its structural behavior under various conditions. Additionally, the research explores an innovative differential geometry aimed at striking the ideal balance, ensuring a robust grasp while retaining a controlled degree of deformability. By refining the differential’s design, this study seeks to enhance the efficiency of underactuated soft robotic grippers, ultimately enhancing their capabilities in handling diverse objects ensuring a compliant and secure grasp with optimized efficiency. Full article

Robotic assembly of electrical connectors enables the automation of high-efficiency production of electronic products. A rigid gripper is adopted as the end-effector by the majority of existing works with a force–torque sensor installed at the wrist, which suffers from very limited perception capability of the manipulated objects. Moreover, the grasping and movement actions, as well as the inconsistency between the robot base and the end-effector frame, tend to result in angular misalignment, usually leading to assembly failure. Bio-inspired by the human finger, we designed a tactile finger in this paper with three characteristics: (1) Compliance: A soft ‘skin’ layer provides passive compliance for plenty of manipulation actions, thus increasing the tolerance for alignment errors. (2) Tactile Perception: Two types of sensing elements are embedded into the soft skin to tactilely sense the involved contact status. (3) Enhanced manipulation force: A rigid fingernail is designed to enhance the manipulation force and enable potential delicate operations. Moreover, a tactile-based alignment algorithm is proposed to search for the optimal orientation angle about the z axis. In the application of U-disk insertion, the three characteristics are validated and a success rate of 100% is achieved, whose generalization capability is also validated through the assembly of three types of electrical connectors. Full article