In order to make a fast and accurate response to gas leakage event, e.g. gas leakage in hydrogen storage station, it is very important to identify and locate the leakage source accurately and quickly. Due to the flexibility and the adaptability of robots to harsh environments, leakage source tracing based on mobile robots has attracted more and more attention. However, the existing ground robots are limited by the ground environment and thus it is difficult to trace and locate the leakage in the complex environment with ground robots. Although unmanned aerial vehicle (UAV) can overcome the limitation of ground obstacles, there are still some problems in the accuracy and reliability of gas sampling due to the interference of flow field caused by UAV rotors to the surrounding gases. Based on computational fluid dynamic simulation, a simulation model of UAV with four rotors was established. Combined with test experiments, the influence of flow field around UAV on gas sampling under different UAV speeds, rotors assembly structures, leakage, and sampling conditions was analyzed and investigated. The optimized UAV assembly structure and gas sensor installation position were determined and verified by the simulations and experiments. The results showed that the sensor was less affected by the rotor airflow when the UAV rotor was reversely assembled and the gases were sampled above the UAV. This research can provide a guidance for gas sampling for emission source tracing with UAV for process safety management of energy gas storage.

Precise and efficient grasping detection is vital for robotic arms to execute stable grasping tasks in industrial and household applications. However, existing methods fail to consider refining different scale features and detecting critical regions, resulting in coarse grasping rectangles. To address these issues, we propose a real-time coarse and fine granularity residual attention (CFRA) grasping detection network. First, to enable the network to detect different sizes of objects, we extract and fuse the coarse and fine granularity features. Then, we refine these fused features by introducing a feature refinement module, which enables the network to distinguish between object and background features effectively. Finally, we introduce a residual attention module that handles different shapes of objects adaptively, achieving refined grasping detection. We complete training and testing on both Cornell and Jacquard datasets, achieving detection accuracy of 98.7% and 94.2%, respectively. Moreover, the grasping success rate on the real-world UR3e robot achieves 98%. These results demonstrate the effectiveness and superiority of CFRA.

This article addresses the localization problem in robotic autonomous luggage trolley collection at airports and provides a systematic evaluation of different methods to solve it. The robotic autonomous luggage trolley collection is a complex system that involves object detection, localization, motion planning and control, manipulation, etc. Among these components, effective localization is essential for the robot to employ subsequent motion planning and end-effector manipulation because it can provide a correct goal position. This article explores four popular and representative localization methods for object localization in luggage trolley collection: radio frequency identification (RFID), Keypoints, ultrawideband (UWB), and Reflectors. A qualitative evaluation framework is constructed to assess performance, encompassing Localization Accuracy, Mobile Power Supplies, Coverage Area, Cost, and Scalability. Furthermore, a series of quantitative experiments concerning Localization Accuracy and Success Rate have been conducted on a real-world robotic autonomous luggage trolley collection system. The performance of various localization methods is further analyzed based on experimental results, indicating that the Keypoints method is optimally suited for indoor environments to facilitate luggage trolley collection. Significantly, these experiment results provide a valuable reference point, extending the application of indoor localization methods across diverse scenarios. A website about this work is available at https://sites.google.com/view/localization-evaluation/.

Pipelines are used in many sectors to transport materials such as fluid from one place to another. These pipelines require regular inspection and maintenance to ensure proper operations and to avoid accidents. Many in-pipe navigation robots have been developed to perform the inspection. Soft in-pipe navigation robot is a special class of in-pipe robot, where the structure is made entirely of soft materials. The soft in-pipe robots are cheaper, lightweight, robust, and more adaptable to the environment inside pipelines as compared to the traditional rigid in-pipe navigation robot. This paper reviews the design of different types of soft in-pipe navigation in terms of the material, structure, locomotion strategy, and actuation techniques. These four different aspects of the design help researchers to narrow down their research and explore different opportunities within each of the design aspects. This paper also offers suggestions on the direction of research to improve the current soft in-pipe navigation robot design.

In scenarios such as environmental data collection and traffic monitoring, timely responses to real-time situations are facilitated by persistently accessing nodes with revisiting constraints using unmanned aerial vehicles (UAVs). However, imbalanced task allocation may pose risks to the safety of UAVs and potentially lead to failures in monitoring tasks. For instance, continuous visits to nodes without replenishment may damage UAV batteries, while delays in recharging could result in missing task deadlines, ultimately causing task failures. Therefore, this study investigates the problem of achieving balanced multi-UAV path planning for persistent monitoring tasks, which has not been previously researched according to the authors’ knowledge. The main contribution of this study is the proposal of two novel indicators to assist in balancing task allocation regarding multi-UAV path planning for persistent monitoring. One of the indicators is namely the waiting factor, which reflects the urgency of a task node waiting to be accessed, and the other is the difficulty level which is introduced to measure the difficulty of tasks undertaken by a UAV. By minimizing differences in difficulty level among UAVs, we can ensure equilibrium in task allocation. For a single UAV, the ant colony initialized genetic algorithm (ACIGA) has been proposed to plan its path and obtain its difficulty level. For multiple UAVs, the K-means clustering algorithm has been improved based on difficulty levels to achieve balanced task allocation. Simulation experiments demonstrated that the difficulty level could effectively reflect the difficulty of tasks and that the proposed algorithms could enable UAVs to achieve balanced task allocation.

The inverse dynamics model of an industrial robot can predict and control the robot’s motion and torque output, improving its motion accuracy, efficiency, and adaptability. However, the existing inverse rigid body dynamics models still have some unmodelled residuals, and their calculation results differ significantly from the actual industrial robot conditions. The bootstrap aggregating (bagging) algorithm is combined with a long short-term memory network, the linear layer is introduced as the network optimization layer, and a compensation method of hybrid inverse dynamics model for robots based on the BLL residual prediction algorithm is proposed to meet the above needs. The BLL residual prediction algorithm framework is presented. Based on the rigid body inverse dynamics of the Newton–Euler method, the BLL residual prediction network is used to perform error compensation on the inverse dynamics model of the Franka robot. The experimental results show that the hybrid inverse dynamics model based on the BLL residual prediction algorithm can reduce the average residuals of the robot joint torque from 0.5651 N·m to 0.1096 N·m, which improves the accuracy of the inverse dynamics model compared with those of the rigid body inverse dynamics model. This study lays the foundation for performing more accurate operation tasks using industrial robots.

In this paper, a novel fast nonsingular integral terminal sliding mode controller based on an adaptive neural network (ANN-FNITSMC) is proposed for the trajectory tracking control of cable-driven continuum robots (CDCRs) in complex underwater environments with uncertainties. First, a novel fast nonsingular integral terminal sliding mode control (FNITSMC) is designed to solve the chattering and singularity problems of the conventional terminal sliding mode control (TSMC). Second, an adaptive neural network (ANN) based on a radial basis function (RBF) is established to derive the uncertainties and compensate for the control input of CDCRs, enabling high-stable accuracy and strong robustness trajectory tracking in complex underwater environments. Simulation results are presented to demonstrate the high accuracy and strong robustness of the ANN-FNITSMC. Finally, the high accuracy, high stability, and strong robustness of the proposed trajectory tracking strategy are verified through an underwater experiment platform.

In this work, we propose a novel approach for tomato pollination that utilizes visual servo control. The objective is to meet the growing demand for automated robotic pollinators to overcome the decline in bee populations. Our approach focuses on addressing this challenge by leveraging visual servo control to guide the pollination process. The proposed method leverages deep learning to estimate the orientations and depth of detected flower, incorporating CAD-based synthetic images to ensure dataset diversity. By utilizing a 3D camera, the system accurately estimates flower depth information for visual servoing. The robustness of the approach is validated through experiments conducted in a laboratory environment with a 3D printed tomato flower plant. The results demonstrate a high detection rate, with a mean average precision of 91.2 %. Furthermore, the average depth error for accurately localizing the pollination target is impressively minimal, measuring only 1.1 cm. This research presents a promising solution for tomato pollination, showcasing the effectiveness of visual-guided servo control and its potential to address the challenges posed by diminishing bee populations in greenhouses.

Gripping devices for harvesting fruits have such types of work as cutting, tearing and unscrewing. For apples, it is preferable to use slicing or unscrewing, while the fruit leg should not remain, damaging the apple during storage. In this article, we are developing a grab for harvesting apples. The gripper is used both for holding the fruit and for jamming, followed by unscrewing. One of the advantages is that the proposed method of collecting apples allows you not to waste time moving the manipulator from the tree to the basket, but only to grab and tear them off. The fruit enters the gripper device; after which it enters the fruit collection container through a rigid or flexible pipe. The gripper device is built on the basis of a ball-screw transmission, which is supplemented by a gear drive along the helical surface. This allows for rotation and rectilinear movement of the held fruit. The gripping device has a ratchet mechanism that allows you to fix the fruit. A mathematical model of the gripper device has been developed, which allows determining the torque of the engine depending on the position of the fingers. The parameters of the mechanism were optimized using a genetic algorithm, and the results are presented in the form of a Pareto set. A 3D model of the gripper device has been built and a layout has been developed using 3D printing. Experimental laboratory and field tests of the gripping device were carried out.

Maintaining object grasp stability represents a pivotal challenge within the domain of robotic manipulation and upper-limb prosthetics. Perturbations originating from external sources frequently disrupt the stability of grasps, resulting in slippage occurrences. Also, if the grasping forces are not optimal while controlling the slip, it may result in the deformation of the objects. This study investigates the robustification of a reinforcement learning (RL) policy for implementing intelligent bionic reflex control, i.e., slip and deformation prevention of the grasped objects. RL-derived policies are vulnerable to failures in environments characterized by dynamic variability. To mitigate this vulnerability, we propose a methodology involving the incorporation of an adaptive sliding mode controller into a pre-trained RL policy. By exploiting the inherent invariance property of the sliding mode algorithm in the presence of uncertainties, our approach strengthens the robustness of the RL policies against diverse and dynamic variations. Numerical simulations substantiate the efficacy of our approach in robustifying RL policies trained within simulated environments.

Continuum robot-based surgical systems are becoming an effective tool for minimally invasive surgery. A flexible, dexterous, and compact robot structure is suitable for carrying out complex surgical operations. In this paper, we propose performance metrics for dexterity based on data density. Data density at a point in the workspace is higher if the number of reachable points is higher, with a unique configuration lying in a small square box around a point. The computation of these metrics is performed with forward kinematics using the Monte Carlo method and, hence, is computationally efficient. The data density at a particular point is a measure of dexterity at that point. In contrast, the dexterity distribution property index is a measure of how well dexterity is distributed across the workspace according to desired criteria. We compare the dexterity distribution property index across the workspace with the dexterity index based on the dexterous solid angle and manipulability-based approach. A comparative study reveals that the proposed method is simple and straightforward because it uses only the position of the reachable point as the input parameter. The method can quantify and compare the performance of different geometric designs of hyper-redundant and multisegment continuum robots based on dexterity.

This paper proposes a seat support mechanism to solve the problem of misalignment between the chest examination and probe scanning areas when the patient is bent in a seated-style echocardiography robot. To guide the patient to an appropriate body position where their chest is within the examination range of the chest examination unit while minimizing the physical load of the patient, the posture of the patient must satisfy the three following conditions. (i) The breech must be in contact with the seat surface, (ii) the legs must be vertical to the floor, and (iii) the chest and mechanism must be parallel while the probe scanning and chest examination ranges must match. The human body was modeled to derive a posture that satisfies the aforementioned conditions for the height of each individual, and a seat support mechanism with four degrees of freedom was installed to guide the user to the derived posture. By installing this mechanism, the body load of the left biceps brachii, right biceps brachii, left latissimus dorsi, and right latissimus dorsi was reduced to 64.7%, 52.7%, 86.4%, and 80.2%, respectively. The sharpness of the image contours was improved to 103.8%.

This paper deals with the optimization of a new redundant spherical parallel manipulator (New SPM). This manipulator consists of two spherical five-bar mechanisms connected by the end-effector, providing three degrees of freedom, and has an unlimited self-rotation capability. Three optimization procedures based on the genetic algorithm method were carried out to improve the dexterity of the New SPM. The first and the second optimizations were applied to a symmetric New SPM structure, while the third was applied to an asymmetric New SPM structure. In both cases, the optimization was performed using an objective function defined by the quadratic sum of link angles. In addition, certain criteria and constraints were implemented. The obtained results demonstrate significant improvements in the dexterity of the New SPM and its capability of an unlimited self-rotate in an extended workspace. A comparison of the self-rotation performances between the classical 3-RRR SPM (R for revolute joint) and the New SPM is also presented.

This article presents a comprehensive evaluation of two nuclear-rated bilateral telerobotic systems, Telbot and Dexter, focusing on critical performance metrics such as effort transparency, stiffness, and backdrivability. Despite the absence of standardized evaluation methodologies for these systems, this study identifies key gaps by experimentally assessing the quantitative performance of both systems under controlled conditions. The results reveal that Telbot exhibits higher stiffness, but at the cost of greater effort transmission, whereas Dexter offers smoother backdrivability. Furthermore, positional discrepancies were observed during the tests, particularly in nonlinear positional displacements. These findings highlight the need for standardized evaluation methods, contributing to the development, manufacturing, and procurement processes of future bilateral telerobotic systems.

The autonomous navigation and obstacle avoidance capabilities of autonomous underwater vehicles (AUVs) are essential for ensuring their safe navigation and long-term, efficient operation. However, the complexity of the marine environment poses significant challenges to safe and effective obstacle avoidance. To address this issue, this study proposes an AUV obstacle avoidance control algorithm based on offline reinforcement learning. This method adopts the Conservative Q-learning (CQL) algorithm, which is based on the Soft Actor-Critic (SAC) framework. It learns from obtained historical obstacle avoidance data and ultimately achieves a favorable obstacle avoidance control strategy. In this method, PID and SAC control algorithms are utilized to generate expert obstacle avoidance data to construct a diversified offline database. Additionally, based on the line-of-sight (LOS) guidance method and artificial potential field (APF) method, information regarding the distance and orientation of targets and obstacles is incorporated into the state space, and heading and obstacle avoidance reward terms are integrated into the reward function design. The algorithm successfully guides the AUV in autonomous navigation and dynamic obstacle avoidance in three-dimensional space. Furthermore, the algorithm exhibits a certain degree of anti-interference capability against uncertain disturbances and ocean currents, enhancing the safety and robustness of the AUV system. Simulation results fully demonstrate the feasibility and effectiveness of the intelligent obstacle avoidance method based on offline reinforcement learning. This study highlights the profound significance of offline reinforcement learning in enabling robust and reliable control systems for AUVs, paving the way for enhanced operational capabilities in challenging marine environments.

Descriptions of various subsets of $\mathbb{SO}(3)$ are encountered frequently in robotics, for example, in the context of specifying the orientation workspaces of manipulators. Often, the Cartesian concept of a cuboid is extended into the domain of Euler angles, notwithstanding the fact that the physical implications of this practice are not documented. Motivated by this lacuna in the existing literature, this article focuses on studying sets of rotations described by such cuboids by mapping them to the space of Rodrigues parameters, where a physically meaningful measure of distance from the origin is available and the spherical geometry is intrinsically pertinent. It is established that the planar faces of the said cuboid transform into hyperboloids of one sheet and hence, the cuboid itself maps into a solid of complicated non-convex shape. To quantify the extents of these solids, the largest spheres contained within them are computed analytically. It is expected that this study would help in the process of design and path planning of spatial robots, especially those of parallel architecture, due to a better and quantitative understanding of their orientation workspaces.

Bilateral teleoperation has witnessed significant development since the mid-20th century, addressing challenges related to human presence in environments with constraints or a lack of skilled professionals. This article presents the kinematic and self-collision analyses of the quasi-spherical parallel manipulator, a three-legged parallel robot used as a haptic master device. The device is designed for remote center of motion-constrained operation in the telesurgical field. Inverse and forward kinematics are thoroughly analyzed to study working modes, singular configurations, and implement a haptic control architecture. The research explores the operative and reachable workspaces of the possible working modes, comparing them to find the most suitable one. Results highlight how the addition of the self-collision phenomenon impacts the working mode choice, drastically reducing most of the modes’ operative workspaces. An anti-collision control algorithm is finally introduced to maintain the architecture within its reachable workspace.

Designing autonomous robotic systems for monitoring tasks in critical security scenarios requires more rigorous verification criteria. The losses associated with unsuccessful practical experiments are immeasurable, ranging from the simple loss of high-value-added equipment to those related to loss of life. This reality justifies the need to adopt an extensive framework of tools for realistic, efficient, and responsive computer simulation. This article proposes a novel integration architecture and combines open-source tools to promote the successful implementation of autonomous robotic systems in monitoring tasks. The proposed solution relies on consolidated tools like Robot Operating System (ROS), Gazebo Simulator, and ArduPilot FCU (Flight Control Unit). It includes full support for implementing XITL techniques (such as Model, Software, and Hardware) – in the Loop. Experimental results demonstrate the proposal’s effectiveness for a new model of autonomous surface vehicles (ASVs) in a realistic environment, dedicated to environmental monitoring in challenging natural conditions, commonly found in a stretch of the Madeira River – Brazil, specifically at Santo Antônio hydroelectric plant.

The snake robot can be used to monitor and maintain underwater structures and environments. The motion of a snake robot is achieved by lateral undulation which is called the gait pattern of the snake robot. The parameters of a gait pattern need to be adjusted for compensating environmental uncertainties. In this work, 3D motion dynamics of a snake robot for the underwater environment is proposed with vertical motion using the buoyancy variation technique and horizontal motion using lateral undulation. “The neutral buoyant snake robot motion in hypothetical plane and added mass effect is negligible”, these previous assumptions are removed in this work. Two different control algorithms are designed for horizontal and vertical motions. The existing super twisting sliding mode control (STSMC) is used for the horizontal serpentine motion of the snake robot. The control law is designed on a reduced-ordered dynamic system based on virtual holonomic constraints. The vertical motion is achieved by controlling the mass variation using a pump. The water pumps are controlled using the event-based controller or Proportional Derivative (PD) controller. The results of the proposed control technique are verified with various external environmental disturbances and uncertainties to check the robustness of the control approach for various path following cases. Moreover, the results of STSMC scheme are compared with SMC scheme to check the effectiveness of STSMC. The practical implementation of the work is also performed using Simscape Multibody environment where the designed control algorithm is deployed on the virtual snake robot.