The design of motion control systems for legged robots has always been a challenge. This article first proposes a motion control method for legged robots based on the gradient central pattern generator (GD-CPG). The periodic signals output from the GD-CPG neural network are used as the drive signals of each thigh joint of the legged robots, which are then converted into the driving signal of the knee and ankle joints by the thigh–knee mapping function and the knee–ankle mapping function. The proposed control algorithm is adapted to quadruped and hexapod robots. To improve the ability of legged robots to cope with complex terrains, this article further proposes the responsive gradient-CPG motion control method for legged robots. From the perspective of bionics, a biological vestibular sensory feedback mechanism is established in the control system. The mechanism adjusts the robot’s motion state in real time through the attitude angle of the body measured during the robot’s motion, to keep the robot’s body stable when it moves in rugged terrains. Compared with the traditional feedback model that only balances the body pitch, this article also adds the balancing functions of body roll and yaw to balance the legged robot’s motion from more dimensions and improve the linear motion capability. This article also introduces a differential evolutionary algorithm and designs a fitness function to adaptively optimize vestibular sensory feedback parameters. The validity, robustness, and transferability of the method are verified through simulations and physical experiments.

This paper presents an algorithm for solving the inverse dynamics of a parallel manipulator (PM) with offset universal joints (RR–joints) via the Newton–Euler method. The PM with RR–joints increase the joint stiffness and enlarge the workspace but introduces additional joint parameters and constraint torques, rendering the dynamics more complex. Unlike existing studies on PMs with RR–joints, which emphasize the kinematics and joint performance, this paper studies the dynamical model. First, an iterative algorithm is established through a rigid body velocity transformation, which calculates the input parameters of the link velocity and acceleration. A linear system of equations in matrix form is then established for the entire PM through the Newton–Euler method. By using the generalized minimal residual method (GMRES) to solve the equation system, all the forces and torques on the joints can be obtained, from which the required actuation force can be derived. This method is validated through numerical simulations using the automatic dynamic analysis of multibody systems software. The proposed method is suitable for establishing the dynamic model of complex PMs with redundant or hybrid structures.

Autonomous navigation has been a long-standing research topic, and researchers have worked on many challenging problems in indoor and outdoor environments. One application area of navigation solutions is material handling in industrial environments. With Industry 4.0, the simple problem in traditional factories has evolved into the use of autonomous mobile robots within flexible production islands in a self-decision-making structure. Two main stages of such a navigation system are safe transportation of the vehicle from one point to another and reaching destinations at industrial standards. The main concern in the former is roughly determining the vehicle’s pose to follow the route, while the latter aims to reach the target with high accuracy and precision. Often, it may not be possible or require extra effort to satisfy requirements with a single localization method. Therefore, a multi-stage localization approach is proposed in this study. Particle filter-based large-scale localization approaches are utilized during the vehicle’s movement from one point to another, while scan-matching-based methods are used in the docking stage. The localization system enables the appropriate approach based on the vehicle’s status and task through a decision-making mechanism. The decision-making mechanism uses a similarity metric obtained through the correntropy criterion to decide when and how to switch from large-scale localization to precise localization. The feasibility and performance of the developed method are corroborated through field tests. These evaluations demonstrate that the proposed method accomplishes tasks with sub-centimeter and sub-degree accuracy and precision without affecting the operation of the navigation algorithms in real time.

The wheeled-legged robot combines the advantages of wheeled and legged robots, making it easier to assist people in completing repetitive and time-consuming tasks in their daily lives. This paper presents a study on the kinematic and dynamic modeling, as well as the controller design, of a wheeled biped robot with a parallel five-bar linkage mechanism as its leg module. During the motion of the robot, the robot relies on the tilt angle of the inverted pendulum, and this angle often results in the tilting of the chassis of the robot, presenting challenges for the installation of upper-body payloads and sensor systems. The controller proposed in this paper, which is developed by decoupling the primary motions of the robot and designing a multi-objective, multilevel controller, addresses this issue. This controller employs the pendulum pitch angle of the equivalent inverted pendulum model as the control variable and compensates for the chassis tilt angle (CTA). This control method can effectively reduce the CTA of such robots and eliminate the need for additional counterweights. It also provides a more spacious structural design for accommodating upper-body devices. The effectiveness of this control framework is verified through variable height control, walking on flat ground, and carrying loads over rough terrain and slopes.

This paper proposes a new type of hybrid manipulator that can be of extensive use in industries where translational motion is required while maintaining an arbitrary end-effector orientation. It consists of two serially connected parallel mechanisms, each having three degrees of freedom, of which the upper platform performs a pure translational motion with respect to the mid-platform. Closed-form forward and inverse kinematic analysis of the proposed manipulator has been carried out. It is followed by the determination of all of its singular configurations. The theoretical results have been verified numerically, and the 3D modeling and simulation of the manipulator have also been performed. A simple optimal design is presented based on optimizing the kinematic manipulability, which further demonstrates the potential of the proposed hybrid manipulator.

Accurate prediction for mechanisms’ dynamic responses has always been a challenging task for designers. For modeling easiness purposes, mechanisms’ synthesis and optimization have been mostly limited to rigid systems, making consequently the designer unable to vow that the manufactured mechanism satisfies the target responses. To address this limitation, flexible mechanism synthesis is aimed in this work. Two benchmark mechanisms being the core of myriad mechanical devices are of scope, mainly, the flexible slider-crank and the four-bar. In addition to the mechanism dimensions, materials properties have been embedded in the synthesis problem. Two responses are of interest for the slider-crank mechanism, the slider velocity, and the midpoint axial displacement for the flexible connecting rod. Whereas five responses have been compiled for the four-bar mechanism synthesis. A comparative analysis of seven optimization techniques to solve the synthesis problem for both mechanisms has been performed. Subsequently, an executable computer-aided design tool for mechanisms synthesis has been developed under MATLAB®. Numerical outcomes emphasize the limits of a single-response-based synthesis for a flexible mechanism. It has been proven that combining different responses alleviates possible error and fulfill high-accuracy requirement.

Autonomous exploration in unknown environments has become a critical capability of mobile robots. Many methods often suffer from problems such as exploration goal selection based solely on information gain and inefficient tour optimization. Recent reinforcement learning-based methods do not consider full area coverage and the performance of transferring learned policy to new environments cannot be guaranteed. To address these issues, a dual-stage exploration method has been proposed, which combines spatial clustering of possible exploration goals and Traveling Salesman Problem (TSP) based tour planning on both local and global scales, aiming for efficient full-area exploration in highly convoluted environments. Our method involves two stages: exploration and relocation. During the exploration stage, we introduce to generate local navigation goal candidates straight from clusters of all possible local exploration goals. The local navigation goal is determined through tour planning, utilizing the TSP framework. Moreover, during the relocation stage, we suggest clustering all possible global exploration goals and applying TSP-based tour planning to efficiently direct the robot toward previously detected but yet-to-be-explored areas. The proposed method is validated in various challenging simulated and real-world environments. Experimental results demonstrate its effectiveness and efficiency. Videos and code are available at https://github.com/JiatongBao/exploration.

Controlling the landing position of a spinning ball is difficult when using a table tennis robot. A complete physical model requires the factoring in of aerodynamic elements and object collisions, and inaccurate environmental coefficients would increase the landing position error. This study proposed a landing position control method based on a cascade neural network (CNN) that consists of forward and recurrent neural networks (RNNs). The forward NNs are used to estimate the velocity of the outgoing ball according to the velocity and acceleration of the incoming ball captured by cameras and the desired velocity of the outgoing ball. The RNN is employed to reverse-predict ball displacement based on the state of the incoming ball, desired landing point, and ball flight duration. The experiments verified that the method proposed in this study achieved control of differently spinning balls more effectively than the locally weighted regression (LWR)-based model did. The success rate of the CNN at two of six desired landing points was 25.9% and 32.9% higher, respectively, compared with use of the LWR-based model.

In order to ensure safe and comfortable human–robot navigation in close proximity, it is imperative for robots to possess the capability to understand human behavioral intention. With this objective in mind, this paper introduces a Human-Aware Navigation (HAN) algorithm. The HAN system combines insights from studies on human detection, social behavioral model, and behavior prediction, all while incorporating social distance considerations. This information is integrated into a layer dedicated to human behavior intention cognition, achieved through the fusion of data from laser radar and Kinect sensors, employing Gaussian functions to account for individual private space and movement trend. To cater to the mapping requirements of the HAN system, we have reduced the computational complexity associated with traditional multilayer cost map by implementing a “first-come, first-served” expansion method. Subsequently, we have enhanced the trajectory optimization equation by incorporating an improved dynamic triangle window method that integrates human behavior intention cognition, leading to the determination of an appropriate trajectory for the robot. Finally, experimental evaluations have been conducted to assess and validate the efficacy of the human behavior intention cognition and the HAN system. The results clearly demonstrate that the HAN system outperforms the traditional Dynamic Window Approach algorithm in ensuring the safety and comfort of humans in human–robot coexistence environments.

A fixed-time control strategy based on adaptive event-triggered communication and force estimators is proposed for a class of teleoperation systems with time-varying delays and limited bandwidth. Two force estimators are designed to estimate the operator force and environment force instead of force sensors. With the position, velocity, force estimate signals, and triggering error, an adaptive event-triggered scheme is designed, which automatically adjusts the triggering thresholds to reduce the access frequency of the communication network. With the state information transmitted at the moment of event triggering while considering the time-varying delays, a fixed-time sliding mode controller is designed to achieve the position and force tracking. The stability of the system and the convergence of tracking error within a fixed time are mathematically proved. Experimental results indicate that the control strategy can significantly reduce the information transmission, enhance the bandwidth utilization, and ensure the convergence of tracking error within a fixed time for teleoperation systems.

Robots have the capability to perform precise and minimally invasive surgeries. For the robot-assisted teleoperated fracture reduction surgery, the operating accuracy largely depends on visual reference through fluoroscopy. The operator needs to adjust several times according to computed tomography (CT) image. During the robot reduction surgery, there are large muscle forces generated by the numerous muscles surrounding the fractured segments. However, there is no effective reduction force feedback to the master robot. In this paper, in order to improve the operating accuracy of the fracture reduction with teleoperated surgery mode, six-dimensional constraints of the master robot are studied by utilizing the virtual fixture method, which can restrict the position and orientation through the force and visual guidance. The six-dimensional force sensor is used to collect information of the reduction force. For the master robot, a motor stall control method based on the current loop is adopted to provide feedback of the reduction force, which can enhance the surgeon’s sense of operational presence. To verify the effectiveness of virtual fixture and force feedback, the fracture reduction experiments are conducted on the fractured model with simulating lager muscle force. Experimental results show that the reduction errors are within acceptable ranges: $0.03\pm 0.73\textrm{mm}$, $0.54\pm 0.43\textrm{mm}$, $0.46\pm 1.05\textrm{mm}$, $1.05\pm 1.31^{\circ}$, $1.15\pm 1.91^{\circ}$, $1.09\pm 2.61^{\circ}$. The number of fluoroscopy procedures required ranges from 1 to 2 and the average operation time is approximately 170 s. Compared to traditional methods and other teleoperation methods, the fracture reduction accuracy and surgical efficiency of method in this paper are significantly improved.

Motion assistance for elderly people is a field of application for service robotic systems that can be characterized by requirements and constraints of human–machine interaction and by the specificity of the user’s conditions. The main aspects of characterization and constraints are examined for the application of service systems that can be specifically conceived or adapted for elderly motion assistance by having to consider conditions of motion deficiency and muscular strength weakness as well as psychological aptitudes of users. The analysis is discussed in general terms with reference to elderly people who may not even suffer from specific pathologies. Therefore, the discussion focuses on the need for motion exercise in proper environments, including domestic ones and frame familiar to a user. The challenges of such applications oriented toward elderly users are discussed as requiring research and design of solutions in terms of specific portability, user-oriented operation, low costs, and clinical-physiotherapeutic functionality. Results of the author’s team experiences are presented as an example of problems and attempted solutions to meet the new challenges of service systems for motion assistance applications for elderly people.

This research offers an adaptive model-based methodology for autonomous control of 3-RRR spherical parallel manipulator (RSPM) based on a novel modeling framework. RSPM is an overconstrained parallel mechanism that has a variety of applications in medical procedures such as ankle rehabilitation because of its precision and accuracy. However, obtaining a complete explicit dynamic model of these mechanisms for tracking purposes has been a problematic challenge due to their inherent singularities, coupling effects of the limbs, and redundant constraints imposed by the intermediate joints. This paper presents a novel algorithm to obtain the analytical kinematic solutions of RSPMs based on the closed-loop vector method, which includes constraint analysis. By incorporating constrained kinematics into the dynamic model, a comprehensive explicit dynamic solution of the non-overconstrained version 3-RCC of RSPM is developed in task space, based on screw theory and the linear homogeneous property of algebraic equations on the manipulator twist. Based on the proposed computational framework, a robust self-tuning backstepping control (STBC) strategy is applied to the robot to overcome the effect of external disturbances and time-varying uncertainties. Furthermore, an observer-based compensation (OBC) method is presented for dealing with the nonlinear hysteresis loops of the ankle during trajectory tracking purposes. The closed-loop stability of the whole system including STBC and OBC is theoretically performed by Lyapunov methods. The proposed methodologies are validated by realistic co-simulations in different scenarios. For instant, in the presence of external disturbances, the maximum tracking error norm of STBC is 37.5% less than the sliding mode approach.

In recent years, unmanned aerial vehicles (UAVs) have been applied in underground mine inspection and other similar works depending on their versatility and mobility. However, accurate localization of UAVs in perceptually degraded mines is full of challenges due to the harsh light conditions and similar roadway structures. Due to the unique characteristics of the underground mines, this paper proposes a semantic knowledge database-based localization method for UAVs. By minimizing the spatial point-to-edge distance and point-to-plane distance, the relative pose constraint factor between keyframes is designed for UAV continuous pose estimation. To reduce the accumulated localization errors during the long-distance flight in a perceptual-degraded mine, a semantic knowledge database is established by segmenting the intersection point cloud from the prior map of the mine. The topological feature of the current keyframe is detected in real time during the UAV flight. The intersection position constraint factor is constructed by comparing the similarity between the topological feature of the current keyframe and the intersections in the semantic knowledge database. Combining the relative pose constraint factor of LiDAR keyframes and the intersection position constraint factor, the optimization model of the UAV pose factor graph is established to estimate UAV flight pose and eliminate the cumulative error. Two UAV localization experiments conducted on the simulated large-scale Edgar Mine and a mine-like indoor corridor indicate that the proposed UAV localization method can realize accurate localization during long-distance flight in degraded mines.

In order to resolve redundancy and path planning of a high DOF mobile manipulator using conventional approaches like Jacobian and a pseudoinverse method, researchers face the limitation of computational load and delay in response. If such kind of mobile manipulator is traversing the rough terrain, then conventional methods become too costly to implement due to the handling of redundant joints, obstacles, and wheel-terrain interaction. A few optimization-based redundancy resolution approaches try incorporating wheel-terrain interaction but fail in real-time response. This paper describes a 14 DOF Rover Manipulator System’s end-effector path-tracking approach using CG-Space framework to incorporate wheel-terrain interaction. CG-Space means the center of gravity (CG) locus of the Rover. The Rover’s CG is calculated while traversing over 3D terrain using a multivariable optimization method and a 3D point cloud image of the actual terrain and stored as CG-Space over the given terrain. First of all, we decide which part of the system moves to track the path, that is, arm or Rover, depending upon the manipulator’s work volume and manipulability measure restrictions. The next task is to obtain the Rover pose according to the end-effector path using a simple arm’s inverse kinematic solution between the CG-Space and end-effector task space without resolving redundancy. Meanwhile, obstacles and non-traversable regions are avoided in CG-Space. On diverse 3D terrains, simulation and experimental results support the suggested CG-Space framework for end-effector tracking.

This paper mainly studies an autonomous path-planning and real-time path-tracking optimization method for snake robot. Snake robots can perform search and rescue, exploration, and other tasks in a variety of complex environments. Robots with visual sensors such as LiDAR can avoid obstacles in the environment through autonomous navigation to reach the target point. However, in an unstructured environment, the navigation of snake robot is easily affected by the external environment, causing the robot to deviate from the planned path. In order to solve the problem that snake robots are easily affected by environmental factors in unstructured environments, resulting in poor path-following ability, this paper uses the Los algorithm combined with steering control to plan the robot in real time and control the robot’s steering parameters in real time, ensuring that the robot can stably follow the planned path.

Diabetic retinopathy (DR) is a complication of diabetes that causes blindness and the early detection of diabetics using retinopathy images remains a challenging task. Hence, a novel, earlier smart prediction of diabetic retinopathy from fundus image under Innovative ResNet Optimization is introduced to effectively detect the earlier stage of DR from Fundus image. Initially, the fundus image is scaled during preprocessing and converted into a grayscale format. As the existing studies neglect some deserving unique features that are crucial for predicting the earliest signs of DR, a novel Fractional Radon Transform with Visibility Graph is introduced for extracting the novel features such as microaneurysms count, dot and blot hemorrhages count, statistical measures, and retinal layer thickness, in which a Generalized Cosine Fractional Radon Transform is used to capture the image’s fine-scale texture information thereby effectively capturing the statistical measures, while a weighted Horizontal Visibility Graph is made to examine the apparent spatial relationships between pixel pairs in the image based on the values of the pixels’ gray levels. Further, the existing works failed to identify the small fine dark areas that were ignored throughout the morphological opening process. In order to overcome this issue, a Morphological Black Hat Transform with Optimized ResNet Algorithm is implemented, where segmentation is made through Enriched Black Hat Transform-based Morphological operation to identify fine dark regions among the pixels inside the eye samples, and the classification is done by using ResNet-driven S-GOA (Socio Grasshopper Optimization Algorithm), to optimally predict the stages of DR. The result obtained showed that the proposed model outperforms existing techniques with high performance and accuracy.

Over decades of robotics research, cooperative object transportation has been studied as a meaningful model problem for robotic networks because it possesses a variety of crucial challenges. Although these challenges are demanding, the cooperation of multiple robots has the potential to solve automation problems that are beyond the scope of an individual robot. So far, the model problem has mostly been addressed by explicitly controlling the robots’ positions. However, the position-based approach suffers from some intrinsic detriments, for example, the lack of explicit feedback between robots and object. Moreover, it remains an open question how many robots shall be employed to ensure a successful transportation. This paper’s purpose is to overcome these challenges using a novel force-based approach taking into account the robots’ actual manipulation capabilities, that is, the exerted forces. Using cost-efficient hardware, the interaction forces are measured and, what is more, explicitly controlled by a highly responsive onboard controller. Employing a tailored software architecture, the novel force-based scheme, useful for robotic manipulation beyond the benchmark problem, is probably the most flexible of its kind regarding the number of robots and the object’s shape. The controller’s functionality and performance as well as the scheme’s versatility are demonstrated by several hardware experiments.

This study proposes a novel hybrid learning approach for developing a visual path-following algorithm for industrial robots. The process involves three steps: data collection from a simulation environment, network training, and testing on a real robot. The actor network is trained using supervised learning for 500 epochs. A semitrained network is then obtained at the $250^{th}$ epoch. This network is further trained for another 250 epochs using reinforcement learning methods within the simulation environment. Networks trained with supervised learning (500 epochs) and the proposed hybrid learning method (250 epochs each of supervised and reinforcement learning) are compared. The hybrid learning approach achieves a significantly lower average error (30.9 mm) compared with supervised learning (39.3 mm) on real-world images. Additionally, the hybrid approach exhibits faster processing times (31.7 s) compared with supervised learning (35.0 s). The proposed method is implemented on a KUKA Agilus KR6 R900 six-axis robot, demonstrating its effectiveness. Furthermore, the hybrid approach reduces the total power consumption of the robot’s motors compared with the supervised learning method. These results suggest that the hybrid learning approach offers a more effective and efficient solution for visual path following in industrial robots compared with traditional supervised learning.

The concept of distance between two rigid-body poses is important in path planning, positioning precision, mechanism synthesis, and in many other applications. In the definition of such a distance, two approaches mainly prevail, which lead to a number of formulas devised to match the needs of motion tasks. Despite the different approaches and formulas, some important theoretical results, which drive toward distance-metrics definitions useful for design and application purposes, have been stated. This paper summarizes the two different approaches together with a critical review of the literature on the distance metrics they generated, and, then, it illustrates a technique, previously proposed by the author, for combining different metrics to obtain novel distance-metric definitions that are tailored to specific applications.