1. Introduction
Industrial automation and the use of robotic agents in manufacturing have been the talk of the town since the last decade owing to the growing need of producing substantially within the stipulated time. Therefore, there has been tremendous use of different forms of robots in medical assistance, entertainment, manufacturing, and automation. However, humanoid robots have gained popularity due to their ability to imitate human behavior in cluttered environments without much need to alter the platform conditions. The human effort should ideally be replaced by robot-looking humans. Therefore, the humanoid robot NAO V4 H 25 is considered for the motion planning technique in this study. A humanoid robot resembles a human in most ways, including how it moves, walks, and goes from point A to point B.
To deal with all the work, a humanoid may competently perform, motion planning has been the most discussed and challenging analysis that requires intelligence to tackle unforeseen environmental conditions. A humanoid integrated with artificial intelligence (AI) can be able to handle obstacles that may be encounter while attempting a planned or unplanned journey. Based on the type of planned or unplanned motion synthesis, navigational approaches are classified as global and local path planning. Global path planning can be considered as a planned journey as the arena conditions are priory known to the robot. However, local path planning can be considered as an unplanned journey as the robot is only aware of the source and target locations. In the last few decades, there have been enormous discussions on the motion planning and navigational analysis of different forms of robots using both classical and AI techniques. Generally, classical approaches are popular for their quick convergence and AI techniques are popular for their accuracy.
Frank et al. [Reference Frank, Stachniss, Abdo and Burgard1] designed a Gaussian process regression-based control architecture for the navigational analysis of a mobile manipulator. They have considered deformable objects in their analysis along with discussions on deformation cost. Kim et al. [Reference Kim, Choi and Oh2] have proposed a kernel subspace learning approach toward autonomous robot navigation in a dynamic environment using Gaussian regression. Keshmiri and Payandeh [Reference Keshmiri and Payandeh3] have attempted to solve a multi-robot recharging problem by utilizing the nearest recharging station for respective robots. Rouxel et al. [Reference Rouxel, Passault, Hofer, N’Guyen and Ly4] have designed a weighted projection regression-based model for visualizing the odometry of a small-scale humanoid robot without utilizing any vision assistance tool. Plagemann et al. [Reference Plagemann, Mischke, Prentice, Kersting, Roy and Burgard5] have proposed a learning probabilistic model of terrain surfaces using Bayesian regression to navigate a legged robot over a rough terrain. To design navigational models for mobile sensor networks, Xu et al. [Reference Xu, Choi and Oh6] have used a Gaussian process regression-based approach with truncated observations. Fentanes et al. [Reference Fentanes, Dondrup and Hanheide7] have used a testing framework in a large-scale robotics project in order to test the approach in simulation as well as experimental platforms. Belter et al. [Reference Belter, Łabęcki and Skrzypczyński8] have designed a navigational controller that uses the on-board sensors for perceiving the environmental map first and then use a predictive model to navigate a legged robot smoothly within the arena. Kumar et al. [Reference Kumar, Sahu and Parhi9, Reference Kumar, Sahu, Parhi, Pandey and Chhotray10] designed regression analysis (RA)-based humanoid navigational schemes for smooth and collision-free navigation within complex arena conditions.
To detect multiple sources in a mobile robotic platform, Krishnanand et al. [Reference Krishnanand, Amruth, Guruprasad, Bidargaddi and Ghose11] designed a navigational controller using firefly algorithm and tested the performance against other nature inspired algorithms. Patle et al. [Reference Patle, Parhi, Jagadeesh and Kashyap12] have proposed a navigational model for smooth motion planning through obstacles based on firefly algorithm (FA). Their developed controller was tested on mobile robots in simulation as well as experimental arena and obtained satisfactory results. Wang et al. [Reference Wang, Guo, Duan, Liu and Wang13] experimented with combat air vehicles by using a firefly-based navigation approach and obtained enhanced results by modification of the standardized parameters of the algorithm. Hidalgo-Paniagua et al. [Reference Hidalgo-Paniagua, Vega-Rodríguez, Ferruz and Pavón14] have considered safety, smoothness, and minimal path length for a navigational path while designing a controller for a mobile robot using a firefly-based approach. Fister et al. [Reference Fister, Fister, Yang and Brest15] have comprehensively reviewed firefly-based approaches in several engineering optimization problems and discussed the importance of tuning to standard parameters of the algorithm. Ali et al. [Reference Ali, Othman, Husain and Misran16] have discussed a critical review regarding the use of the firefly algorithm in navigational and other similar problems. They have also discussed the potential of the firefly algorithm in solving multidimensional problems. Liu et al. [Reference Liu, Zhao, Gao and Liu17] have introduced new operators to the standard firefly algorithm while designing a navigational controller for the motion planning of an autonomous underwater vehicle. To reduce redundancies available in the environment, Christensen et al. [Reference Christensen, O’Grady and Dorigo18] have used a firefly-based approach to navigate a swarm of robots with collision avoidance and smooth navigation. A demonstration of mobile robot navigation in a simulation environment was shown by Brand and Yu [Reference Brand and Yu19]. They proposed a firefly-based navigational scheme and attempted the navigational model in dynamic environments. Farahani et al. [Reference Farahani, Abshouri, Nasiri and Meybodi20] have used a Gaussian distribution model to modify standard firefly operators and obtained enhanced results. A 3-D locomotion model for navigational control of a humanoid biped has been proposed by Saputra et al. [Reference Saputra, Botzheim, Sulistijono and Kubota21]. They have used a biologically inspired recurrent neural network method to design the proposed motion planning model and verified it in a simulation platform considering a 12-DOF robot. He et al. [Reference He, Ge, Li, Liu, Yang and Sun22] have developed an approach to design and analyze the Denavit–Hartenberg (DH) model of a humanoid robot’s upper limb. To model all the motions of the limb, a recursive Newton–Euler formulation has been used, and the trajectory of each point has been obtained by use of a Particle Swarm Optimization approach. An inverse optimal control scheme to efficiently transfer motion control parameters from humans to humanoids has been proposed by Clever and Mombaur [Reference Clever, Hu and Mombaur23]. They have considered parameters like phase duration, mass trajectory, and orientation of the upper body and foot trajectories for designing the above control scheme. To enhance the performance of human–robot correlation, Ryu et al. [Reference Ryu, Kang, Kim, Lee, You and Doh24] have proposed a navigational scheme using a time index and waypoints. A time index has been used to obtain a path in relation to human’s way of selecting the most natural path, and a waypoint-based approach has been used to accurately track a robot’s motion even in complex dynamic arenas. Kumar et al. [Reference Kumar, Muni and Parhi25] perform navigational analysis using their developed intelligent motion planner on a humanoid robot. Muni et al. [Reference Muni, Parhi, Kumar, Sahu and Kumar26–Reference Muni, Parhi and Kumar31] introduced and successfully implemented various artificial intelligence algorithms toward motion planning analysis of legged robots in obstacle-prone environments.
The extensive study of literature can be used to infer that RA and firefly algorithm as navigational controllers primarily find application in the field motion planning of mobile robots. However, finding them applied in the field of humanoid navigation is quite rare. Along with that, works on analyzing the navigation behavior of humanoids in a common environment are rare as well. The use of hybrid controllers in humanoid navigation is also rare to find. Therefore, the objective of this paper is geared toward the complete development of a hybrid regression-firefly-based motion planner for single to multiple humanoid navigations and its implementation in an environment with randomly placed obstacles.
Here, the research aims to design and develop a hybrid regression-firefly-based motion planner for motion planning of single and multiple humanoids for static and dynamic environments cluttered with complex obstacles.
The authors of the paper believed that the controller, designed and developed by implementing the two techniques (regression and firefly technique) provides an optimized path for the global path planning of humanoid robots in a cluttered environment with dynamic obstacles.
The outline of the research work is as follows:
-
In Section 1, the introduction to the research is explained.
-
Section 2 is focused on the regression model.
-
Section 3 is focused on the firefly model.
-
Section 4 describes the hybridization of the regression model with the firefly model.
-
The Petri-Net Control Strategy has been described in Section 5 for the multiple humanoid robots.
-
The simulation and experimental analysis have been depicted in Section 6.
-
In Section 7, an evaluation of the proposed regression-firefly model against another navigational model has been described.
-
The research work has been concluded in Section 8.
2. Regression model
Regression is a classic data forecasting tool that considers previous data trends to prepare an approximation for the future.
2.1. Technical basics
Regression relates dependent parameters with independent ones using standard functions. A primary regression-based mathematical equation can be expressed as follows:
where
$u_{p}=\eta _{1}y_{p,1}+\eta _{2}y_{p,2}+\cdots+\eta _{p}y_{p,n},\eta =(\eta _{1},\eta _{2},\ldots,\eta _{p})$ are taken as the standard functions used in regression and $x_{p}$ represents the error term.
A humanoid navigational model can also be formulated using the basic principles of regression which have been discussed in the following section.
2.2. Regression-based humanoid navigational model
Here, the major objective of the regression-based humanoid navigational model has been set as the generation of a collision-free trajectory toward the preset target with optimization of both path length and navigational time. The regression model takes three input parameters, namely front sensor yield (FSY), left sensor yield (LSY), and right sensor yield (RSY) and outputs the initial turning angle (ITA). Figure 1 represents the scheme in which the input and output parameters are presented for a regression-based navigational model [Reference Kumar, Sahu and Parhi32].
As already stated, regression considers previous data trends to generate a futuristic prediction model. Table I represents a sample data trend used for the regression navigational model. The negative signs in Table I enforce the convention that a left turn by the humanoid is taken as negative while a right turn is taken as positive. Zero value in ITA represents no turn which means the humanoid proceeds in the previous angle of turn as it was moving. Around 750 training pattern data have been fed to a Minitab regression toolbox and an equation used for navigation has been obtained as follows:
where E 1 = FSY, E 2 = LSY, E 3 = RSY, and E 4 = ITA
With a preset start and goal location, the humanoid advances toward the goal with the help of a regression-based navigational model. The regression-based scheme comes into effect upon encountering a potential obstacle within the inception range of the humanoid. Here, the inception range has been considered as 25 cm from the robot’s location. Various responsive behaviors such as hurdle avoidance, destination trailing, and wall guiding have been added to the navigation model to obtain an optimal toward the goal location. Hurdle avoidance behavior keeps a safe distance from the obstacles, destination trailing behavior maintains a straight path toward the destination when obstacles are absent, and wall guiding behavior follows a long obstacle to avoid excess consumption of energy when a long-sized obstacle is encountered by the robot [Reference Sahu, Parhi, Kumar, Muni, Chhotray and Pandey33].
3. Firefly model
The Firefly algorithm is a nature-inspired intelligent approach derived from the flashing behavior of fireflies. It is based on the special manner in which fireflies move in their colony.
3.1. Firefly-based humanoid navigational model
Some assumptions mentioned below are considered as prerequisites for designing a humanoid navigational model:
-
i. Being considered to be unisexual in nature, all fireflies are attracted toward each other.
-
ii. The amount of attractiveness a firefly exhibits is considered directly proportional to its brightness. Hence, a firefly is attracted toward all the fireflies having more brightness. With an increase in the distance, the brightness diminishes. The brightest firefly in the entire colony does not have any other to be attracted, so it has the freedom of random movement.
-
iii. The brightness of a firefly is largely dependent on the fitness function considered for optimization.
In every iteration of the algorithm, the firefly is always attracted to a surrounding firefly that is brighter than itself. This probabilistic movement is represented in mathematical form as follows.
Let the probability of attraction of the pth firefly toward qth firefly be represented by λ pq and given by:
where $\mathrm{\mu}_{p}\lt \mathrm{\mu}_{q}$ ; µ p , µ q , and µ r represent the light intensities of pth, qth, and rth fireflies, respectively.
Let all fireflies in the inception range having more brightness than the pth firefly be denoted by a set S p and given as:
The Euclidean distance between pth and rth firefly is denoted by d(p, r). The equation is valid only when this distance is lesser than the inception range (25 cm for the current investigation).
As already stated, brightness follows a decreasing trend with distance, so it can be given as:
where µ 0, ϑ, and d represent the initial brightness, the light absorption coefficient, and the distance, respectively.
Equation (5) can be simplified in terms of inverse proportionality as:
As per the basic principle of the firefly algorithm, in each iteration, pth firefly approaches qth firefly as per the probabilistic equation and the new position of the firefly can be represented as follows:
where n denotes the iteration count, σ denotes the step size in each movement, and $||.||$ denotes the distance vector.
In each iteration, there is a possibility of a gradual decrease in the brightness of the fireflies. So, the brightness is updated in each iteration to enhance the possibility of the fireflies reaching the goal. This is given by the equation:
where θ 1 and θ 2 are the balancing coefficients and f(x p ) is the objective function of the pth firefly.
In the current investigation, NAO robots have been used as humanoid platforms. NAO [Reference Kofinas, Orfanoudakis and Lagoudakis34] is a medium-sized intelligent humanoid capable of performing several handy operations with the help of its vast sensory network consisting of SONARs, Infrareds, tactile, and force resistors.
Here, SONARs are used for obstacle detection purpose.
3.2. Fitness function for humanoid navigational model (DD)
Fitness function plays a crucial role while designing humanoid motion planning as it reflects the effect of several navigational parameters. Here, three parameters, namely hurdle avoidance, destination trailing and drift minimization, are selected as the parts for formulating the overall fitness function [Reference Sahu, Parhi and Kumar35].
3.2.1 Hurdle avoidance
In the firefly algorithm, the destination is considered to be the brightest firefly; as a result, all the surrounding fireflies are attracted toward it. The fireflies form a colony around the obstacle when one is detected within the range of inception. The Nearest Sensor Yield (NSY) is considered as one of the inputs to the firefly-based model. The destination being the brightest firefly attracts all other fireflies toward it. A maximum distance from the surrounding static obstacles should be maintained by the brightest firefly. This accounts for a specific set of movements to prevent a collision. The objective function has been considered as a minimization problem here. Hence, hurdle avoidance pattern can be considered as an inverse proportionality for the fitness function as:
where $\text{HA}_{d}=\sqrt{(\text{UP}_{x}-\text{NSY}_{x})^{2}+(\text{UP}_{y}-\text{NSY}_{y})^{2}}$
(UP x , UP y ) denote the coordinates for the upcoming position of the firefly and (NSY x , NSY y ) denote the nearest sensor yield.
3.2.2 Destination trailing
In the absence of any obstacle in the path, the brightest firefly in the colony should always head toward the destination. Hence, the upcoming position of the firefly should always maintain a minimum distance from the destination. Here, the destination trailing pattern is a direct relationship:
where $\text{DT}_{d}=\sqrt{(\text{DT}_{x}-\text{UP}_{x})^{2}+(\text{DT}_{y}-\text{UP}_{y})^{2}}$
And (DT x , DT y ) denote the coordinates for the robot’s destination position.
3.2.3 Drift minimization
While selecting the upcoming position to move, a firefly must follow an optimal fashion which is mathematically given as follows:
where $\text{DM}_{d}=\sqrt{(\text{UP}_{x}-\text{CP}_{x})^{2}+(\text{UP}_{y}-\text{CP}_{y})^{2}}$
(CP x , CP y ) denotes the current position of the robot.
A linear combination of the individual parts with the help of suitable weightages is used to generate the final fitness function:
The individual parts of the final fitness function have weightages associated with them and denoted by γ.
Due to this being a minimization problem, the optimal solution is the one with the minimal value of the fitness function. Here, a hit and trail approach has been adopted to decide the values of the weightages assigned to the individual parts of the final fitness function. After finding out the best position to move, the required ITA can be calculated by simple geometrical considerations.
4. Hybridization of regression model with firefly model
As already discussed, regression model is a classical method of analysis and firefly is an artificial intelligent approach. While classical methods are combined with AI methods, both accurate and converged solutions can be generated. In the first step of hybridization, sensory data such as FSY, LSY, and RSY are fed as inputs to the regression model and ITA is generated as the initial output. In the second step of hybridization, NSY and Fitness Function for Humanoid Navigational Model (DD) along with ITA are fed as inputs to the firefly model, and final turning angle (FTA) is generated as the final output. Figure 2 represents the scheme of hybridization adopted in the current investigation [Reference Sahu, Kumar and Parhi36, Reference Jánoš, Sukop, Semjon, Tuleja, Marcinko, Kočan, Grytsiv, Vagaš, Miková and Kelemenová37].
Figure 3 represents the pseudocode for the regression-firefly hybrid model, and Fig. 4 represent the flowchart for the same.
5. Petri-Net control strategy
As already discussed, in the current investigation, along with navigation of a single humanoid in a complex arena, navigation of multiple humanoids is also attempted. While multiple humanoids navigate in a common platform, there is a possibility of potential conflict in the path upon the encounter of a common obstacle. Hence, along with the proposed regression-firefly-based model, the integration of a Petri-Net control strategy [Reference Peterson38, Reference Pham and Parhi39] is done for smooth and hassle-free navigation. Figure 5 demonstrates a standard Petri-Net control strategy.
In Fig. 5, the black circle represents current position and the bar symbol represents a stage transition. Here, six stages of the control strategy are operated as follows.
-
Stage 1: This is the initial stage where the robot has information about the source and destination locations only and is unaware of the position of fellow robots.
-
Stage 2: In this stage, the robots mark their journey toward their respective destinations while avoiding any static obstacles that are detected around them.
-
Stage 3: Stage 3 denotes the detection of a dynamic obstacle. This arises when multiple humanoids encounter a common obstacle.
-
Stage 4: Stage 4 is the negotiation stage where the robot closest to the destination is given preference to move first while the other robot waits as a static obstacle.
-
Stage 5: After the prioritized robot of stage 4 leaves the conflict, the other one checks for any further conflicts and marks its journey again.
-
Stage 6: Stage 6 is a special waiting state. If a robot encounters another set of robots already in stage 3, it waits as a static obstacle and after the resolution of conflict among the first set of robots, it again marks its journey starting from stage 2.
By integration of the above-discussed Petri-Net control strategy, the navigation of multiple humanoids in a common platform can be achieved.
6. Execution of proposed regression-firefly hybrid model
The proposed regression-firefly hybrid model has been executed for the navigation of both single and multiple humanoid robots. NAO has been taken as the humanoid platform for the stated purpose in this research.
6.1. Motion planning of a single NAO
Here, motion planning in both simulation and experimental platforms has been attempted using the proposed hybrid model. In order to represent the humanoid as a whole-body model, the selection of V-REP as an appropriate simulation platform is done. In the simulation platform, an area of size 240 × 160 units has been designated as the working size, and definite source and destination regions are defined. Seven hurdles of arbitrary shapes and sizes are spawned randomly in the arena. The humanoid communicates with the hybrid model through an LUA script to receive commands. Figure 6 represents the simulation arena results obtained in the current study. It can be observed that the humanoid has successfully reached the destination without colliding against any of the obstacles present in the arena.
To evaluate the results obtained from the simulation arena, an experimental platform having the same working size has been prepared under laboratory testing conditions. To keep coherence with the simulation platform, the position of source and destination, size, shape, and position of obstacles have been kept exactly alike. The connection to the humanoid is established through Wi-Fi and a Python script containing the hybrid model communicates with this humanoid. Figure 7 represents the experimental results obtained in the current study.
As seen from Figs. 6 and 7, the humanoid has followed an optimal trajectory while reaching the destination from the source location.
The Petri-Net control strategy, as explained above, can be found in Fig. 8(d) and (e), and Fig. 9(d) and (e), where N2 acts as a static obstacle to N1 and N1 moves forward toward the target as it is very nearer to the goal location.
To have concrete evidence against the effectiveness of the proposed hybrid model, navigational parameters such as route length and time interval from source to destination are selected for comparison purposes. The values of these parameters can be directly obtained in simulation. In the case of real-world setup, their value is recorded by conducting measurements using a measuring tape and stopwatch. Tables II and III represent the comparison of the selected navigational parameters between the simulation and experimental results.
It can be observed from Tables II and III that the simulation and experimental results are well in agreement with each other with minimal error limits. Here, the experimental results always show higher values compared to the simulation counterparts. The reason for the same can be justified by the presence of external factors like the slippage effect, data transmission loss, and frictional losses in the experimental platform which are ideal for the simulation arena.
6.2. Motion planning of multiple NAOs
While navigating multiple humanoids in a common platform, the Petri-Net control strategy is integrated with the proposed hybrid model. Here, the arena size has been kept the same as used for the navigation of a single NAO. Five obstacles of random shape and size are placed at arbitrary locations in the arena, and two NAOs fed with the logic of the proposed hybrid model along with the Petri-Net control strategy are used for the navigation purpose. Figure 8 represents the simulation results.
The simulation results obtained from the motion planning of multiple NAOs are also verified in the experimental platform. Figure 9 represents the experimental results.
Tables IV and V demonstrate the comparison of simulation and experimental results in terms of route length and time interval, respectively.
It has been observed that the proposed regression-firefly hybrid model has worked efficiently for the navigation of both single and multiple humanoid robots.
7. Evaluation of the proposed regression-firefly hybrid model against another navigational model
The developed regression-firefly hybrid model has been evaluated against another existing navigational model developed by Chen and Richardson [Reference Chen and Richardson40] based on a neuro-fuzzy approach. Figure 10 represents a comparison of trajectory generated between both the navigational models and Table VI demonstrates the comparison of route length.
The proposed regression-firefly hybrid model has been proven to be more efficient than the existing path planning models.
8. Conclusions
In the current investigation, a regression-firefly-based hybrid model has been designed and tested on single and multiple humanoids for smooth and efficient navigation in a complex arena. In the regression model, sensory information regarding the hurdles present in the arena is fed as inputs to calculate the ITA. In the second step of hybridization, along with the ITA generated in the first step, the nearest sensor range and destination distance are fed as inputs to the firefly model, and the FTA is generated as the ultimate guiding angle to move the humanoids toward the respective destinations. The proposed hybrid model has been implemented in simulation and experimental platforms for both single and multiple humanoids. The results obtained from both platforms are compared in terms of trajectory generated, route length, and time interval, and satisfactory results have been observed with a minimal percentage of errors. Finally, the proposed hybrid model has been compared against another existing navigational model and significant performance enhancements have been recorded.
9. Future work
Motion planning analysis of humanoid robots in different environments has been successfully studied using the regression-firefly-based method. The developed novel technique is compared against existing methodology [Reference Chen and Richardson40], and significant improvements of 8.33% in navigational parameters like route length have been observed. Though the motion planning analysis has been studied successfully, improvements toward dynamic stabilization, gait pattern analysis, analysis related to robustness and resilience [Reference Wang, Qian, Yan, Yuan and Zhang41], as well as hybridization methods to design and optimize autonomous mechatronics systems [Reference Zhang, Ouyang and Sun42, Reference Zhang, Zhang and Zhang43] are still to be carried out.
Author contributions
Chinmaya Sahu: Conceptualization, Validation, Formal analysis, Data Analysis, Methodology, Data Curation, Writing – original draft, and Editing.
Dayal R. Parhi: Conceptualization, Image Recreation, Data Collection, Writing – Rough draft, Supervision, and Editing.
Manoj Kumar Muni: Validation, Formal analysis, Investigation, Writing – Review and Editing.
Saurabh Sameer Kamat: Formal analysis Investigation, Software, Data Curation, Writing – Review and Editing.
Financial support
This research received no specific grant from any funding agency, commercial, or not-for-profit sectors.
Competing interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethical standards
Not applicable.