This paper proposes a seat support mechanism to solve the problem of misalignment between the chest examination and probe scanning areas when the patient is bent in a seated-style echocardiography robot. To guide the patient to an appropriate body position where their chest is within the examination range of the chest examination unit while minimizing the physical load of the patient, the posture of the patient must satisfy the three following conditions. (i) The breech must be in contact with the seat surface, (ii) the legs must be vertical to the floor, and (iii) the chest and mechanism must be parallel while the probe scanning and chest examination ranges must match. The human body was modeled to derive a posture that satisfies the aforementioned conditions for the height of each individual, and a seat support mechanism with four degrees of freedom was installed to guide the user to the derived posture. By installing this mechanism, the body load of the left biceps brachii, right biceps brachii, left latissimus dorsi, and right latissimus dorsi was reduced to 64.7%, 52.7%, 86.4%, and 80.2%, respectively. The sharpness of the image contours was improved to 103.8%.

Body-worn sensor data is used in monitoring patient activity during rehabilitation and also can be extended to controlling rehabilitation devices based on the activity of the person. The primary focus of research has been on effectively capturing the spatiotemporal dependencies in the data collected by these sensors and efficiently classifying human activities. With the increasing complexity and size of models, there is a growing emphasis on optimizing their efficiency in terms of memory usage and inference time for real-time usage and mobile computers. While hybrid models combining convolutional and recurrent neural networks have shown strong performance compared to traditional approaches, self-attention-based networks have demonstrated even superior results. However, instead of relying on the same transformer architecture, there is an opportunity to develop a novel framework that incorporates recent advancements to enhance speed and memory efficiency, specifically tailored for human activity recognition (HAR) tasks. In line with this approach, we present GLULA, a unique architecture for HAR. GLULA combines gated convolutional networks, branched convolutions, and linear self-attention to achieve efficient and powerful solutions. To enhance the performance of our proposed architecture, we employed manifold mixup as an augmentation variant which proved beneficial in limited data settings. Extensive experiments were conducted on five benchmark datasets: PAMAP2, SKODA, OPPORTUNITY, DAPHNET, and USC-HAD. Our findings demonstrate that GLULA outperforms recent models in the literature on the latter four datasets but also exhibits the lowest parameter count and close to the fastest inference time among state-of-the-art models.

This article examines the feasibility of employing a cold-gas thruster (CGT), intended as a backpack-wearable device, for purposes of arresting backward falls, and in particular describes a supervisory controller that, for some motion described by an arbitrary combination of center-of-mass angle and angular velocity, both detects an impending fall and determines when to initiate thrust in the CGT in order to arrest the impending fall. The CGT prototype and the supervisory controller are described and experimentally assessed using a rocking block apparatus intended to approximate a backward-falling human. In these experiments, the CGT and supervisory controller restored upright stability to the rocking block in all experiment cases that would have otherwise resulted in a fall without the CGT assistance. Since the controller and experiments employ a reduced-order model of a falling human, the authors also conducted a series of simulations intended to examine the extent to which the controller might remain effective in the case of a multi-segment human. The results of these simulations suggest that the CGT controller would be nearly as effective on a multi-segment falling human as on the reduced-order model.

Admittance control of the robot is an important method to improve human–robot collaborative performance. However, it displays poor matching between admittance parameters and human–robot collaborative motion. This results in poor motion performance when the robot interacts with the changeable environment (human). Therefore, to improve the performance of human–robot collaboration, the human-like variable admittance parameter regulator (HVAPR) based on the change rate of interaction force is proposed by studying the human arm’s static and dynamic admittance parameters in human–human collaborative motion. HVAPR can generate admittance parameters matching with human collaborative motion. To test the performance of the proposed HVAPR, the human–robot collaborative motion experiment based on HVAPR is designed and compared with the variable admittance parameter regulator (VAPR). The satisfaction, recognition ratio, and recognition confidence of the two admittance parameter regulators are statistically analyzed via questionnaire. Simultaneously, the trajectory and interaction force of the robot are analyzed, and the performance of the human–robot collaborative motion is assessed and compared using the trajectory smoothness index and average energy index. The results show that HVAPR is superior to VAPR in human–robot collaborative satisfaction, robot trajectory smoothness, and average energy consumption.

This article proposes, describes, and tests a swing-assist walking controller for a stance-controlled, swing-assisted knee prosthesis that aims to combine benefits of passive swing mechanics (e.g., quiet operation, biomimetic function, and low power requirements) with benefits of powered swing assistance (e.g., increased robustness of swing-phase motion and specifically increased toe clearance). A three-participant, multislope, multispeed treadmill walking study was performed using the swing-assist prosthesis and controller, as well as using the participants’ prescribed microprocessor knee devices. The swing-assist device and approach were found to improve user minimum foot clearance during walking at slopes and speeds, and also to improve symmetry of knee motion. Hip power inputs from stance knee release to heel strike indicated that, on average, less hip power was required when using the swing-assist prosthesis, indicating that the observed benefits were likely the result of the knee device and its control methodology, rather than a result of increased hip joint effort.

Human-centered intelligent human–robot interaction can transcend the traditional keyboard and mouse and have the capacity to understand human communicative intentions by actively mining implicit human clues (e.g., identity information and emotional information) to meet individuals’ needs. Gait is a unique biometric feature that can provide reliable information to recognize emotions even when viewed from a distance. However, the insufficient amount and diversity of training data annotated with emotions severely hinder the application of gait emotion recognition. In this paper, we propose an adversarial learning framework for emotional gait dataset augmentation, with which a two-stage model can be trained to generate a number of synthetic emotional samples by separating identity and emotion representations from gait trajectories. To our knowledge, this is the first work to realize the mutual transformation between natural gait and emotional gait. Experimental results reveal that the synthetic gait samples generated by the proposed networks are rich in emotional information. As a result, the emotion classifier trained on the augmented dataset is competitive with state-of-the-art gait emotion recognition works.

Robots with human-like appearances and structures are usually well accepted in the human–robot interaction. However, compared with human-like appearances and structures, the human-like motion plays a much more critical role in improving the efficiency and safety of the human–robot interaction. This paper develops a human-like motion planner based on human arm motion patterns (HAMPs) to fulfill the human–robot object handover tasks. First, a handover task is divided into two sub-tasks, that is, pick-up and delivery, and HAMPs are extracted for these two sub-tasks separately. The resulting HAMPs are analyzed, and a method is proposed to select HAMPs that can represent the characteristics of the human arm motion. Then the factors affecting the duration of the movement primitives are analyzed, and the relationship between the duration of the movement primitives and these factors is determined. Based on the selected HAMP and the computed duration of the movement primitives, a human-like motion planning framework is developed to generate the human-like motion for the robotic arms. Finally, this motion planner is verified by the human–robot handover experiments using a KUKA IIWA robot. It shows that the resulting trajectories can correctly reflect the relative relationship between the joints in the human arm motion and are very close to the recorded human arm trajectories. Furthermore, the proposed motion planning method is compared with the motion planning method based on minimum total potential energy. The results show that the proposed method can generate more human-like motion.

In this paper, an overall structure with the asymmetric constrained controller is constructed for human–robot interaction in uncertain environments. The control structure consists of two decoupling loops. In the outer loop, a discrete output feedback adaptive dynamics programing (OPFB ADP) algorithm is proposed to deal with the problems of unknown environment dynamic and unobservable environment position. Besides, a discount factor is added to the discrete OPFB ADP algorithm to improve the convergence speed. In the inner loop, a constrained controller is developed on the basis of asymmetric barrier Lyapunov function, and a neural network method is applied to approximate the dynamic characteristics of the uncertain system model. By utilizing this controller, the robot can track the prescribed trajectory precisely within a security boundary. Simulation and experimental results demonstrate the effectiveness of the proposed controller.

Electrical muscle stimulation (EMS) is widely used in rehabilitation and athletic training to generate involuntary muscle contractions. However, EMS leads to rapid muscle fatigue, limiting the force a muscle can produce during prolonged use. Currently available methods to monitor localized muscle fatigue and recovery are generally not compatible with EMS. The purpose of this study was to examine whether Doppler ultrasound imaging can assess changes in stimulated muscle twitches that are related to muscle fatigue from electrical stimulation. We stimulated five isometric muscle twitches in the medial and lateral gastrocnemius of 13 healthy subjects before and after a fatiguing EMS protocol. Tissue Doppler imaging of the medial gastrocnemius recorded muscle tissue velocities during each twitch. Features of the average muscle tissue velocity waveforms changed immediately after the fatiguing stimulation protocol (peak velocity: -38%, p = .022; time-to-zero velocity: +8%, p = .050). As the fatigued muscle recovered, the features of the average tissue velocity waveforms showed a return towards their baseline values similar to that of the normalized ankle torque. We also found that features of the average tissue velocity waveform could significantly predict the ankle twitch torque for each participant (R2 = 0.255–0.849, p < .001). Our results provide evidence that Doppler ultrasound imaging can detect changes in muscle tissue during isometric muscle twitch that are related to muscle fatigue, fatigue recovery, and the generated joint torque. Tissue Doppler imaging may be a feasible method to monitor localized muscle fatigue during EMS in a wearable device.

Social robots serve people as tutors, caretakers, receptionists, companions, and other social agents. People know that the robots are mechanical artifacts, yet they interact with them as if they were actual agents. How is this possible? The proposal here is that people construe social robots not as social agents per se, but as depictions of social agents. They interpret them much as they interpret ventriloquist dummies, hand puppets, virtual assistants, and other interactive depictions of people and animals. Depictions as a class consist of three physical scenes with part-by-part mappings between them: (a) a base scene (the raw physical artifact), (b) the depiction proper (the artifact construed as a depiction), and (c) the scene depicted (the scene people are to imagine). With social robots, evidence shows people form the same three scenes plus mappings: They perceive the raw machinery of a robot, construe it as a depiction of a character, and, using the depiction as a guide, engage in the pretense that they are interacting with the character depicted. With social robots, people also recognize three classes of agents – the characters depicted, the intended recipients of the depictions (those who view or interact with the robots), and the authorities responsible for the robots (the designers, makers, and owners). Construing social robots as depictions, we argue, accounts for many phenomena not covered by alternative models.

Today, demandsin industrial manufacturing mandate humans to work with large-scale industrial robots, and this collaboration may result in dangerous conditions for humans. To deal with this situation, this work proposes a novel approach for redundant large-scale industrial robots. In the proposed approach, an admittance controller is designed to regulate the interaction between the end effector of the robot and the human. Additionally, an obstacle avoidance algorithm is implemented in the null space of the robot to prevent any possible unexpected collision between the human and the links of the robot. After safety performance of this approach is verified via simulations and experimental studies, the effect of the parameters of the admittance controller on the performance of collaboration in terms of both accuracy and total human effort is investigated. This investigation is carried out via 8 experiments by the participation of 10 test subjects in which the effect of different admittance controller parameters such as mass and damper are compared. As a result of this investigation, tuning insights for such parameters are revealed.

In this paper, we present an electrically driven childlike android named ibuki equipped with a wheeled mobility unit that enables it to move in a real environment. Since the unit includes a vertical oscillation mechanism, the android can replicate the movements of the human center of mass and can express human-like upper-body movements even when moving by wheels. Moreover, providing 46 degrees of freedom enables it to perform various human-like physical expressions. The development of ibuki, as well as the implementation and testing of several functions, is described. Finally, we discuss the potential advantages and future research direction of a childlike mobile android.

What exactly is it that makes one morally responsible? Is it a set of facts which can be objectively discerned, or is it something more subjective, a reaction to the agent or context-sensitive interaction? This debate gets raised anew when we encounter newfound examples of potentially marginal agency. Accordingly, the emergence of artificial intelligence (AI) and the idea of “novel beings” represent exciting opportunities to revisit inquiries into the nature of moral responsibility. This paper expands upon my article “Artificial Moral Responsibility: How We Can and Cannot Hold Machines Responsible” and clarifies my reliance upon two competing views of responsibility. Although AI and novel beings are not close enough to us in kind to be considered candidates for the same sorts of responsibility we ascribe to our fellow human beings, contemporary theories show us the priority and adaptability of our moral attitudes and practices. This allows us to take seriously the social ontology of relationships that tie us together. In other words, moral responsibility is to be found primarily in the natural moral community, even if we admit that those communities now contain artificial agents.

With the widespread development of leg exoskeletons to provide external force-based repetitive training for gait rehabilitation, the prospect of undesired movement adaptation due to applied forces and imposed constraints require adequate investigation. A cable-driven leg exoskeleton, CDLE, presents a lightweight, flexible, and redundantly actuated architecture that enables the possibility of system parameters modulation to alter human–robot interaction while applying the desired forces. In this work, multi-joint stiffness performance of CDLE is formulated to systematically analyze human–CDLE interaction. Further, potential alterations in CDLE architecture are presented to tune human–CDLE interaction that favors the desired human leg movement during a gait rehabilitation paradigm.

Human–robot interaction (HRI) is becoming more important nowadays. In this paper, a low-cost communication system for HRI is designed and implemented on the Scout robot and a robotic face. A hidden Markov model-based voice command detection system is proposed and a non-native database has been collected by Persian speakers, which contains 10 desired English commands. The experimental results confirm that the proposed system is capable to recognize the voice commands, and properly performs the task or expresses the right answer. Comparing the system with a trained system on the Julius native database shows a better true detection (about 10%).

The variable stiffness actuator (VSA) is helpful to realize the post-collision safety strategies for safe human–robot interaction.1 The stiffness of the robot will be reduced to protect the user from injury when the collision between the robot and human occurs. However, The VSA has a mechanism limit constraint that can cause harm to users even if the stiffness is minimized. Accordingly, in this article, a concept combining danger index and robust fault detection and isolation is presented and applied to active–passive variable stiffness elastic actuator (APVSEA). APVSEA can actively change joint stiffness with the change of danger index. Experimental results show that this concept can effectively confirm the fault mode and provide additional protection measures to ensure the safety of users when the joint stiffness has been adjusted to the minimum.

With the increasing demand for humans and robots to collaborate in a joint workspace, it is essential that robots react and adapt instantaneously to unforeseen events to ensure safety. Constraining robot dynamics directly on SE(3), that is, the group of 3D translation and rotation, is essential to comply with the emerging Human–Robot Collaboration (HRC) safety standard ISO/TS 15066. We argue that limiting coordinate-independent magnitudes of physical dynamic quantities at the same time allows more intuitive constraint definitions. We present the first real-time capable online trajectory generator that constrains translational and rotational magnitude values of 3D translation and 3D rotation dynamics in a singularity-free formulation. Simulations as well as experiments on a hardware platform show the utility in HRC contexts.

Performing actions in a timely manner is an indispensable aspect in everyday human activities. Accordingly, it has to be present in robotic systems if they are going to seamlessly interact with humans. The current work addresses the problem of learning both the spatial and temporal characteristics of human motions from observation. We formulate learning as a mapping between two worlds (the observed and the action ones). This mapping is realized via an abstract intermediate representation termed “Latent Space.” Learned actions can be subsequently invoked in the context of more complex human–robot interaction (HRI) scenarios. Unlike previous learning from demonstration (LfD) methods that cope only with the spatial features of an action, the formulated scheme effectively encompasses spatial and temporal aspects. Learned actions are reproduced under the high-level control of a time-informed task planner. During the implementation of the studied scenarios, temporal and physical constraints may impose speed adaptations in the reproduced actions. The employed latent space representation readily supports such variations, giving rise to novel actions in the temporal domain. Experimental results demonstrate the effectiveness of the proposed scheme in the implementation of HRI scenarios. Finally, a set of well-defined evaluation metrics are introduced to assess the validity of the proposed approach considering the temporal and spatial consistency of the reproduced behaviors.