View Chapter

Chapter 35 — Multisensor Data Fusion

Hugh Durrant-Whyte and Thomas C. Henderson

Multisensor data fusion is the process of combining observations from a number of different sensors to provide a robust and complete description of an environment or process of interest. Data fusion finds wide application in many areas of robotics such as object recognition, environment mapping, and localization.

This chapter has three parts: methods, architectures, and applications. Most current data fusion methods employ probabilistic descriptions of observations and processes and use Bayes’ rule to combine this information. This chapter surveys the main probabilistic modeling and fusion techniques including grid-based models, Kalman filtering, and sequential Monte Carlo techniques. This chapter also briefly reviews a number of nonprobabilistic data fusion methods. Data fusion systems are often complex combinations of sensor devices, processing, and fusion algorithms. This chapter provides an overview of key principles in data fusion architectures from both a hardware and algorithmic viewpoint. The applications of data fusion are pervasive in robotics and underly the core problem of sensing, estimation, and perception. We highlight two example applications that bring out these features. The first describes a navigation or self-tracking application for an autonomous vehicle. The second describes an application in mapping and environment modeling.

The essential algorithmic tools of data fusion are reasonably well established. However, the development and use of these tools in realistic robotics applications is still developing.

Multisensor remote surface inspection

Author  S. Hayati, H. Seraji, B. Balaram, R. Volpe, B. Ivlev, G. Tharp, T. Ohm, D. Lim

Video ID : 639

Jet Propulson Lab, Pasadena, applies telerobotic inspection techniques to space platforms.

Chapter 58 — Robotics in Hazardous Applications

James Trevelyan, William R. Hamel and Sung-Chul Kang

Robotics researchers have worked hard to realize a long-awaited vision: machines that can eliminate the need for people to work in hazardous environments. Chapter 60 is framed by the vision of disaster response: search and rescue robots carrying people from burning buildings or tunneling through collapsed rock falls to reach trapped miners. In this chapter we review tangible progress towards robots that perform routine work in places too dangerous for humans. Researchers still have many challenges ahead of them but there has been remarkable progress in some areas. Hazardous environments present special challenges for the accomplishment of desired tasks depending on the nature and magnitude of the hazards. Hazards may be present in the form of radiation, toxic contamination, falling objects or potential explosions. Technology that specialized engineering companies can develop and sell without active help from researchers marks the frontier of commercial feasibility. Just inside this border lie teleoperated robots for explosive ordnance disposal (EOD) and for underwater engineering work. Even with the typical tenfold disadvantage in manipulation performance imposed by the limits of today’s telepresence and teleoperation technology, in terms of human dexterity and speed, robots often can offer a more cost-effective solution. However, most routine applications in hazardous environments still lie far beyond the feasibility frontier. Fire fighting, remediating nuclear contamination, reactor decommissioning, tunneling, underwater engineering, underground mining and clearance of landmines and unexploded ordnance still present many unsolved problems.

Nuclear manipulator, remote-handling equipment (1960)

Author  James P. Trevelyan

Video ID : 588

Demonstration video showing the pouring of a cup of tea – illustrates the dexterity of these popular manipulators which are ubiquitous in nuclear laboratories.

IED hunters

Author  James P. Trevelyan

Video ID : 572

The video shows the work of route-clearance teams in Afghanistan.   This video has been included because researchers can see plenty of examples of realistic field conditions under which explosive-ordnance clearance is being done in Afghanistan. It is essential for researchers to have an accurate appreciation of the real field conditions before considering expensive research projects. It is also essential that researchers understand how easily insurgent forces can adapt and defeat technological solutions that have cost tens of millions of dollars to develop. Read the caption below carefully and then watch the video with this in mind. Better-quality blast-protected vehicles provide the teams with more confidence to handle challenging tasks. You will also see that improvised explosive devices (IEDs) used by insurgents are typically made from the unexploded ordnance (UXO) which the demining teams are trying to remove. Between 15% (typical failure rate for high quality US-made ammunition) and 70% (old Russian-designed ammunition) fail to explode when used.   These UXOs lie in the ground in a, at best, semi-stable state, so some easily exploded accidentally at times. Insurgents collect and attempt to disarm them, then set them up with remotely operated or vehicle-triggered detonation fuses. That is why the demining teams came to be seen as legitimate targets by insurgents, because they were removing the explosive devices the insurgency needed to fight people who they regarded as legitimate enemies. Although not explicitly acknowledged in the commentary, this video also demonstrates one of the many methods used by insurgents to adapt their techniques to defeat the highly advanced technologies available to the ISAF teams. By laying multiple devices in different locations, using different triggering devices and different deployment methods, the insurgents soon learned what the ISAF teams could and could not detect.   Every blast indicated a device that was not detected in advance by the ISAF team. Every device removed by the team indicated a device that was detected. In this way, the insurgents rapidly learned how to deploy undetectable devices that maximized their destructive power.

Chapter 25 — Underwater Robots

Hyun-Taek Choi and Junku Yuh

Covering about two-thirds of the earth, the ocean is an enormous system that dominates processes on the Earth and has abundant living and nonliving resources, such as fish and subsea gas and oil. Therefore, it has a great effect on our lives on land, and the importance of the ocean for the future existence of all human beings cannot be overemphasized. However, we have not been able to explore the full depths of the ocean and do not fully understand the complex processes of the ocean. Having said that, underwater robots including remotely operated vehicles (ROVs) and autonomous underwater vehicles (AUVs) have received much attention since they can be an effective tool to explore the ocean and efficiently utilize the ocean resources. This chapter focuses on design issues of underwater robots including major subsystems such as mechanical systems, power sources, actuators and sensors, computers and communications, software architecture, and manipulators while Chap. 51 covers modeling and control of underwater robots.

Six-legged, walking, underwater robot Crabster

Author  Hyun-Taek Choi

Video ID : 793

This video shows basic function testing of the six-legged, underwater robot named Crabster developed by KRISO (Korea Research Institute of Ships and Ocean Engineering).

Chapter 76 — Evolutionary Robotics

Stefano Nolfi, Josh Bongard, Phil Husbands and Dario Floreano

Evolutionary Robotics is a method for automatically generating artificial brains and morphologies of autonomous robots. This approach is useful both for investigating the design space of robotic applications and for testing scientific hypotheses of biological mechanisms and processes. In this chapter we provide an overview of methods and results of Evolutionary Robotics with robots of different shapes, dimensions, and operation features. We consider both simulated and physical robots with special consideration to the transfer between the two worlds.

Coevolved predator and prey robots

Author  Dario Floreano

Video ID : 38

Coevolved predator and prey robots engaged in a tournament. The predator and prey robot (from left to right) are placed in an arena surrounded by walls and are allowed to interact for several trials starting at different, randomly-generated orientations. Predators are selected on the basis of the percentage of trials in which they are able to catch (i.e., to touch) the prey, and prey on the basis of the percentage of trials in which they were able to escape (i.e., to not be touched by) predators. Predators have a vision system, whereas the prey have only short-range distance sensors, but can go twice as fast as the predator. Collision between robots is detected by a conductive belt at the base of the robots.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

Flexible robot gripper for KUKA Light Weight Robot (LWR): Collaboration between human and robot

Author  Robotiq

Video ID : 632

Flexible robot gripper on KUKA Light Weight Robot engaged in a proximal human-robot collaboration. The human-safe robot combined with a agile robot gripper demonstrates collaborative part feeding and part holding in assembly tasks.

Chapter 21 — Actuators for Soft Robotics

Alin Albu-Schäffer and Antonio Bicchi

Although we do not know as yet how robots of the future will look like exactly, most of us are sure that they will not resemble the heavy, bulky, rigid machines dangerously moving around in old fashioned industrial automation. There is a growing consensus, in the research community as well as in expectations from the public, that robots of the next generation will be physically compliant and adaptable machines, closely interacting with humans and moving safely, smoothly and efficiently - in other terms, robots will be soft.

This chapter discusses the design, modeling and control of actuators for the new generation of soft robots, which can replace conventional actuators in applications where rigidity is not the first and foremost concern in performance. The chapter focuses on the technology, modeling, and control of lumped parameters of soft robotics, that is, systems of discrete, interconnected, and compliant elements. Distributed parameters, snakelike and continuum soft robotics, are presented in Chap. 20, while Chap. 23 discusses in detail the biomimetic motivations that are often behind soft robotics.

BLUE: A biped robot with variable stiffness and damping

Author  Chengxu Zhou, Xin Wang, Zhibin Li, Nikolaos Tsagarakis

Video ID : 466

The video includes clips of the robot walking, squatting while displaying various degrees of stiffness, and the stiffness adjustment mechanism.

Chapter 64 — Rehabilitation and Health Care Robotics

H.F. Machiel Van der Loos, David J. Reinkensmeyer and Eugenio Guglielmelli

The field of rehabilitation robotics considers robotic systems that 1) provide therapy for persons seeking to recover their physical, social, communication, or cognitive function, and/or that 2) assist persons who have a chronic disability to accomplish activities of daily living. This chapter will discuss these two main domains and provide descriptions of the major achievements of the field over its short history and chart out the challenges to come. Specifically, after providing background information on demographics (Sect. 64.1.2) and history (Sect. 64.1.3) of the field, Sect. 64.2 describes physical therapy and exercise training robots, and Sect. 64.3 describes robotic aids for people with disabilities. Section 64.4 then presents recent advances in smart prostheses and orthoses that are related to rehabilitation robotics. Finally, Sect. 64.5 provides an overview of recent work in diagnosis and monitoring for rehabilitation as well as other health-care issues. The reader is referred to Chap. 73 for cognitive rehabilitation robotics and to Chap. 65 for robotic smart home technologies, which are often considered assistive technologies for persons with disabilities. At the conclusion of the present chapter, the reader will be familiar with the history of rehabilitation robotics and its primary accomplishments, and will understand the challenges the field may face in the future as it seeks to improve health care and the well being of persons with disabilities.

ARMin plus HandSOME robotic therapy system

Author  Peter Lum

Video ID : 497

The ARMin exoskeleton is combined with the HandSOME orthosis to enable practice of pick and place tasks with real objects. The ARMin is controlled by a joint-based guidance algorithm which enforces normal coordination between shoulder and elbow joints.

Chapter 53 — Multiple Mobile Robot Systems

Lynne E. Parker, Daniela Rus and Gaurav S. Sukhatme

Within the context of multiple mobile, and networked robot systems, this chapter explores the current state of the art. After a brief introduction, we first examine architectures for multirobot cooperation, exploring the alternative approaches that have been developed. Next, we explore communications issues and their impact on multirobot teams in Sect. 53.3, followed by a discussion of networked mobile robots in Sect. 53.4. Following this we discuss swarm robot systems in Sect. 53.5 and modular robot systems in Sect. 53.6. While swarm and modular systems typically assume large numbers of homogeneous robots, other types of multirobot systems include heterogeneous robots. We therefore next discuss heterogeneity in cooperative robot teams in Sect. 53.7. Once robot teams allow for individual heterogeneity, issues of task allocation become important; Sect. 53.8 therefore discusses common approaches to task allocation. Section 53.9 discusses the challenges of multirobot learning, and some representative approaches. We outline some of the typical application domains which serve as test beds for multirobot systems research in Sect. 53.10. Finally, we conclude in Sect. 53.11 with some summary remarks and suggestions for further reading.

Multi-robot box pushing

Author  C. Ronald Kube, Hong Zhang

Video ID : 199

Robots are used to locate an object in the environment (a box with lights on it) and push it to the desired position (an area of the environment with a light shining on it). The robots cannot communicate with each other, and the box is weighted so at least two robots have to push the box to move it. Each robot has three levels of control. First, it wanders randomly looking for the box. Second, it travels toward the box until contact is made. Third, it checks to see if the box is facing the desired direction; if so, it pushes the box, and, if not, it relocates to a different side of the box.

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

ACM-R5H

Author  Shigeo Hirose

Video ID : 397

The ACM-R5H is a snake robot that can go where no human can go. It is designed to perform underwater inspections and search-and-rescue missions in hazardous environments. It is a snake-like robot with extra dust sealing, waterproofing and a rigid structure that allows operation under any severe condition. It is composed of several modules with small passive wheels that allow the robot to move smoothly on surfaces. ACM-R5 can also move sinuously in underwater environments. In the front unit, a wireless camera is mounted on a special mechanism that keeps the view orientation always horizontal. ACM-R5H is ideal for inspection and search operations in underwater environments.