View Chapter

Chapter 13 — Behavior-Based Systems

François Michaud and Monica Nicolescu

Nature is filled with examples of autonomous creatures capable of dealing with the diversity, unpredictability, and rapidly changing conditions of the real world. Such creatures must make decisions and take actions based on incomplete perception, time constraints, limited knowledge about the world, cognition, reasoning and physical capabilities, in uncontrolled conditions and with very limited cues about the intent of others. Consequently, one way of evaluating intelligence is based on the creature’s ability to make the most of what it has available to handle the complexities of the real world. The main objective of this chapter is to explain behavior-based systems and their use in autonomous control problems and applications. The chapter is organized as follows. Section 13.1 overviews robot control, introducing behavior-based systems in relation to other established approaches to robot control. Section 13.2 follows by outlining the basic principles of behavior-based systems that make them distinct from other types of robot control architectures. The concept of basis behaviors, the means of modularizing behavior-based systems, is presented in Sect. 13.3. Section 13.4 describes how behaviors are used as building blocks for creating representations for use by behavior-based systems, enabling the robot to reason about the world and about itself in that world. Section 13.5 presents several different classes of learning methods for behavior-based systems, validated on single-robot and multirobot systems. Section 13.6 provides an overview of various robotics problems and application domains that have successfully been addressed or are currently being studied with behavior-based control. Finally, Sect. 13.7 concludes the chapter.

Using ROS4iOS

Author  François Michaud

Video ID : 419

Demonstration of the integration, using HBBA (hybrid behaviour-based architecture), of navigation, remote localization, speaker identification, speech recognition and teleoperation. The scenario employs the ROS4iOS to provide remote perceptual capabilities for visual location, speech and speaker recognition. Reference: F. Ferland, R. Chauvin, D. Létourneau, F. Michaud: Hello robot, can you come here? Using ROS4iOS to provide remote perceptual capabilities for visual location, speech and speaker recognition, Proc. Int. ACM/IEEE Conf. Human-Robot Interaction (2014), p. 101

Chapter 56 — Robotics in Agriculture and Forestry

Marcel Bergerman, John Billingsley, John Reid and Eldert van Henten

Robotics for agriculture and forestry (A&F) represents the ultimate application of one of our society’s latest and most advanced innovations to its most ancient and important industries. Over the course of history, mechanization and automation increased crop output several orders of magnitude, enabling a geometric growth in population and an increase in quality of life across the globe. Rapid population growth and rising incomes in developing countries, however, require ever larger amounts of A&F output. This chapter addresses robotics for A&F in the form of case studies where robotics is being successfully applied to solve well-identified problems. With respect to plant crops, the focus is on the in-field or in-farm tasks necessary to guarantee a quality crop and, generally speaking, end at harvest time. In the livestock domain, the focus is on breeding and nurturing, exploiting, harvesting, and slaughtering and processing. The chapter is organized in four main sections. The first one explains the scope, in particular, what aspects of robotics for A&F are dealt with in the chapter. The second one discusses the challenges and opportunities associated with the application of robotics to A&F. The third section is the core of the chapter, presenting twenty case studies that showcase (mostly) mature applications of robotics in various agricultural and forestry domains. The case studies are not meant to be comprehensive but instead to give the reader a general overview of how robotics has been applied to A&F in the last 10 years. The fourth section concludes the chapter with a discussion on specific improvements to current technology and paths to commercialization.

VisualGPS – High accuracy localization for forestry machinery

Author  Juergen Rossmann, Michael Schluse, Arno Buecken, Christian Schlette, Markus Emde

Video ID : 96

Developments in space robotics continue to find their way into our everyday lives. These advances, for instance, include novel methods to increase localization accuracy in determining one's position in comparison to conventional GPS systems. The example here is the "VisualGPS" approach that helps to estimate the position of forestry machinery, such as harvesters in the woods, with high accuracy. For "VisualGPS", harvesters are equipped with laser scanners. The sensors scan the surrounding area to generate landmarks from the tree positions. The tree positions are combined into a local, single-tree map. By comparing the local, single-tree map with a map generated from aerial survey data, the current machine position can be calculated with an accuracy of 0.5 m.

Chapter 15 — Robot Learning

Jan Peters, Daniel D. Lee, Jens Kober, Duy Nguyen-Tuong, J. Andrew Bagnell and Stefan Schaal

Machine learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors; conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in robot learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this chapter, we attempt to strengthen the links between the two research communities by providing a survey of work in robot learning for learning control and behavior generation in robots. We highlight both key challenges in robot learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our chapter lies on model learning for control and robot reinforcement learning. We demonstrate how machine learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.

Inverse reinforcement

Author  Pieter Abbeel

Video ID : 353

This video shows a successful example of inverse reinforcement learning for acrobatic helicopter maneuvers. It illustrates apprenticeship learning algorithms, which leverage expert demonstrations to efficiently learn good controllers for tasks as demonstrated by an expert. The experimental results captured here include the first autonomous execution of a wide range of maneuvers and a complete airshow. The controllers perform as well as, and often even better than, the human expert pilot. The video illustrates a solution to the "Curse of Goal Specification" in Sect 15.3.6 Challenges in Robot Reinforcement Learning. Reference: P. Abbeel, A. Coates, A.Y. Ng: Autonomous helicopter aerobatics through apprenticeship learning, Int. J. Robot. Res. 29(13), 1608–1639 (2010)

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

SpinybotII: Climbing hard walls with compliant microspines

Author  Sangbae Kim, Alan T. Asbeck, Mark R. Cutkosky, William R. Provancher

Video ID : 388

This climbing robot can scale flat, hard vertical surfaces including those made of concrete, brick, stucco and masonry without using suction or adhesives. It employs arrays of miniature spines that catch opportunistically on surface asperities. The approach is inspired by the mechanisms observed in some climbing insects and spiders.

Chapter 17 — Limbed Systems

Shuuji Kajita and Christian Ott

A limbed system is a mobile robot with a body, legs and arms. First, its general design process is discussed in Sect. 17.1. Then we consider issues of conceptual design and observe designs of various existing robots in Sect. 17.2. As an example in detail, the design of a humanoid robot HRP-4C is shown in Sect. 17.3. To design a limbed system of good performance, it is important to take into account of actuation and control, like gravity compensation, limit cycle dynamics, template models, and backdrivable actuation. These are discussed in Sect. 17.4.

In Sect. 17.5, we overview divergence of limbed systems. We see odd legged walkers, leg–wheel hybrid robots, leg–arm hybrid robots, tethered walking robots, and wall-climbing robots. To compare limbed systems of different configurations,we can use performance indices such as the gait sensitivity norm, the Froude number, and the specific resistance, etc., which are introduced in Sect. 17.6.

Hexapod ParaWalker-II

Author  Yusuke Ota

Video ID : 520

A twin-frame walking robot, which is a reduced-DOF practical walking robot, developed by Dr. Ota and Prof. Hirose.

Chapter 30 — Sonar Sensing

Lindsay Kleeman and Roman Kuc

Sonar or ultrasonic sensing uses the propagation of acoustic energy at higher frequencies than normal hearing to extract information from the environment. This chapter presents the fundamentals and physics of sonar sensing for object localization, landmark measurement and classification in robotics applications. The source of sonar artifacts is explained and how they can be dealt with. Different ultrasonic transducer technologies are outlined with their main characteristics highlighted.

Sonar systems are described that range in sophistication from low-cost threshold-based ranging modules to multitransducer multipulse configurations with associated signal processing requirements capable of accurate range and bearing measurement, interference rejection, motion compensation, and target classification. Continuous-transmission frequency-modulated (CTFM) systems are introduced and their ability to improve target sensitivity in the presence of noise is discussed. Various sonar ring designs that provide rapid surrounding environmental coverage are described in conjunction with mapping results. Finally the chapter ends with a discussion of biomimetic sonar, which draws inspiration from animals such as bats and dolphins.

Monash DSP sonar tracking a moving plane

Author  Lindsay Kleeman

Video ID : 313

A four-transducer system is controlled with a DSP microcontroller which processes echoes to determine the normal incidence and range to a plane reflector. The transducer scans to locate the plane and then tracks the normal-incidence section of the plane as it moves in real time.

Chapter 53 — Multiple Mobile Robot Systems

Lynne E. Parker, Daniela Rus and Gaurav S. Sukhatme

Within the context of multiple mobile, and networked robot systems, this chapter explores the current state of the art. After a brief introduction, we first examine architectures for multirobot cooperation, exploring the alternative approaches that have been developed. Next, we explore communications issues and their impact on multirobot teams in Sect. 53.3, followed by a discussion of networked mobile robots in Sect. 53.4. Following this we discuss swarm robot systems in Sect. 53.5 and modular robot systems in Sect. 53.6. While swarm and modular systems typically assume large numbers of homogeneous robots, other types of multirobot systems include heterogeneous robots. We therefore next discuss heterogeneity in cooperative robot teams in Sect. 53.7. Once robot teams allow for individual heterogeneity, issues of task allocation become important; Sect. 53.8 therefore discusses common approaches to task allocation. Section 53.9 discusses the challenges of multirobot learning, and some representative approaches. We outline some of the typical application domains which serve as test beds for multirobot systems research in Sect. 53.10. Finally, we conclude in Sect. 53.11 with some summary remarks and suggestions for further reading.

Self-assembly and morphology control in a swarm-bot

Author  Rehan O'Grady, Andres Lyhne Christensen, Marco Dorigo

Video ID : 195

This video shows the capability of the swarm-bot mobile robot platform to self-assemble into a specific connected morphology. Each S-bot opens a connection slot by lighting its blue and green LEDs, which indicates the desired angle and the specific place for grasping by another S-bot. The video shows four different morphologies - star, line, arrow, and dense.

Chapter 40 — Mobility and Manipulation

Oliver Brock, Jaeheung Park and Marc Toussaint

Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.

HERMES, a humanoid experimental robot for mobile manipulation and exploration services

Author  Rainer Bischoff

Video ID : 783

Mobile robot HERMES grasps and releases a glass with tactile sensing using joint-angle, encoder values and motor currents. The robot can fill a glass with water from a bottle using vision. It can communicate with natural spoken language,and it can come to you to get your cup and take the cup to the kitchen, by planning a path and avoiding obstacles.

Chapter 15 — Robot Learning

Jan Peters, Daniel D. Lee, Jens Kober, Duy Nguyen-Tuong, J. Andrew Bagnell and Stefan Schaal

Machine learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors; conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in robot learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this chapter, we attempt to strengthen the links between the two research communities by providing a survey of work in robot learning for learning control and behavior generation in robots. We highlight both key challenges in robot learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our chapter lies on model learning for control and robot reinforcement learning. We demonstrate how machine learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.

Machine learning table tennis

Author  Jan Peters, Katharina Mülling, Jens Kober, Oliver Kroemer, Zhikun Wang

Video ID : 354

The video shows recent successful demonstrations of using machine learning for robot table tennis. The first part shows learning of motor primitives for forehand strikes by training a robot with a mixture of imitation and reinforcement learning. The second part shows how the robot can anticipate an opponent's intended targets based on both forehand and backhand primitives. The video illustrates Sect. 15.3.5 Policy Search of the Springer Handbook of Robotics, 2nd edn (2016). Reference: K. Mülling, J. Kober, O. Kroemer, J. Peters: Learning to select and generalize striking movements in robot table tennis, Int. J. Robot. Res. 32(3), 263-279 (2013)

Chapter 21 — Actuators for Soft Robotics

Alin Albu-Schäffer and Antonio Bicchi

Although we do not know as yet how robots of the future will look like exactly, most of us are sure that they will not resemble the heavy, bulky, rigid machines dangerously moving around in old fashioned industrial automation. There is a growing consensus, in the research community as well as in expectations from the public, that robots of the next generation will be physically compliant and adaptable machines, closely interacting with humans and moving safely, smoothly and efficiently - in other terms, robots will be soft.

This chapter discusses the design, modeling and control of actuators for the new generation of soft robots, which can replace conventional actuators in applications where rigidity is not the first and foremost concern in performance. The chapter focuses on the technology, modeling, and control of lumped parameters of soft robotics, that is, systems of discrete, interconnected, and compliant elements. Distributed parameters, snakelike and continuum soft robotics, are presented in Chap. 20, while Chap. 23 discusses in detail the biomimetic motivations that are often behind soft robotics.

DLR Hand Arm System throwing a ball and Justin catching it

Author  Alin Albu-Schäffer, Thomas Bahls, Berthold Bäuml, Maxime Chalon, Markus Grebenstein, Oliver Eiberger, Werner Friedl, Hannes Höppner, Dominic Lakatos, Nico Mansfeld, Florian Petit, Jens Reinecke, Roman Weitschat, Sebastian Wolf, Tilo Wüsthoff

Video ID : 547

The DLR Hand Arm System throws a ball and Justin catches it. There is no data connection between the two systems. Justin catches the ball by visual observation.