View Chapter

Chapter 28 — Force and Tactile Sensing

Mark R. Cutkosky and William Provancher

This chapter provides an overview of force and tactile sensing, with the primary emphasis placed on tactile sensing. We begin by presenting some basic considerations in choosing a tactile sensor and then review a wide variety of sensor types, including proximity, kinematic, force, dynamic, contact, skin deflection, thermal, and pressure sensors. We also review various transduction methods, appropriate for each general sensor type. We consider the information that these various types of sensors provide in terms of whether they are most useful for manipulation, surface exploration or being responsive to contacts from external agents.

Concerning the interpretation of tactile information, we describe the general problems and present two short illustrative examples. The first involves intrinsic tactile sensing, i. e., estimating contact locations and forces from force sensors. The second involves contact pressure sensing, i. e., estimating surface normal and shear stress distributions from an array of sensors in an elastic skin. We conclude with a brief discussion of the challenges that remain to be solved in packaging and manufacturing damage-tolerant tactile sensors.

The effect of twice dropping, and then gently placing, a two-gram weight on a small capacitive tactile array

Author  Mark Cutkosky

Video ID : 15

Video illustrating the effect of twice dropping, and then gently placing, a two-gram weight on a small capacitive tactile array sampled at 20 Hz. The first drop produces a large dynamic signal in comparison to the static load, but the second drop is missed, demonstrating the value of having dynamic tactile sensing.

Chapter 18 — Parallel Mechanisms

Jean-Pierre Merlet, Clément Gosselin and Tian Huang

This chapter presents an introduction to the kinematics and dynamics of parallel mechanisms, also referred to as parallel robots. As opposed to classical serial manipulators, the kinematic architecture of parallel robots includes closed-loop kinematic chains. As a consequence, their analysis differs considerably from that of their serial counterparts. This chapter aims at presenting the fundamental formulations and techniques used in their analysis.

Tripteron robot

Author  Clément Gosselin

Video ID : 54

This video demonstrates a 3-DOF decoupled translational parallel robot (Tripteron). References: 1. X. Kong, C.M. Gosselin: Kinematics and singularity analysis of a novel type of 3-CRR 3-DOF translational parallel manipulator, Inte. J. Robot. Res. 21(9), 791-798 (2002); 2. C. Gosselin: Compact dynamic models for the tripteron and quadrupteron parallel manipulators, J. Syst. Control Eng. 223(I1), 1-11 (2009)

Chapter 74 — Learning from Humans

Aude G. Billard, Sylvain Calinon and Rüdiger Dillmann

This chapter surveys the main approaches developed to date to endow robots with the ability to learn from human guidance. The field is best known as robot programming by demonstration, robot learning from/by demonstration, apprenticeship learning and imitation learning. We start with a brief historical overview of the field. We then summarize the various approaches taken to solve four main questions: when, what, who and when to imitate. We emphasize the importance of choosing well the interface and the channels used to convey the demonstrations, with an eye on interfaces providing force control and force feedback. We then review algorithmic approaches to model skills individually and as a compound and algorithms that combine learning from human guidance with reinforcement learning. We close with a look on the use of language to guide teaching and a list of open issues.

Learning compliant motion from human demonstration

Author  Aude Billard

Video ID : 478

This video illustrates how one can teach a robot to display the right amount of stiffness to perform a task successfully. Decrease in stiffness is demonstrated by shaking the robot, while increase in stiffness is conveyed by pressing on the robot's arm (pressure being measured through tactile sensors along the robot's arm). Reference: K. Kronander,A. Billard: Learning compliant manipulation through kinesthetic and tactile human-robot interaction, IEEE Trans. Haptics 7(3), 367-380 (2013); doi: 10.1109/TOH.2013.54 .

Chapter 6 — Model Identification

John Hollerbach, Wisama Khalil and Maxime Gautier

This chapter discusses how to determine the kinematic parameters and the inertial parameters of robot manipulators. Both instances of model identification are cast into a common framework of least-squares parameter estimation, and are shown to have common numerical issues relating to the identifiability of parameters, adequacy of the measurement sets, and numerical robustness. These discussions are generic to any parameter estimation problem, and can be applied in other contexts.

For kinematic calibration, the main aim is to identify the geometric Denavit–Hartenberg (DH) parameters, although joint-based parameters relating to the sensing and transmission elements can also be identified. Endpoint sensing or endpoint constraints can provide equivalent calibration equations. By casting all calibration methods as closed-loop calibration, the calibration index categorizes methods in terms of how many equations per pose are generated.

Inertial parameters may be estimated through the execution of a trajectory while sensing one or more components of force/torque at a joint. Load estimation of a handheld object is simplest because of full mobility and full wrist force-torque sensing. For link inertial parameter estimation, restricted mobility of links nearer the base as well as sensing only the joint torque means that not all inertial parameters can be identified. Those that can be identified are those that affect joint torque, although they may appear in complicated linear combinations.

Calibration of ABB's IRB 120 industrial robot

Author  Ilian Bonev

Video ID : 422

The video depicts the process for the geometric calibration of the 6 DOF IRB 120. The calibration is based on the measurement of the position and the orientation of a tool using the laser tracking system from FARO. The video shows in sequence the steps in the acquisition of various configurations which can then be be employed using an algorithm similar to that of Sect. 6.2.

Chapter 72 — Social Robotics

Cynthia Breazeal, Kerstin Dautenhahn and Takayuki Kanda

This chapter surveys some of the principal research trends in Social Robotics and its application to human–robot interaction (HRI). Social (or Sociable) robots are designed to interact with people in a natural, interpersonal manner – often to achieve positive outcomes in diverse applications such as education, health, quality of life, entertainment, communication, and tasks requiring collaborative teamwork. The long-term goal of creating social robots that are competent and capable partners for people is quite a challenging task. They will need to be able to communicate naturally with people using both verbal and nonverbal signals. They will need to engage us not only on a cognitive level, but on an emotional level as well in order to provide effective social and task-related support to people. They will need a wide range of socialcognitive skills and a theory of other minds to understand human behavior, and to be intuitively understood by people. A deep understanding of human intelligence and behavior across multiple dimensions (i. e., cognitive, affective, physical, social, etc.) is necessary in order to design robots that can successfully play a beneficial role in the daily lives of people. This requires a multidisciplinary approach where the design of social robot technologies and methodologies are informed by robotics, artificial intelligence, psychology, neuroscience, human factors, design, anthropology, and more.

An example of repeated, long-term interaction

Author  Takayuki Kanda

Video ID : 809

This video shows examples of repeated interactions between a robot in a shopping mall and mall visitors. The robot was designed for repeated long-term interaction. It identified visitors using RFID tags and gradually exhibits friendly behaviors over time.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

The power of prediction: Robots that read intentions

Author  E. Bicho , W. Erlhagen , E. Sousa , L. Louro , N. Hipolito , E.C. Silva , R. Silva , F. Ferreira , T. Machado , M. Hulstijn , Y.Maas , E. de Bruijn , R.H. Cuijpers , R. Newman-Norlund , H. van Schie, R.G.J. Meulenbroek , H. Bekkering

Video ID : 617

Action and intention understanding are critical components of efficient joint action. In the context of the EU Integrated Project JAST, the authors have developed an anthropomorphic robot endowed with these cognitive capacities. This project and the respective robot (ARoS) is the focus of the video. More specifically, the results illustrate crucial cognitive capacities for efficient and successful human-robot collaboration, such as goal inference, error detection, and anticipatory-action selection.

Chapter 46 — Simultaneous Localization and Mapping

Cyrill Stachniss, John J. Leonard and Sebastian Thrun

This chapter provides a comprehensive introduction in to the simultaneous localization and mapping problem, better known in its abbreviated form as SLAM. SLAM addresses the main perception problem of a robot navigating an unknown environment. While navigating the environment, the robot seeks to acquire a map thereof, and at the same time it wishes to localize itself using its map. The use of SLAM problems can be motivated in two different ways: one might be interested in detailed environment models, or one might seek to maintain an accurate sense of a mobile robot’s location. SLAM serves both of these purposes.

We review the three major paradigms from which many published methods for SLAM are derived: (1) the extended Kalman filter (EKF); (2) particle filtering; and (3) graph optimization. We also review recent work in three-dimensional (3-D) SLAM using visual and red green blue distance-sensors (RGB-D), and close with a discussion of open research problems in robotic mapping.

SLAM++: Simultaneous localization and mapping at the level of objects

Author  Andrew Davison

Video ID : 454

This video describes SLAM++, an object-based, 3-D SLAM system. Reference. R.F. Salas-Moreno, R.A. Newcombe, H. Strasdat, P.H.J. Kelly, A.J. Davison: SLAM++: Simultaneous localisation and mapping at the level of objects, Proc. IEEE Int. Conf. Computer Vision Pattern Recognition, Portland (2013).

Chapter 43 — Telerobotics

Günter Niemeyer, Carsten Preusche, Stefano Stramigioli and Dongjun Lee

In this chapter we present an overview of the field of telerobotics with a focus on control aspects. To acknowledge some of the earliest contributions and motivations the field has provided to robotics in general, we begin with a brief historical perspective and discuss some of the challenging applications. Then, after introducing and classifying the various system architectures and control strategies, we emphasize bilateral control and force feedback. This particular area has seen intense research work in the pursuit of telepresence. We also examine some of the emerging efforts, extending telerobotic concepts to unconventional systems and applications. Finally,we suggest some further reading for a closer engagement with the field.

Teleoperated hmanoid robot - HRP

Author  O. Miki, T. Itoko, K. Sawada, T. Nishiyama, K. Hira, S. Nakayama, H. Inaba, M. Sudo, K. Tanie, K. Yokoi, S. Hira, H. Hirukawa, H. Inoue, S. Tachi

Video ID : 318

This video shows a tele-existence system to teleoperate a humanoid robot HRP using multimodal feedback and integrated whole-body perception and control. Presented at ICRA 2001.

Chapter 61 — Robot Surveillance and Security

Wendell H. Chun and Nikolaos Papanikolopoulos

This chapter introduces the foundation for surveillance and security robots for multiple military and civilian applications. The key environmental domains are mobile robots for ground, aerial, surface water, and underwater applications. Surveillance literallymeans to watch fromabove,while surveillance robots are used to monitor the behavior, activities, and other changing information that are gathered for the general purpose of managing, directing, or protecting one’s assets or position. In a practical sense, the term surveillance is taken to mean the act of observation from a distance, and security robots are commonly used to protect and safeguard a location, some valuable assets, or personal against danger, damage, loss, and crime. Surveillance is a proactive operation,while security robots are a defensive operation. The construction of each type of robot is similar in nature with amobility component, sensor payload, communication system, and an operator control station.

After introducing the major robot components, this chapter focuses on the various applications. More specifically, Sect. 61.3 discusses the enabling technologies of mobile robot navigation, various payload sensors used for surveillance or security applications, target detection and tracking algorithms, and the operator’s robot control console for human–machine interface (HMI). Section 61.4 presents selected research activities relevant to surveillance and security, including automatic data processing of the payload sensors, automaticmonitoring of human activities, facial recognition, and collaborative automatic target recognition (ATR). Finally, Sect. 61.5 discusses future directions in robot surveillance and security, giving some conclusions and followed by references.

Scout robot for outdoor surveillance

Author  Nikos Papanikolopoulos

Video ID : 681

The Scout robot has been developed at the University of Minnesota in partnership with MTS, Honeywell, and ATC. The Scouts are specialized robots that carry out low-level, usually parallel tasks to meet the mission objectives. Scouts can include simple sensory units or units with locomotion, tools, or other specializations. All Scouts have a similar form factor to enable delivery of the ranger by a uniform mechanism. The Scout has a body roughly 11 cm long and 4 cm in diameter (the special foam wheels can expand to 5 cm in diameter). This body fits snugly inside a protective covering called a Sabot which absorbs much of the impact during the launch and enables the Scout to break through a glass window, land safely, and be ready to begin its mission.

Chapter 51 — Modeling and Control of Underwater Robots

Gianluca Antonelli, Thor I. Fossen and Dana R. Yoerger

This chapter deals with modeling and control of underwater robots. First, a brief introduction showing the constantly expanding role of marine robotics in oceanic engineering is given; this section also contains some historical backgrounds. Most of the following sections strongly overlap with the corresponding chapters presented in this handbook; hence, to avoid useless repetitions, only those aspects peculiar to the underwater environment are discussed, assuming that the reader is already familiar with concepts such as fault detection systems when discussing the corresponding underwater implementation. Themodeling section is presented by focusing on a coefficient-based approach capturing the most relevant underwater dynamic effects. Two sections dealing with the description of the sensor and the actuating systems are then given. Autonomous underwater vehicles require the implementation of mission control system as well as guidance and control algorithms. Underwater localization is also discussed. Underwater manipulation is then briefly approached. Fault detection and fault tolerance, together with the coordination control of multiple underwater vehicles, conclude the theoretical part of the chapter. Two final sections, reporting some successful applications and discussing future perspectives, conclude the chapter. The reader is referred to Chap. 25 for the design issues.

Saturation-based, nonlinear, depth-and-yaw control of an underwater vehicle

Author  Eduardo Campos-Mercado, Ahmed Chemori, Vincent Creuze, Jorge Torres-Munoz, Rogelio Lozano

Video ID : 268

This video demonstrates the robustness of a saturation-based, nonlinear controller for underwater vehicles. The performance of yaw and depth control of the L2ROV prototype is maintained, even when the buoyancy and the damping are changed. This work has been conducted by the LIRMM (University Montpellier 2, France) and the LAFMIA (CINVESTAV Mexico), in collaboration with Tecnalia France Foundation. This work has been supported by the French-Mexican PCP program and by the Region Languedoc-Roussillon.