Complex Behavior in Evolutionary Robotics

Complex Behavior in Evolutionary Robotics

by Lukas König
Released March 2015
Publisher(s): De Gruyter Oldenbourg
ISBN: 9783110409185

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Today, autonomous robots are used in a rather limited range of applications such as exploration of inaccessible locations, cleaning floors, mowing lawns etc. However, ongoing hardware improvements (and human fantasy) steadily reveal new robotic applications of significantly higher sophistication. For such applications, the crucial bottleneck in the engineering process tends to shift from physical boundaries to controller generation. As an attempt to automatize this process, Evolutionary Robotics has successfully been used to generate robotic controllers of various types. However, a major challenge of the field remains the evolution of truly complex behavior. Furthermore, automatically created controllers often lack analyzability which makes them useless for safety-critical applications. In this book, a simple controller model based on Finite State Machines is proposed which allows a straightforward analysis of evolved behaviors. To increase the model's evolvability, a procedure is introduced which, by adapting the genotype-phenotype mapping at runtime, efficiently traverses both the behavioral search space as well as (recursively) the search space of genotype-phenotype mappings. Furthermore, a data-driven mathematical framework is proposed which can be used to calculate the expected success of evolution in complex environments.

Table of contents

  1. Also of interest
  2. Title Page
  3. Copyright Page
  4. Acknowledgements
  5. Dedication
  6. Table of Contents
  7. Table of Figures
  8. List of Tables
  9. List of Notations
  10. 1 Introduction
    1. 1.1 Evolutionary Robotics and Evolutionary Swarm Robotics
    2. 1.2 Further Classifications
    3. 1.3 Challenges of ER
    4. 1.4 Structure and Major Contributions of the Thesis
  11. 2 Robotics, Evolution and Simulation
    1. 2.1 Evolutionary Training of Robot Controllers
      1. 2.1.1 Two Views on Selection in ER and ESR
      2. 2.1.2 Classification of Fitness Functions in ER
      3. 2.1.3 The Bootstrap Problem
      4. 2.1.4 The Reality Gap
      5. 2.1.5 Decentralized Online Evolution in ESR
      6. 2.1.6 Evolvability, Controller Representation and the Genotype-Phenotype Mapping
      7. 2.1.7 Controller Representation
      8. 2.1.8 Recombination Operators
      9. 2.1.9 Success Prediction in ESR
    2. 2.2 Agent-based Simulation
  12. 3 The Easy Agent Simulation
    1. 3.1 History of the Easy Agent Simulation Framework
    2. 3.2 Basic Idea and Architectural Concept
      1. 3.2.1 Overview
      2. 3.2.2 Preliminaries
      3. 3.2.3 Classification of the Architecture
      4. 3.2.4 The SPI Architecture from an MVC Perspective
      5. 3.2.5 Comparison of the SPI Architecture with State-of-the-Art ABS Frameworks
    3. 3.3 Implementation of the SPI within the EAS Framework
      1. 3.3.1 Overview
      2. 3.3.2 Plugins
      3. 3.3.3 Master Schedulers
      4. 3.3.4 The classes SimulationTime and Wink
      5. 3.3.5 The Interface EASRunnable
      6. 3.3.6 “Everything is an Agent”: a Philosophical Decision
      7. 3.3.7 Running a Simulation
      8. 3.3.8 Getting Started
    4. 3.4 A Comparative Study and Evaluation of the EAS Framework
      1. 3.4.1 Method of Experimentation
      2. 3.4.2 Results and Discussion
    5. 3.5 Chapter Resume
  13. 4 Evolution Using Finite State Machines
    1. 4.1 Theoretical Foundations
      1. 4.1.1 Preliminaries
      2. 4.1.2 Definition of the MARB Controller Model
      3. 4.1.3 Encoding MARBs
      4. 4.1.4 Mutation and Hardening
      5. 4.1.5 Selection and Recombination
      6. 4.1.6 Fitness calculation
      7. 4.1.7 The Memory Genome: a Decentralized Elitist Strategy
      8. 4.1.8 Fitness Adjustment after Mutation, Recombination and Reactivation of the Memory Genome
      9. 4.1.9 The Robot Platforms
    2. 4.2 Preliminary Parameter Adjustment using the Example of Collision Avoidance
      1. 4.2.1 Specification of Evolutionary Parameters
      2. 4.2.2 Method of Experimentation
      3. 4.2.3 Evaluation and Discussion
      4. 4.2.4 Concluding Remarks
    3. 4.3 A Comprehensive Study Using the Examples of Collision Avoidance and Gate Passing
      1. 4.3.1 Method of Experimentation
      2. 4.3.2 Experimental results
      3. 4.3.3 Concluding remarks
    4. 4.4 Experiments With Real Robots
      1. 4.4.1 Evolutionary Model
      2. 4.4.2 Method of Experimentation
      3. 4.4.3 Results and Discussion
      4. 4.4.4 Concluding Remarks
    5. 4.5 Chapter Résumé
  14. 5 Evolution and the Genotype-Phenotype Mapping
    1. 5.1 Overview of the Presented Approach
    2. 5.2 A Completely Evolvable Genotype-Phenotype Mapping
      1. 5.2.1 Definition of (complete) evolvability
      2. 5.2.2 Properties of ceGPM-based genotypic encodings
      3. 5.2.3 The Translator Model MAPT and the Course of Evolution
      4. 5.2.4 Genotypic and Phenotypic Spaces
      5. 5.2.5 Evolutionary Operators
    3. 5.3 Evaluation of the Proposed Evolutionary Model
      1. 5.3.1 First Part – Method of Experimentation
      2. 5.3.2 First Part – Results and Discussion
      3. 5.3.3 Second Part – An Alternate Completely Evolvable Genotype-Phenotype Mapping and its Effects on Evolvability
      4. 5.3.4 Second Part – Method of Experimentation
      5. 5.3.5 Second Part – Results and Discussion
      6. 5.3.6 Third Part – Method of Experimentation
      7. 5.3.7 Third Part – Results and Discussion
    4. 5.4 Chapter Résumé
  15. 6 Data Driven Success Prediction of Evolution in Complex Environments
    1. 6.1 Preliminaries
    2. 6.2 A Model Capturing Completely Implicit Selection
      1. 6.2.1 Two Parents per Reproduction (CIS-2)
      2. 6.2.2 Eventually Stable States (k=2)
      3. 6.2.3 Tournament size k
      4. 6.2.4 Eventually Stable States (arbitrary k)
    3. 6.3 Extending the CIS Model to Capture Explicit Selection
    4. 6.4 Experiments
      1. 6.4.1 Evolutionary setup
      2. 6.4.2 Experimental Results Using the EIS Model
      3. 6.4.3 Remarks on Evolution in the scope of the CIS Model
    5. 6.5 Chapter Résumé
  16. 7 Conclusion
  17. References
  18. Index

Product information

  • Title: Complex Behavior in Evolutionary Robotics
  • Author(s): Lukas König
  • Release date: March 2015
  • Publisher(s): De Gruyter Oldenbourg
  • ISBN: 9783110409185