You are previewing Speech, Image, and Language Processing for Human Computer Interaction.
O'Reilly logo
Speech, Image, and Language Processing for Human Computer Interaction

Book Description

Human Computer Interaction is the study of relationships among people and computers. As the digital world is getting multi-modal, the information space is getting more and more complex. In order to navigate this information space and to capture and apply this information to appropriate use, an effective interaction between human and computer is required. Such interactions are only possible if computers can understand and respond to important modalities of human interaction. Speech, Image, and Language Processing for Human Computer Interaction aims to indentify the emerging research areas in Human Computer Interaction and discusses the current state of the arts in these areas. This collection of knowledge includes the basic concepts and technologies in language, as well as future developments in this area. This volume will serve as a reference for researchers and students alike to broaden their knowledge of state-of-the-art HCI.

Table of Contents

  1. Cover
  2. Title Page
  3. Copyright Page
  4. Editorial Advisory Board and List of Reviewers
    1. Editorial Advisory Board
    2. List of Reviewers
  5. Preface
  6. Section 1: Modeling Interaction
    1. Chapter 1: A Brief Survey on User Modelling in Human Computer Interaction
      1. ABSTRACT
      2. INTRODUCTION
      3. THE GOMS FAMILY OF MODELS
      4. COGNITIVE ARCHITECTURES
      5. GRAMMAR BASED MODELS
      6. APPLICATION SPECIFIC MODELS
      7. REVIEW
      8. THE SIMULATOR
      9. IMPLICATIONS AND LIMITATIONS
      10. CONCLUSION
    2. Chapter 2: Working Together with Computers
      1. ABSTRACT
      2. 1. INTRODUCTION
      3. 2. BASIC COMPONENTS OF HCI
      4. 3. PARADIGMS FOR HCI ARCHITECTURE
      5. 4. TOWARDS A NEW FRAMEWORK FOR DISTRIBUTED COLLABORATIVE HCI
      6. 5. CONCLUSION
    3. Chapter 3: Interactive and Cognitive Models in the Social Network Environment for Designing
      1. ABSTRACT
      2. INTRODUCTION
      3. COMPUTER SUPPORTED COOPERATIVE WORK
      4. METAVERSE
      5. METHODOLOGY
      6. ANALYSIS AND DISCUSSION
      7. DISCUSSION
      8. CONCLUSION
    4. Chapter 4: Fuzzy Linguistic Modelling in Multi Modal Human Computer Interaction
      1. ABSTRACT
      2. INTRODUCTION
      3. WEB-BASED ADAPTIVE HYPERMEDIA SYSTEMS AND FUZZY LOGIC THEORY
      4. COGNITIVE/LEARNING STYLES
      5. NAVIGATION AND PRESENTATION PREFERENCES
      6. SIMULATION EXAMPLE
      7. CONCLUSION AND FUTURE WORK
  7. Section 2: Speech, Image and Language-Based Interaction
    1. Chapter 5: Improving Audio Spatialization Using Customizable Pinna Based Anthropometric Model of Head-Related Transfer Functions
      1. ABSTRACT
      2. INTRODUCTION
      3. MEASUREMENT AND IMPLEMENTATION OF HRTFS
      4. SOUND SPATIALIZATION BASED ON ANTHROPOMETRIC MODELS
      5. EVOLUTION OF STRUCTURAL SOUND SPATIALIZATION MODELS
      6. MODEL EVALUATION: PROCEDURE, RESULTS AND DISCUSSION
      7. CONCLUSION
      8. FUTURE RESEARCH DIRECTIONS
    2. Chapter 6: Recent Trends in Speech Recognition Systems
      1. ABSTRACT
      2. 1. INTRODUCTION
      3. 2. EFFECTIVE HCI WITH RELIABLE ASR
      4. 4. FRAMEWORK FOR ADVANCED MODELING TECHNIQUES
      5. 5. FEATURE EXTRACTION AND REDUCTION
      6. 6. ASR CHALLENGES AND MODEL OPTIMIZATION
      7. 7. EXPERIMENTAL RESULTS
      8. 8. CONCLUSION
    3. Chapter 7: Issues in Spoken Dialogue Systems for Human- Computer Interaction
      1. ABSTRACT
      2. 1. INTRODUCTION
      3. 2. ISSUES IN DIALOGUE
      4. 3. TYPES OF DIALOGUE SYSTEMS
      5. 4. DIALOGUE SYSTEM ARCHITECTURE
      6. 5. EVALUATION OF DIALOGUE SYSTEM
      7. 6. SUMMARY AND FUTURE DIRECTIONS
    4. Chapter 8: Enhancing Robustness in Speech Recognition using Visual Information
      1. ABSTRACT
      2. 1. INTRODUCTION
      3. 2. AUDIO SPEECH RECOGNITION SYSTEM
      4. 3 AVASR DESIGN
      5. 4. CASE STUDY: HINDI VISEME CLASSIFICATION
      6. 5. SUMMARY AND CONCLUSION
    5. Chapter 9: On Applying the Farey Sequence for Shape Representation in Z2
      1. ABSTRACT
      2. INTRODUCTION
      3. DETECTION OF STRAIGHT EDGES
      4. SHAPE DESCRIPTION METHOD
      5. SHAPE DECOMPOSITION
      6. IMPLEMENTATION AND RESULTS
      7. CONCLUSION
    6. Chapter 10: Multi Finger Gesture Recognition and Classification in Dynamic Environment under Varying Illumination upon Arbitrary Background
      1. ABSTRACT
      2. 1. INTRODUCTION
      3. 2. RELATED WORK
      4. 3. OUR APPROACH: PRINCIPLES, ASSUMPTIONS AND CALIBRATION
      5. 4. RELIABLE INTRUSION DETECTION UNDER PROJECTOR ILLUMINATION
      6. 5. GESTURE DETECTION
      7. 6. RESULTS AND CONCLUSION
      8. 7. APPLICATIONS
      9. 9. FUTURE POSSIBILITIES
    7. Chapter 11: Human Computer Interaction for Effective Metasearching
      1. ABSTRACT
      2. 1. INTRODUCTION
      3. 2. BACKGROUND AND RELATED WORK
      4. 3. USER FEEDBACK BASED METASEARCHING
      5. 5. EXPERIMENTS AND RESULTS
      6. 7. CONCLUSION
    8. Chapter 12: Science of Emoticons
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. FRAMEWORK FOR NLP RESEARCH ON EMOTICONS
      5. DATABASE OF EMOTICONS
      6. CAO: EMOTICON ANALYSIS SYSTEM
      7. EVALUATION OF CAO
      8. RESULTS AND DISCUSSION
      9. CONCLUSION
      10. FUTURE WORK
  8. Section 3: Multimodal Developments
    1. Chapter 13: On the Development of Adaptive and User-Centred Interactive Multimodal Interfaces
      1. ABSTRACT
      2. 1. INTRODUCTION TO MULTIMODAL INTERFACES
      3. 2. DEVELOPMENT OF MULTIMODAL INTERFACES: ARCHITECTURES AND TOOLKITS
      4. 3. ADAPTIVE MULTIMODAL INTERFACES
      5. 5. CONCLUSION AND FUTURE RESEARCH DIRECTIONS
    2. Chapter 14: A Survey of Mobile Vision Recognition Applications
      1. ABSTRACT
      2. INTRODUCTION
      3. REPRESENTATIVE SURVEY OF MOBILE VISION RECOGNITION APPLICATIONS
      4. COMPARISON/ANALYSIS
      5. DISCUSSION
      6. SUMMARY
      7. APPENDIX
    3. Chapter 15: Speech Disorders Recognition using Speech Analysis
      1. ABSTRACT
      2. INTRODUCTION
      3. ASR IN SPEECH IMPAIRMENT DETECTION
      4. LTTERATURE REVIEW
      5. AVAILABLE TOOLS
      6. INNOVATIVE APPROACHES
  9. Compilation of References
  10. About the Contributors