You are previewing Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability.
O'Reilly logo
Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability

Book Description

Multimodality in Mobile Computing and Mobile Devices: Methods for Adaptable Usability explores a variety of perspectives on multimodal user interface design, describes a variety of novel multimodal applications, and provides real-life experience reports. This innovative publication presents core concepts that define multi-modal, multi-channel, and multi-device interactions.

Table of Contents

  1. Copyright
  2. Editorial Advisory Board
  3. Foreword
  4. Preface
  5. Introduction
    1. Multimodal and Multichannel Issues in Pervasive and Ubiquitous Computing
      1. ABSTRACT
      2. INTRODUCTION
      3. UNDERSTANDING MULTIMODALITY FOR MOBILE COMPUTING
      4. MULTI-DMC REFERENTIAL
      5. PERVASIVE AND UBIQUITOUS COMPUTING FOR MOBILE COMPUTING
      6. CONCLUSION
      7. ACKNOWLEDGMENT
    2. REFERENCES
      1. ENDNOTES
    3. Ubiquitous User Interfaces: Multimodal Adaptive Interaction for Smart Environments
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. THE MULTI-ACCESS SERVICE PLATFORM
      5. EXECUTABLE MODELS
      6. INTERACTION MODELING
      7. USER INTERFACE ADAPTATION
      8. APPLICATIONS
      9. FUTURE TRENDS
      10. CONCLUSION
    4. REFERENCES
  6. Theoretical Foundations
    1. A Formal Approach to the Verification of Adaptability Properties for Mobile Multimodal User Interfaces
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. THE PROPOSED APPROACH
      5. EQUIVALENCE
      6. FUTURE TRENDS
      7. CONCLUSION
    2. REFERENCES
    3. Platform Support for Multimodality on Mobile Devices
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. PLATFORM CONCEPTS
      5. FUTURE TRENDS
      6. CONCLUSION
    4. REFERENCES
  7. Design Approaches
    1. Designing Mobile Multimodal Applications
      1. ABSTRACT
      2. INTRODUCTION
      3. MOBILE MULTIMODALITY, DESIGN CHALLENGES AND MAIN GOALS
      4. DEFINING SCENARIOS AND SELECTING CONTEXTS
      5. MOBPRO: MOBILE MIXED-FIDELITY SOFTWARE PROTOTYPES
      6. MULTIMODAL RICH DIGITAL BOOK PLAYER: RESULTING APPLICATION
      7. CONCLUSION AND FUTURE WORK
    2. REFERENCES
    3. Bodily Engagement in Multimodal Interaction: A Basis for a New Design Paradigm?
      1. ABSTRACT
      2. INTRODUCTION
      3. CONCEPTUALISING MULTIMODALITY
      4. MULTIMODAL INTERACTION DEsIGN
      5. CHALLENGES AHEAD
      6. CONCLUDING STATEMENTS
      7. ACKNOWLEDGMENT
    4. REFERENCES
      1. ENDNOTE
    5. Two Frameworks for the Adaptive Multimodal Presentation of Information
      1. ABSTRACT
      2. INTRODUCTION
      3. RELATED WORK
      4. MOTIVATION FOR OUR RESEARCH WORK
      5. FIRST FRAMEWORK: CONTEXTUAL PRESENTATION OF INFORMATION
      6. SECOND FRAMEWORK: OPPORTUNISTIC PRESENTATION OF INFORMATION
      7. COMPARISON
      8. CONCLUSION AND FUTURE RESEARCH DIRECTIONS
    6. REFERENCES
      1. ENDNOTES
    7. A Usability Framework for the Design and Evaluation of Multimodal Interaction: Application to a Multimodal Mobile Phone
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. THEORETICAL CORNERSTONES
      5. USABILITY FRAMEWORK
      6. IMPLEMENTATION
      7. CASE STUDY
      8. CONCLUSION
      9. FUTURE WORK
    8. REFERENCES
  8. Applications and Field Reports
    1. Exploiting Multimodality for Intelligent Mobile Access to Pervasive Services in Cultural Heritage Sites
      1. ABSTRACT
      2. INTRODUCTION
      3. CULTURAL HERITAGE FRUITION IN THE NEW MILLENNIUM: A TIMELINE
      4. EXPLOITING MULTIMODALITY: INTERACTING IN MULTIPLE WAYS
      5. MULTIMODAL MOBILE ACCESS TO SERVICES AND CONTENTS IN CULTURAL HERITAGE SITES
      6. MAGA: A CASE STUDY ON MULTIMODAL INTERACTION
      7. CONCLUSIONS AND FUTURE WORK
    2. REFERENCES
    3. Multimodal Search on Mobile Devices: Exploring Innovative Query Modalities for Mobile Search
      1. ABSTRACT
      2. INTRODUCTION
      3. STATE OF ART
      4. SYSTEM DESIGN
      5. EXAMPLE SYSTEM: MOBILE SEARCH BY VISUAL QUERIES
      6. PROSPECTIVE CASE STUDY: MOBILE SEARCH FROM LOCATION
      7. CONCLUSION
      8. ACKNOWLEDGMENT
    4. REFERENCES
    5. Simplifying the Multimodal Mobile User Experience
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. RELATED WORK
      5. MULTIMODALITY FOR MOBILE SYSTEMS
      6. NETWORK CONSTRAINTS
      7. MOBILE CELLULAR HANDSET CONSTRAINTS
      8. MOBILE DEVICE PROPERTIES
      9. DELIVERY CONTEXT: CLIENT INTERFACES
      10. FUTURE TRENDS
      11. CONCLUSION
      12. ACKNOWLEDGMENT
    6. REFERENCES
      1. KEY TERMS AND DEFINITIONS
  9. New Directions
    1. Multimodal Cues: Exploring Pause Intervals between Haptic/Audio Cues and Subsequent Speech Information
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. USER STUDY ONE: PAUSE DURATION AND SIMPLE CUES
      5. USER STUDY TWO: PAUSE DURATION AND MORE COMPLEX CUES
      6. FUTURE RESEARCH DIRECTIONS
      7. CONCLUSION
    2. REFERENCES
    3. Towards Multimodal Mobile GIS for the Elderly
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND AND RELATED WORK
      4. Summary
      5. GIS FOR THE ELDERLY: ISSUES AND REQUIREMENTS
      6. CASE STUDY: ADAPTING COMPASS FOR ELDERLY USAGE
      7. CONCLUSION AND FUTURE TRENDS
      8. ACKNOWLEDGMENT
    4. REFERENCES
    5. Automatic Signature Verification on Handheld Devices
      1. ABSTRACT
      2. INTRODUCTION
      3. BACKGROUND
      4. CASE STUDY: A SIGNATURE VERIFICATION SYSTEM FOR HANDHELD DEVICES BASED ON FUSION OF LOCAL AND GLOBAL INFORMATION
      5. FUTURE RESEARCH DIRECTIONS
      6. CONCLUSION
    6. REFERENCES
  10. Compilation of References
  11. About the Contributors
  12. Index