You are previewing MPEG-4 Book, The.
O'Reilly logo
MPEG-4 Book, The

Book Description

The most complete, focused guide to MPEG-4—the breakthrough standard for interactive multimedia.

  • The comprehensive, focused, up-to-the-minute guide to MPEG-4

  • Practical solutions for next-generation multimedia applications

  • In-depth coverage of natural and synthetic audiovisual object coding, description, composition and synchronization

  • Binary and textual scene description

  • Transport and storage of MPEG-4 content

  • MPEG-4 profiles and levels; verification tests

MPEG-4 represents a breakthrough in multimedia, delivering not just outstanding compression but also a fully interactive user experience. In The MPEG-4 Book, two leaders of the MPEG-4 standards community offer a comprehensive, targeted guide to the MPEG-4 standard—and its use in cutting-edge applications. Fernando Pereira and Touradj Ebrahimi, together with a unique collection of key MPEG experts, demonstrate how MPEG-4 addresses tomorrow's multimedia applications more successfully than any previous standard. They review every element of the standard to offer you a book that covers:

  • Synthetic and natural audio and video object coding, description and synchronization

  • BIFS—the MPEG-4 language for scene description and interaction

  • The extensible MPEG-4 textual format XMT

  • Transport and delivery of MPEG-4 content

  • MPEG-J: using Java classes within MPEG-4 content

  • A complete overview of MPEG-4 Profiles and Levels

  • Verification tests

The authors also walk through the MPEG-4 Systems Reference Software ?offering powerful real-world insights for every product developer, software professional, engineer, and researcher involved with MPEG-4 and state-of-the-art multimedia delivery.

Part of the new IMSC Press Series from the Integrated Multimedia System Center at the University of Southern California, a federally funded center specializing in cutting-edge multimedia research.

Table of Contents

  1. Copyright
  2. IMSC Press Multimedia Series
  3. Foreword
  4. Preface
  5. Abbreviations
  6. Context, Objectives, and Process
    1. MPEG-4 Objectives
    2. Formal Standardization Process
    3. MPEG Modus Operandi
    4. MPEG-4 Standard Organization
    5. MPEG-4 Schedule
    6. MPEG-4 Industry Forum
    7. Summary
    8. References
  7. MPEG-4 Overview
    1. Design Goals
    2. An End-to-End Walkthrough
    3. Terminal Architecture
    4. MPEG-4 Tools
    5. MPEG-4 and Other Multimedia Standards
    6. MPEG-4 Applications
    7. Summary
    8. References
  8. Object Description and Synchronization
    1. Object Descriptors: Entry Points to MPEG-4 Content
    2. Semantic Description and Access Management
    3. Timing Model and Synchronization of Streams
    4. Summary
    5. References
  9. BIFS: Scene Description
    1. Basics of BIFS
    2. Basic BIFS Features by Example
    3. Advanced BIFS Features
    4. A Peek Ahead on BIFS
    5. Profiles
    6. All BIFS Nodes
    7. Summary
    8. References
  10. MPEG-J: MPEG-4 and Java
    1. MPEG-J Architecture
    2. MPEG-J APIs
    3. Application Scenarios
    4. Reference Software
    5. Summary
    6. References
  11. Extensible MPEG-4 Textual Format
    1. Objectives
    2. Cross-Standard Interoperability
    3. XMT Two-Tier Architecture
    4. XMT-Ω FORMAT
    5. XMT-A Format
    6. Summary
    7. References
  12. Transporting and Storing MPEG-4 Content
    1. Delivery Framework
    2. FlexMux Tool
    3. MPEG-4 File Format
    4. Transporting MPEG-4 over MPEG-2
    5. Transporting MPEG-4 over IP
    6. Summary
    7. References
  13. Natural Video Coding
    1. General Overview
    2. Coding of Rectangular Video Objects
    3. Coding of Arbitrarily Shaped Video Objects
    4. Scalable Video Coding
    5. Special Video Coding Tools
    6. Visual Texture Coding
    7. Summary
    8. References
  14. Visual SNHC Tools
    1. SNHC Overview
    2. Face and Body Animation
    3. 2D Mesh Coding
    4. 3D Mesh Coding
    5. View-Dependent Scalability
    6. Profiles and Levels
    7. Summary
    8. Acknowledgments
    9. References
  15. Speech Coding
    1. Introduction to Speech Coding
    2. Overview of MPEG-4 Speech Coders
    3. MPEG-4 CELP Coding
    4. MPEG-4 HVXC Coding
    5. Error Robustness
    6. Summary
    7. References
  16. General Audio Coding
    1. Introduction to Time/Frequency Audio Coding
    2. MPEG-2 Advanced Audio Coding
    3. MPEG-4 Additions to AAC
    4. MPEG-4 Scalable Audio Coding
    5. Introduction to Parametric Audio Coding
    6. MPEG-4 HILN Parametric Audio Coding
    7. Summary
    8. Acknowledgments
    9. References
  17. SNHC Audio and Audio Composition
    1. Synthetic-Natural Hybrid Coding of Audio
    2. Structured Audio Coding
    3. Text-to-Speech Interface
    4. Audio Composition
    5. Summary
    6. References
  18. Profiling and Conformance: Approach and Overview
    1. Profiling and Conformance: Goals and Principles
    2. Profiling Policy and Version Management
    3. Overview of Profiles in MPEG-4
    4. Summary
    5. Acknowledgements
    6. References
  19. Implementing the Standard: The Reference Software
    1. Reference Software Modules
    2. Systems Reference Software
    3. MPEG-4 Player Architecture
    4. Scene Graph
    5. PROTOs
    6. Synchronization
    7. Object Descriptors
    8. Plug-Ins
    9. 2D Compositor
    10. 3D Compositor
    11. Summary
    12. References
  20. Video Testing for Validation
    1. General Aspects
    2. Test Methods
    3. Error-Resilience Test
    4. Content-Based Coding Test
    5. Coding Efficiency for Low and Medium Bit-Rate Test
    6. Advanced Real-Time Simple Profile Test
    7. Summary
    8. References
  21. Audio Testing for Validation
    1. General Aspects
    2. Test Methods
    3. Narrowband Digital Audio Broadcasting Test
    4. Audio on the Internet Test
    5. Speech Communication Test
    6. Version 2 Coding Efficiency Test
    7. Version 2 Error-Robustness Test
    8. Summary
    9. References
  22. Levels for Visual Profiles
    1. Video Buffering Verifier Mechanism
    2. Definition of Levels for Video Profiles
    3. Definition of Levels for Synthetic Profiles
    4. Definition of Levels for Synthetic and Natural Hybrid Profiles
    5. References
  23. Levels for Audio Profiles
    1. Complexity Units
    2. Definition of Levels for Audio Profiles
    3. References
  24. Levels for Graphics Profiles
    1. Simple 2D Profile
    2. Simple 2D + Text Profile
    3. Core 2D Profile
    4. Advanced 2D Profile
    5. References
  25. Levels for Scene Graph Profiles
    1. Simple 2D Profile
    2. Audio Profile
    3. 3D Audio Profile
    4. Basic 2D Profile
    5. Core 2D Profile
    6. Advanced 2D Profile
    7. Main 2D Profile
    8. References
  26. MPEG-J Code Samples
    1. Scene APIs
    2. Resource and Decoder APIs
    3. Network APIs
    4. Section Filtering APIs