Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

O'Reilly logo
Media Production, Delivery and Interaction for Platform Independent Systems: Format-Agnostic Media

Book Description

Presents current trends and potential future developments by leading researchers in immersive media production, delivery, rendering and interaction

The underlying audio and video processing technology that is discussed in the book relates to areas such as 3D object extraction, audio event detection; 3D sound rendering and face detection, gesture analysis and tracking using video and depth information. The book will give an insight into current trends and developments of future media production, delivery and reproduction. Consideration of the complete production, processing and distribution chain will allow for a full picture to be presented to the reader. Production developments covered will include integrated workflows developed by researchers and industry practitioners as well as capture of ultra-high resolution panoramic video and 3D object based audio across a range of programme genres. Distribution developments will include script based format agnostic network delivery to a full range of devices from large scale public panoramic displays with wavefield synthesis and ambisonic audio reproduction to 'small screen' mobile devices. Key developments at the consumer end of the chain apply to both passive and interactive viewing modes and will incorporate user interfaces such as gesture recognition and 'second screen' devices to allow manipulation of the audio visual content.

  • Presents current trends and potential future developments by leading researchers in immersive media production, delivery, rendering and interaction.

  • Considers the complete production, processing and distribution chain illustrating the dependencies and the relationship between different components.

  • Proposes that a format-agnostic approach to the production and delivery of broadcast programmes will overcome the problems faced with the steadily growing number of production and delivery formats.

  • Explains the fundamentals of media production in addition to the complete production chain, beyond current-state-of-the-art through to presenting novel approaches and technologies for future media production.

  • Focuses on the technologies that will allow for the realization of an E2E media platform that supports flexible content representations and interactivity for users.

  • An essential read for Researchers and developers of audio-visual technology in industry and academia, such as engineers in broadcast technology companies and students working toward a career in the rapidly changing area of broadcast both from a production and an engineering perspective.

    Table of Contents

    1. Cover
    2. Title Page
    3. Copyright
    4. List of Editors and Contributors
      1. Editors
      2. Contributors
    5. List of Abbreviations
    6. Notations
      1. General
      2. Specfic Symbols
    7. Chapter 1: Introduction
    8. Chapter 2: State-of-the-Art and Challenges in Media Production, Broadcast and Delivery
      1. 2.1 Introduction
      2. 2.2 Video Fundamentals and Acquisition Technology
      3. 2.3 Audio Fundamentals and Acquisition Technology
      4. 2.4 Live Programme Production
      5. 2.5 Coding and Delivery
      6. 2.6 Display Technology
      7. 2.7 Audio Reproduction Technology
      8. 2.8 Use of Archive Material
      9. 2.9 Concept of Format-Agnostic Media
      10. 2.10 Conclusion
      11. Notes
      12. References
    9. Chapter 3: Video Acquisition
      1. 3.1 Introduction
      2. 3.2 Ultra-High Definition Panoramic Video Acquisition
      3. 3.3 Use of Conventional Video Content to Enhance Panoramic Video
      4. 3.4 High Frame Rate Video
      5. 3.5 High Dynamic Range Video
      6. 3.6 Conclusion
      7. Notes
      8. References
    10. Chapter 4: Platform Independent Audio
      1. 4.1 Introduction
      2. 4.2 Terms and Definitions
      3. 4.3 Definition of the Problem Space
      4. 4.4 Scene Representation
      5. 4.5 Scene Acquisition
      6. 4.6 Scene Reproduction
      7. 4.7 Existing Systems
      8. 4.8 Conclusion
      9. References
    11. Chapter 5: Semi-Automatic Content Annotation
      1. 5.1 Introduction
      2. 5.2 Metadata Models and Analysis Architectures
      3. 5.3 Domain-independent Saliency
      4. 5.4 Person Detection and Tracking
      5. 5.5 Online Detection of Concepts and Actions
      6. 5.6 Supporting Annotation for Automated Production
      7. 5.7 Conclusion
      8. References
    12. Chapter 6: Virtual Director
      1. 6.1 Introduction
      2. 6.2 Implementation Approaches
      3. 6.3 Example Architecture and Workflow
      4. 6.4 Virtual Director Subprocesses
      5. 6.5 Behaviour Engineering: Production Grammar
      6. 6.6 Virtual Director: Example Prototype
      7. 6.7 Conclusion
      8. References
    13. Chapter 7: Scalable Delivery of Navigable and Ultra-High Resolution Video
      1. 7.1 Introduction
      2. 7.2 Delivery of Format-Agnostic Content: Key Concepts and State-of-the-Art
      3. 7.3 Spatial Random Access in Video Coding
      4. 7.4 Models for Adaptive Tile-based Representation and Delivery
      5. 7.5 Segment-based Adaptive Transport
      6. 7.6 Conclusion
      7. References
    14. Chapter 8: Interactive Rendering
      1. 8.1 Introduction
      2. 8.2 Format-Agnostic Rendering
      3. 8.3 Device-less Interaction for Rendering Control
      4. 8.4 Conclusions
      5. References
    15. Chapter 9: Application Scenarios and Deployment Domains
      1. 9.1 Introduction
      2. 9.2 Application Scenarios
      3. 9.3 Deployment in the Production Domain
      4. 9.4 Deployment in the Network Domain
      5. 9.5 Deployment in the Device Domain
      6. 9.6 Deployment in the User Domain
      7. 9.7 Conclusion
      8. References
    16. Index