O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Programming for Mixed Reality with Windows 10, Unity, Vuforia and UrhoSharp, First Edition

Book Description

This is the first start-to-finish guide to programming AI-powered mixed reality apps and games using today’s breakthrough technologies -- including Microsoft Cognitive Services, Unity, Vuforia, Xamarin UrhoSharp, and the Universal Windows Platform. Pioneering mixed reality developer Dawid Borycki guides you through every aspect and phase of mixed reality development, from simple 2D apps to cutting-edge apps that run on Microsoft HoloLens and today’s newest immersive headsets. One step at a time, you’ll learn how to:

  • Set up a mixed reality development environment with all the tools you’ll need, including HoloLens and Mixed Reality simulators
  • Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware
  • Acquire, display and process audio and video
  • Send images from world-facing headset cameras to Microsoft’s computer vision machine learning modules
  • Generate descriptions of what the user sees, and present them via text or speech
  • Use mobile sensor readings to control content displayed through mixed reality headsets
  • Master core concepts and techniques for building 3D mixed reality apps with Unity
  • Format 3D objects with materials to create holograms
  • Add interactions to holograms based on user inputIntegrate HoloLens-specific capabilities, including air gestures, spatial sound, and mapping
  • Connect mixed reality experiences with real objects in the environment via the Vuforia Unity extension
  • Write cross-platform 3D mixed reality apps with Xamarin UrhoSharp
  • And much more

Table of Contents

  1. Cover Page
  2. Title Page
  3. Table of Contents
  4. Contents
  5. Part 1 Fundamentals
    1. Chapter 1 Introduction to Windows Mixed Reality
      1. Virtual, Augmented, and Mixed Reality
      2. Windows Mixed Reality Hardware
      3. Mixed Reality in Windows 10
      4. Summary
    2. Chapter 2 Development Tools
      1. Universal Windows Platform
      2. Microsoft DirectX
      3. Unity
      4. UrhoSharp
      5. Summary
    3. Chapter 3 Configuring the Development Environment, Emulators, and Hardware
      1. Setting Up the Development Environment
      2. HelloWorld Project
      3. Deploying Apps to the HoloLens Emulator
      4. Running Apps in the Mixed Reality Simulator
      5. Summary
  6. Part 2 Developing 2D UWP Apps
    1. Chapter 4 UWP Basics
      1. XAML and UI
      2. Data Binding and the Model-View-ViewModel Software Architecture Pattern
      3. Implementing Data Binding
      4. Using Converters
      5. Notifying the Binding about Changes to Source Properties
      6. Adapting a View to the Platform
      7. Summary
    2. Chapter 5 Working with Media Controls, Speech Synthesis and Recognition [This content is currently in development.]
    3. Chapter 6 Using Microsoft Cognitive Services to Develop AI-Enabled apps [This content is currently in development.]
    4. Chapter 7 Connecting with Other Devices [This content is currently in development.]
  7. Part 3 Developing 3D Apps
    1. Chapter 8 Understanding 3D Graphics Fundamentals [This content is currently in development.]
    2. Chapter 9 Using the Unity Editor to Create and Modify 3D Scenes [This content is currently in development.]
    3. Chapter 10 Adding Physical Effects and Interactivity to 3D Scenes [This content is currently in development.]
    4. Chapter 11 Adding Animations to 3D Objects in Unity [This content is currently in development.]
    5. Chapter 12 Understanding HoloLens-Specific Functionalities [This content is currently in development.]
    6. Chapter 13 Creating an AI-Powered 3D App [This content is currently in development.]
    7. Chapter 14 Installing and Using the Vufora Extension for Unity [This content is currently in development.]
    8. Chapter 15 Using UrhoSharp to Build 3D Mixed Reality Apps [This content is currently in development.]