3D Video: From Capture to Diffusion

Chapter 9

Synthesizing Intermediary Viewpoints

9.1. Introduction

Virtual or intermediary viewpoint synthesis relates to creating a different perspective from that in the acquisition bank. A number of applications such as robotized navigation, object recognition or even free navigation, more commonly known as “free-viewpoint navigation”, require the use of a virtual view point. In this chapter, we focus on the synthesis of this viewpoint using depth information, a method known as “depth-image-based rendering”, (DIBR).

In this chapter, we begin with a general overview of the basic requirements for virtual viewpoint synthesis. In particular, we examine viewpoint synthesis with interpolation and extrapolation. Section 9.3 focuses on a specific problem in viewpoint synthesis, completing discovered zones. Finally, section 9.4 concludes the chapter.

9.2. Viewpoint synthesis by interpolation and extrapolation

In this section, we examine the general principal underlying DIBR viewpoint synthesis, specifically by means of direct projection and inverse projection. The typical distortions and the methods used in viewpoint synthesis which allow us to correct or avoid these distortions will be examined in section 9.2.2. We examine viewpoint interpolation and extrapolation, particularly texture fusion methods in section 9.2.3. View synthesis by DIBR in the context of 3DTV has been well studied in the European project ATTEST [FEH 04]. For a more general overview, the book by Schreer et al. provides ...