Fig. 11

3D conversion Pipeline. Here we illustrate steps one to three of the 3D conversion pipeline presented in the “Overview of a 3D conversion pipeline” section. First, in a, rough 3D geometry is generated for all objects in the scene (here, only the Virgin Mary and Angel Gabriel are shown). Next, in b, accurate masks are generated for all objects (again, only Mary and Gabriel are shown). In c, the camera is turned into a projector and the masks from b onto the rough 3D geometry from a. This projection is then used to “clip” the 3D models by throwing away the portion of the geometry not falling within the projection. Finally, in d, the clipped geometry is “painted” by projecting the original image onto it