RayZer: A Self-supervised Large View Synthesis Model

Novel view synthesis and SfM from unposed and uncalibrated multiview images \(\mathcal{I}\) .

For a set of images, split it into two disjoint sets. Reconstruct scene using one set, train the model to render the second set.

Camera Estimation

Latent Scene Representation

Rendering

The fact that this even works is interesting.