Understanding and generating scenes using neural networks

摘要

PROBLEM TO BE SOLVED: To provide a method, a system and an apparatus including a computer program encoded on a computer storage medium for rendering an image. In one aspect, the method is a step of receiving a plurality of observations that characterize a particular scene, each observation comprising an image of the particular scene and data identifying the location of the camera that captured the image. , Including steps. In another aspect, the method is the step of receiving multiple observations that characterize a particular video, where each observation contains video frames from a particular video and data that identifies the time stamps of the video frames in a particular video. Including, including steps. In yet another embodiment, the method comprises receiving multiple observations that characterize a particular image, each observation comprising cropping a particular image and data that characterizes the crop of a particular image. .. The method uses an observation neural network to process each of the multiple observations and determine the numerical representation as an output. [Selection diagram] Fig. 1