METHOD FOR CREATION OF MULTILAYERED SCENE REPRESENTATION AND COMPUTER DEVICE FOR ITS IMPLEMENTATION Russian patent published in 2023 - IPC G06T7/00 

FIELD: computer technology.

SUBSTANCE: present invention relates to a method and a device for creation of a multilayered scene representation. In the method, a pair of scene images is received, in which one image of the pair is considered as a reference image, and the other image of the pair is considered as an initial image; a reprojection operation is performed relatively to the pair of images for creation of a volume expanded on a plane; using a geometrical network Fg, a multilayered scene structure is predicted based on the volume expanded on the plane, and, using a color network Fc, color values and non-transparency values α are assessed for the predicted multilayered scene structure to obtain a multilayered scene representation; wherein, the geometrical network and the color network are trained in an end-to-end way, while the geometrical network is trained using at least geometrical loss calculated between the predicted multilayered structure and a real sparse point cloud corresponding to the scene in the reference image selected from a training video of a training dataset.

EFFECT: increase in the quality of new image synthesis.

16 cl, 14 dwg