METHOD OF TRAINING A CONVOLUTIONAL NEURAL NETWORK FOR IMAGE RECONSTRUCTION AND A SYSTEM FOR FORMING AN IMAGE DEPTH MAP (VERSIONS) Russian patent published in 2019 - IPC G06T7/593 H04N13/10 

Abstract RU 2698402 C1

FIELD: image processing means.

SUBSTANCE: group of inventions relates to the field of image processing. Method comprises the steps of: obtaining a stereoscopic pair image including the original left and right images; each of the images is transmitted to the input of the corresponding Siamese convolutional neural subnetwork to estimate the depth map; processing the supplied images to obtain high-level features maps and back depth maps for the left and right images; obtained maps of high-level features are transmitted to input of convolutional neural subnetwork for evaluation of chamber parameters; processing obtained maps of high-level features to obtain camera parameters, by means of which original left and right images were taken; applying affine transformation to reverse depth maps for the left and right images, respectively, taking into account the obtained camera parameters to obtain disparity maps for the left and right images; bilinear interpolation samples are used to obtain a reconstructed right and left image, recovered disparity maps for a right and left image, an auxiliary right and a left image, generating a loss function for reconstructed images based on original left and right images, reconstructed left and right images, disparity maps, recovered disparity maps for left and right images and auxiliary images.

EFFECT: increased accuracy.

12 cl, 8 dwg

Similar patents RU2698402C1

Title Year Author Number
METHOD OF GENERATING A COMMON LOSS FUNCTION FOR TRAINING A CONVOLUTIONAL NEURAL NETWORK FOR CONVERTING AN IMAGE INTO AN IMAGE WITH DRAWN PARTS AND A SYSTEM FOR CONVERTING AN IMAGE INTO AN IMAGE WITH DRAWN PARTS 2019
  • Shcherbinin Andrei Yurievich
  • Anisimovskiy Valery Valerievich
  • Biryulin Pavel Igorevich
RU2706891C1
METHOD FOR ESTIMATING THE DEPTH OF A SCENE BASED ON AN IMAGE AND COMPUTING APPARATUS FOR IMPLEMENTATION THEREOF 2020
  • Romanov Mikhail Viktorovich
  • Patakin Nikolay Andreevich
  • Belikov Ilia Igorevich
  • Konushin Anton Sergeevich)
RU2761768C1
SYSTEM FOR SYNTHESIS OF INTERMEDIATE TYPES OF LIGHT FIELD AND METHOD OF ITS OPERATION 2018
  • Milyukov Gleb Sergeevich
  • Kolchin Konstantin Viktorovich
  • Simutin Aleksandr Vladislavovich
  • Rychagov Mikhail Nikolaevich
  • Turko Sergej Aleksandrovich
RU2690757C1
METHOD FOR OBTAINING A SET OF OBJECTS OF A THREE-DIMENSIONAL SCENE 2019
  • Novikov Andrej Vladimirovich
  • Gerasimov Vladimir Nikolaevich
  • Gorbachev Roman Aleksandrovich
  • Shvindt Nikita Evgenevich
  • Novikov Vladimir Ivanovich
  • Efremenko Andrej Evgenevich
  • Shishkov Dmitrij Leonidovich
  • Zaripov Mikhail Nilovich
  • Kozin Filipp Aleksandrovich
  • Starostenko Aleksej Mikhajlovich
RU2803287C1
SELECTION OF IMAGE OBTAINING PARAMETER FOR IMAGE GENERATION SYSTEM 2017
  • Zalbakh, Aksel
  • Senegas, Dzhulen
  • Grot, Aleksandra
  • Jokel, Sasha Andreas
  • Bergtoldt, Martin
RU2780966C2
METHOD AND APPARATUS FOR JOINT DEBAYERING AND IMAGE NOISE ELIMINATION USING A NEURAL NETWORK 2020
  • Kurmanov Vladimir Gennadievich
  • Fetisov Iurii Gennadievich
  • Petrova Xenya Yurievna
  • Karacharov Ivan Olegovich
  • Lebedev Kirill Victorovich
RU2764395C1
REPEATED SYNTHESIS OF IMAGE USING DIRECT DEFORMATION OF IMAGE, PASS DISCRIMINATOR AND COORDINATE-BASED REMODELLING 2019
  • Sevastopolsky Artem Mikhailovich
  • Grigoriev Artur Andreevich
  • Lempitsky Victor Sergeevich
  • Vakhitov Alexander Timurovich
RU2726160C1
DEVICE FOR RECONSTRUCTING A DEPTH MAP WITH SEARCHING FOR SIMILAR BLOCKS BASED ON A NEURAL NETWORK 2019
  • Gapon Nikolaj Valerevich
  • Voronin Vyacheslav Vladimirovich
  • Sizyakin Roman Alekseevich
  • Zhdanova Marina Mikhajlovna
  • Semenishchev Evgenij Aleksandrovich
  • Balabaeva Oksana Sergeevna
RU2716311C1
METHOD AND APPARATUS FOR IDENTIFYING PORTIONS OF FRAGMENTED MATERIAL WITHIN AN IMAGE 2016
  • Tafazoli Bilandi, Shakhram
  • Ramezani, Makhdi
  • Bell, Yan Lo
  • Sameti, Mokhammad
  • Abolmaesumi, Purang
  • Nuranian, Seman
RU2694021C1
METHOD FOR VISUALIZING A 3D PORTRAIT OF A PERSON WITH ALTERED LIGHTING AND A COMPUTING DEVICE FOR IT 2021
  • Sevastopolskij Artem Mikhajlovich
  • Lempitskij Viktor Sergeevich
RU2757563C1

RU 2 698 402 C1

Authors

Anisimovskiy Valery Valerievich

Shcherbinin Andrei Yurievich

Turko Sergei Alexandrovich

Dates

2019-08-26Published

2018-08-30Filed