TEXTURED NEURAL AVATARS Russian patent published in 2020 - IPC G06T11/40 G06T7/40 G06T1/40 

Abstract RU 2713695 C1

FIELD: computer equipment.

SUBSTANCE: invention relates to the computer equipment. Method for synthesis of a two-dimensional human image, in which three-dimensional coordinates of positions of human body joints are received, given in a camera coordinate system, wherein three-dimensional coordinates of positions of body joints set a human pose and a viewpoint of a two-dimensional image; using a trained machine learning predictor is predicted, a stack of body parts assignment maps and a stack of body parts coordinates maps based on three dimensional coordinates of the body joints, wherein the body parts coordinates map stack sets the coordinates of the human body parts pixels, the body parts assignment stack sets the weights, each weight indicating the probability that a specific pixel belongs to a specific part of the human body, wherein the trained machine learning predictor is trained for a plurality of different human postures and different human viewing points; retrieving from memory a previously initialized stack of texture maps for human body parts; and reconstructing a two-dimensional human image as a weighted combination of pixel values using a stack of body parts assignments, a stack of coordinates maps of parts of the body and a stack of texture maps.

EFFECT: technical result consists in providing the possibility of obtaining two-dimensional images of the entire human body in different positions and from different points of view using artificial intelligence.

6 cl, 4 dwg

Similar patents RU2713695C1

Title Year Author Number
RAPID TWO-LAYER NEURAL NETWORK SYNTHESIS OF REALISTIC IMAGES OF A NEURAL AVATAR BASED ON A SINGLE IMAGE 2020
  • Zakharov Egor Olegovich
  • Ivakhnenko Aleksei Aleksandrovich
  • Shysheya Aliaksandra Petrovna
  • Lempitsky Victor Sergeevich
RU2764144C1
METHOD FOR 3D RECONSTRUCTION OF A HUMAN HEAD TO OBTAIN A RENDER IMAGE OF A PERSON 2022
  • Khakhulin Taras Andreevich
  • Sklyarova Vanessa Valerievna
  • Lempitsky Victor Sergeevich
  • Zakharov Egor Olegovich
RU2786362C1
METHOD AND SYSTEM FOR REMOTE CLOTHING SELECTION 2020
  • Fedyukov Maxim Alexandrovich
  • Poskonin Andrey Vladimirovich
  • Klimentyev Sergey Mikhailovich
  • Guzov Vladimir Vladimirovich
  • Petrov Ilia Alexeevich
  • Koval Andrei Vasilievich
  • Patakin Nikolay
  • Fedotov Anton Vladimirovich
  • Korneev Oleg Vladimirovich
RU2805003C2
MODELLING PEOPLE'S CLOTHING BASED ON MULTIPLE POINTS 2021
  • Grigorev Artur Andreevich
  • Lempitsky Victor Sergeevich
  • Zakharkin Ilya Dmitrievich
  • Mazur Kirill Yevgenevich
RU2776825C1
NEURAL-NETWORK RENDERING OF THREE-DIMENSIONAL HUMAN AVATARS 2021
  • Lempitsky Victor Sergeevich
  • Iskakov Karim Zhamalovich
  • Vakhitov Alexander Timurovich
  • Bashirov Renat Maratovich
  • Grigoriev Artur Andreevich
  • Ianina Anastasiia Olegovna
RU2775825C1
METHOD OF SYNTHESIS OF A TWO-DIMENSIONAL IMAGE OF A SCENE VIEWED FROM A REQUIRED VIEW POINT AND ELECTRONIC COMPUTING APPARATUS FOR IMPLEMENTATION THEREOF 2020
  • Kolos Maria Vladimirovna
  • Sevastopolskiy Artem Mikhailovich
  • Aliev Kara-Ali Alibulatovich
  • Lempitsky Victor Sergeevich
RU2749749C1
REPEATED SYNTHESIS OF IMAGE USING DIRECT DEFORMATION OF IMAGE, PASS DISCRIMINATOR AND COORDINATE-BASED REMODELLING 2019
  • Sevastopolsky Artem Mikhailovich
  • Grigoriev Artur Andreevich
  • Lempitsky Victor Sergeevich
  • Vakhitov Alexander Timurovich
RU2726160C1
METHOD OF MULTIMODAL CONTACTLESS CONTROL OF MOBILE INFORMATION ROBOT 2020
  • Ryumin Dmitrij
  • Kipyatkova Irina Sergeevna
  • Kagirov Ildar Amirovich
  • Aksenov Aleksandr
  • Karpov Aleksej Anatolevich
RU2737231C1
NEURAL NETWORK TRANSFER OF THE FACIAL EXPRESSION AND POSITION OF THE HEAD USING HIDDEN POSITION DESCRIPTORS 2020
  • Burkov Egor Andreevich
  • Pasechnik Igor Igorevich
  • Lempitsky Victor Sergeevich
RU2755396C1
METHOD FOR PROVIDING COMPUTER VISION 2022
  • Rukhovich Danila Dmitrievich
  • Konushin Anton Sergeevich
  • Konushin Anton Sergeevich
RU2791587C1

RU 2 713 695 C1

Authors

Shysheya Aliaksandra Petrovna

Zakharov Egor Olegovich

Pasechnik Igor Igorevich

Burkov Egor Andreevich

Iskakov Karim Zhamalovich

Malkov Yury Andreevich

Vakhitov Alexander Timurovich

Aliev Kara-Ali Alibulatovich

Ivakhnenko Aleksei Aleksandrovich

Bashirov Renat Maratovich

Ulyanov Dmitry Vladimirovich

Lempitsky Viktor Sergeevich

Dates

2020-02-06Published

2019-02-21Filed