NEURAL-NETWORK RENDERING OF THREE-DIMENSIONAL HUMAN AVATARS Russian patent published in 2022 - IPC G06T15/00 G06N3/04 

Abstract RU 2775825 C1

FIELD: computing technology.

SUBSTANCE: invention relates to means of creating and rendering a three-dimensional model of an avatar of the user and can be applied in augmented and virtual reality systems, video games, and teleconferences. Method for rendering a avatar includes the stages of: obtaining the body shape parameters s characterising the body shape of the user, the pose parameters p characterising the desired pose of the avatar of the user, and the camera parameters C characterising the desired angle; creating a deformable polygonal structure as a three-dimensional model of the body of the user; overlaying an L-channel neural network texture characterising the physical features of the user; and rendering an avatar of the user by means of a pre-trained rendering neural network, wherein the neural network texture and the rendering neural network are trained by readjusting the parameters of the neural network texture and the rendering neural network until the resulting images of the avatar of the user correspond to one or more frames of the image of the user.

EFFECT: possibility of creating or rendering a photorealistic three-dimensional avatar of the user in the desired pose and/or from the desired angle based on only one or more photo images of the user.

16 cl, 3 dwg

Similar patents RU2775825C1

Title Year Author Number
NEURAL DOT GRAPHIC 2019
  • Aliev Kara-Ali Alibulatovich
  • Ulyanov Dmitry Vladimirovich
  • Lempitsky Victor Sergeevich
RU2729166C1
MODELLING PEOPLE'S CLOTHING BASED ON MULTIPLE POINTS 2021
  • Grigorev Artur Andreevich
  • Lempitsky Victor Sergeevich
  • Zakharkin Ilya Dmitrievich
  • Mazur Kirill Yevgenevich
RU2776825C1
TEXTURED NEURAL AVATARS 2019
  • Shysheya Aliaksandra Petrovna
  • Zakharov Egor Olegovich
  • Pasechnik Igor Igorevich
  • Burkov Egor Andreevich
  • Iskakov Karim Zhamalovich
  • Malkov Yury Andreevich
  • Vakhitov Alexander Timurovich
  • Aliev Kara-Ali Alibulatovich
  • Ivakhnenko Aleksei Aleksandrovich
  • Bashirov Renat Maratovich
  • Ulyanov Dmitry Vladimirovich
  • Lempitsky Viktor Sergeevich
RU2713695C1
NEURAL NETWORK TRANSFER OF THE FACIAL EXPRESSION AND POSITION OF THE HEAD USING HIDDEN POSITION DESCRIPTORS 2020
  • Burkov Egor Andreevich
  • Pasechnik Igor Igorevich
  • Lempitsky Victor Sergeevich
RU2755396C1
RAPID TWO-LAYER NEURAL NETWORK SYNTHESIS OF REALISTIC IMAGES OF A NEURAL AVATAR BASED ON A SINGLE IMAGE 2020
  • Zakharov Egor Olegovich
  • Ivakhnenko Aleksei Aleksandrovich
  • Shysheya Aliaksandra Petrovna
  • Lempitsky Victor Sergeevich
RU2764144C1
METHOD AND SYSTEM FOR REMOTE CLOTHING SELECTION 2020
  • Fedyukov Maxim Alexandrovich
  • Poskonin Andrey Vladimirovich
  • Klimentyev Sergey Mikhailovich
  • Guzov Vladimir Vladimirovich
  • Petrov Ilia Alexeevich
  • Koval Andrei Vasilievich
  • Patakin Nikolay
  • Fedotov Anton Vladimirovich
  • Korneev Oleg Vladimirovich
RU2805003C2
METHOD FOR CONSTRUCTING A SCENE REPRESENTATION WITH DIRECT CORRECTION FOR REAL-TIME IMAGE SYNTHESIS 2022
  • Solovev Pavel Ilyich
  • Korzhenkov Denis Mikhailovich
  • Khakhulin Taras Andreevich
RU2799237C1
METHOD OF CREATING FULL-LENGTH ANIMATED AVATAR OF PERSON FROM ONE IMAGE OF PERSON, COMPUTING DEVICE AND MACHINE-READABLE MEDIUM FOR IMPLEMENTATION THEREOF 2023
  • Svitov David Viacheslavovich
  • Gudkov Dmitrii Iurevich
  • Bashirov Renat Maratovich
  • Lempitsky Victor Sergeevich
RU2813485C1
METHOD FOR 3D RECONSTRUCTION OF A HUMAN HEAD TO OBTAIN A RENDER IMAGE OF A PERSON 2022
  • Khakhulin Taras Andreevich
  • Sklyarova Vanessa Valerievna
  • Lempitsky Victor Sergeevich
  • Zakharov Egor Olegovich
RU2786362C1
METHOD FOR AUDIOVISUAL RECOGNITION OF PERSONAL PROTECTION EQUIPMENT ON HUMAN FACE 2022
  • Riumina Elena Vitalevna
  • Markitantov Maksim Viktorovich
  • Riumin Dmitrii Aleksandrovich
  • Karpov Aleksei Anatolevich
RU2791415C1

RU 2 775 825 C1

Authors

Lempitsky Victor Sergeevich

Iskakov Karim Zhamalovich

Vakhitov Alexander Timurovich

Bashirov Renat Maratovich

Grigoriev Artur Andreevich

Ianina Anastasiia Olegovna

Dates

2022-07-11Published

2021-04-27Filed