RAPID TWO-LAYER NEURAL NETWORK SYNTHESIS OF REALISTIC IMAGES OF A NEURAL AVATAR BASED ON A SINGLE IMAGE Russian patent published in 2022 - IPC G06T13/40 G06N3/00 

Abstract RU 2764144 C1

FIELD: image data processing.

SUBSTANCE: invention relates to the field of computer graphics and can be used for synthesising a talking head, animating a face. According to the proposed approach, the appearance of a person is modelled by decomposing into two layers. The first layer is a pose-dependent rough image synthesised by a relatively small neural network. The second layer is determined by a pose-independent texture image containing high-frequency details. The texture image is created in the off-line mode and distorted, and then added to the rough image in order to provide high effective resolution of the synthesised views of the head.

EFFECT: increase in the resolution and increase in the operation speed. The proposed system creates neural avatars based on a single photograph.

10 cl, 2 dwg

Similar patents RU2764144C1

Title Year Author Number
TEXTURED NEURAL AVATARS 2019
  • Shysheya Aliaksandra Petrovna
  • Zakharov Egor Olegovich
  • Pasechnik Igor Igorevich
  • Burkov Egor Andreevich
  • Iskakov Karim Zhamalovich
  • Malkov Yury Andreevich
  • Vakhitov Alexander Timurovich
  • Aliev Kara-Ali Alibulatovich
  • Ivakhnenko Aleksei Aleksandrovich
  • Bashirov Renat Maratovich
  • Ulyanov Dmitry Vladimirovich
  • Lempitsky Viktor Sergeevich
RU2713695C1
METHOD FOR 3D RECONSTRUCTION OF A HUMAN HEAD TO OBTAIN A RENDER IMAGE OF A PERSON 2022
  • Khakhulin Taras Andreevich
  • Sklyarova Vanessa Valerievna
  • Lempitsky Victor Sergeevich
  • Zakharov Egor Olegovich
RU2786362C1
METHOD AND SYSTEM FOR REMOTE CLOTHING SELECTION 2020
  • Fedyukov Maxim Alexandrovich
  • Poskonin Andrey Vladimirovich
  • Klimentyev Sergey Mikhailovich
  • Guzov Vladimir Vladimirovich
  • Petrov Ilia Alexeevich
  • Koval Andrei Vasilievich
  • Patakin Nikolay
  • Fedotov Anton Vladimirovich
  • Korneev Oleg Vladimirovich
RU2805003C2
MODELLING PEOPLE'S CLOTHING BASED ON MULTIPLE POINTS 2021
  • Grigorev Artur Andreevich
  • Lempitsky Victor Sergeevich
  • Zakharkin Ilya Dmitrievich
  • Mazur Kirill Yevgenevich
RU2776825C1
NEURAL-NETWORK RENDERING OF THREE-DIMENSIONAL HUMAN AVATARS 2021
  • Lempitsky Victor Sergeevich
  • Iskakov Karim Zhamalovich
  • Vakhitov Alexander Timurovich
  • Bashirov Renat Maratovich
  • Grigoriev Artur Andreevich
  • Ianina Anastasiia Olegovna
RU2775825C1
NEURAL NETWORK TRANSFER OF THE FACIAL EXPRESSION AND POSITION OF THE HEAD USING HIDDEN POSITION DESCRIPTORS 2020
  • Burkov Egor Andreevich
  • Pasechnik Igor Igorevich
  • Lempitsky Victor Sergeevich
RU2755396C1
IMAGE GENERATORS WITH CONDITIONALLY INDEPENDENT PIXEL SYNTHESIS 2021
  • Anokhin Ivan Aleksandrovich
  • Demochkin Kirill Vladislavovich
  • Khakhulin Taras Andreevich
  • Sterkin Gleb Mikhailovich
  • Lempitsky Victor Sergeevich
  • Korzhenkov Denis Mikhailovich
RU2770132C1
REPEATED SYNTHESIS OF IMAGE USING DIRECT DEFORMATION OF IMAGE, PASS DISCRIMINATOR AND COORDINATE-BASED REMODELLING 2019
  • Sevastopolsky Artem Mikhailovich
  • Grigoriev Artur Andreevich
  • Lempitsky Victor Sergeevich
  • Vakhitov Alexander Timurovich
RU2726160C1
METHOD OF CREATING FULL-LENGTH ANIMATED AVATAR OF PERSON FROM ONE IMAGE OF PERSON, COMPUTING DEVICE AND MACHINE-READABLE MEDIUM FOR IMPLEMENTATION THEREOF 2023
  • Svitov David Viacheslavovich
  • Gudkov Dmitrii Iurevich
  • Bashirov Renat Maratovich
  • Lempitsky Victor Sergeevich
RU2813485C1
SYSTEM AND METHOD FOR OBTAINING PROCESSED OUTPUT IMAGE HAVING USER-SELECTABLE QUALITY FACTOR 2023
  • Ivakhnenko Aleksei Aleksandrovich
  • Karpikova Polina Vladimirovna
  • Iashchenko Anastasiia Sergeevna
  • Spiridonov Andrei Nikolaevich
  • Radionova Ekaterina Yurievna
  • Fabbricatore Riccardo
  • Kostiushko Leonid Igorevich
RU2823750C1

RU 2 764 144 C1

Authors

Zakharov Egor Olegovich

Ivakhnenko Aleksei Aleksandrovich

Shysheya Aliaksandra Petrovna

Lempitsky Victor Sergeevich

Dates

2022-01-13Published

2020-07-27Filed