MULTI-FRAME TRAINING OF REALISTIC NEURAL MODELS OF SPEAKERS HEADS Russian patent published in 2020 - IPC G06T1/00 G09B23/00 

FIELD: computer equipment.

SUBSTANCE: present invention relates to computer engineering. Method comprises steps of: receiving at least one video frame from a single sequence of frames of said person; evaluating head orientation and facial expression descriptors for at least one video frame; computing an N-dimensional embedding vector which characterizes a person-specific information, based on at least one video frame using a meta-trained embedded network; implementing a generator network based on a set of parameters of a meta-trained generator network and an N-dimensional embedding vector; and fine tuning network parameters of generator to match at least one video frame, when the generator network is provided with head orientation and facial expression descriptors, synthesising a sequence of images of the talking persona head for said person using a finely tuned generator network and a previously unobserved sequence of head orientation and facial expression descriptors.

EFFECT: technical result consists in improvement of quality of synthesized images.

9 cl, 5 dwg