MODELLING PEOPLE'S CLOTHING BASED ON MULTIPLE POINTS Russian patent published in 2022 - IPC G06T1/40 G06T17/00 G06V10/00 G06N3/02 

FIELD: computing technology.

SUBSTANCE: invention relates to modelling realistic clothing worn by people and to realistic 3D modelling of people. In the method for training an overlay network for modelling clothing on a person, wherein the clothing adapts to the pose and body shape of any person, a set of frames of people is provided, wherein each person is dressed in clothing and wherein the frames constitute a video sequence where each person performs a series of motions; a Skinned Multi-Person Linear (SMPL) mesh is calculated for each frame for the pose and body shape of the person in the frame; for each frame, a clothing mesh is calculated for the pose and body shape of the person in the frame; a source point cloud in the form of a set of vertices of said Skinned Multi-Person Linear (SMPL) meshes is created for each frame; a randomly initialised d-dimensional code vector is set to code the style of clothing for each person; the source point clouds and code vectors of clothing are supplied to the overlay network, namely: the source point clouds are supplied to the input of the neural network of the cloud converter of the overlay network, and the code vectors of clothing are supplied to the input of the neural network of the MLP (multilayer perceptron) encoder; the code vector of clothing is processed by the neural network of the MLP encoder, and then the output thereof is transferred to the neural network of the cloud converter, which deforms introduced the input point cloud with account for the output of the neural network of the MLP encoder, and outputs the predicted point cloud of clothing for each frame; after processing all the frames from the set of frames of people, a pre-trained overlay network is obtained, namely: weights of the trained neural network of the MLP encoder, weights of the trained neural network of the cloud converter, code vectors of clothing of the coded styles for all people; by means of the pre-trained overlay network, a suitable style of clothing corresponding to one of the vectors and one of the point clouds is overlaid on any body shape and any pose selected by the user.

EFFECT: possibility of generating images of a person wearing clothing selected from another person.

6 cl, 8 dwg, 2 tbl