FIELD: computer technology.
SUBSTANCE: present invention relates to the field of computer technology for creating a 3D portrait with variable lighting. A method for visualizing a 3D portrait of a person with altered lighting is proposed, which consists in taking an input that determines the camera position and lighting conditions; rasterization of hidden 3D point cloud descriptors is performed, and a 3D point cloud is created based on a sequence of images captured by a camera with a blinking flashlight when the camera moves around the upper part of the human body, while the image sequence contains a set of images taken with a flash and a set of images taken without a flashlight; rasterized images are processed by a deep neural network to predict albedo, normals, environmental shadow maps and segmentation masks for the adopted camera pose, and combine the predicted albedo, normals, environmental shadow maps and segmentation mask into a 3D portrait with modified lighting in accordance with lighting conditions.
EFFECT: improving the quality characteristics of the created 3D portrait.
21 cl, 5 dwg
| Title | Year | Author | Number |
|---|---|---|---|
| METHOD OF OBTAINING INFORMATION ON SHAPE AND DIMENSIONS OF THREE-DIMENSIONAL OBJECT FROM ITS TWO-DIMENSIONAL IMAGE | 2022 |
|
RU2816504C1 |
| MODELLING PEOPLE'S CLOTHING BASED ON MULTIPLE POINTS | 2021 |
|
RU2776825C1 |
| METHOD OF CREATING FULL-LENGTH ANIMATED AVATAR OF PERSON FROM ONE IMAGE OF PERSON, COMPUTING DEVICE AND MACHINE-READABLE MEDIUM FOR IMPLEMENTATION THEREOF | 2023 |
|
RU2813485C1 |
| METHOD FOR 3D RECONSTRUCTION OF A HUMAN HEAD TO OBTAIN A RENDER IMAGE OF A PERSON | 2022 |
|
RU2786362C1 |
| NEURAL DOT GRAPHIC | 2019 |
|
RU2729166C1 |
| NEURAL NETWORK TRANSFER OF THE FACIAL EXPRESSION AND POSITION OF THE HEAD USING HIDDEN POSITION DESCRIPTORS | 2020 |
|
RU2755396C1 |
| TEXTURED NEURAL AVATARS | 2019 |
|
RU2713695C1 |
| RAPID TWO-LAYER NEURAL NETWORK SYNTHESIS OF REALISTIC IMAGES OF A NEURAL AVATAR BASED ON A SINGLE IMAGE | 2020 |
|
RU2764144C1 |
| METHOD OF SYNTHESIS OF A TWO-DIMENSIONAL IMAGE OF A SCENE VIEWED FROM A REQUIRED VIEW POINT AND ELECTRONIC COMPUTING APPARATUS FOR IMPLEMENTATION THEREOF | 2020 |
|
RU2749749C1 |
| REPEATED SYNTHESIS OF IMAGE USING DIRECT DEFORMATION OF IMAGE, PASS DISCRIMINATOR AND COORDINATE-BASED REMODELLING | 2019 |
|
RU2726160C1 |
