FRC OCCLUSION PROCESSING WITH DEEP LEARNING Russian patent published in 2021 - IPC G06T1/40 G06T11/00 

FIELD: video processing.

SUBSTANCE: invention relates to the field of video processing. The method for converting the frame rate of the input video includes the steps of: performing motion estimation by generating at least one set of motion vectors for each block of one reference frame of the input video, which point to another reference frame of the input video; preparing the first data for a predetermined interpolation phase for each block of the interpolated frame. The first data contain parameters for a pre-trained OcC CNN (Convolutional Neural Network for Occlusion Correction) obtained based on at least one set of motion vectors; occlusion correction with OcC CNN is performed for each block of the interpolated frame by predicting weights associated with motion vectors based on the prepared first data and motion compensated interpolation is performed for each block and/or for each pixel of the interpolated frame by processing data from the OcC CNN.

EFFECT: invention improves processing occlusions accuracy.

16 cl, 16 dwg, 3 tbl