FIELD: video frame rate conversion.
SUBSTANCE: invention relates to a method and user device for frame rate conversion (FRC) video. The method comprises obtaining at least one pair of video frames to be FRC-transformed; dividing each frame into a plurality of blocks; estimating motion between frames on a block-by-block basis to obtain: a forward motion field, which is a set of motion vectors, each of which corresponds to a corresponding block of the plurality of blocks of the first frame and points to a corresponding area in the second frame, and a backward motion field, which is a set of motion vectors , each corresponding to a corresponding block of the plurality of blocks of the second frame and pointing to a corresponding region in said first frame, each motion vector being assigned a corresponding motion estimation metric value, with the first frame preceding the second frame in time; deriving closing occlusions, opening occlusions, and indeterminate occlusions based on a forward motion field and a backward motion field; calculating an artifact occurrence probability score indicative of a probability of occurrence of the artifact when interpolating the motion-compensated frame between the first frame and the second frame, the calculation comprising detecting discontinuities between spatially adjacent motion vectors in at least one of the forward motion field and the backward motion field; discontinuity processing that suppresses discontinuities that only overlap with opening occlusions for discontinuities in the backward motion field or only with closing occlusions for discontinuities in the forward motion field, and reinforces discontinuities that overlap with undefined occlusions; and suppressing discontinuities between spatially adjacent motion vectors based on motion estimation metric values; performing smoothing filtering to estimate the probability of artifact occurrence; and obtaining one or more intermediate frames, taking into account the values of the smoothed estimate of the probability of occurrence of the artifact.
EFFECT: increasing the accuracy of detecting possible artifacts.
19 cl, 15 dwg
Title | Year | Author | Number |
---|---|---|---|
FRC OCCLUSION PROCESSING WITH DEEP LEARNING | 2020 |
|
RU2747965C1 |
METHOD AND DEVICE FOR SUB-PIXEL REFINEMENT OF MOTION VECTORS | 2022 |
|
RU2803233C1 |
METHOD OF ADAPTIVE FRAME PREDICTION FOR MULTIVIEW VIDEO SEQUENCE CODING | 2011 |
|
RU2480941C2 |
RECOGNITION QUALITY ENHANCEMENTS BY INCREASING IMAGE RESOLUTION | 2013 |
|
RU2538941C1 |
METHOD OF CALCULATING MOVEMENT WITH OCCLUSION CORRECTIONS | 2012 |
|
RU2517727C2 |
RECORDING AND CREATING STEREO IMAGES AND STEREO VIDEO IN REAL TIME USING MONOSCOPIC LOW-POWER MOBILE DEVICE | 2007 |
|
RU2417548C2 |
MOTION ESTIMATION THROUGH THREE-DIMENSIONAL RECURSIVE SEARCH (3DRS) IN REAL TIME FOR FRAME CONVERSION (FRC) | 2017 |
|
RU2656785C1 |
DEVICE AND METHOD TO PROCESS IMAGES AND DEVICE AND METHOD OF IMAGES DISPLAY | 2008 |
|
RU2419243C1 |
BACKGROUND HYBRID RETOUCH METHOD FOR 2D TO 3D CONVERSION | 2014 |
|
RU2576490C1 |
METHOD FOR AUTOMATIC RETRIEVAL OF KEY FRAME INDICES FOR VIDEO DATA EXTENSION | 2014 |
|
RU2577486C2 |
Authors
Dates
2022-12-26—Published
2022-04-29—Filed