FRAME RATE CONVERSION METHOD SUPPORTING FRAME INTERPOLATION REPLACEMENT WITH MOTION COMPENSATION BY LINEAR FRAME COMBINATION AND DEVICE IMPLEMENTING IT Russian patent published in 2022 - IPC G06T7/20 H04N19/51 

Abstract RU 2786784 C1

FIELD: video frame rate conversion.

SUBSTANCE: invention relates to a method and user device for frame rate conversion (FRC) video. The method comprises obtaining at least one pair of video frames to be FRC-transformed; dividing each frame into a plurality of blocks; estimating motion between frames on a block-by-block basis to obtain: a forward motion field, which is a set of motion vectors, each of which corresponds to a corresponding block of the plurality of blocks of the first frame and points to a corresponding area in the second frame, and a backward motion field, which is a set of motion vectors , each corresponding to a corresponding block of the plurality of blocks of the second frame and pointing to a corresponding region in said first frame, each motion vector being assigned a corresponding motion estimation metric value, with the first frame preceding the second frame in time; deriving closing occlusions, opening occlusions, and indeterminate occlusions based on a forward motion field and a backward motion field; calculating an artifact occurrence probability score indicative of a probability of occurrence of the artifact when interpolating the motion-compensated frame between the first frame and the second frame, the calculation comprising detecting discontinuities between spatially adjacent motion vectors in at least one of the forward motion field and the backward motion field; discontinuity processing that suppresses discontinuities that only overlap with opening occlusions for discontinuities in the backward motion field or only with closing occlusions for discontinuities in the forward motion field, and reinforces discontinuities that overlap with undefined occlusions; and suppressing discontinuities between spatially adjacent motion vectors based on motion estimation metric values; performing smoothing filtering to estimate the probability of artifact occurrence; and obtaining one or more intermediate frames, taking into account the values of the smoothed estimate of the probability of occurrence of the artifact.

EFFECT: increasing the accuracy of detecting possible artifacts.

19 cl, 15 dwg

Similar patents RU2786784C1

Title Year Author Number
FRC OCCLUSION PROCESSING WITH DEEP LEARNING 2020
  • Ilichev Sergei Dmitrievich
  • Kovliga Igor Mironovich
  • Pohl Petr
  • Rakova Kristina Olegovna
RU2747965C1
METHOD AND DEVICE FOR SUB-PIXEL REFINEMENT OF MOTION VECTORS 2022
  • Pohl Petr
  • Podlesnyy Sergey Yurievich
  • Danilevich Alexey Bronislavovich
  • Yakovenko Alexander Viktorovich
  • Moskovtsev Evgeny Andreevich
  • Aliev Timur Erkinovich
RU2803233C1
METHOD OF ADAPTIVE FRAME PREDICTION FOR MULTIVIEW VIDEO SEQUENCE CODING 2011
  • Fartukov Aleksej Mikhajlovich
  • Kovliga Igor' Mironovich
  • Mishurovskij Mikhail Naumovich
RU2480941C2
RECOGNITION QUALITY ENHANCEMENTS BY INCREASING IMAGE RESOLUTION 2013
  • Zagajnov Ivan Germanovich
  • Loginov Vasilij Vasil'Evich
RU2538941C1
METHOD OF CALCULATING MOVEMENT WITH OCCLUSION CORRECTIONS 2012
  • Sirotenko Mikhail Jur'Evich
  • Pol' Petr
  • Efimov Sergej Vikent'Evich
  • Bucha Viktor Valentinovich
RU2517727C2
RECORDING AND CREATING STEREO IMAGES AND STEREO VIDEO IN REAL TIME USING MONOSCOPIC LOW-POWER MOBILE DEVICE 2007
  • Van Khaokhun
  • Li Sian-Tsun'
  • Mandzhunatkh Sharatkh
RU2417548C2
MOTION ESTIMATION THROUGH THREE-DIMENSIONAL RECURSIVE SEARCH (3DRS) IN REAL TIME FOR FRAME CONVERSION (FRC) 2017
  • Pohl Petr
  • Kovliga Igor Mironovich
  • Anisimovskiy Valery Valerievich
  • Gruzdev Alexey Mikhailovich
  • Arzumanyan Roman
RU2656785C1
DEVICE AND METHOD TO PROCESS IMAGES AND DEVICE AND METHOD OF IMAGES DISPLAY 2008
  • Ueno Masafumi
  • Jamamoto Kenitirokh
  • Furukava Khirojuki
  • Josida Jasukhiro
  • Josii Takasi
  • Tsubaki Ikuko
RU2419243C1
BACKGROUND HYBRID RETOUCH METHOD FOR 2D TO 3D CONVERSION 2014
  • Pohl Petr
  • Molchanov Alexander Alexandrovich
  • Shamsuarov Artem Gennadyevich
  • Zaitsev Alexey Dmitrievich
RU2576490C1
METHOD FOR AUTOMATIC RETRIEVAL OF KEY FRAME INDICES FOR VIDEO DATA EXTENSION 2014
  • Pohl Petr
RU2577486C2

RU 2 786 784 C1

Authors

Ilichev Sergej Dmitrievich

Kovliga Igor Mironovich

Pogl Petr

Dates

2022-12-26Published

2022-04-29Filed