FIELD: processing of video images.
SUBSTANCE: invention relates to video processing, and in particular to time interpolation of video frames to increase frame rate (FPS) of video. Disclosed is a video frame rate conversion (FRC) method comprising steps of: obtaining at least two video key frames (KF) from an input video frame sequence; generating at least one interpolated frame for adding to the video image frame sequence based on at least one of the KF, wherein the formation of at least one interpolated frame comprises steps of estimating motion vectors (MV) for at least one pixel of each block of the interpolated frame using a trained motion estimation algorithm (ME), trained using loss function gradients regularization by selection of estimated motion vectors from optical flow and modification of fractional parts of coordinates of selected motion vectors with back propagation of error without taking into account of said modification and/or using finite-difference approximation of spatial derivatives of key frames (KF) brightness with back propagation of error; obtaining at least one interpolated frame by performing motion compensation using said at least one key frame (KF) and motion vectors (MV) obtained by said estimation of motion vectors; adding the obtained at least one interpolated frame to the sequence of frames of the video image; and outputting a sequence of video frames with an increased number of frames. Invention also discloses a device and a machine-readable medium which realizes said method.
EFFECT: high quality of converting the frame rate of a video image.
1 cl, 9 dwg, 1 tbl
Title | Year | Author | Number |
---|---|---|---|
METHOD OF INTERPOLATING VIDEO FRAMES TAKING INTO ACCOUNT REPEATING STRUCTURES AND DEVICE AND CARRIER IMPLEMENTING SAID METHOD | 2024 |
|
RU2836221C1 |
FRC OCCLUSION PROCESSING WITH DEEP LEARNING | 2020 |
|
RU2747965C1 |
METHOD FOR SPATIALLY PARAMETERIZED ESTIMATION OF MOTION VECTORS | 2024 |
|
RU2839709C1 |
FRAME RATE CONVERSION METHOD SUPPORTING FRAME INTERPOLATION REPLACEMENT WITH MOTION COMPENSATION BY LINEAR FRAME COMBINATION AND DEVICE IMPLEMENTING IT | 2022 |
|
RU2786784C1 |
METHOD OF CODING VIDEO SIGNALS, SUPPORTING FAST ALGORITHM OF PRECISE SCALABILITY ON QUALITY | 2006 |
|
RU2340115C1 |
DEVICE AND METHOD TO PROCESS IMAGES AND DEVICE AND METHOD OF IMAGES DISPLAY | 2008 |
|
RU2419243C1 |
IMAGE PROCESSING METHOD AND SYSTEM FOR FORMING SUPERHIGH-RESOLUTION IMAGES | 2016 |
|
RU2635883C1 |
MOTION ESTIMATION THROUGH THREE-DIMENSIONAL RECURSIVE SEARCH (3DRS) IN REAL TIME FOR FRAME CONVERSION (FRC) | 2017 |
|
RU2656785C1 |
VIDEO DISPLAY DEVICE | 2008 |
|
RU2461979C2 |
METHOD AND SYSTEM FOR IMAGE PROCESSING | 2014 |
|
RU2583725C1 |
Authors
Dates
2025-04-16—Published
2024-10-04—Filed