METHOD FOR REGULARIZING GRADIENTS WHEN TRAINING DEEP NEURAL NETWORK IN ALGORITHM FOR INCREASING FRAME RATE OF VIDEO IMAGE WITH IMAGE DEFORMATION OPERATION AND DEVICE AND MACHINE-READABLE MEDIUM REALIZING SAID METHOD Russian patent published in 2025 - IPC H04N7/14 G06T3/4007 G06V10/40 

Abstract RU 2838424 C1

FIELD: processing of video images.

SUBSTANCE: invention relates to video processing, and in particular to time interpolation of video frames to increase frame rate (FPS) of video. Disclosed is a video frame rate conversion (FRC) method comprising steps of: obtaining at least two video key frames (KF) from an input video frame sequence; generating at least one interpolated frame for adding to the video image frame sequence based on at least one of the KF, wherein the formation of at least one interpolated frame comprises steps of estimating motion vectors (MV) for at least one pixel of each block of the interpolated frame using a trained motion estimation algorithm (ME), trained using loss function gradients regularization by selection of estimated motion vectors from optical flow and modification of fractional parts of coordinates of selected motion vectors with back propagation of error without taking into account of said modification and/or using finite-difference approximation of spatial derivatives of key frames (KF) brightness with back propagation of error; obtaining at least one interpolated frame by performing motion compensation using said at least one key frame (KF) and motion vectors (MV) obtained by said estimation of motion vectors; adding the obtained at least one interpolated frame to the sequence of frames of the video image; and outputting a sequence of video frames with an increased number of frames. Invention also discloses a device and a machine-readable medium which realizes said method.

EFFECT: high quality of converting the frame rate of a video image.

1 cl, 9 dwg, 1 tbl

Similar patents RU2838424C1

Title Year Author Number
METHOD OF INTERPOLATING VIDEO FRAMES TAKING INTO ACCOUNT REPEATING STRUCTURES AND DEVICE AND CARRIER IMPLEMENTING SAID METHOD 2024
  • Pohl Petr
  • Fetisov Iurii Gennadievich
  • Kovliga Igor Mironovich
  • Zubiuk Andrei Vladimirovich
  • Lomaev Mikhail Sergeevich
  • Konovalchuk Dmitrii Sergeevich
  • Bae Sujung
RU2836221C1
FRC OCCLUSION PROCESSING WITH DEEP LEARNING 2020
  • Ilichev Sergei Dmitrievich
  • Kovliga Igor Mironovich
  • Pohl Petr
  • Rakova Kristina Olegovna
RU2747965C1
METHOD FOR SPATIALLY PARAMETERIZED ESTIMATION OF MOTION VECTORS 2024
  • Pohl Petr
  • Podlesnyy Sergey Yurievich
  • Moskovtsev Evgeniy Andreevich
  • Aliev Timur Erkinovich
  • Yakovenko Alexander Victorovich
RU2839709C1
FRAME RATE CONVERSION METHOD SUPPORTING FRAME INTERPOLATION REPLACEMENT WITH MOTION COMPENSATION BY LINEAR FRAME COMBINATION AND DEVICE IMPLEMENTING IT 2022
  • Ilichev Sergej Dmitrievich
  • Kovliga Igor Mironovich
  • Pogl Petr
RU2786784C1
METHOD OF CODING VIDEO SIGNALS, SUPPORTING FAST ALGORITHM OF PRECISE SCALABILITY ON QUALITY 2006
  • Khan Voo-Dzin
  • Li Kio-Khiuk
  • Cha Sang-Chang
RU2340115C1
DEVICE AND METHOD TO PROCESS IMAGES AND DEVICE AND METHOD OF IMAGES DISPLAY 2008
  • Ueno Masafumi
  • Jamamoto Kenitirokh
  • Furukava Khirojuki
  • Josida Jasukhiro
  • Josii Takasi
  • Tsubaki Ikuko
RU2419243C1
IMAGE PROCESSING METHOD AND SYSTEM FOR FORMING SUPERHIGH-RESOLUTION IMAGES 2016
  • Petrova Ksenia Yurievna
  • Sultanov Dmitry Alexandrovich
RU2635883C1
MOTION ESTIMATION THROUGH THREE-DIMENSIONAL RECURSIVE SEARCH (3DRS) IN REAL TIME FOR FRAME CONVERSION (FRC) 2017
  • Pohl Petr
  • Kovliga Igor Mironovich
  • Anisimovskiy Valery Valerievich
  • Gruzdev Alexey Mikhailovich
  • Arzumanyan Roman
RU2656785C1
VIDEO DISPLAY DEVICE 2008
  • Khasimoto Mitsuru
  • Takanezava Jasunori
RU2461979C2
METHOD AND SYSTEM FOR IMAGE PROCESSING 2014
  • Glazistova Evgeniya Mikhailovna
  • Zheludev Mikhail Valerievich
  • Petrova Kseniya Yurievna
RU2583725C1

RU 2 838 424 C1

Authors

Zubiuk Andrei Vladimirovich

Konovalchuk Dmitrii Sergeevich

Lomaev Mikhail Sergeevich

Fetisov Iurii Gennadievich

Kovliga Igor Mironovich

Bae Sujung

Dates

2025-04-16Published

2024-10-04Filed