FIELD: computer technology.
SUBSTANCE: present invention relates to the field of computer technology for the segmentation of video sequence scenes. The effect is achieved by defining features for each frame of the video sequence in each of the data streams; performing vectorization of said features in each of said data streams; normalizing the vector representations obtained in each stream and then concatenating the normalized vector representations to obtain a common set of features for each frame of the video sequence as a single vector; determining a distance metric for each data stream as a cosine distance between vectors for video face images and as a Euclidean distance between vectors for text data and content images; calculating, based on said metrics, an indicator of a common metric for said single vector characterizing each frame of the video sequence; performing segmentation of the video sequence into context-related scenes based on a comparison of the obtained single vector representations of frames in vector space, while the division is performed based on exceeding the threshold value of the common metric of vector representations of the common vectors of frames of the video sequence.
EFFECT: improving the accuracy of determining contextual scenes for video segmentation, due to the parallel analysis of the data streams that form the video.
7 cl, 4 dwg
Title | Year | Author | Number |
---|---|---|---|
METHOD FOR OBTAINING LOW-DIMENSIONAL NUMERIC REPRESENTATIONS OF SEQUENCES OF EVENTS | 2020 |
|
RU2741742C1 |
DEVICE FOR SEMANTIC CLASSIFICATION AND SEARCH IN ARCHIVES OF DIGITIZED FILM MATERIALS | 2016 |
|
RU2628192C2 |
CLASSIFICATION OF CONTENT FOR PROCESSING MULTIMEDIA DATA | 2006 |
|
RU2402885C2 |
VIDEO PROCESSING METHOD FOR VISUAL SEARCH PURPOSES | 2018 |
|
RU2693994C1 |
METHOD AND DEVICE FOR HIGHLY EFFICIENT COMPRESSION OF LARGE-VOLUME MULTIMEDIA INFORMATION BASED ON THE CRITERIA OF ITS VALUE FOR STORING IN DATA STORAGE SYSTEMS | 2016 |
|
RU2654126C2 |
ENCODER, DECODER, ENCODING METHOD, DECODING METHOD AND FRAME COMPRESSION PROGRAM | 2019 |
|
RU2784381C2 |
METHOD AND SYSTEM FOR DETERMINING SYNTHETICALLY MODIFIED FACE IMAGES ON VIDEO | 2021 |
|
RU2768797C1 |
DETECTING OBJECTS FROM VISUAL SEARCH REQUESTS | 2017 |
|
RU2729956C2 |
METHOD AND APPARATUS FOR DETECTING GAME INCIDENTS IN FIELD SPORTS IN VIDEO SEQUENCES | 2012 |
|
RU2526049C2 |
METHOD FOR DECODING VIDEOS AND IMAGES USING BLOCK SEGMENTATION | 2019 |
|
RU2808103C2 |
Authors
Dates
2022-11-15—Published
2022-06-16—Filed