NEURAL NETWORK SYSTEMS AND COMPUTER-IMPLEMENTED METHODS OF IDENTIFYING AND/OR EVALUATING ONE OR MORE FOOD PRODUCTS IN VISUAL INPUT INFORMATION Russian patent published in 2022 - IPC G06N3/02 G06V10/40 G06Q50/10 

FIELD: data processing.

SUBSTANCE: invention relates to a method, a system and a data medium for processing a video stream for identifying and evaluating the quality of pizza production. Method comprises receiving, by a processor, a continuous video stream from at least one camera position above a table configured to receive ready pizzas; collecting, using the processor, a plurality of video frames of the pizza containing video frames of the selected pizza from the video stream; using the processor to use a first convolutional neural network (CNN) to select a set of video frames of the selected pizza with the highest rating from the plurality of video frames of the pizza; using the processor first CNN to identify the image of the selected pizza with the highest rating from the set of video frames of the highest rated pizza; using the processor first CNN to localize at least one portion of the selected pizza in the identified image with the highest rating pizza; using the processor of the first CNN to determine the type of the selected pizza from the identified image with the highest rating pizza; using the processor to use a second convolutional neural network (CNN) to set a map of components of the selected pizza as a result of automatically performing segmentation of the image of the portion of pizza based on at least the type of pizza; and applying, by means of a processor, a second CNN for automatically scoring a selected pizza based on a given pizza component map, comprising: dividing, using a processor, a portion of pizza from the identified best image into a plurality of slices; calculating, using the processor, gradients of one of the plurality of slices of the selected pizza; repeating, by the processor, the step for calculating gradients of the remaining slices from the plurality of slices; and determining, using the processor, the final score of the selected pizza based on the calculation of gradients of the plurality of slices.

EFFECT: high accuracy of recognizing objects in a video stream.

30 cl, 23 dwg, 1 tbl