METHOD AND SYSTEM FOR ANALYSIS OF VOICE CALLS FOR SOCIAL ENGINEERING DETECTION AND PREVENTION USING VOICE BOT ACTIVATION Russian patent published in 2023 - IPC G06F17/00 

FIELD: computer technology

SUBSTANCE: processing of data from incoming audio calls to classify the presence of fraudulent activities. The claimed technical result is achieved by performing a computer-implemented method of analyzing the dialogue during audio calls to detect fraudulent activity, performed by the processor and comprising the steps of: receiving an incoming audio stream coming from the calling party; processing the incoming audio stream using at least one machine learning model, during which: convert the incoming audio stream into a vector form; perform a comparison of the vector form of the audio stream with previously stored vectors characterizing the fraudulent activity; perform transcription of the audio stream to analyze the dialogue of the calling party for at least the semantic composition of the information and the pattern of the dialogue; classify the incoming audio stream based on the processing performed.

EFFECT: increase in the efficiency and accuracy of recognizing fraudulent activity in incoming audio calls due to the combined analysis of the audio stream and the semantics of the dialogue pattern.

12 cl, 5 dwg