ALGORITHM OF INTEGRATED REMOTE CONTACTLESS MULTICHANNEL ANALYSIS OF PSYCHOEMOTIONAL AND PHYSIOLOGICAL STATE OF OBJECT BASED ON AUDIO AND VIDEO CONTENT Russian patent published in 2019 - IPC A61B5/16 A61B3/113 A61B5/488 H04N5/76 

FIELD: medicine.

SUBSTANCE: invention refers to medicine, namely to neurocognitive studies, and can be used for complex remote noncontact multichannel analysis of a psychoemotional and physiological state of a subject based on audio-video data containing information on a subject. Disclosed is a method, characterized by the fact that obtaining audio-visual data is carried out continuously and dynamically, and as channels of source data one of the following combinations is used: optical information channel in combination with an acoustic information channel; optical information channel in combination with an oculographic information channel; an optical information channel in combination with the proximity and kinetic information channels; an optical information channel in combination with a physiological data channel; an optical information channel in combination with a semantic information channel; acoustic information channel in combination with an oculographic information channel; an acoustic information channel in combination with a proximity and kinetic information channels; an acoustic information channel in combination with a physiological data channel; an acoustic information channel in combination with a semantic information channel; an oculographic information channel in a combination with a proximal and kinetic information channels; an oculographic information channel in combination with a physiological data channel; oculographic information channel in combination with semantic information channel; a proximal and kinetic information channels in combination with a physiological data channel; proxemic and kinetic information channels in combination with semantic information channel; physiological data channel in combination with a semantic information channel, using a matrix of classes of states of subjects, state of which is evaluated using trained computer algorithms, according to results of analysing source data from corresponding channels, one or more integrated estimates of state of living subject, which are then superimposed on a matrix of state classes of subjects in order to determine a logical region characterizing the state of a living subject, wherein interpretation of results is carried out using mathematical-statistical methods, which operate with pre-compiled data bank, containing information on state patterns and their evaluation.

EFFECT: invention provides obtaining information on the physiological and psychoemotional state of the body directly from the video image and sound recording.

5 cl