METHOD OF CONTROLLING TELEVISION USING MULTIMODAL INTERFACE Russian patent published in 2011 - IPC G06F3/48 G09G5/00 H04N5/44 

FIELD: information technology.

SUBSTANCE: method of controlling television using a multimodal interface (MMI) involves visual interaction between a user and the television display system. The MMI, which contains a television control system in form of a personal computer, a video camera and a microphone, is used to control the television through interaction of the user with the television display system using a user detection and recognition algorithm, a gesture recognition algorithm and an algorithm for recognising voice signals and extrapolating the dynamic data series of these algorithms using defined formulae which mathematically express the relationship of algorithms of these three modalities which interact with the MMI graphic menu. Mathematical analysis is employed to detect algorithms of three sets of television signal control instructions which are included in the data base and memory of the MMI. As a result, the MMI automatically detects user-specific algorithms of the three sets of signal instructions interacting with the graphic menu, and executes them through television control.

EFFECT: broader interaction between the user and the television display system.

9 dwg