FIELD: information technology.
SUBSTANCE: method of multimodal user service performed by the application server includes the steps of receiving, on the management path, an indication that the gesture was recognized based on the video data sent from the client device to the gesture server received from the client device, sending a message with the result of recognizing the gesture, which prescribes an update in accordance with the result of recognition; receiving from the client device an indication that the visual display is updated in accordance with the recognition result, sending a message to the gesture server and sending a message to the service robot with a speech recognition result that instructs the service robot to execute the corresponding program of actions.
EFFECT: increased reliability of interaction between service robots.
3 cl, 5 dwg
