TRAINING-DEMONSTRATION MODULE AND TRAINING SYSTEM FOR DEAF, DUMB AND DEAF-MUTE PEOPLE OF COLLOQUIAL SPEECH Russian patent published in 2020 - IPC G06T1/00 G09B21/00 

FIELD: physics.

SUBSTANCE: invention relates to the field of education, in particular, to surdopedagogy, and is intended for visual training of people with disabilities by hearing and/or speech semantics of spoken words and can be used as a teaching aid. Training and demonstration module 1 (TDM) includes memory 2 and information input/output processor 3, consumer display device in real time mode. Memory 2 includes video files of images of an object or action or phenomenon 4 (OAP) in physical space, file 5 of writing a word identifying the name of the OAP, and file 6 of the sign language semantics by its writing with characteristic gestures of fingers, hands and facial expression of sign language interpretation, integrated with processor 3 with the possibility of synchronous output of video recordings of files 4, 5 and 6 of video images of images into separate windows 16, 17, 18 of consumer display device 9. Sign language translation file is configured to represent a sign language interpreter by an animation character. Module 4 is configured to: display a OAP in the form of two-dimensional (2D) or three-dimensional (3D) model; to produce OAP sounds 4 and to perceive the name of OAP through verbal speech. Training system comprises server 7 adapted to consumer display devices 9 in real time mode for viewing and changing images, a separating content insert control module 10 connected to image database 8 and a separating content database 11 including a lexeme dictionary base 12 with codes which are authentically spelled and a spell correction module 13 for inputting the word. Image database 8 includes TDM unit 14 performing sign language sign language semantics for writing thereof, inputs of which are connected by bus 15 to TDM unit 14, wherein the latter is connected to separating content insert control module 10 with the possibility of synchronous output of the video files of the sign-language video-recording files from the UDM-1 to the consumer display device 9 by the instruction of the separating content insertion control module 10 according to the code, the authentic writing of the word entered by the consumer from the virtual keyboard of the consumer display device. TDM module 1 is recorded on an external storage device adapted to consumer display device 9. Consumer display device used is a smartphone and/or a personal computer.

EFFECT: technical result is higher efficiency of training of deaf, mute and deaf-mute people of colloquial speech due to higher quality of training of people with disabilities by ear and/or speech by expanding demonstration capabilities of sign language interpretation for training and understanding the semantics of words of colloquial language in writing and the image of the identified object, action or phenomenon with result display on the consumer display device in real time.

8 cl, 2 dwg