FIELD: data transmission.
SUBSTANCE: invention relates to means of receiving and playing audio and video streams. Video signals are decoded from video streams to present an environment of virtual reality (VR), augmented reality (AR), mixed reality (MR), or panoramic video to the user. Audio signals are decoded from audio streams to represent audio scenes. At least one audio stream is requested and/or received from the server based on the current field of view of the user and/or user position data and/or the orientation of the head of the user and/or user movement data and/or user metadata and/or user virtual position data and/or metadata. Requesting at least one stream from the server is controlled based on the distance of the position of the user from the boundaries of neighboring and/or adjacent video environments associated with different audio scenes. The first audio elements in the first audio streams therein are more relevant and/or audible than the second audio elements in the second audio streams. The first audio streams are requested and/or received at a higher bit rate than the bit rate of the second audio streams.
EFFECT: technical result is increased efficiency of receiving and playing audio and video streams.
47 cl, 19 dwg
Title | Year | Author | Number |
---|---|---|---|
OPTIMIZING SOUND DELIVERY FOR VIRTUAL REALITY APPLICATIONS | 2018 |
|
RU2765569C1 |
OPTIMIZING AUDIO DELIVERY FOR VIRTUAL REALITY APPLICATIONS | 2022 |
|
RU2801698C2 |
METHOD AND DEVICE FOR EFFECTIVE DELIVERY AND USE OF AUDIO COMMUNICATIONS FOR HIGH QUALITY OF PERCEPTION | 2018 |
|
RU2744969C1 |
AUDIO DEVICE AND AUDIO PROCESSING METHOD | 2019 |
|
RU2823573C1 |
AUDIO DEVICE AND AUDIO PROCESSING METHOD | 2019 |
|
RU2815366C2 |
AUDIO DEVICE AND AUDIO PROCESSING METHOD | 2019 |
|
RU2815621C1 |
AUDIO DEVICE AND AUDIO PROCESSING METHOD | 2019 |
|
RU2798414C2 |
DEVICE AND METHOD FOR PROCESSING AUDIOVISUAL DATA | 2019 |
|
RU2805260C2 |
ENCODING AND DECODING MULTICHANNEL AUDIO USING DIRECTIVITY METADATA | 2020 |
|
RU2826480C1 |
AUDIO DEVICE AND METHOD THEREFOR | 2020 |
|
RU2804014C2 |
Authors
Dates
2021-06-29—Published
2018-10-11—Filed