FIELD: physics.
SUBSTANCE: invention relates to a method of controlling on-board systems of unmanned vehicles using neural networks based on a transformer architecture. Method includes combined processing of output signals of unmanned vehicle sensors. Neural network is trained directly on the input signals of the sensors and outputs the required control signals based on the studied patterns. Architecture of the convolutional neural network directly maps input raw image pixels to control commands. Synthesis network is the basis of the model architecture and is responsible for extraction of environmental characteristics. Path prediction network receives the feature vectors provided by the synthesis network and predicts the next multiple route points for the vehicle. Synthesis network is divided into an image branch and a bird's-eye view branch. Characteristic maps from both branches are transmitted to the input of the transformer module, which performs combined processing of modality branch data.
EFFECT: improving the accuracy and performance of on-board systems of unmanned vehicles.
2 cl, 4 dwg
Title | Year | Author | Number |
---|---|---|---|
METHOD FOR CONSTRUCTING A DEPTH MAP FROM A PAIR OF IMAGES | 2022 |
|
RU2806009C2 |
METHOD AND ELECTRONIC DEVICE FOR DETECTING THREE-DIMENSIONAL OBJECTS USING NEURAL NETWORKS | 2021 |
|
RU2776814C1 |
METHODS AND SYSTEMS FOR GENERATING TRAINING DATA FOR DETECTING HORIZON AND ROAD PLANE | 2020 |
|
RU2767838C1 |
METHODS AND SYSTEMS FOR COMPUTER TO DETERMINE PRESENCE OF OBJECTS | 2018 |
|
RU2743895C2 |
METHOD OF TRAINING A CONVOLUTIONAL NEURAL NETWORK FOR IMAGE RECONSTRUCTION AND A SYSTEM FOR FORMING AN IMAGE DEPTH MAP (VERSIONS) | 2018 |
|
RU2698402C1 |
METHOD OF DETERMINING PARAMETERS OF FOREST | 2024 |
|
RU2828596C1 |
METHOD AND PROCESSOR FOR CLASSIFICATION OF POINTS ON BOUNDARY OF POLYGONAL SECTION | 2023 |
|
RU2836700C1 |
TEXT RECOGNITION USING ARTIFICIAL INTELLIGENCE | 2017 |
|
RU2691214C1 |
METHOD FOR ESTIMATING THE DEPTH OF A SCENE BASED ON AN IMAGE AND COMPUTING APPARATUS FOR IMPLEMENTATION THEREOF | 2020 |
|
RU2761768C1 |
IMAGE RECOGNITION SYSTEM: BEORG SMART VISION | 2020 |
|
RU2777354C2 |
Authors
Dates
2025-06-02—Published
2024-06-28—Filed