UAV Operator Interface Using Georeferenced Augmented Reality
The current methods of operator-UAV interaction are largely derived from interfaces used in manned aviation. Typically, these interfaces consist of two or more screens that display a two-dimensional map of the UAV's flight path and the readings from onboard sensors transmitted digitally through onboard telemetry. In some cases, particularly when using a first-person piloting method, information from onboard sensors is overlaid on the flight screen as a two-dimensional interface on the video feed, known as OSD (On-Screen Display). This type of information presentation forces operators to constantly shift their attention between piloting screens and mission displays, distracting them and reducing their operational accuracy. Moreover, while optical or acoustic flow methods can provide estimates of linear and/or angular movement speeds, such data alone is insufficient for effective navigation. Operators also need to know their precise position coordinates and spatial orientation, which requires integrating data from various onboard devices. This raises the challenge of data fusion from heterogeneous sources, leading to the proposal of developing a hardware-software complex (HSC) that addresses the shortcomings of existing systems. The innovative aspect of the proposed project lies in the implementation of a high-definition video transmission system, seamlessly integrated with cutting-edge UAV operator interface utilizing augmented reality. Consequently, this allows the overlay of virtual 3D images with specific geographic coordinates onto the video stream in real-time. Such an interface type can effectively blend real-world objects with three-dimensional visualizations of processes or items that the operator interacts with, providing them with insights into scenarios that a real-time camera cannot depict, thus enhancing operator accuracy and decision-making.
Sky, Space And Communication Technologies
Drones and drone solutions
1 year
Russia, BRICS countries
The project offers several competitive advantages that distinguish it from existing UAV operator interfaces and enhance user experience. 1. **Advanced Augmented Reality Integration**: The proposed interface utilizes augmented reality (AR) to overlay virtual 3D imagery onto video feeds, providing operators with improved situational awareness. This immersive experience enables better visualization of critical data compared to traditional two-dimensional displays, enhancing decision-making and operational efficiency. 2. **Proprietary Data Transmission Protocol**: The development of a proprietary protocol for seamless data transmission allows for the integration of high-definition video and telemetry data with frame-by-frame synchronization. This consolidated view of video and performance metrics enhances operators' navigation capabilities, giving it an edge over systems that struggle with data integration. 3. **Real-Time Data Fusion and Visualization**: The project excels in merging real-time information from various onboard devices, combining positional coordinates and sensor data with visual feeds. This integrated approach promotes situational context for UAV operators, improving their understanding and responsiveness during missions. 4. **User-Friendly Interface Design**: The interface prioritizes user experience with intuitive design that minimizes cognitive load. By reducing the need for operators to switch between multiple screens, the system enhances focus and decreases the risk of errors, setting it apart from more cumbersome setups. 5. **Broader Application Spectrum**: The innovative features make the system applicable across various sectors, including defense, agriculture, and commercial services. This versatility attracts a wider customer base, increasing market potential. By leveraging these advantages, the project stands out in the UAV industry, offering superior technical capabilities and a transformative user experience that enhances operational outcomes across multiple sectors.
InHub 2022 (Novosibirsk,2022) - Silver medal
Rospatent RU2023683859
