Autonomous Systems
This area collects the Cognitive Autopilot / ASR-D501 integration guides. Start with the platform and demo architecture, then follow the camera inference guide for the obstacle-avoidance scenario.
Choose a guide
| Guide | What it covers |
|---|---|
| ASR-D501 Flight Integration | Hardware components, environment setup, and the camera, LiDAR, IMU, and system-monitor demo modules. |
| Downloading Qualcomm AI Hub Models | Utilizing Qualcomm AI Hub to optimize, quantize, and export a model tailored for the qualcomm chipset. |
| Object Detection with MIPI Camera | Using a MIPI camera to run real-time AI inference directly on the edge device. |
| Obstacle Avoidance with USB Camera | Using a USB camera to run live inference, and connecting to the flight controller. |
| LiDAR Integration | Configuring the 2D LiDAR to capture high-precision distance data and point clouds for enhanced spatial awareness and environmental perception. |
| IMU Dashboard | Configuring the Xsens MTi IMU, integrating ROS 2 drivers for robust 9-axis attitude estimation, and monitoring live sensor data using a custom dashboard. |
| System Monitor | Retrieving real-time hardware metrics (CPU, GPU, NPU, and DDR temperature) from Linux virtual files and visualizing them via a dashboard. |
Suggested reading order
- Review the ASR-D501 Flight Integration guide to identify the hardware and software used in the demo.
- Follow the Downloading Qualcomm AI Hub Models guide to select, compile, and export a hardware-accelerated model.
- Follow the Object Detection with MIPI Camera guide to deploy the AI model for real-time video stream inference.
- Follow the Obstacle Avoidance with USB Camera guide to run real-time obstacle detection using a 3D camera and understand how it connects to the flight controller.
- Follow the LiDAR Integration guide to enable spatial mapping and long-range detection capabilities.
- Follow the IMU Dashboard guide to configure the ROS 2 drivers and ensure robust attitude estimation for flight stability.
- Check the System Monitor guide to learn how to track critical system resources and thermal states when running workloads.
The companion computer and flight controller have different roles: the ASR-D501 runs the perception and application logic, while the flight controller handles low-level flight control.