Skip to main content

Autonomous Systems

This area collects the Cognitive Autopilot / ASR-D501 integration guides. Start with the platform and demo architecture, then follow the camera inference guide for the obstacle-avoidance scenario.

Choose a guide​

GuideWhat it covers
ASR-D501 Flight IntegrationHardware components, environment setup, and the camera, LiDAR, IMU, and system-monitor demo modules.
Downloading Qualcomm AI Hub ModelsUtilizing Qualcomm AI Hub to optimize, quantize, and export a model tailored for the qualcomm chipset.
Object Detection with MIPI CameraUsing a MIPI camera to run real-time AI inference directly on the edge device.
Obstacle Avoidance with USB CameraUsing a USB camera to run live inference, and connecting to the flight controller.
LiDAR IntegrationConfiguring the 2D LiDAR to capture high-precision distance data and point clouds for enhanced spatial awareness and environmental perception.
IMU DashboardConfiguring the Xsens MTi IMU, integrating ROS 2 drivers for robust 9-axis attitude estimation, and monitoring live sensor data using a custom dashboard.
System MonitorRetrieving real-time hardware metrics (CPU, GPU, NPU, and DDR temperature) from Linux virtual files and visualizing them via a dashboard.

Suggested reading order​

  1. Review the ASR-D501 Flight Integration guide to identify the hardware and software used in the demo.
  2. Follow the Downloading Qualcomm AI Hub Models guide to select, compile, and export a hardware-accelerated model.
  3. Follow the Object Detection with MIPI Camera guide to deploy the AI model for real-time video stream inference.
  4. Follow the Obstacle Avoidance with USB Camera guide to run real-time obstacle detection using a 3D camera and understand how it connects to the flight controller.
  5. Follow the LiDAR Integration guide to enable spatial mapping and long-range detection capabilities.
  6. Follow the IMU Dashboard guide to configure the ROS 2 drivers and ensure robust attitude estimation for flight stability.
  7. Check the System Monitor guide to learn how to track critical system resources and thermal states when running workloads.

The companion computer and flight controller have different roles: the ASR-D501 runs the perception and application logic, while the flight controller handles low-level flight control.


← Solution Overview