Skip to content

Usage of Solex CC to create custom controls

mtbsteve edited this page Jan 19, 2020 · 4 revisions

Introduction

Within the original Redtail project, it was required to carry a laptop with a remote connection to the TX2 to start, stop and to control the ROS nodes. With Solex Google Play store and its extension framework Solex-CC it is easily possible to build the required extensions and menus to control the ROS nodes and to launch the drone so that a laptop is (almost) no longer required. Note that Solex needs to be purchased from the Google Play store.

This repository includes the workers for the start menu, the ZED camera control and to launch the drone with the px4 controller via MAVROS.

To install, copy the workers into the Solex-CC workers directory and follow the instructions of Solex-CC to deploy them.

Start Menu Worker

This worker allows to launch and shutdown of:

  • stereo_dnn_ros ap_zed_resnet18_2D_fp16 DNN (includes the zed_wrapper and the ros_rtsp streaming server)
  • caffe_ros ap_zed_ros_trailnet DNN (includes the zed wrapper and ros_rtsp streaming server)
  • darknet-yolo DNN (requires that either the stereo_dnn or caffe_ros node has been initiated before)
  • MAVROS

In addition, you can directly shutdown the TX2.

Start menu

Camera Worker

Camera controls are displayed on th flight screen. You can:

  • start/stop video recording
  • take a picture

Note that it is possible to take a picture during video recording in parallel.

image

With the image node selector, you can choose between:

  • The rectified video image
  • Depth confidence map
  • YOLO object detection and
  • a Full 4 frame view of video, yolo, depth map and a color-code stereo depth map.

For the full 4 frame view the stereoDNN node must be up and running.

image

Launch Drone Worker

On the bottom of the flight screen you will find a red "Launch Drone on Trailnet" button. By pressing this button, the px4 controller ROS node will be launched, the results of trailnet DNN analyzed, and the corrresponding autonomous steering actions transmitted via MAVROS to the flight controller.

Pressing the button agail will cancel that node, the drone will return to AltHold mode and control is given back to RC.

Clone this wiki locally