Description: We present our work of enabling HPC in an interactive real-time autonomy loop. The workflow consists of many different software components deployed within Singularity containers and communicating using both the Robotic Operating System's (ROS) publish-subscribe system and the Message Passing Interface (MPI). We use Singularity's container networking interface (CNI) to enable virtual networking within the containers, so that multiple containers can run the various components using different IP addresses on the same compute node. The Virtual Autonomous Navigation Environment Environmental Sensor Engine (VANE: ESE) is used for physically-realistic simulation of LIDAR along with the Autonomous Navigation Virtual Environment Laboratory (ANVEL) for vehicle simulation. VANE:ESE sends Velodyne UDP LIDAR packets directly to the Robotic Technology Kernel (RTK) and is distributed across multiple compute nodes via MPI along with OpenMP for shared memory parallelism within each compute node. The user interfaces with the navigation environment using an XFCE desktop with virtual workspaces running over a VNC containerized deployment through a double-hop ssh tunnel, which uses noVNC (a JavaScript-based VNC client) to provide a browser-based client interface. We automate the complete launch process using a custom iLauncher plugin. We benchmark scalable performance with multiple vehicle simulations on four different HPC systems and discuss our findings.

Presenter(s): Dr. Wesley Brewer, GDIT/PET
Location: IEEE High Performance Extreme Computing Virtual Conference
Date & Time: September 19, 2022, 12:45p - 1:00p ET

Controlled by: DoD HPCMP
Controlled by: PET Program
CUI Category: OPSEC
Limited Dissemination Control: FEDCON
POC: Mr. Ronald Hedgepeth, pet@hpc.mil

CUI

technical_area: Programming Environments`Software Refactoring