Immersive Multi-Robot Telepresence

Immersive Multi-Robot Control and Interaction

Telepresence System Overview

Telepresence System Overview

Description

This project focuses on developing advanced multi-robot telepresence systems using the Omnideck - a 360 Treadmill, allowing users to control and interact with robots remotely. It incorporates real-time video streaming, haptic feedback, and intuitive control interfaces.

Project Details

This project shows how interesting immersive remote interaction is. By combining several robots such as Unitree's Aliengo, TiaGo and a DJI Tello Drone with a private dockerized cloud communication, we have created a system that allows users to have a physical presence in distant locations. A user can literally embody each robot and walk and see from its prespective. Key features include: • Ultra-low latency video streaming • Precision control models and systems for natural movement where each robot has its own model • Haptic feedback for enhanced sensory experience • Integration with VR/AR and Omnideck Treadmill for immersive control This technology has applications in various fields, from healthcare and education to industrial inspections and space exploration.

At a Glance

CategoryResearch