Joshua Brown (2141679) Joshua Brown

Virtual Reality for Controlling and Interacting with Robots

Project Abstract

This project seeks to help incorporate the use of robotics and virtual reality within different fields with a focus on assisting those living with difficulties such as autism spectrum disorder (ASD). This project has immense potential especially within an every growing environment for both virtual reality and humanoid robotics. The main aim of this project is to develop a software that allows the user to control a NAO robot through the use of a VR headset specifically the Meta Quest 2. This will be implemented through the use of the PePut toolkit which allows for a connection between the NAO robot and the Unity Game Engine. This can then be expanded to connect to the Meta Quest 2 through the plugins available for Unity. As a result of this study a VR controlled NAO robot was developed with a mock-up of the robotics lab also being created to create an immersive experience for the user. The robot gain the ability to move around, go to premade positions by Aldebaran as well as more precise movement detected from the users physical arm position. The conclusion from this study is that the development of humanoid robots in conjunction with virtual reality is a field of study that will help drive the next wave of revolutionary technology.

Keywords: Robotics, Virtual Reality, HCI

 

 Conference Details

 

Session: Poster Session B at Poster Stand 112

Location: Sir Stanley Clarke Auditorium at Wednesday 8th 09:00 – 12:30

Markers: Muneeb Ahmad, Yuanbo Wu

Course: MSci Computer Science FI, 3rd Year

Future Plans: I have a job lined-up