Project Abstract

We have crafted a project that delves into the realm of human-robot interactions within virtual reality (VR) environments, an area ripe with unexplored potential. Our endeavour aims to amalgamate existing research to unearth novel methods for human-robot engagement in virtual spaces. The primary goal is to utilize Unity3D to construct an application enabling control of the NAO robot through an Oculus Quest 2 headset. Our approach involved the development of Python scripts leveraging SoftBank Robotics’ Python SDK for NAO robot control, coupled with the creation of a VR environment in Unity using the XR Interaction Toolkit. Additionally, we established TCP/IP network connections to facilitate seamless communication between Unity and the robot. Within our VR environment we have created a panel that allows the user to select a variety of different actions that can be completed. This is then sent to the robot via the network connection and starts the python script the is pre-loaded on to the robot. The development of this application hopes to make an impact to the industries that might find it useful. For example, academia with the use a VR school setting but also industries like medicine that can use it to help with the therapy of children with severe learning disabilities. To conclude this project will allow users to interact with other users remotely via the robot.

Keywords: Robotics, Virtual Reality, Human-Computer Interactions

 Conference Details

Session: Poster Session B at Poster Stand 65

Location: Sir Stanley Clarke Auditorium at Wednesday 8th 09:00 – 12:30

Markers: Muneeb Ahmad, Lu Zhang

Course: MSci Computer Science, 3rd Year

Future Plans: I’m continuing studies