Researchers at NASA's Jet propulsion Laboratory have reportedly been experimenting with controlling robots through the use of Microsoft's Xbox One Kinect sensor and the new virtual reality headset from Oculus Rift.
According to reports from IGN, the team in question has been using the gaming technology as a means to control a robotic arm called JACO in real time. NASA says the way it works is simply by combining the position tracking from the Kinect's data readout with the rational tracking of the oculus Rift's VR sensor to create a first-person view of their operator. Once the operator is set and the view is oriented properly, the person using the system can perform simple tasks with the arm such as picking up blocks.
According to NASA, if the remainder of the tests on the technology prove successful, future applications of this system will include use aboard the Robonaut 2 humanoid on the International Space Station. Why risk any lives with a space walk when someone can send a robot and control it with the same technology that's now found its way into countless living rooms across the world.
While Kinect is making one of its first appearances with the United State's space program, this is the Oculus Rift's second project. Previously in 2013, NASA used the technology on the Jet Propulsion Laboratory. They paired an Oculus Rift headset with an Omni treadmill in order to recreate the conditions and feel to give people and idea of what it's like to walk on the surface of Mars.
The video, seen below, shows the robitc arm and the Kinect/Oculus Rift system setup. After calibrating the body tracker and linking up with the headset, the person demonstrating is able to, very slowly, maneuver the arm in position to grab the block. It also has some cool in-space images of Robonaut 2. Watch the video and then tell us what you think about this emerging robot technology, all based on hardware designed for the world of gamers.
