Printed from

MIT students make Minority Report-style iPad control system

updated 03:02 pm EDT, Fri May 25, 2012

iPad and glove combination used to control virtual objects

Researchers at the MIT Media Lab have created a Minority Report-style glove and iPad input system for three-dimensional virtual object manipulation called T(ether). The system lets the team use motion tracking on gloves to create and alter virtual items with the iPads used as a point-of-view window to see what the users are manipulating. A demonstration video shows the system having multiple users simultaneously affecting the compter-generated world, both with and without the glove.

The iPad and glove have markers that are seen by Vicon motion-capture cameras, which in turn feeds the positioning data to a central server. Data includes states of individual virtual objects, as well as the co-ordinates and orientation of the tablet, in order to correctly render a scene. Gestures performed by the glove, such as pinching together a finger and thumb, tell the server to add, remove or alter an object. Users can also draw on the iPad, with the system working out where on the screen the finger is pressing and relating it to the iPad's position in order to create three-dimensional line drawings.

Due to the way that the system relies upon a motion-capture rig instead of the camera on the iPad, it is unlikely for it to be appearing on an iPad for consumer use any time soon. It has potential use in a corporate environment, most likely for animation and design purposes.

The object-tracking capabilities could be compared to Google's recent Project Glass patent filing, which described using two camera points to track a uniquely decorated item such as a ring. However, that system would only be able to deal with volumetric data within a close range of the wearer's eyeline, and based on the demonstration video, Google appears to be more concerned about menu navigation. [via Cult of Mac]

By Electronista Staff
Post tools:




  1. Arne_Saknussemm

    Forum Regular

    Joined: Apr 2011


    AWESOME tech!

    but did I mention the Mac Pro is DEAD!!!

  1. BigMac2

    Forum Regular

    Joined: Dec 2000



    Can you enlightened us what is the relation between your brain dead post and the related news?

  1. macnnoel

    Fresh-Faced Recruit

    Joined: Feb 2005


    without apps

    this will remain a novelty.

Login Here

Not a member of the MacNN forums? Register now for free.


Network Headlines


Most Popular


Recent Reviews

Apple 13-inch MacBook Pro (Early 2015)

Although the new darling of the Apple MacBook line up is the all-new MacBook, Apple has given its popular 13-inch MacBook Pro with Ret ...

Seagate Wireless

It seems like no matter how much internal storage is included today's mobile devices, we, as users, will always find a way to fill the ...

Lenovo Yoga Tablet 2 (Android, 10.1-inch)

Lenovo is building a bigger name for itself year after year, including its devices expanding beyond desktop computers. The company's l ...



Most Commented


Popular News