What Is Sixth Sense Technology Computer Science

Traditionally, Information is confined to either paper or digitally to a screen. Computing devices allow us to carry computers in our pocket, that connects us to the digital world continuously, but there is no link between digital devices and our interactions with the physical world. Solution of this is 'Sixth Sense Technology'.

'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and let us uses natural hand gestures to interact with that information. It was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab.

Sixth Sense Bridges the gap by bringing intangible , digital information out into the tangible world , and allowing us to interact with this information via natural hand. It comprises a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device (smartphone).

It is a mixture of various technologies like augmented reality, Gesture Recognition, Computer Vision and Radio Frequency Identification.

Augmented Reality is a term for a live direct or indirect view of a physical real world environment whose elements are augmenter by virtual computer generated imagery.

Gesture Recognition is a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms.

Computer Vision is the science and technology of machines that see. It is Connected with the theory behind artificial systems that extract information from images.

Radio Frequency Identification is an electronic tagging technology that allows the detection , tracking of tags and consequently the objects that they are affixed to.

Camera Captures an object in view and tracks the user's hand gestures. Then it Sends All the Data to the Smart phone. Smart phone do further processing on captured data or captured gestures positions. Camera acts as a 'Digital Eye', Connecting person to the world of digital information. It is also use to identify objects like book, surface etc. camera also used to take a picture from real-world. It is Basically located as it's easy to identify gestures of hand.

Projector projects visual information enabling surfaces and physical objects to be used as interfaces. Projector itself contains a battery inside, with 3 hours of battery life which can easily charge just like mobile phones.

A tiny LED projector displays data sent from the smartphone on any surface in view-object, wall, or a person. So person can easily see the information or data on required surface. So this whole device can work on any surface and at anywhere where we wants. Projector is also located at place from where display can easily located or viewable.

Mirror:

Usage of the mirror is significant as the projector dangles pointing downwards from the neck. So it's also easy to display data on any other surface which are not exactly in front side. Mirror is located bellow the projector.

Smart Phone:

A smartphone is a mobile phone that offers more advanced computing ability and connectivity than a contemporary basic feature phone. Smartphones and feature phones may be thought of as handheld computers integrated within a mobile telephone, it allows the user to install and run more advanced applications based on a specific platform. Smartphones run complete operating system software providing a platform for application developers.

So Smartphone with specific Advanced Software can handle data which come from camera, Identify gestures and then process that data and finally displays output by projector to any surface.

It is also web-enabled phone so data can also fetch from Internet also. So any information from web can viewed or can access through projectors by gestures using various software made for this technology only. It is basically located in person's pocket.

Color Markers:

Color Markers are at the tip of the person's fingers. Marking them with red, yellow, green and blue tape which helps webcam to recognize gestures.

The various Movements and arrangements of these markers are interpreted into gestures that act as interaction instructions for the projected application interfaces as per predefined algorithms. Like for opening internet person have to draw '@' symbol by gestures , for take photo from real-world just make rectangle frame by fingers and etc.

How it Works?

The Hardware that makes Sixth Sense work is a pendant like any mobile wearable interface. It has a camera, a Mirror, and a Projector and This all are connected wirelessly to a Bluetooth enabled Smart phone that can slip comfortably into person's pocket.

The camera recognizes individuals, images, pictures, gestures which person make with their hands. This all Information is sent to the Smartphone for further Processing. Smart phone process them and also fetch data from web as per required.

The downward-facing projector projects the output image on to the mirror and it effects image on to the desired surface. Thus , Digital Information is freed from its confines and placed in the physical world.

Applications

There are large amount of Applications of Sixth sense technology. Like make a call , call up map , check time ,Multimedia Reading , Drawing Applications ,Product Information , Book Information , Zooming Feature , Flight Updates , Feed Information of Persons , tack Pictures and many more.

Make a Call :

Person can use the sixth sense to project a keypad onto him/her hand, then use that virtual keypad to make a call.

Call up a Map :

With the map application we can call up map of our choice and then use thumbs and index fingers to navigate the map.

Check Time :

Just draw a circle on your wrist to get a virtual watch that gives you the correct time. So person have not wory to take watch on his/her hand.

Multimedia Reading :

Sixth sense can be programmed to project related videos onto newspaper articles person is reading.

Drawing application :

The Drawing application lets the user draw on any surface by tracking the fingertip movements of the user's index finger.

Fetch Product Information :

Sixth sense use image recognition or marker technology to recognize any products we pick up, then feeds us information on those products.

Book Info :

The system can project rating as per Amazon on that book, as well as review and other relevant information.

Get Flight Updates :

The system will recognize persons boarding pass and let you know whether person's flight is on time or whether it has changed.

Feed Information on people :

The system will project relevant information about a person such as what they do, where they work, what is their name & other information and so on.

Zooming Feature :

The user can zoom in or zoom out and move them just by using intuitive hand movements.

Take Pictures :

If you fashion your index fingers and thumbs into a square ("Framing' gesture), the system will automatically snap a photo. After taking the desired number of photos, we can project them on to surface and can use the gestures to sort through the photos and organize and resize them.

Advantages

Supports Multi-touch & Multi-user interaction

Portable

Connect Physical word and digital Info.

Cost Effective ( $350 or Rs. 17500 only)

Data Access Real-time, anytime , anywhere.

It is an Open Source

There is very Large Scope of Future Applications

There are No Disadvantages.

Article name: What Is Sixth Sense Technology Computer Science essay, research paper, dissertation