Sixth Sense Technology Is A Mini Projector Computer Science

Sixth Sense Technology is a mini-projector coupled with a camera and a cellphone -which acts as the computer and connected to the Cloud, all the information stored on the web. Sixth Sense can also obey hand gestures. Also can access or manipulate the information using fingers. Make a call by Extend hand on front of the projector and numbers will appear for to click.know the time by Draw a circle on wrist and a watch will appear.

Sixth Sense is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Pranav Mistry is the inventor of Sixth Sense technology Sixth Sense bridges the gap by bringing intangible, digital information out into the tangible world. Sixth Sense comprises a pocket projector, a mirror, a camera and a Smartphone. The hardware components are coupled in a pendant like mobile wearable device.

We've evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses which includes eye, ear, nose, tongue mind and body to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. 'SixthSense' frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer. "Sixth Sense Technology", it is the newest jargon that has proclaimed its presence in the technical arena. This technology has emerged, which has its relation to the power of these sixth senses.

WORKINGComponents

Hardware Components

Camera:

Captures an object in view and tracks the user's hand gestures .It sends the data to smart phone .It acts as a digital eye, connecting you to the world of digital information

Projector:

The projector projects visual information enabling surfaces and physical objects to be used as interfaces.The projector itself contains a battery inside, with 3 hours of battery life. A tiny LED projector displays data sent from the smart phone on any surface in view-object, wall, or person.

Mirror:

The usage of the mirror is significant as the projector dangles pointing downwards from the neck.

Mobile Component:

The mobile devices like Smartphone in our pockets transmit and receive voice and data anywhere and to anyone via the mobile internet.

Color Markers:

It is at the tip of the user's fingers .Marking the user's fingers with red, yellow, green and blue tape helps the webcam recognize gestures. The movements and arrangements of these makers are interpreted into gestures that act as interaction instructions for the projected application interfaces.

How It Works

Untitled.png

The hardware that makes Sixth Sense work is a pendant like mobile wearable Interface. The camera recognizes individuals, images, pictures, gestures one makes with their hands Information is sent to the Smartphone for processing. The downward-facing projector projects the output image on to the mirror. Mirror reflects image on to the desired surface. Thus, digital information is freed from its confines and placed in the physical world.

RELATED TECHNOLOGIES

Sixth Sense technology takes a different approach to computing and tries to make the digital aspect of our lives more intuitive, interactive and, above all, more natural. We shouldn't have to think about it separately. It's a lot of complex technology squeezed into a simple portable device. The technology is mainly based on hand augmented reality, gesture recognition, computer vision based algorithm etc.

Augmented reality

Augmented reality (AR) is a term for a live direct or indirect view of a physical realworld environment whose elements are augmented by virtual computer-generated imagery. It is related to a more general concept called mediated reality in which a view of reality is modified (possibly even diminished rather than augmented) by a computer.

The main hardware components for augmented reality are: display, tracking, input devices, and computer. Combination of powerful CPU, camera, accelerometers, GPS and solid state compass are often present in modern Smartphone, which make them prospective platforms. There are three major display techniques for Augmented Reality:

Head Mounted Displays

A Head Mounted Display (HMD) places images of both the physical world and registered virtual graphical objects over the user's view of the world. The HMD's are either optical see through or video see-through in nature.

Handheld Displays

Handheld Augment Reality employs a small computing device with a display that fits in a user's hand. All handheld AR solutions to date have employed video see-through techniques to overlay the graphical information to the physical world. Initially handheld AR employed sensors such as digital compasses and GPS units for its six degree of freedom tracking sensors.

Spatial Displays

Instead of the user wearing or carrying the display such as with head mounted displays or handheld devices; Spatial Augmented Reality (SAR) makes use of digital projectors to display graphical information onto physical objects.

Gesture Recognition

Gesture recognition is a topic in computer science and language technology with the goal of interpreting human gestures via mathematical algorithms. Gestures can originate from any bodily motion or state but commonly originate from the face or hand. Current focuses in the field include emotion recognition from the face and hand gesture recognition. Many approaches have been made using cameras and computer vision algorithms to interpret sign language.

Symbolic gestures:

These are gestures that, within each culture, have come to a single meaning. An Emblemsuch as the "OK" gesture is one such example, however American Sign Language gesturesalso fall into this category.

Deictic gestures:

These are the types of gestures most generally seen in HCI and are the gestures of pointing, or otherwise directing the listeners attention to specific event or objects in the environment.

Iconic gestures:

These gestures are used to convey information about the size, shape or orientation of the object of discourse. They are the gestures made when someone says "The plane flew like this", while moving their hand through the air like the flight path of the aircraft.

Computer vision

Computer vision is the science and technology of machines that see, where see in this case means that the machine is able to extract information from an image that is necessary to solve some task. As a scientific discipline, computer vision is concerned with the theory behind artificial systems that extract information from images. The image data can take many forms, such as video sequences, views from multiple cameras, or multi-dimensional data from a medical scanner.

RADIO FREQUENCY IDENTIFICATION

Radio frequency identification (RFID) is a generic term that is used to describe a system that transmits the identity (in the form of a unique serial number) of an object or person wirelessly, using radio waves. It is basically an electronic tagging technology that allows the detection, tracking of tags and consequently the objects that they are affixed to. It's grouped under the broad category of automatic identification technologies. RFID is in use all around us.

APPLICATIONS

The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system.The SixthSense device has a huge number of applications.

Phone Call:

The Sixth Sense prototype can be used to project a keypad onto your hand and then use that virtual keypad to make a call.

Map viewer:

With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map.

Work On Paper:

With the paper application we can work like games, internet, etc on a small piece of paper .

Check The Time:

User can draw a circle on your wrist to get a virtual watch that gives you the correct time.

Multimedia Reading Experience:

The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. Thus a piece of paper turns into a video display.

Drawing application:

The drawing application lets the user draw on any surface by tracking the fingertip movements of the user's index finger.

Zooming Features:

The user can zoom in or zoom out using intuitive hand movements.

Watch Videos

Sixth Sense can be programmed to project related videos onto newspaper articles you are reading

Advantages

1) SixthSense is an user friendly interface which integrates digital information into the physical world and its objects, making the entire world your computer.

2) It uses hand gestures to interact with digital information.

3) Supports multi-touch and multi -user interaction.

4) Data access directly from machine in real time.

5) It is portable and easy to carry.

6) The device could be used by anyone without even a basic knowledge of a keyboard or mouse.

CONCLUSION

Sixth Sense is a wearable gestural interface that recognizes the physical object around us, with displaying information automatically and letting us to access it in any way we need.The potential of becoming the ultimate "transparent" user interface for accessing information about everything around us. Integrating information to everyday objects will not only help us to get rid of the digital divide, but will also help us in some way to stay human, to be more connected to our physical world. Allow user to interact with this information via hand gestures. Sixth Sense bridges the gap by bringing intangible, digital information out into the tangible world. The sixth sense prototype implements several applications that demonstrate usefulness, viabillty and flexibility of the system.

Article name: Sixth Sense Technology Is A Mini Projector Computer Science essay, research paper, dissertation