ABSTRACT ON TOUCH LESS

TOUCHSCREEN
A NEW LEAD IN TOUCH SCREEN TECHNOLOGY

STUDENTS: P.AKSHARA, A.ASHA, K.S.VAISHALI

SRI SAIRAM INSTITUTE OF TECHNOLOGY

INTRODUCTION:

Touchless Touch allows you to turn any suitable theoretically detect all 128 touch points

surface into a multi-touch surface by harnessing although in practice this is probably physically

the power of the cameras on the Kinect or impossible, thus the support for up to 4

Primesense (OpenNI) sensors. You can connect sensors. The software does not mind which

a maximum of 4 sensors* to extend the size of sensors are installed, so you can have a

the touchable area and increase accuracy when combination of different compatible hardware

many people are using the surface. Possible

The touch less touch screen sounds like it
usages include adding touch screen support for
would be nice and easy, however after closer
a front/rear projected screen, making a examination it looks like it could be quite a

projected white board touch-enabled, or for a workout. This unique screen is made by

cheaper way to enable touch support on large TouchKo , White Electronics Designs , and

format displays. For most applications only a Groupe 3D. The screen resembles the

Nintendo Wii without the Wii Controller. With

single sensor is required. For larger multi-user
the touchless touch screen your hand doesn’t
and multi-touch application you may find the
have to come in contact with the screen at all,
need for more than one sensor. One sensor can
it works by detecting your hand movements in
front of it. This is a pretty unique and to the hologram-like IO2 Technologies

interesting invention, until you break out in a Heliodisplay M3 , but thats for anyone that has

sweat. Now this technology doesn’t compare $18,100 laying around.

You probably wont see this screen in term this as “Touchless human/machine

stores any time soon. Everybody loves a user interface for 3D navigation ”.

touch screen and when you get a gadget

with touch screen the experience is really

exhilarating. When the I-phone was

introduced,everyone felt the same.But

gradually,the exhilaration started fading.

While using the phone with the finger tip or

with the stylus the screen started getting

lots of finger prints and scratches. When

we use a screen protector; still dirty marks

over such beautiful glossy screen is a

strict no-no. Same thing happens with I-

pod touch.

Most of the time we have to wipe the

screen to get a better unobtrusive view of

the screen. Thanks to EllipticaLabs

innovative technology that lets you control

your gadgets like Computers, MP3 players

WORKING:
or mobile phones without touching them.
The system is capable of detecting
Simply point your finger in the air towards
movements in 3-dimensions without ever
the device and move it accordingly to
having to put your fingers on the screen. Their
control the navigation in the device. They
patented touchless interface doesn’t require
that you wear any special sensors on your might be wearing surgical gloves, the display

hand either. You just point at the screen (from features capacitive sensors that can read

as far as 5 feet away), and you can movements from up to 15cm away from the

manipulate objects in 3D. Sensors are screen. Software can then translate gestures

mounted around the screen that is being into screen commands.

used, by interacting in the line-of-sight of

Touchscreen interfaces are great, but all that
these sensors the motion is detected and
touching, like foreplay, can be a little bit of a
interpreted into on-screen movements. What
drag. Enter the wonder kids from Elliptic Labs,
is to stop unintentional gestures being used as
who are hard at work on implementing a
input is not entirely clear, but it looks
touchless interface. The input method is, well,
promising nonetheless. The best part? Elliptic
in thin air. The technology detects motion in
Labs says their technology will be easily small
3D and requires no special worn-sensors for
enough to be implemented into cell phones
operation. By simply pointing at the
and the like. IPod touchless, anyone?
screen,users can manipulate the object being

displayed in 3D. Details are light on how this

actually functions, but what we do know is

TOUCHLESS MONITOR:
this:
Sure, everybody is doing touchscreen

interfaces these days, but this is the first time

Touch-less Gives Glimpse
I’ve seen a monitor that can respond to

gestures without actually having to touch the of GBUI:

screen.
We have seen the futuristic user interfaces of
The monitor, based on technology from
movies like Minority Report and the Matrix
TouchKo was recently demonstrated by White
Revolutions where people wave their hands in
Electronic Designs and Tactyl Services at the
3 dimensions and the computer understands
CeBIT show. Designed for applications where
what the user wants and shifts and sorts data
touch may be difficult, such as for doctors who
with precision. Microsoft's XD Huang
What’s next??
demonstrated how his company sees the

future of the GUI at ITEXPO this past Many personal computers will likely have
September in fact. similar screens in the near future. But touch

interfaces are nothing new -- witness ATM

Touch-less SDK:
machines. How about getting completely out

The Touchless SDK is an open source SDK of touch? A startup called LM3Labs says it's

for .NET applications. It enables developers to working with major computer makers in
create multi-touch based applications using a
Japan, Taiwan and the US to incorporate
webcam for input. Color based markers
touch less navigation into their laptops,
defined by the user are tracked and their
Called Airstrike; the system uses tiny
information is published through events to
charge-coupled device (CCD) cameras
clients of the SDK. In a nutshell, the

Touchless SDK enables touch without integrated into each side of the keyboard to

touching. Well, Microsoft Office Labs has just detect user movements.

released “Touchless,” a webcam-driven multi- You can drag windows around or close
touch interface SDK that enables “touch
them, for instance, by pointing and gesturing
without touching.”
in midair above the keyboard.You should be
Using the SDK lets developers offer users “a
able to buy an Airstrike-equipped laptop
new and cheap way of experiencing multi-
next year, with high-end stand-alone
touch capabilities, without the need of

expensive hardware or software. All the user keyboards to follow.

needs is a camera,” to track the multi-colored

Any such system is unlikely to replace
objects as defined by the developer. Just
typing and mousing. But that's not the point.
about any webcam will work
Airstrike aims to give you an occasional

quick break from those activities.

Advantages & Disadvantages of

Touchscreen Technology

ADVANTAGES :

 -Touchscreen devices have

limited buttons that will possibly
break after 3 – 4 years

 -Touchscreen devices usually

have more simple user interfaces
Ex. Ipod Apps

 -Having less or not buttons

means that you can put more
effort into having a big screen
 DISADVANTAGES :
 –For the people worried about
hygiene, most devices are easy  -The screen has to be big enough
to clean, some are even dirt, dust to be able to touch the buttons
and grease resistant without missing

 -For people new or  -Having a big bright screen and

uncomfortable with normal needing massive computing
desktops, touchscreens are easy power to run this means a very
to use helping more people get low battery life
used to using computers
 -In direct sunlight it is much less
efficient and most of the time
very difficult to read the screen

 -If a touchscreen devise were to

crash the whole screen would be
unresponsive, and because of the
 lack of buttons recovering it
would be very difficult
 -The screens will get very dirty
 -You have to be within arms
reach of the device
 -They usually cost more than
ordinary devices
used effectively in computers, cell phones,
webcams and laptops. May be few years
down the line, our body can be transformed
into a virtual mouse, virtual keyboard and
what not??, Our body may be turned in to
OUR MAIN IDEA:
TO OVERCOME THE BRIGHTNESS
PROBLEM IN SOLAR LIGHT OF THE
SCREEN:
WE CAN FIX THE AUTO BRIGHTNESS OPTION
THAT IS THE INTERNAL BRIGHTNESS CHANGE
ACCORDING TO THE EXTERNAL LIGHT
POSITION GESTURE:
IF THERE IS A PROBLEM IN MAKING THE GESTURE
IS THAT
WE CAN OVERCOME THIS IN KEEP
SOME TIME FOR MILLISECOND LIKE KEY
DEBOUNCING TECHNOLOGY
FIXING OR POINTING TOWARDS THE
SCREEN FOR ABOUT 10 MILLISECONDS
1.WHAT’S TOUCHLESS?
Touchless is an SDK that allows
users to create and experience
multi-touch applications.
Touchless started as Mike
Wasserman’s college project at
Columbia University. The main
idea: to offer users a new and
cheap way of experiencing multi-
touch capabilities, without the
need of expensive hardware or
software. All the user needs is a
camera, which will track colored
markers defined by the user.
Mike presented the project at the
Microsoft Office Labs Productivity
Science Fair, Office Labs fell in love
with it, and Touchless was chosen
as a Community Project. Our
deliverables include an extensible
demo application to showcase a
limited set of multi-touch
capabilities, but mainly we are
delivering an SDK to allow users to
build their own multi-touch
applications.
Now, Touchless is released free
and open-source to the world
under the Microsoft Public License
(Ms-PL) on CodePlex. Our goals
are to drive community
 involvement and use of the SDK as Touchless.chm - A documentation
it continues to develop. file of the Touchless API for
developers
Remember that this is just the
beginning; and you're invited to Touchless.jpg - A class diagram of
join our journey. Send us your the Touchless API for developers
questions and feedback, use
Touchless.rtf - This file; you're
Touchless SDK in your .NET
reading it right now!
applications and XNA games, and
support the community by If you just want to try out the
contributing to the source code. simple demos offered with the
SDK, extract the release to any
Unleash the power of your
location on your computer, and
webcam!
run "TouchlessDemo.exe".
an input device

2. WHAT’S IN THIS RELEASE?

This release includes a short list of

binary files to demonstrate
3. WHAT’S IN SOURCE REPOSITORY?
Touchless:
The source repository is hosted at
WebCamLib.dll - Interfaces with
the homepage of Touchless:
DirectShow to grab webcam
frames http://www.codeplex.com/touchl
ess
TouchlessLib.dll - Contains the
functionality of Touchless SDK The directories you'll find there
are:
TouchlessDemo.exe - A small
demonstration of what Touchless bin - Binary versions of the files,
can be used for updated more frequently than our
releases
Image.gif - Used in
TouchlessDemo's image demo Documentation - Browse media
 documenting the project
Samples - Apps/Games that
demonstrate or use Touchless
(submit yours!)
TouchlessLib - Touchless
functionality, written in C#, uses
.NET 3.0+, VS2005+
TouchlessUnitTests - Unit tests to
"WebcamLib.dll"
prevent regression
WebCamLib - Webcam
functionality, written in C++, uses
DX SDK Aug. 2007
Become a contributor by adding
your Touchless apps or improving
the SDK code!
5. REFERENCE INFORMATION
4. HOW TO ADD TOUCHLESS TO
YOUR PROJECT
By adding Touchless to your
project, you can give your users a
truly fun, novel, and functional
multi-touch experience, and all
they need is a webcam!
The prerequisites you'll need to
develop using Touchless are:
Visual Studio 2005 or 2008
.NET 3.0 or higher
"TouchlessLib.dll" and
To add Touchless to an existing
visual Studio project, simply right
click “References” and select “Add
Reference…” go to the browse
tab, and select "TouchlessLib.dll".
Ensure that both
"TouchlessLib.dll" and
"WebcamLib.dll" are copied to the
same output directory to be used
with your builds.
You can find extensive
information on all properties and
methods of each class in our XML-
generated documentation file
“TouchessLib.chm”. The Touchless
class diagram reflects public
classes, methods, and properties
of the API; it is avaiable as
"Touchless.jpg". These files are
 distributed with each release, and
also available in the source code
repository, located in the
documentation folder.
6. BACKLOG OF IDEAS
This is a very terse list of ideas for
improving Touchless SDK.
ColorLib:
Improve HSV colorspace partitioning
model. We could group perceived
similar colors better. Potentially
replace with a group clustering
algorithm. Perhaps just refine the
per-dimension bin counts, or replace
the hash function.
Use a lookup table instead of
transforming RGB to HSV. We can
just terminate early if it’s not in the
lookup table.
Reduce loop overhead of converting
ARGB values into RGB values, then
into HSV values, then into Binned
HSV values, then finally into a hash #
for color lookup during marker
update. Potentially use a lookup table
for a subset of colors to avoid the
math altogether.
Improve HSV color grouping, consider
refining the per-dimension bin counts
or using a different HSV color-space
partitioning model that better suits
human perception of similar colors.
Marker:
Implement a way of getting higher
degree moments of inertia. Mostly,
we are interested in the axis of least
rotational momentum and the
roundness factor.
Allow the user to send a mask image
with the add marker bitmap for
arbitrary marker region selections.”
Extend or replace alpha smoothing
with exponential decay to provide
smoothed marker data and reduce
the marker jumpiness.
Optimize threshold, or replace
threshold concept with a partial
matching. Also, step threshold by
numbers that actually make a
difference, or just have sensitivity +/-
buttons and increment functions
Expose smoothing factor as a public
marker property.
Fix and improve the automated
marker tests
Standardize some marker colors,
create an “auto-find makers”
Improve the search bounds of a
previously absent marker.
Improve the meta-tracking (cases
where small numbers of pixels are
missing from the middle of a marker,
or are outliers of the concentration of
pixels)
Periodically/continuously adopt
surrounding pixels of confirmed
marker pixels
Coloravg is currently just marker marker data such as
representative color. Implement a ColorAverage,
way of actually getting a color ColorSpace, Axis and
average from the set of colors found Roundness.
Improve Marker highlighting Add flood fill algorithm
Improve upon the raster scan so we can add a marker
algorithm used for marker updating. with a few points in the
Optimize the method for getting the Bitmap.
marker appearance from a circular Refine the marker
area of a bitmap; we could use tracked colors as we find
hierarchical bounds intersection or colors around the
something smarter than the current marker.
scan algorithm. The representative
Optimize the values used to color doesn’t always
increment/decrement color match the perceived
frequencies for marker appearance color of the marker.
detection. This should be somehow Provide subsequent
based on signal/noise ratios. examples of a marker
Improve the expected marker regions appearance
used for scanning on update. We Have TouchlessMgr
could consider the marker’s actually expose a way
acceleration, rather than just the to get a list of the
velocity. Perhaps try using regions current markers
that aren’t axis-aligned rectangles. Make a better
exception for camera
TouchlessMgr start failure
Add functionality to save Validate the
and load marker PixelFormat of
configuration files incoming images.
(reduce repeat training Create a utility
of the same marker, function to retrieve
possibly provide ImageData in a
autoconfig files for consistent manner;
standard markers... will we have a bit of code
variant lighting allow for duplication right now.
this?) Make a public
Implement additional interface for demo
 classes to implement,
then allow the user to
just invoke start and
stop of a demo class
on the library
Standardize error
handling and
exception generation
across the project.
 TOUCHLESS
TOUCHSCREEN USER
INTERFACE
Touch Less Touch Screen
• Touch less control of
electrically operated equipment
is being developed by Elliptic
Labs.
• This innovative technology
lets you control your gadgets
like Computers, MP3 players or
mobile phones without
touching them.
• This system depends on hand
and or finger motions, a hand
wave in a certain direction
• The sensor can be placed
either on the screen or near the
screen.
• Technology touch less device
• The device is based on optical
pattern recognition
using a solid state optical
matrix sensor with a lens to
detect hand motions.
Touch less Monitor :
This monitor is made TouchKo
Touch less touch screen your
hand doesn’t have to come in
contact with the screen at all, it
works by detecting your hand
movements in front of it.
• point your finger in the air
towards the device and move it
accordingly to control the
navigation in the device
• Designed for applications
where touch may be difficult,
such as for doctors who might
be wearing surgical gloves
3D NAVIGATION OF
HAND MOVEMENTS IN
TOUCHLESS S CREEN

Touch less UI
• Sensors are mounted around the
screen that is being used, by
interacting in the line-of-sight of these
sensors the motion is detected and
interpreted into on-screen movements.
• just point at the screen (from as far
as 5 feet away), and you can
manipulate objects in 3D.
• Gestures are translated into screen
commands
• Touch less monitor
• GBUI(gesture-based graphical user
Interface)
• Working of touch less UI
• sensors arrayed around the perimeter
of the device capable of sensing
finger movements in 3-D space.
• Touch less-SDK
software is plex .
• Touch Wall consists of three
infrared
lasers that scan a surface.
• By using a projecter entire
walls can easily be turned into a
multi touch user interface.

CONCLUSION
• The Touch less touch screen
user interface can be used
effectively in computers, cell
phones, webcams and laptops.
• May be few years down the
line, our body can be
transformed into a virtual
 TOUCHLESS-DEMO  mouse, virtual keyboard ,Our
The Touch less Demo is an body may be turned in to an
open source application that input device!
anyone with a webcam can use
to experience multi-touch.
• The demo was created using
the Touch less SDK and
Windows Forms with C#
• window shop PIC
• Here that you may need a few
cameras in stereo to maximize
accuracy and you could
theoretically use your hands as
a mouse

 Touch Wall:
• Touch Wall it is the first multi
touch product
• It refers to the touch screen
hardware setup itself and