Blue Eyes

BlueEyes
Human Operator Monitoring System
BlueEyes
Human-Operator Monitoring System
Presented by Saste Ashwini S.
BlueEyes
Agenda
What is Blue Eyes (and what is not) ? Emotional mouse. Magic
Agenda Introduction What Is Blue Eyes Emotional Mouse MAGIC Artificial Intelligent Speech Recognition Suitor Conclusion
Artificial intelligent speech recognition

Suitor Conclusion
BlueEyes
Introduction
BLUE EYES technology enables the computer to
gather information about person and interact with the

person through special techniques like facial recognition, speech recognition etc.
It verifies persons identity ,feels his presence &

starts interacting with him.
Human cognition depends primarily on the ability to
perceive , interpret & integrate audio-visuals &

sensing information.
BlueEyes
What Is Blue Eyes ?

The Blue Eyes technology aims at creating
computational machines that have perceptual and sensory ability like those of human beings.
What Is Blue Eyes Not?

Doesnt predict nor interfere with operators thoughts Cannot force directly the operator to work
BlueEyes
Emotional Mouse
One goal of Human Computer Interaction (HCI) is to make an adaptive, smart computer system. In order to start creating smart
computers, the computer must start

gaining information about the user.
BlueEyes
Emotion And Computing

Rosalind Picard (1997) describes two aspects of
affective computing:
1) Giving the computer the ability to detect emotions &
2) Giving the computer the ability to express

emotions. We can gain the information from user via
(1) Touch
(2) Video (3) Speech
BlueEyes
Theories & Technologies

It Contains The Four Technologies As:
a)
Paul Ekmans Facial Expression.
b)
Magic Pointing.
c)
Artificial Intelligent Speech Recognition.
d) Suitor.
BlueEyes
Paul Ekmans Facial Expression

Based on Paul Ekmans facial expression work, we
see a correlation between a persons emotional state and a persons physiological measurements. He defined the six basic emotions as anger, fear, sadness, disgust, joy and surprise. Six participants were trained to exhibit the facial expressions of the six basic emotions The measures taken were GSR, heart rate, skin temperature and general somatic activity (GSA).
BlueEyes
Emotion Sensing Mouse
BlueEyes
Analysis
To analyze data there are two types of analysis:
(1) Multidimensional scaling (MDS)

(2) Discriminate function analysis
The amount of conductivity of the skin is best taken from the fingers. The changes in the temperature of the finger are reliable for prediction of emotion. GSA can be measured by changes in movement in the computer mouse.
BlueEyes
Manual And Gaze Input Cascaded

(MAGIC) Pointing
Gaze tracking has long been considered as an alternative or potentially superior pointing method
for computer input.

Many fundamental limitations exist with traditional gaze pointing. We therefore propose an alternative approach, MAGIC pointing. Two specific MAGIC pointing techniques are as: 1) Conservative & 2) Liberal.
BlueEyes
Liberal MAGIC Pointing Technique Of Cursor
BlueEyes
Conservative MAGIC pointing technique of cursor
BlueEyes
Advantages
Reduction of manual stress and fatigue. Practical accuracy level. A more natural mental model for the user. Speed
Improved subjective speed and ease-of-use.
BlueEyes
Disadvantages
With the more liberal MAGlC pointing technique, the cursor warping can be overactive at times It is possible to introduce additional constraint
according to the context

a strategy may prolong the target acquisition time Motor action may start as soon as the user's gaze
settles on a target.
With MAGlC pointing techniques, the motor action computation (decision) cannot start until the cursor
appears.
BlueEyes
IBM Almaden Eye Tracker
BlueEyes
Implementation Of Magic Pointing

The MAGIC pointing program takes data from both the manual input device and the eye tracking system. Raw data from an eye tracker can not be directly used for gaze-based interaction, due to noise from image processing. To eliminate noise we have used Filters.
The goal of filter design is to make the best

compromise between preserving signal bandwidth & eliminating unwanted noise.
BlueEyes
Implementing MAGIC pointing
BlueEyes
Experimental Results
SESSION
SESSION
Mean Completion Time (Sec) Vs. Experimental Session
No_Gaze -1.4sec ,Gaze-1.52 sec ,Gaze 2 -1.33 sec
BlueEyes
1.8 1.6 1.4 1.2 1 0.8 0.6
0.4 0.2
NO GAZE GAZE 1 GAZE 2
0 0 20 40 60 80
Mean Completion Time (Sec) Vs. Target Size (Pixels)

SMALL W LARGE
BlueEyes
1.8 1.6
1.4 1.2 1
0.8 0.6 NO_GAZE
GAZE 1
GAZE 2
0.4 0.2 0
0
Short
200
Mid 500 A
Long 1000
Mean Completion Time (Sec) Vs. Pointing Amplitude(pixels)
BlueEyes
1.8 1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 0
No_Gaze
Gaze 1
Gaze 2
Horizontal 200 Diagonal

Short Mid
Vertical
Long
Mean Completion Time (Sec) Vs. Target Angle(Degree)
No_Gaze-8.2% , Gaze 1-7% , Gaze 2-7.5%
BlueEyes
MAGIC Pointing Is More

Significant
(1) Reduced physical effort and fatigue (2) Greater accuracy and naturalness (3) Higher speed
BlueEyes
Artificial Intelligence Speech

Recognition
It is important to consider the environment in which speech recognition system has to work. Example : an automatic call-handling system is used without employing any telephone operator.
BlueEyes
Technology
(AI) involves two basic ideas as: 1. It involves studying the thought processes of human beings. 2. It deals with representing those processes via machines (like computers, robots, etc). It makes machines smarter and more useful.
BlueEyes
Speech Recognition
The user speaks to the computer through a microphone, which may use minimum three filters. As the number of filters used increases, the probability of accurate recognition increases. The filter output is then fed to the ADC to translate the analogue signal into digital word. The binary representation of each of these words becomes template or standard, against which the
future words are compared.
BlueEyes
Simple User Interest Tracker (Suitor)

We have to develop an intimate relationship between the computer and the humans. By simply noticing where the users eyes focus on the computer screen, the SUITOR can be more precise in determining users topic of interest. Two prototypes of gaze-tracking technology are as: (1)SUITOR (Simple User Interest Tracker) (2)Filling a scrolling ticker on a computer screen with
information related to the user's current task.
BlueEyes
Applications
Blue Eyes can be implemented in surveillance systems that record and interpret customer movements. Blue Eyes can be applied in the automobile industry. We could see its use in video games. Current interface between computers and human users
becomes more natural and intuitive.
BlueEyes
CONCLUSION
The BLUE EYES technology ensures a convenient
way of simplifying the life by providing more delicate

and user friendly facilities in computing devices.
BlueEyes
BIBLIOGRAPHY:
www.newtech.com www.blue-eyestech.com
www.wikipedia.com
www.google.com www.eetimes.com
BlueEyes
Thank you for your attention
BlueEyes
Human-Operator Monitoring System

Blue Eyes

Diunggah oleh

Informasi Dokumen

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Blue Eyes

Diunggah oleh

Hak Cipta:

Format Tersedia

BlueEyes

Human Operator Monitoring System

Presented by Saste Ashwini S.

Artificial intelligent speech recognition

gather information about person and interact with the

It verifies persons identity ,feels his presence &

Human cognition depends primarily on the ability to

perceive , interpret & integrate audio-visuals &

What Is Blue Eyes ?

What Is Blue Eyes Not?

computers, the computer must start

Emotion And Computing

2) Giving the computer the ability to express

Theories & Technologies

Paul Ekmans Facial Expression.

Artificial Intelligent Speech Recognition.

Paul Ekmans Facial Expression

Emotion Sensing Mouse

(1) Multidimensional scaling (MDS)

Manual And Gaze Input Cascaded

for computer input.

Liberal MAGIC Pointing Technique Of Cursor

Conservative MAGIC pointing technique of cursor

Improved subjective speed and ease-of-use.

according to the context

IBM Almaden Eye Tracker

Implementation Of Magic Pointing

The goal of filter design is to make the best

Implementing MAGIC pointing

Mean Completion Time (Sec) Vs. Experimental Session

No_Gaze -1.4sec ,Gaze-1.52 sec ,Gaze 2 -1.33 sec

NO GAZE GAZE 1 GAZE 2

Mean Completion Time (Sec) Vs. Target Size (Pixels)

Mean Completion Time (Sec) Vs. Pointing Amplitude(pixels)

Horizontal 200 Diagonal

Mean Completion Time (Sec) Vs. Target Angle(Degree)

No_Gaze-8.2% , Gaze 1-7% , Gaze 2-7.5%

MAGIC Pointing Is More

Artificial Intelligence Speech

future words are compared.

Simple User Interest Tracker (Suitor)

information related to the user's current task.

becomes more natural and intuitive.

way of simplifying the life by providing more delicate

Thank you for your attention

Anda mungkin juga menyukai