Main

What is SSVEP?
Types of Stimuli SSVEP applications Problem Solution Example Stimuli in action Hybrid System Summary Reference extra
Enhancement of SSVEP-Based BCI Systems via a

Steady-State Motion Visual Stimulus Modality
Yunyong Punsawad, Yodchanan Wongsawata
Youmna Ismaeil1
1 Computer Science
June 7, 2018
Youmna Ismaeil Saarland University SSVEP June 7, 2018 1 / 25

What is SSVEP? Types of Stimuli SSVEP applications Problem Solution Example Stimuli in action Hybrid System Summary Reference extra
Overview
1 What is SSVEP?
2 Types of Stimuli
3 SSVEP applications
4 Problem
5 Solution
Change of Stimuli
Visual Motion Stimulus
6 Example
7 Stimuli in action
EEG
Algorithm
SSVEP Results
Motion Results
8 Hybrid System
Hybrid System Results
9 Summary
10 Reference
11 extra

What is SSVEP?
Brain signal
Flickering stimuli at constant rate
stable over time
Trigger harmonics

Types of Stimuli
Figure: A Stimuli with flickering light as depicted by [Walters, 2018]

Types of Stimuli
Figure: A Stimuli with flickering pattern as designed by [mrbobowen, 2018]

Figure: A music player controller with flickering light as proposed by [Zerafa et al., 2018]

Problem ?
Figure: A Stimuli with flickering pattern as designed by [mrbobowen, 2018]

Solution
Proposed Solutions
Change flickering rate

Change color of the stimuli
Or Just flicker but without anyone noticing

Figure: Motion stimuli as proposed in [Yunyong and Yodchanan, ]
Text
Text




Expectations vs Realty
Text
Figure: motion stimuli simulated as motion to the right Figure: motion stimuli is in reality flickering with 7 Hz

Working example
Two moving stimuli, both with

flickering rate of 7 Hz
Commands left and right
measure SSVEP using EEG
Figure: Motion stimuli as depicted in

[Yunyong and Yodchanan, ]

EEG
How to obtain a signal?
EEG
recording brain signals
location of importance
Figure: A model of EEG hats as found in

[Issa, 2018]

EEG
Electrode Locations
Naming convention (O, T, F, C, ...)

Ground Connections (Fz)
Reference Connections (C3, C4)
EGG signal to contributions
Figure: Locations of the electrodes

as in [Asanagi, 2018]

EEG
Power Spectrum Density (PSD)
contribution of f
Welch PSD
Fourier transform
Figure: Power spectrum density of Noise as depicted in

[Lopes et al., 2007]

EEG
Power Spectrum Density (PSD)
Figure: Summary of signal extraction as depicted in

Figure: Power spectrum density of Noise as depicted in [Chumerin et al., ]
[Lopes et al., 2007]

Algorithm
SSVEP Algorithm
Start
EEG signal
processing Baseline
(PSD)
Extract features
PSD - baseline
Normalize
remove -ve
features
yes
right left > Right
No
yes No
Nothing left = Right left
Figure: Diagram showing the SSVEP Algorithm for both O1 and O2 signals

SSVEP Results
Experiment and Results
SSVEP
Subject accuracy(%)
1 92.5
7 healthy subjects 2 82.5
No prior experience 3 80.0
40 trials 4 85.0
20 right 5 85.0
20 left 6 77.5
7 82.5
mean 83.57±4.76

SSVEP Results
Different Notations
flickering -> SSVEP

No flickering
Alpha band, 10-12 Hz
Beta band, 14-25 Hz
Motion and Alpha & beta band signals
Assumptions: PSDO1α ≈ PSDO1β , => right Vice versa

Motion Results
Motion Visual Stimuli Algorithm
Start
EEG signal
processing
(PSD)
Attention indices
ratio => PSD_alpha/
PSD_(alpah, beta)
Difference
alpah - beta
Normalize
remove -ve
& >0.25
yes
right Ndiff_1< Ndiff2
No
yes No
Nothing Ndiff_1= Ndiff2 left
Figure: Diagram showing the motion stimuli Algorithm for both O1 and O2 signals

Motion Results
SSVEP vs Motion
Subject SSVEP(%) motion(%)
7 healthy subjects 1 92.5 87.5

2 82.5 70.0
No prior experience
3 80.0 80.0
focus on the cross
4 85.0 75.0
40 trials 5 85.0 85.0
20 right
20 left 6 77.5 75.0
7 82.5 77.5
mean 83.57±4.76 78.57±6.10

Hybrid System and Application
SSVEP
13 HZ option
Forward option
Figure: Extended SSVEP stimuli as depicted in


Hybrid System and Application
Motion Stimuli
13 HZ option
Forward option
stop command
Figure: Extended motion stimuli as depicted in


Hybrid system
Subject Hybrid(%)
1 85.83
2 89.18
10 healthy subjects 3 82.93
3 no prior experience 4 86.68
5 83.35
15 mins training
6 85.75
30 mins SSVEP
7 86.68
30 motion stimuli 8 82.5
-trials/command
9 83.33
10 90.0
mean 85.62±2.48
meantime/command 4.14

Summary
SSVEP signals are triggered by flickering stimuli

Application of SSVEP systems
Problems with flickering Stimuli
Possible solution
Introduction of motion stimuli
From Stimuli to action
SSVEP Algorithm experiments and results
motion detection stimuli experiments and results
Hybrid systems in Wheelchairs
Results

Reference I
Asanagi (2018).
cerebral cortex.
https://commons.wikimedia.org/wiki/File:
21_electrodes_of_International_10-20_system_for_EEG.svg.
Chumerin, N., Manyakov, N. V., van Vliet, M., Robben, A., Combaz, A., and Hulle,
M. M. V.
Processing and decoding steady-state visual evoked potentials for brain-computer
interfaces.
Laboratorium voor Neuro- en Psychofysiologie, KU Leuven, Campus
Gasthuisberg, O&N 2, Herestraat 49, 3000 Leuven, Belgium.
Issa, N. P. (2018).
cerebral cortex.
https://www.docneuro.com/cerebral-cortex.html.
Lopes, P. A. C., Germano, J., Almeida, T. M., Sousa, L., Piedade, M. S., Cardoso,
F., Ferreira, H. A., and Freitas, P. P. (2007).
A new handheld biochip-based microsystem.
In 2007 IEEE International Symposium on Circuits and Systems, pages
2379–2382.

Reference II
mrbobowen (2018).
Visual evoked potential (vep) - can also uncover scotomas.wmv.
https://www.youtube.com/watch?v=xEd1h_lz4rA.
Walters, J. (2018).
A quick intro to ssvep: Steady state visually evoked potential.
http://synaptitude.me/blog/
a-quick-intro-to-ssvep-steady-state-visually-evoked-potential/.
Yunyong, P. and Yodchanan, W.
Enhancement of steady-state visual evoked potential-based brain–computer
interface systems via a steady-state motion visual stimulus modality.
IEEE Transactions on Electrical and Electronic Engineering, 12(S1):S89–S94.
Zerafa, R., Camilleri, T., and Falzon, O. (2018).
Ssvep-based brain-computer interface (bci) system for real-time application.
https://www.youtube.com/watch?v=uekFQ6X5Gg0.

extra
motion visual stimuli

Simulation
Figure: Brain topographic mapping of Occipital lobe

with motion visual stimuli as depicted in

extra
Motor Cortex
central area
C2, C4
Motion Visual
stimuli
Simulation
Figure: Brain topographic mapping of central

area with motion stimuli as depicted in

extra
Occipital lobe and motion detection

Akinetopsia: Motion blindness
precise, symmetric damage to small
part in the occipital lobe

Main

Diunggah oleh

Informasi Dokumen

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Main

Diunggah oleh

Hak Cipta:

Format Tersedia

What is SSVEP?

Enhancement of SSVEP-Based BCI Systems via a

Youmna Ismaeil Saarland University SSVEP June 7, 2018 1 / 25

Youmna Ismaeil Saarland University SSVEP June 7, 2018 2 / 25

Youmna Ismaeil Saarland University SSVEP June 7, 2018 3 / 25

Figure: A Stimuli with flickering light as depicted by [Walters, 2018]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 4 / 25

Figure: A Stimuli with flickering pattern as designed by [mrbobowen, 2018]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 4 / 25

Youmna Ismaeil Saarland University SSVEP June 7, 2018 5 / 25

Figure: A Stimuli with flickering pattern as designed by [mrbobowen, 2018]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 6 / 25

Change flickering rate

Youmna Ismaeil Saarland University SSVEP June 7, 2018 7 / 25

Visual Motion Stimulus

Visual Motion Stimulus

Figure: Motion stimuli as proposed in [Yunyong and Yodchanan, ]

Visual Motion Stimulus

Visual Motion Stimulus

Figure: Motion stimuli as proposed in [Yunyong and Yodchanan, ]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 8 / 25

Visual Motion Stimulus

Visual Motion Stimulus

Figure: Motion stimuli as proposed in [Yunyong and Yodchanan, ]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 8 / 25

Visual Motion Stimulus

Visual Motion Stimulus

Figure: Motion stimuli as proposed in [Yunyong and Yodchanan, ]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 8 / 25

Visual Motion Stimulus

Visual Motion Stimulus

Figure: Motion stimuli as proposed in [Yunyong and Yodchanan, ]

Youmna Ismaeil Saarland University SSVEP June 7, 2018 8 / 25

Visual Motion Stimulus

Youmna Ismaeil Saarland University SSVEP June 7, 2018 9 / 25

Two moving stimuli, both with

Figure: Motion stimuli as depicted in

Youmna Ismaeil Saarland University SSVEP June 7, 2018 10 / 25

How to obtain a signal?

Figure: A model of EEG hats as found in

Youmna Ismaeil Saarland University SSVEP June 7, 2018 11 / 25

Naming convention (O, T, F, C, ...)

Figure: Locations of the electrodes

Youmna Ismaeil Saarland University SSVEP June 7, 2018 12 / 25

Power Spectrum Density (PSD)

Figure: Power spectrum density of Noise as depicted in

Youmna Ismaeil Saarland University SSVEP June 7, 2018 13 / 25

Power Spectrum Density (PSD)

Figure: Summary of signal extraction as depicted in

Youmna Ismaeil Saarland University SSVEP June 7, 2018 13 / 25

Youmna Ismaeil Saarland University SSVEP June 7, 2018 14 / 25

Experiment and Results

Youmna Ismaeil Saarland University SSVEP June 7, 2018 15 / 25

flickering -> SSVEP

Youmna Ismaeil Saarland University SSVEP June 7, 2018 16 / 25

Motion Visual Stimuli Algorithm

Youmna Ismaeil Saarland University SSVEP June 7, 2018 17 / 25

Experiment and Results

7 healthy subjects 1 92.5 87.5

Youmna Ismaeil Saarland University SSVEP June 7, 2018 18 / 25

Hybrid System and Application

Figure: Extended SSVEP stimuli as depicted in

Youmna Ismaeil Saarland University SSVEP June 7, 2018 19 / 25

Hybrid System and Application