1

The future of Computing

Robotizing the world!

Montreux 2016
Alessandro CREMONESI
ST Central Labs
STMicroelectronics

Where are we?

This Decade:
The era of Cloud and Internet of Things
Brain
eyes

muscles

IoT Examples
Making Things smarter

It used to tell
you the time

It used to remind
you of someone
close to your heart

Now it tells you

what to do

Now it reminds
you to take care
of your heart

And how you

are doing

And exactly
what you
doing

It used to just
provide power

They used to help you

see clearly

Now it talks to your

machines and tells how you
much they are consuming

Now they help you

to see more

From cell phone to everything

+
Image sensor

Processing

+
Accelerometer
and
Gyroscope

Pressure
Temperature
Humidity

+
RF

Processing

Pressure

+
Processing

RF

Traditional markets

IoT

An industry need:
Quick turn from idea to product
customer need

building blocks

Our answer

Sensors

Connectivity

Motion & Environ.

Sensors
Bluetooth Low Energy

Audio

Actuators

Sub-GHZ
NFC
Microphone

Power

Processing
Software

Motor control
Microcontroller

Integrated Development
Environment
and Middleware

www.st.com/stm32ode

i.e.STM32 Open Development Environment

IoT + Cloud enables the world to

Sense and Act
Brain

Senses

Muscles

In 2012 more data produced than in previous 5000 years

90% of data produced in last two years
Less than 1% of data analyzed today

2020and beyond Cognitive &

Autonomous thinking

Think!

Sense.. Think.. Act!

THINK!
10

analytics

Cognitive
Computing

Nanotechnology

Evolution of CDNN complexity over time

(Deep Learning)
1.96E+10

2E+10

150.00

1.9E+10

138.00

1.8E+10
1.7E+10
1.6E+10
1.5E+10

Operations

1.4E+10
1.3E+10
1.2E+10

1.13E+10

1.1E+10
1E+10
9E+09
8E+09

60.00

7E+09

50.00

6E+09
5E+09
4E+09
3E+09
2E+09

1.00E+09

1.50E+09

1E+09
0

1.50E+05

0.01

Early ANNs (1997-2007)

3 layers

AlexNET (2012)
7 layers

GoogleLeNet (2014)
22 layers
Operations

parameters

VGG19 (2014)
19 layers

ResNet (2015)
152 layers

160
155
150
145
140
135
130
125
120
115
110
105
100
95
90
85
80
75
70
65
60
55
50
45
40
35
30
25
20
15
10
5
0

Parameters

2.1E+10

Millions

11

Which technology?

New computing architectures & New

Devices
3D Electronics

Electric

Merge of electronics with Photonics

...also for computing and storage

Bio chemical
Molecular computing?

12

Lets Start from power:

SiC GaN @ ST
Architectures and Technologies (SiC, GaN) for efficient power
management and distribution in Datacenters and Server Farms

13

Power for Processing and Communication:

FD-SOI AND SILICON PHOTONICS @ ST
Silicon Photonics

gate

Thin Silicon film

Extreme performances &

Low power

Communication speed
up to 50 Gbit/s

To allow our customers to address power efficiency and extreme

performances in the Infrastructure and in the server farms

14

Periphery: Sense & Act .. and Think!

Zero power
Scavenging
3D Electronics
Self repairing
Self configuring
Miniaturized
Non invasive
..
..

Sub Conscious
Environment
Awareness

15

Traditional vs cognitive sensing

Accellerometer
Gyroscope
Magnetometers
Pressure
Temperature

Algorithmic
based
sensors
fusion

Most precise sensor

calibration required
Different algo for
different sensor family

Touch
Sound
UV index
Biometrics
Camera
Sentiment
(cloud based)

Cognitive
based
sensors
processing
Tolerant to measurement
inaccuracies
Same approach for all
kinds of sensor

More accurate
homogeneous
measurement
(e.g. quaternions)
Semantically
relevant
interpretation and
classification
Multisensory
based learning
Generative
behavior

16

Distributed Intelligence: why ?

17

Centralized

Artificial neural network

placing intelligence
where required
Scalability

Big data
Service enablement
Global optimization

Service

Responsiveness

10000 sensors
100 Mb-1 Tb / sec
10 TOPS-10000 TOPS

Smart units

concentrator

Local analytic
Real time

100 sensors
1 Mb-10 Gb / sec
100 MOPS-100 TOPS

100 sensors
~100 Kb / sec
~100 MOPS

1 sensor
10 KOPS-100 MOPS

1 Intelligent sensor
100 MOPS-1 TOPS

Sensors

Unit
Comm

Sensors

Unit
Comm

Sensors

Unit
Comm

Sensors

Unit
Comm

Sensors

Comm

Sensors

Comm

Unit

10000 sensors
~10 Mb / sec
~10 GOPS

Collected data analytic

Service enablement

concentrator

Unit

Distributed

1 sensor
10 Kb-100 Mb / sec

Toward better automation of everything !

Energy
Brain

Environmental balance
Senses

Clean transportation
Nutrition
Health and Life Science
Ageing wealthy population

Muscles

..

Robotizing the World !

18

Human?

19

Evolution of Man Machine Interface

Technology
1940s

1980s

2006

2007

Type

Click

Move

Touch

2010

2012

2013

Talk/Listen

Look

Gesture

20XX

Think

20

Wearable for more intimacy between

human and electronics

Open
Platform

Aware

Intuitive

Key Enablers
Always on

Intelligent

Connected

Sensors
+
Microcontrollers
+
RF

21

VIRTUAL ME with VIRTUAL YOU!! Forever..

Mitra
Alex
Alex
Prof Liu

Mitra

Liu

Costas

Nanni

Costas

Luca
Nanni

Luca

Anyone.
Anytime.
Anywhere.

23

End of 20th
Century:
The era of
communications

Anything.

Forever

21st Century
Life sciences:
Strive for
Eternity!
From: DAC S. Francisco 2006

Robots
Able to perform useful tasks for humans or equipment

Personal Service Robots

Robots for domestic tasks

Entertainment robots
Handicap assistance
Personal transportation
Home security & surveillance
Flying (UAV) and Visual Inspection (Rover)

Professional Service Robots

Field robotics (Agriculture, Milking, Forestry, )

Professional cleaning
Inspection and maintenance systems
Logistic systems (Courier/Mail, Cargo handling, )
Medical robotics
Defense, rescue & security applications
Underwater systems
Robot arms in general use
Public relation robots (Marketing, Information, )

Source: IFR, International Federation of Robotics

All products, trademarks and logos are the property of their respective owners. All rights reserved. They are used here only as conceptual examples

24

Global Cognitive Computing

25

The Industrial Revolution

From Industry 1.0 to Industry 4.0

First

Second

Third

Fourth

Industrial Revolution

Industrial Revolution

Industrial Revolution

Industrial Revolution

Mechanical
production
equipments
driven by water and
steam power

Mass production
achieved by division
of labour concept
and the use of
electrical energy

Based on the use of

electronics and IT to
further automate
production

Based on the use of

cyber-physical
systems,
communications,IoT
and decentralized
decisions

18th Century

20th Century

70s

Starting

26

Industry 4.0

27

The basic principle of Industry 4.0 is that by connecting machines, work

pieces and systems, we are creating intelligent networks along the entire
value chain that can control each other autonomously
Benefits

Security & Safety Concerns

Preventive Maintenance
Connectivity (M2M, M2Cloud)
Shorter production cycle time
Improved productivity with less human intervention
Lower power consumption
Factory closer to Cities due to lower pollution
Real time information on machine status

- Ability to remotely manipulate physical assets

- Viruses and hacking

Industrie 4.0 Machines can react to unexpected changes in the Production, predict failures,
trigger maintenance autonomously, optimize logistics by reducing production cycle time and
machine downtime.

Moving to Data Driven Innovation

The CNN (Convolutional Neural Networks) example
CNN Model
10010001001
10010010111

DSPs clusters
I$ M M

DMA

SM

I$ M M

I$ M M

I$ M M

I$ M M
L-xbar

DSP

DSP

DSP

DSP

DSP

DSP

DSP

L-xbar

L-xbar

L-xbar

L-xbar

L-xbar

DSP

DSP

DSP

S-xbar

SM

L-xbar

L-xbar

L-xbar

DMA

S-xbar

DMA

I$ M M

SM

I$ M M

L-xbar

L-xbar

DSP

DSP

DSP

DSP

L-xbar

L-xbar

S-xbar

DMA

SM

S-xbar

I$ M M
L-xbar

DSP

XBAR

L-xbar

I$ M M

S-xbar

SM
DMA

I$ M M

I$ M M

S-xbar

SM
DMA

I$ M M

I$ M M

S-xbar

SM
DMA

I$ M M

I$ M M

DSP
S-xbar

SM
DMA

L-xbar

I$ M M

BUS

CNN Optimised
HW architecture

Data base

CDNN
co-processor
subsystem

MEM

MEM

MEM

MEM

28

29

COMPETITORS?

From the era of computational support

To the era of cognitive support
Neuromorphic
acceleration

30

20th Century: human progress driven by

computational support

21th Century: human progress driven by

cognitive support

31

32

Is this a Smarter World ?

Services, Data,

33

Knowledge, Profiling, Expertize, Clone

34

Scary?

Opportunity?
Energy

Big Brother
Privacy
Freedom
Identity
Security
Clones.

Environmental balance
Clean transportation
Nutrition
Health and Life Science
Ageing wealthy population
Robotics
Industry 4.0

Unless we find another 3 planets

capolinea.

Photo: www.mars-one.com

35

36

Think You!

IoT + Cloud enables the world to

Sense and Act
Brain

Senses

Muscles

In 2012 more data produced than in

previous 5000 years
90% of data produced in last two years
Less than 1% of data analyzed today

Wireless World Research predicts

7 trillion sensors by 2017
IDC predicts generated data goes
to 40 zettabytes (270) in 2020

37

Artificial Intelligence Technology Trend:

To 2016
Image recognition
technology directly to
smartphones.

Autonomous Visual
Feature Extraction
system (AVFE)

Helium SDK

Self-Driving Car

Digital identities

MEMS sensors

Panasonic AI Assistant

2010 & Before

Cyber
Intelligence
Platform

Qualcomm Snapdragon
Neural Processing
Engine

2011

Pedestrian Detection
System

Tensor Processing
Unit

Deep learning (DL)

SDK

Captionbot

S-Detect

Fathom Neural
Compute Stick (Deep
Learning accelerator)

Google Assistant Virtual assistant &

Product: Google Home

Fathom machine
learning software
framework

Eyeriss Chip

Dynamic Neuromorphic
Asynchronous Processor
(DYNAP)

2012

Smart sensor system

TorchNet

Robot

Resistive
processing units

DIGITS 4

DAVE2

CogniPoint sensor

2013

Car Honking
Method

Warp-CTC

DeepText Bidirectional recurrent

neural nets (BRNNs)

Twitter's
Cortext System

Helium Green
IoT Sensor

AutoPilot

Phantom 4, Myriad 2

Intel Xeon Phi

2014

A novel word
embedding method

Tesla P100 - A deep

learning chip

Tesla P100 - A deep

learning chip

2015

2016

Viv ( a virtual assistant)

Nervana Engine

Tay - Chatbot

Neon

Semiconductor Player
Application Player
Collaboration
Research Facility

CaffeOnSpark

News Feed dataset

Radar

Robot homes

OpenAI Gym

AI-on-a-chip

Strive for Eternity!

39

A possible future?
Clones

40

humanoid

Wearable and implantable electronics

Robot

The mix of Real & Virtual starts from gaming:

the Pokemon go experience

41