Processing
07/29/19 1
Introduction
07/29/19 2
Course Outcomes: On completion of the course the students are expected to-
• Apply the concepts of sampling, quantization in the context of digital
images. They should also be able to measure pixel distances and evaluate
neighbourhood properties in an image.
• Represent an image in spatial and frequency domains and transform from
one to the other. The student should acquire the requisite mathematical
knowledge to perform the transform.
• Understand the statistical tools used in image enhancement, perform
spatial transforms, design masks for enhancing images and apply them in
efficient ways.
• Differentiate between constrained and unconstrained restoration, develop
the mathematical model for restoring images and solve the models for
special cases.
• Calculate mathematical parameters related to compression, understand
lossy and non lossy compression and compute evaluation criterion for
compression methods.
07/29/19 3
• Text Book:
– Rafael. C. Gonzalez & Richard E. Woods.- Digital
Image Processing, 3/e Pearson Education.
• Reference Books:
– W.K.Pratt.-Digital Image Processing ,3/e Edn., John
Wiley & sons, Inc. 2006
– M. Sonka et.al Image Processing, Analysis and
Machine Vision, 2/e, Thomson, Learning, India
Edition, 2007.
07/29/19 4
What is a Digital Image?
A digital image is a representation of a two-
dimensional image as a finite set of digital
values, called picture elements or pixels
07/29/19 5
What is a Digital Image? (cont…)
Pixel values typically represent gray levels,
colors, heights, opacities etc
•digitization implies that a digital image is an
approximation of a real scene
1 pixel
07/29/19 6
What is a Digital Image? (cont…)
Common image formats include:
– 1 sample per point (B&W or Grayscale)
– 3 samples per point (Red, Green, and Blue)
– 4 samples per point (Red, Green, Blue, and “Alpha”, a.k.a.
Opacity)
07/29/19 7
What is Digital Image Processing?
Digital image processing focuses on two major
tasks
– Improvement of pictorial information for human
interpretation
– Processing of image data for storage, transmission
and representation for Autonomous machine
perception
07/29/19 8
What is DIP? (cont…)
The continuum from image processing to
computer vision can be broken up into low-,
mid- and high-level processes
Low Level Process Mid Level Process High Level Process
Input: Image Input: Image Input: Attributes
Output: Image Output: Attributes Output: Understanding
Examples: Noise Examples: Object Examples: Scene
removal, image recognition, understanding,
sharpening segmentation autonomous navigation
07/29/19 9
Medical Imagery
Medical imaging refers to
diagnosing, monitoring, or treating
medical conditions in a human
body.
Each type of technology gives
different information about the area Image of Retina
Processed retina
07/29/19 10
image
Medical Imagery
• X-rays are a type of radiation, and when they pass
through the body, dense objects such as bone block
the radiation and appear white on the x-ray film,
while less dense tissues appear gray and are difficult
to see.
• X-rays are typically used to diagnose and assess bone
degeneration or disease, fractures and dislocations,
infections, or tumors.
07/29/19 11
Medical Imagery
• MRI, or magnetic resonance imaging, combines a
powerful magnet with radio waves (instead of x-rays)
and a computer to manipulate these magnetic
elements and create highly detailed images of
structures in the body.
• Images are viewed as cross sections or "slices" of the
body part being scanned. There is no radiation
involved as with x-rays.
• MRI scans are frequently used to diagnose bone and
joint problems.
07/29/19 12
Medical Imagery
CT Scan- A computed tomography (CT) scan (also
known as CAT scan) is similar to an MRI in the detail
and quality of image it produces, yet the CT scan is
actually a sophisticated, powerful x-ray that takes
360-degree pictures of internal organs, spine, and
vertebrae.
07/29/19 13
Satellite Imaging
Satellite imagery consists of photographs
of Earth or other planets made by means
of artificial satellites.
07/29/19 14
Image Forensics
• Editing, adding or removing important features
from an image without leaving any obvious
traces of tampering.
• Data Removal.
• Data Replacement.
• Data Replication.
07/29/19 15
Examples: Image Enhancement
One of the most common uses of DIP
techniques: improve quality, remove noise etc
07/29/19 16
Examples: Industrial Inspection
•Human operators are
expensive, slow and
unreliable
•Make machines do the
job instead
•Industrial vision systems
are used in all kinds of
industries
07/29/19 17
Examples: PCB Inspection
Printed Circuit Board (PCB) inspection
Machine inspection is used to determine that all
components are present and that all solder
joints are acceptable
07/29/19 18
Examples: Law Enforcement
Image processing
techniques are used
extensively by law
enforcers
– Number plate
recognition for speed
cameras/automated toll
systems
– Fingerprint recognition
– Enhancement of CCTV
07/29/19
images 19
Examples: HCI
Try to make human computer
interfaces more natural
– Face recognition
– Gesture recognition
Does anyone remember the
user interface from “Minority
Report”?
These tasks can be extremely difficult
07/29/19 20
Components of a Image Processing
System
07/29/19 21
Elements of Visual Perception
• Structure
of the
human eye
07/29/19 22
• Rods and cones in the retina
07/29/19 23
Image Sensing and Acquisition
07/29/19 24
• Image acquisition using a single sensor
07/29/19 25
• Using
sensor
strips
07/29/19 26
• A simple
image
formation
model
07/29/19 27
Image Sampling and Quantization
07/29/19 28
• Sampling and
quantization
07/29/19 29
• To acquire digital images from the continuous sensed
data f(x, y):
– Digitization in coordinate values: Sampling
– Digitization in amplitude values: Quantization.
• The resulting image has M rows and N columns as
07/29/19 30
The digitization process requires to determine
the M, N, and L.
M and N: spatial resolution
L: gray-level resolution
L = 2k. L = gray-level
Dynamic range: the range of values spanned
by the gray scale, [Lmin, Lmax].
High dynamic range = high contrast image
The number of bits required to store the
image
b = M N k or
b = N2 k
07/29/19 31
Key Stages in Digital Image Processing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 32
Key Stages in Digital Image Processing:
Image Aquisition
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 33
Key Stages in Digital Image Processing:
Image Enhancement
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 34
Key Stages in Digital Image Processing:
Image Restoration
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 35
Key Stages in Digital Image Processing:
Morphological Processing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 36
Key Stages in Digital Image Processing:
Segmentation
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 37
Key Stages in Digital Image Processing:
Object Recognition
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 38
Key Stages in Digital Image Processing:
Representation & Description
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 39
Key Stages in Digital Image Processing:
Image Compression
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 40
Key Stages in Digital Image Processing:
Colour Image Processing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
07/29/19 41