Digital Image Processing Lecture 1 Introduction

DigitalImageProcessing(CS/ECE545)
Lecture1:IntroductiontoImage
ProcessingandImageJ
ProfEmmanuelAgu
ComputerScienceDept.
WorcesterPolytechnicInstitute(WPI)
WhatisanImage?
2dimensionalmatrixofIntensity(grayorcolor)values
Image coordinates
Set of Intensity values are integers
ExampleofDigitalImages
a) Naturallandscape
b) Syntheticallygeneratedscene
c) Postergraphic
d) Computerscreenshot
e) Blackandwhiteillustration
f) Barcode
g) Fingerprint
h) Xray
i) Microscopeslide
j) SatelliteImage
k) Radarimage
l) Astronomicalobject
ImagingSystem
Example: a camera Credits: Gonzales and Woods

Converts light to image
DigitalImage?
Remember:digitization
causesadigitalimageto
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
becomeanapproximation ofarealscene
1 pixel
Digital Image Digital Image

Real image Real image
(an approximation) (an approximation)
DigitalImage
Commonimageformatsinclude:
1valuesperpoint/pixel(B&WorGrayscale)
3valuesperpoint/pixel(Red,Green,andBlue)
4valuesperpoint/pixel(Red,Green,Blue,+AlphaorOpacity)
Grayscale RGB RGBA
Wewillstartwithgrayscaleimages,extendtocolorlater
WhatisimageProcessing?
Algorithmsthatalteraninputimagetocreatenewimage
Inputisimage,outputisimage
Image Processing
Algorithm
(e.g. Sobel Filter)
Original Image Processed Image
Improvesanimageforhumaninterpretationinwaysincluding:
Imagedisplayandprinting
Imageeditting
Imageenhancement
Imagecompression
ExampleOperation:NoiseRemoval
Think of noise as white specks on a picture (random or non-random)

Examples:NoiseRemoval
Example:ContrastAdjustment
Example:EdgeDetection
Example:RegionDetection,
Segmentation
Example:ImageCompression
Example:ImageInpainting
Inpainting? Reconstruct corrupted/destroyed parts of an image

Examples:Artistic(MovieSpecial)Effects
ApplicationsofImageProcessing
dd
dd
ApplicationsofImageProcessing:Medicine
OriginalMRIImageofaDogHeart EdgeDetectionImage
dd
ApplicationsofImageProcessing:
GeographicInformationSystems(GIS)
Terrainclassification
Meteorology(weather)
ApplicationsofImageProcessing:Law
Enforcement
Numberplaterecognitionforspeedcamerasor
automatedtollsystems
Fingerprintrecognition
ApplicationsofImageProcessing:HCI
Facerecognition
Gesturerecognition
RelationshipwithotherFields
KeyStagesinDigitalImageProcessing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Representation
Acquisition & Description
Object
Problem Domain
recognition
Colour Image Image
Processing Compression
KeyStagesinDigitalImageProcessing:
ImageAquisition
Image Morphological
Image
Segmentation
Enhancement
Example: Take a picture Object

Problem Domain
recognition
Colour Image Image
ImageEnhancement
Image Morphological
Image
Segmentation
Enhancement
Example: Change contrast

Object
Problem Domain
recognition
Colour Image Image
ImageRestoration
Image Morphological
Example: Remove
Noise
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Colour Image Image
MorphologicalProcessing
Extract
Image Morphological attributes

Restoration Processing useful for
describing
image
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Colour Image Image
Segmentation
Divide
Image Morphological image into

Restoration Processing constituent
parts
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Colour Image Image
ObjectRecognition
Image
regions
Image Morphological transformed

Restoration Processing suitable for
computer
processing
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Colour Image Image
Representation&Description
Finds &
Image Morphological Labels

Restoration Processing objects in
scene (e.g.
motorbike)
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Colour Image Image
ImageCompression
Reduce
Image Morphological
image size
Restoration Processing (e.g. JPEG)
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Colour Image Image
ColourImageProcessing
Image Morphological
Image
Segmentation
Enhancement
Object
Problem Domain
recognition
Consider color
Colour Image Image
images (color
models, etc) Processing Compression
MathematicsforImageProcessing
Calculus
Linearalgebra
Probabilityandstatistics
DifferentialEquations(PDEsandODEs)
DifferentialGeometry
HarmonicAnalysis(Fourier,wavelet,etc)
AboutThisCourse
ImageProcessinghasmanyaspects
ComputerScientists/Engineersdeveloptools(e.g.photoshop)
Requires knowledgeofmaths,algorithms,programming
Artists useimageprocessingtoolstomodifypictures
DOESNOTrequireknowledgeofmaths,algorithms,programming
Example: Knoll Light Factory photoshop plugin
Example: Portraiture photoshop plugin Example: ToonIt

photoshop plugin
AboutThisCourse
Mosthobbyistsfollowartistpath.Notmuchmath!
ThisCourse:ImageProcessingforcomputerscientistsand
Engineers!!!
Teachesconcepts,usesImageJ asconcreteexample
ImageJ:Imageprocessinglibrary
Includeslotsofalreadyworkingalgorithms,
Canbeextendedbyprogrammingnewimageprocessingtechniques
CourseisNOT
justaboutprogrammingImageJ
acomprehensivecourseinImageJ.(OnlypartsofImageJ covered)
aboutusingpackageslikePhotoshop,GIMP
AboutThisCourse
Classisconcernedwith:
Howtoimplementimageprocessingalgorithms
Underlyingmathematics
Underlyingalgorithms
Thiscourseisalotofwork.Requires:
LotsofprogramminginJava(maybesomeMATLAB)
Lotsofmath,linearsystems,fourieranalysis
Administrivia:SyllabusSummary
2Exams(50%),5Projects(50%)
Projects:
DevelopImageJJavacodeonanyplatformbutmustworkinZoolabmachine
Maydiscussprojectsbutturninindividualprojects
Classwebsite: http://web.cs.wpi.edu/~emmanuel/courses/cs545/S14/
Text:
DigitalImageProcessing:AnAlgorithmicIntroductionusingJava byWilhelmBurger
andMarkJ.Burge,SpringerVerlag,2008
Cheating:ImmediateFinthecourse
Myadvice:
Cometoclass
Readthetext
Understandconceptsbeforecoding
LightAndTheElectromagnetic
Spectrum
justaparticularpartofelectromagnetic
Light:
spectrumthatcanbesensedbythehumaneye
Theelectromagneticspectrumissplitupaccordingto
thewavelengthsofdifferentformsofenergy
ReflectedLight
Thecolourshumansperceivearedeterminedby
natureoflightreflectedfromanobject
Forexample,ifwhitelight
(containsallwavelengths)
isshoneontogreenobject
itabsorbsmostwavelengths Colours
Absorbed
absorbedexceptgreen
wavelength(color)
ElectromagneticSpectrumandIP
ImagescanbemadefromanyformofEMradiation
ImagesfromDifferentEMRadiation
Radarimaging(radiowaves)
MagneticResonanceImaging(MRI)(Radiowaves)
Microwaveimaging
Infraredimaging
Photographs
Ultravioletimagingtelescopes
XraysandComputedtomography
Positronemissiontomography(gammarays)
Ultrasound(notEMwaves)
HumanVisualSystem:StructureOf
TheHumanEye
Thelensfocuseslightfromobjectsontotheretina
Retinacoveredwith
lightreceptorscalled
cones (67million)and
rods (75150million)
Conesconcentrated
aroundfovea.Very
sensitivetocolour
Rodsmorespreadout
andsensitivetolowilluminationlevels
ImageFormationInTheEye
Musclesineyecanchangetheshapeofthelens
allowingusfocusonnearorfarobjects
Animageisfocusedontoretinaexcitingtherodsand
conesandsendsignalstothebrain
ImageFormation
ThePinholeCamera(abstraction)
FirstdescribedbyancientChineseandGreeks(300400AD)
ThinLens
BrightnessAdaptation&
Discrimination
Thehumanvisualsystemcanperceiveapproximately
1010 differentlightintensitylevels
However,atanyonetimewecanonlydiscriminate
betweenamuchsmallernumber brightnessadaptation
Similarly,perceivedintensity ofaregionisrelatedtothe
lightintensitiesoftheregionssurroundingit
Discrimination:MachBandEffect
Perceived intensity
overshoots or undershoots
at areas of intensity change
Discrimination
An example of simultaneous contrast
All inner squares have same intensity but appear darker as outer
square (surrounding area) gets lighter
ImageAcquisition
Imagestypicallygeneratedbyilluminatingascene
andabsorbingenergyreflectedbysceneobjects
ImageSensing
Incomingenergy(e.g.light)landsonasensormaterial
responsivetothattypeofenergy,generatingavoltage
Collectionsofsensorsarearrangedtocaptureimages
Imaging Sensor
Line of Image Sensors

Array of Image Sensors
SpatialSampling
Cannotrecordimagevaluesforall(x,y)
Sample/recordimagevaluesatdiscrete(x,y)
Sensorsarrangedingridtosampleimage
Image(Spatial)Sampling
Adigitalsensorcanonlymeasurealimitednumberof
samples atadiscrete setofenergylevels
Sampling canbethoughtofas:
Continuoussignalxcombfunction
ImageQuantization
Quantization: processofconvertingcontinuousanalog
signalintoitsdigitalrepresentation
DiscretizeimageI(u,v) values
Limitvaluesimagecantake
ImageSamplingAndQuantization
Samplingandquantizationgenerates
approximation ofarealworldscene
ImageasDiscreteFunction
ImageasaFunction
RepresentingImages
Imagedatastructureis2Darrayofpixelvalues
Pixelvaluesaregraylevelsinrange0255orRGBcolors
Arrayvaluescanbeanydatatype(bit,byte,int,float,
double,etc.)
SpatialResolution
Thespatialresolutionofanimageisdeterminedby
howfine/coarsesamplingwascarriedout
Spatialresolution:smallestdiscernableimagedetail
Visionspecialists
talkaboutimageresolution
Graphicdesigners
talkaboutdotsper
inch(DPI)
SpatialResolution
SpatialResolution:StretchedImages
IntensityLevelResolution
Intensitylevelresolution:numberofintensitylevels
usedtorepresenttheimage
Themoreintensitylevelsused,thefinerthelevelofdetail
discernableinanimage
Intensitylevelresolutionusuallygivenintermsofnumber
ofbitsusedtostoreeachintensitylevel
Number of Intensity
Number of Bits Examples
Levels
1 2 0, 1
2 4 00, 01, 10, 11
4 16 0000, 0101, 1111
8 256 00110011, 01010101
16 65,536 1010101010101010
256 grey levels (8 bits per pixel) 128 grey levels (7 bpp) 64 grey levels (6 bpp) 32 grey levels (5 bpp)
16 grey levels (4 bpp) 8 grey levels (3 bpp) 4 grey levels (2 bpp) 2 grey levels (1 bpp)
Saturation&Noise
Saturation: highest intensity

value above which color is
washed out
Noise: grainy texture pattern

Resolution:HowMuchIsEnough?
Thebigquestionwithresolutionisalwayshowmuch
isenough?
Dependsonwhatisintheimage(details)andwhat
youwouldliketodowithit(applications)
Keyquestions:
Doesimagelookaestheticallypleasing?
Canyouseewhatyouneedtoseeinimage?
Resolution:HowMuchIsEnough?
Example:Pictureonrightokayforcountingnumber
ofcars,butnotforreadingthenumberplate
Low Detail
Medium Detail
High Detail
ImageFileFormats
Hundredsofimagefileformats.Examples
TaggedImageFileFormat(TIFF)
GraphicsInterchangeFormat(GIF)
PortableNetworkGraphics(PNG)
JPEG,BMP,PortableBitmapFormat(PBM),etc
Imagepixelvaluescanbe
Grayscale:0 255range
Binary:0or1
Color:RGBcolorsin0255range(orothercolormodel)
Applicationspecific(e.g.floatingpointvaluesinastronomy)
HowmanyBitsPerImageElement?
IntroductiontoImageJ
ImageJ:OpensourceJavaImageprocessingsoftware
DevelopedbyWayneRasbandatNat.InstforHealth(NIH)
Manyimageprocessingalgorithmsalreadyimplemented
Newimageprocessingalgorithmscanalsobeimplementedeasily
Niceclickanddraginterface
Wayne Rasband (right)

ImageJ:KeyFeatures
Interactivetoolsforimageprocessingofimages
Supportsmanyimagefileformats(JPEG,PNG,GIF,TIFF,
BMP,DICOM,FITS)
Pluginmechanismforimplementingnew
functionality,extendingImageJ
Macrolanguage+interpreter:Easytoimplement
largeblocksfromsmallpieceswithoutknowingJava
ImageJSoftwareArchitecture
ImageJusesJavaswindowingsystem(AWT)fordisplay
ProgrammerwritespluginstoextendImageJ
AlreadyimplementedpluginsavailablethroughImageJs
pluginsmenu
ImageJPlugins
Plugins:Javaclassesthatimplementaninterface
definedbyImageJ
Twotypesofplugins
Plugin:Requiresnoimagetobeopenfirst
PlugInFilter:Passedcurrentlyopenimage,operatesonit
WewillmostlyfocusonPlugInFilters
Twomethodsdefined
intsetup(Stringarg,ImagePlusim):
Doesinitialization,verifiesplugincapabilitiesmatchesinputimage
intrun(ImageProcessorip):
Doesactualwork.Passedimage(ip),modifiesit,createsnewimages
FirstImageJExample:InvertImage
Task:Invert8bitgrayscale(MxN)image
Basically,replaceeachimagepixelwithitscomplement
WeshallcallplugInMy_Inverter
NameofJavaClass:My_Inverter
Nameofsourcefile:My_Inverter.java
_underscoremakesImageJrecognizesourcefileasplugin
Aftercompilation,automaticallyinsertedintoImageJmenu
FirstImageJExample:InvertImage
Indicates plugIn handles

8-bit grayscale images
Retrieves width and

height of input image
Loops over all image pixels

Sets each pixel to its compliment
(255 original pixel value)
CompilingImageJPlugins
1. PlaceplugIn sourcecode(My_Inverter.java)insub
directoryofImageJ installlocation<ij>/plugins/
2. Opengrayscaleimagefromsamples(sincepluginrequires
imagetobeopen)
3. Compileinrunpluginbygoingtomenu
Plugins->Compile and Run
Note:Onstartup,ImageJ loadsallpluginsinthe<ij>plugins/
subdirectory
ImageJ canalsobeusedwitheclipseIDE(largeprograms)
References
WilhelmBurgerandMarkJ.Burge,DigitalImage
Processing,Springer,2008
UniversityofUtah,CS4640:ImageProcessingBasics,
Spring2012
GonzalesandWoods,DigitalImageProcessing(3rd
edition),PrenticeHall
DigitalImageProcessingslidesbyBrianMacNamee

Digital Image Processing Lecture 1 Introduction

Diunggah oleh

Informasi Dokumen

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Digital Image Processing Lecture 1 Introduction

Diunggah oleh

Hak Cipta:

Format Tersedia

DigitalImageProcessing(CS/ECE545)

Example: a camera Credits: Gonzales and Woods

Digital Image Digital Image

Grayscale RGB RGBA

Original Image Processed Image

Think of noise as white specks on a picture (random or non-random)

Inpainting? Reconstruct corrupted/destroyed parts of an image

Example: Take a picture Object

Example: Change contrast

Image Morphological attributes

Image Morphological image into

Image Morphological transformed

Image Morphological Labels

Example: Knoll Light Factory photoshop plugin

Example: Portraiture photoshop plugin Example: ToonIt

An example of simultaneous contrast

Line of Image Sensors

Saturation: highest intensity

Noise: grainy texture pattern

Wayne Rasband (right)

Indicates plugIn handles

Retrieves width and

Loops over all image pixels

Anda mungkin juga menyukai