Image fusion

Goal: Combine higher spatial information in one

band with higher spectral information in another dataset to create synthetic higher resolution multispectral datasets and images

Motivation: why fuse ?

Sharper image resolution (display) Improved classification (and others)

More data types and bands available now .. because we can

Sensors
Panchromatic higher spatial resolution, visible wavelengths some include NearIR since 1999 Why are they higher resolution ? Multispectral: Lower spatial resolution visible, NIR, MIR, Thermal May include MIR depending on date (more recent) and with a lower resolution (why ?)

SPOT technical band specs

SPOT 1-3 HRV SPOT 4 SPOT 5 1986 10m 20m Vis,NIR 1998 10m 20m + MIR 2002 2.5/5m 10/20m

Pan band is in the visible spectrum (.5-.7) (.51-.73)

Geobase orthoimage program

http://geobase.ca/geobase/en/data/imagery/imr/index.html

Coverage of Canada 2005-2010 using a combination of SPOT 4 and 5 giving Pan and MS 10 /20m

Medium-High resolution sensors: Landsat

Platform/Sensor date PAN MS (m) Thermal

Landsat TM 4/5 1982/4 Landsat ETM+ 1999(-03) 15

30 30

120 60

Pan is Visible + NIR (.52-.9 microns)

[Landsat MSS 1972- 1 2 3 80m Vis/NIR ]

Cranbrook Hill, SPOT image 10m PAN and 20m MS

FUSE and IMGFUSE

IMGFUSE 432 and 234

432 RGB

234 RGB

1. Dreamcatcher movie 2003 (cabin)

Cranbrook Hill famous spots

2. Cranbrook Hill airport ? Maps/GIS

SPOT PAN

Pan Landsat 7

SPOT 20m MS

FUSE

NIR/Red ratio SPOT 20m MS data

NIR / Red SPOT fused 10m data

RGB and IHS colour models

http://www.colorspire.com/rgb-color-wheel/ IHS Interactive colour wheel: http://www.r0k.us/graphics/SIHwheel.html

RGB model

http://en.wikipedia.org/wiki/RGB_color_model

Fusing Method
IHS transformation
RGB image -> HSI

Hue,Saturation, Intensity The intensity channel is replaced by the high res (PAN) channel and the transformation is reversed: HIS -> RGB

http://eoedu.belspo.be/en/guide/fusion.asp?section=3.11.2

Problems with fuse / IHS

Colour shift Spectral fidelity

Partly solved by ?? HIS v FUSE PANSHARP v FUSE IMGFUSE v FUSE

NWT Geomatics imagery

http://www.gnwtgeomatics.nt.ca/RemoteSensing/avhrr/TM7files.asp

Wunderle et al, IJRS 2007: Regenerating forest structure estimation using SPOT-5 pan-sharpened imagery
http://homepage.usask.ca/~xug991/Publications/Wunderle_ijrst2007.pdf

a. 10m MS bands 4-2-3 b. 2.5m fused image Examined texture, and NDMI= SPOT `(3-4)/(3+4) versus forest structure Needed high resolution AND mid-IR ; used PCI PANSHARP

Combine from same or different sensors

MODIS 1999 250 (Vis/NIR) 500 MIR 1km TIR

SPOT Landsat Landsat MODIS MODIS RADARSAT Orthophotos Satellite Imagery

Max 5: 1 maximum ratio recommended (?)

FUSION OF MODIS AND RADARSAT DATA FOR CROP TYPE CLASSIFICATION

G. Hong , Y. Zhang , A. Zhangb, F. Zhou b J. Li http://www.commission4.isprs.org/urumchi/papers/153-156%20G.%20Hong%20.pdf MODIS: 250 / 500 m res. Radarsat: 12.5 m -> 25m

Fusion Technique to Extract Detail Information from Moderate Resolution Data for Global Scale Image Map Production Francis X.J. Canisius, Hugh Turral

The Principal Components Analysis method

Run PCA on the Multispectral data Create PC1, PC2, PC3 Replace PC1 (brightness) with the higher res PAN band Retransform PCA (decorrelate) back to RGB

Very high resolution sensors Sensor date Pan Ikonos 1999 1 Quickbird 2001 0.6 Orbview3 2003 1 ALOS 2006 2.5 Worldview 1 2007 0.5 Worldview 2 2009 0.46 Formosat 2007 2 GeoEye 2008 0.41 SPOT 5 2002 2.5/5 Cartosat 2005 0.8 EROS A, B 2000/06 1.8/0.7 Rapideye 2008 x MS (res: m) 4 2.4 4 RIP 2003 10 2 1.84 8 1.65 10 (no MS) (no MS) 5

(very) High resolution imagery = < 10 metres

Ikonos Quickbird GeoEye Worldview I Worldview II Cartosat 1 (India) EROS A, B (Israel) ALOS-PRISM SPOT 5 (France) Monitor-E (Russia) Korona keyhole RapidEye 1-5 (Germany) TerraSAR (Germany)
Task: research and describe one of these in a 4 slide powerpoint