Photogrammetric Triangulation
Overview
1
Photogrammetry: The Reconstruction Process
Input Imagery
Perspective Center y
xa a
ya
x
2
Collinearity Equations
(Perspective Center)
zi yi
ZG
a (xa, ya)
c pp
+ xi
+
R(ω , φ ,κ ) Oi
A
ZO
YG ZA
XA
XO YA
YO XG
OG
Collinearity Equations
3
Single Photograph
Single Photograph
a (image point)
Perspective Center
4
Stereo-Photogrammetry
• We have the same point appearing in two images.
– Four equations (two collinearity equations in each image).
– Three unknowns (ground coordinates of the corresponding
object points - Best Case Scenario).
• IOP & EOP are available.
• Thus, we have a redundancy of one (which will
contribute towards the computation of the ROP).
• Conceptually: the two image points define two light
rays.
– The object point is the intersection of these light rays.
Stereo-Photogrammetry
5
Stereo-Photogrammetry
a a´
PC PC
Stereo-Photogrammetry
From Images to Object Space
• For a stereo-pair, we can derive a 3-D
representation of the object space covered by the
overlap area as follows:
– Perform RO of the stereo-pair under consideration
(using at least five conjugate points) → stereo-model.
– Using some GCP, we can rotate, scale, and shift the
stereo-model (AO) until it fits at the location of the
ground control points (i.e., the residuals at the GCP are
as small as possible).
– For the absolute orientation, we need at least three
ground control points (those points should not be
collinear).
Advanced Topics in Photogrammetry Ayman F. Habib
12
6
From Images to Object Space (RO)
Model Space
Model Space
Model Space
Advanced Topics in Photogrammetry Ayman F. Habib
13
Stereo Model
Object Space
Advanced Topics in Photogrammetry Ayman F. Habib
14
7
Photogrammetric Triangulation
• Objective:
– How can we reconstruct the object space from imagery
without the need for three ground control points in each
stereo-model?
• Alternatives:
– Strip Triangulation.
– Block Adjustment of Independent Models (BAIM).
– Bundle Block Adjustment.
Strip Triangulation
8
Strip Triangulation
• Strip triangulation is used for mapping linear features (such
as road and rail road network and pipelines).
• Given: imagery along one strip with 60% overlap between
successive imagery.
Strip Triangulation
• Procedure:
– Perform RO of the first stereo-model (DRO or IRO).
– Perform AO of the first stereo-model using 3GCP.
– Perform RO for the second model using only DRO (we
do not want to disturb the orientation parameters for the
second image).
– Only scale is required to establish the AO for the
second model.
– Adjust the base until a point in the overlap area
between the first and second model has the same
elevation.
– For the remaining models, repeat the above three steps.
Advanced Topics in Photogrammetry Ayman F. Habib
18
9
Strip Triangulation
Strip Triangulation
• Error Propagation:
– Similar to an open traverse, errors will increase as the
length of the strip increases.
• Solution:
– Implement GCP every three or four models.
– Apply corrections polynomials.
• Correction Polynomials:
– They are used to reduce the difference between the
photogrammetric and geodetic coordinates of the
control points.
Advanced Topics in Photogrammetry Ayman F. Habib
20
10
Correction Polynomials
Photogrammetric Points
Geodetic Points
Correction Polynomials
11
Correction Polynomials
12
Accuracy of Strip Triangulation
σsZ/σM (max)
σsXY/σM (max)
σsZ/σM (mean)
σsXY/σM (mean)
1
i
1
• i number of models bridged together.
• Maximum (worst) accuracy takes place at the center
between the control points.
Advanced Topics in Photogrammetry Ayman F. Habib
25
13
Block Adjustment
Block Adjustment
14
Block Adjustment
15
Block Adjustment of Independent Models
• Procedure:
– Perform RO (DRO or IRO) for all the stereo-models in
the project.
– The models are simultaneously rotated, scaled, and
shifted until:
• The tie points fit together as well as possible.
• The residuals at the location of the ground control points are as
small as possible.
16
BAIM: Concept
1 2 3
6 5 4
BAIM: Concept
Tie Point
YG
Control Point
2 2 3 3
1 2
1 Y
Y I II
x x
I II
5 5 6 5 6
4
4
4
5 5 6 III IV
Y
Y
III IV 8
7 9
x x
7 9
8 8
XG
Before BAIM After BAIM
Advanced Topics in Photogrammetry Ayman F. Habib
34
17
Block Adjustment of Independent Models
• BAIM can be carried out in either 2-D or 3-D.
• Planimetric BAIM:
– Given: 2-D model coordinates (X, Y) measured in
relatively oriented and leveled models.
– Required: 2-D ground coordinates of these points as
well as the transformation parameters associated with
the involved models.
• Spatial BAIM:
– Given: 3-D model coordinates (X, Y, Z) measured in
relatively oriented models.
– Required: 3-D ground coordinates of these points as
well as the transformation parameters associated with
the involved models.
Advanced Topics in Photogrammetry Ayman F. Habib
35
Planimetric BAIM
18
Leveling Relatively Oriented Models
⎡ XG ⎤ ⎡ XT ⎤ ⎡XM ⎤
⎢ Y ⎥ = ⎢ Y ⎥ + S R(Ω,Φ,Κ) ⎢Y ⎥
⎢ G⎥ ⎢ T⎥ ⎢ M⎥
⎢⎣ ZG ⎥⎦ ⎢⎣ ZT ⎥⎦ ⎢⎣ ZM ⎥⎦
• For leveled models, (Ω and Φ) should be zeros.
• Let’s look at the third equation:
Advanced Topics in Photogrammetry Ayman F. Habib
37
19
Leveling Relatively Oriented Models
20
Effect of Leveling Errors
X G = X T + S [cos Κ X M − sin Κ YM ] + S dΦ Z M
YG = YT + S [sin Κ X M + cos Κ YM ] − S dΩ Z M
t Height differences
within the model
Planimetric Error
t
Leveling error
21
Planimetric BAIM
• Given:
– Planimetric model coordinates of tie points (XM, YM).
• Tie points: Points that appear in more than one model.
– Planimetric ground coordinates of control points.
• Adjustment procedure:
– The models are displaced (XT, YT), rotated (Κ), and
scaled (S) until:
• The tie points fit together as well as possible.
• The residuals at the ground control points are as small as
possible.
Planimetric BAIM
⎡ X G ⎤ ⎡ X T ⎤ ⎡a − b ⎤ ⎡ X M ⎤
⎢ Y ⎥ = ⎢ Y ⎥ + ⎢b a ⎥ ⎢ Y ⎥
⎣ G⎦ ⎣ T⎦ ⎣ ⎦⎣ M ⎦
a = S cos Κ
b = S sin Κ Linear Model
Advanced Topics in Photogrammetry Ayman F. Habib
44
22
Planimetric BAIM
• Unknowns:
– Transformation parameters (XT, YT, a, and b) for each
model.
– Ground coordinates of tie points, which appear in more
than one model.
• Observable quantities:
– Ground coordinates of control points.
– Model coordinates of tie points.
Planimetric BAIM
1 2 3
6 5 4
23
Planimetric BAIM: Example
Tie Point
YG
Control Point
2 2 3 3
1 2
1 Y
Y I II
x x
I II
5 5 6 5 6
4
4
4
5 5 6 III IV
Y
Y
III IV 8
7 9
x x
7 9
8 8
XG
Before BAIM After BAIM
Advanced Topics in Photogrammetry Ayman F. Habib
47
24
Planimetric BAIM: Ground Control Points
X G − e X G = X T + a ( X M − e X M ) − b (YM − eYM )
YG − eYG = YT + b ( X M − e X M ) + a (YM − eYM )
X G = X T + a X M − b YM + e X G − a e X M + b eYM
YG = YT + b X M + a YM + eYG − b e X M − a eYM
X G = X T + a X M − b YM + v X • Underlined terms:
• Unknown quantities.
YG = YT + b X M + a YM + vY
where :
v X = e X G − a e X M + b eYM
vY = eYG − b e X M − a eYM
Advanced Topics in Photogrammetry Ayman F. Habib
49
25
Planimetric BAIM
• Adding the observation equations from ground
control and tie points, we get:
⎡ y1 ⎤ ⎡ A11 0 ⎤ ⎡ x1 ⎤ ⎡ e1 ⎤ ⎧Observation equations arising from GCP
⎢~ ⎥=⎢ A22 ⎥⎦ ⎢ x ⎥ + ⎢e ⎥ ⎨
⎣ 0 ⎦ ⎣ A21 ⎣ 2⎦ ⎣ 2⎦ ⎩ Observation equations from tie points
Planimetric BAIM
⎡ e1 ⎤ ⎛⎜ ⎡0⎤ 2 ⎡ P1
−1
0 ⎤⎞
⎢e ⎥ ~ ⎜ ⎢0⎥ , σ o ⎢ ⎥⎟
⎣ 2⎦ ⎝⎣ ⎦ ⎣ 0 P2−1 ⎦ ⎟⎠
⎡ A11T T
A21 ⎤ ⎡ P1 0 ⎤ ⎡ A11 0 ⎤ ⎡ xˆ1 ⎤ ⎡ A11T T
A21 ⎤ ⎡ P1 0 ⎤ ⎡ y1 ⎤
⎢ T ⎥ ⎢
P2 ⎥⎦ ⎢⎣ A21 A22 ⎥⎦ ⎢ xˆ ⎥ = ⎢ T ⎥ ⎢ ~
P2 ⎥⎦ ⎢⎣ 0 ⎥⎦
⎣0 A22 ⎦ ⎣ 0 ⎣ 2⎦ ⎣ 0 A22 ⎦ ⎣ 0
26
Planimetric BAIM
N11 xˆ1 + N12 xˆ 2 = C1
~
N12T xˆ1 + N 22 xˆ 2 = 0
• N11 is a block diagonal matrix with 4x4 sub-
blocks along the diagonal.
• N22 is a block diagonal matrix with 2x2 sub-
blocks along the diagonal.
• We can start by solving for x2 first as follows:
xˆ1 = N11−1 C1 − N11−1 N12 xˆ2
(N 22 − N12T N11−1 N12 ) 2np × 2np
(N 22 −N T
12 N −1
11 N12 ) xˆ2 = − N T
12 N −1
11 C1 where :
(
xˆ 2 = − N 22 − N12T N11−1 N12 )
−1
N12T N11−1 C1 np ≡ number of tie points
Advanced Topics in Photogrammetry Ayman F. Habib
53
Planimetric BAIM
• Sequential solution of the parameters:
• Option # 1: Solving for x2 first.
(
xˆ2 = − N 22 − N12T N11−1 N12 )−1
N12T N11−1 C1
xˆ1 = N11−1 C1 − N11−1 N12 xˆ 2
• Option # 2: Solving for x1 first.
(
xˆ1 = N11 − N12 N 22−1 N12T ) −1
C1 (N 11 − N12 N 22−1 N12T )
4nm × 4nm
where :
xˆ2 = − N 22−1 N12T xˆ1
nm ≡ number of models
Advanced Topics in Photogrammetry Ayman F. Habib
54
27
Planimetric BAIM
• Sequential solution of parameters:
– Option # 1 is useful whenever 2np < 4nm.
– Option # 2 is useful whenever 4nm < 2np.
– Where:
• np ≡ number of tie points.
• nm ≡ number of models.
• Remarks:
– Refer the coordinates within each stereo-model to its
centroid.
• Whenever we have ΣXM or ΣYM, they would reduce to zero
(improve the sparsity of the normal equation matrix).
– A point that appears in one model is not useful
(eliminate it from the adjustment).
Advanced Topics in Photogrammetry Ayman F. Habib
55
Planimetric BAIM
• Remarks: Instead of dealing with control points
and tie points in different ways, we can do the
following:
– Treat all the points as tie points.
– Add pseudo observations for the ground control points.
• This approach is more general/flexible.
X G = X T + a ( X M − e X M ) − b (YM − eYM ) ⎡e X M ⎤
⎢ e ⎥ ~ (0, Σ M )
YG = YT + b ( X M − e X M ) + a (YM − eYM ) ⎣ YM ⎦
⎡ X Go ⎤ ⎡ X G ⎤ ⎡e X ⎤ ⎡e X Go ⎤
⎢Y ⎥ = ⎢ ⎥ + ⎢ Go ⎥ ⎢ e ⎥ ~ (0, Σ G )
⎣ Go ⎦ Observed ground coordinates ⎣ YG ⎦ ⎢⎣ eYGo ⎥⎦ ⎢⎣ YGo ⎥⎦
Advanced Topics in Photogrammetry Ayman F. Habib
56
28
Spatial BAIM
• Given:
– 3-D model coordinates (XM, YM, ZM) of tie and control
points in relatively oriented models.
– 3-D ground coordinates of control points.
• Required:
– 3-D ground coordinates of tie points (3 np).
• Where np is the number of tie points.
– The transformation parameters associated with each
model (7 nm).
• Where nm is the number of models.
Spatial BAIM
29
Spatial BAIM: Mathematical Model
ZM YM
ZG XM
R( Ω, Φ, Κ)
S OM
YG
ZT
XT
YT
OG XG
⎡ XG ⎤ ⎡ XT ⎤ ⎡XM ⎤
⎢ Y ⎥ = ⎢ Y ⎥ + S R(Ω,Φ,Κ) ⎢Y ⎥
⎢ G⎥ ⎢ T⎥ ⎢ M⎥
⎢⎣ ZG ⎥⎦ ⎢⎣ ZT ⎥⎦ ⎢⎣ ZM ⎥⎦
30
Spatial BAIM: Mathematical Model
⎡XM ⎤ ⎡ X G − XT ⎤
⎢ Y ⎥ = 1/ S RT (Ω,Φ,Κ) ⎢ Y −Y ⎥
⎢ M⎥ ⎢ G T ⎥
⎢⎣ ZM ⎥⎦ ⎢⎣ ZG − ZT ⎥⎦
⎡XM ⎤ ⎡ X G − XT ⎤
⎢ Y ⎥ = S′ M (Ω,Φ,Κ) ⎢ Y −Y ⎥
⎢ M⎥ ⎢ G T ⎥
⎢⎣ ZM ⎥⎦ ⎢⎣ ZG − ZT ⎥⎦
Example (BAIM)
1 2 3
6 5 4
31
Example (Spatial BAIM)
2 2 3
1 Tie points
II GCP
I
5
4 5 6
5
5 6
4
III IV
8 8 9
7
Advanced Topics in Photogrammetry Ayman F. Habib
63
32
Example (Spatial BAIM)
• What is the balance between the observations and
unknowns?
– Unknowns:
• 4 * 7 AO parameters.
• 5 * 3 GC of tie points.
• Total of 43.
– Equations:
• 4 (models) x 4 (points/model) x 3 (equations/point) = 48.
– Redundancy:
• 5.
• This is a non-linear system: approximations and
partial derivatives are required.
Advanced Topics in Photogrammetry Ayman F. Habib
65
33
The Structure of the Observation Equations
I II III IV 24568
A= y=
⎡ N11 N12 ⎤
⎢N T =
⎣ 12 N 22 ⎥⎦
34
Spatial BAIM: Final Remarks
• To stabilize the heights along the strip, we should use the
projection centers as tie points.
• To stabilize the heights across the strip, we can do one of
the following:
– Implement a side lap of 60%.
– Apply a chain of vertical control points across the strip.
– Use GPS observations at the projection centers.
• We can sequentially solve for the parameters.
– Solve for the ground coordinates of tie points first whenever 3np <
7nm.
– Solve for the transformation parameters for the models first
whenever 7nm < 3np.
– Where: (np ≡ number of tie points) and (nm ≡ number of models).
Accuracy of BAIM
• Due to the reduction in the involved GCP, we
should expect a degradation in the accuracy when
compared with this associated with a single model.
• Planimetric accuracy is not affected by the
accuracy of the measured model heights or by the
layout/distribution of vertical control points.
• In a similar way, height accuracy is not affected
by the accuracy of measured model planimetric
coordinates or the the distribution of horizontal
control points.
• Planimetric and height accuracies can be treated
separately.
Advanced Topics in Photogrammetry Ayman F. Habib
70
35
Accuracy of BAIM
• We can derive the accuracy of the derived
parameters after the adjustment as follows:
D{xˆ} = σ o2 Q{xˆ}
where :
Q{xˆ} = N −1
σ o2 ≡ Variance of observation of unit weight (variance componenet)
⎧v x ⎫ ⎡ − a b ⎤ 2 ⎡− a − b ⎤
D⎨ ⎬ = ⎢ ⎥ σ M I2 ⎢ ⎥
⎩v y ⎭ ⎣ − b − a ⎦ ⎣ b − a⎦
where :
σ M2 Accuracy of model coordinate measurements
Advanced Topics in Photogrammetry Ayman F. Habib
72
36
Accuracy of BAIM
⎧v x ⎫ ⎡a 2 + b 2 0 ⎤
D ⎨ ⎬ = σ M2 ⎢ ⎥
⎩v y ⎭ ⎣ 0 a + b2 ⎦
2
a = S cos Κ
b = S sin Κ
a2 + b2 = S 2
⎧v x ⎫
D ⎨ ⎬ = S 2σ M2 I 2
⎩v y ⎭
• If we assigned a weight of unity for the observations, then the
estimated variance component σo ≈ S σM.
• Variance component: accuracy of model coordinate
measurements expressed in ground units.
Advanced Topics in Photogrammetry Ayman F. Habib
73
37
Planimetric Accuracy of BAIM
• 2 Strips x 4 Models: σ = 1.44 σ o
σ = 1.2 σ o
σ = 1.40 σ o σ = 1.40 σ o
σ = 1.44 σ o
• 4 Strips x 8 Models:
σ = 2.28 σ o
σ = 1.66σ o
σ = 2.25 σ o σ = 2.25 σ o
σ = 2.28 σ o
Advanced Topics in Photogrammetry Ayman F. Habib
75
σ = 2.17 σ o
σ = 3.14 σ o σ = 3.14 σ o
σ = 3.16 σ o
• 8 Strips x 16 Models:
σ = 4.08 σ o
σ = 2.71σ o
σ = 4.06 σ o σ = 4.06 σ o
σ = 4.08 σ o
Advanced Topics in Photogrammetry Ayman F. Habib
76
38
Planimetric Accuracy of BAIM
• Now, let’s investigate the effect of adding a dense
pattern of ground control points at the boundaries
of the block:
– Ground control point every model across the strips of
the block.
– Ground control point every other model along the strips
of the block.
• 2 Strips x 4 Models:
σ mean = 0.94 σ o
σ max = 1.01 σ o
σ mean = 1.00 σ o
• 6 Strips x 12 Models:
σ max = 1.10 σ o
σ mean = 1.03 σ o
• 8 Strips x 16 Models:
σ max = 1.15 σ o
39
Planimetric Accuracy of BAIM
40
Empirical Formulas for Square Blocks
• P3: 8 control points along the boundaries of the
block (regardless of the size of the block).
σ mean = (0.83 + 0.05 ns ) σ o
Where : ns ≡ number of strips
41
Vertical Accuracy of BAIM
i
σZ mean
= (0.34 + 0.22 i ) σ Z o
σZ maax
= (0.27 + 0.31 i ) σ Z o
42
Bundle Block Adjustment
• Direct relationship between image and ground
coordinates.
• We measure the image coordinates in the images
of the block.
• Using the collinearity equations, we can relate the
image coordinates, the corresponding ground
coordinates, the IOP, and the EOP.
• Using a simultaneous least squares adjustment, we
can solve for the:
– The ground coordinates of the tie points.
– The EOP.
Advanced Topics in Photogrammetry Ayman F. Habib
85
43
Bundle Block Adjustment
44
Unknown Parameters
Observable Quantities
45
Mathematical Model
⎣ y⎦
46
Least Squares Adjustment
xˆ = ( AT PA) −1 AT Py
D{xˆ}= σ o2 ( AT PA) −1
e~ = y − Axˆ
σˆ o2 = (e~ T Pe~ ) / (n − m)
Y = a( X ) + e
Non Linear System
a ( X ) is the non − linear function
We use Taylor Series Expansion
∂a
Y ≈ a( X o ) + (X − Xo)+ e (We ignore higher order terms)
∂X Xo
Where :
X o is approximat e values for the unknown parameters
∂a
Y − a( X o ) = (X − Xo)+ e
∂X Xo
y= Ax+e
Where :
y = Y − a( X o )
∂a
A=
∂X Xo
47
Example (4 Images in Two Strips)
1 2 1 2
3 4 3 4
Control Point
5 6 5 6 Tie Point
I II
3 4 3 4
5 6 5 6
7 8 7 8
III IV
• Number of observations:
– 4 x 6 x 2 = 48 observations (collinearity equations).
• Number of unknowns:
– 4 x 6 + 3 x 4 = 36 unknowns
• Redundancy:
– 12.
• Assumptions:
– IOP are known.
48
Structure of the Design Matrix (BA)
A= y=
49
Structure of the Normal Matrix
I II III IV
⎡ N11 N12 ⎤
⎢N T ⎥ =
⎣ 12 N 22 ⎦
3 4 5 6
Sample Data:
• 2 cameras.
• 4 images.
• 16 points.
50
Structure of the Normal Matrix: Example
Observation Equations
yn×1 = An×m xm×1 + en×1 e ~ (0, σ o2 P −1 )
[
yn×1 = A1n×6 m1 A2n×3 m2 ] ⎡ x16 m1×1 ⎤
⎢x ⎥ + en×1
⎢⎣ 23 m2×1 ⎥⎦
• n ≡ Number of observations (image coordinate measurements).
• m ≡ Number of unknowns:
• m1 ≡ Number of images ⇒ 6 m1 (EOP of the images).
• m2 ≡ Number of tie points ⇒ 3 m2 (ground coordinates of tie points).
• m = 6 m1 + 3 m2.
51
Normal Equation Matrix
⎡ A1T ⎤
N ( 6 m1 +3m2 )×( 6 m1 +3m2 ) = ⎢ T ⎥ P [ A1 A2 ]
⎣ A2 ⎦
⎡ N116 m1×6 m1 N126 m1×3 m2 ⎤
N =⎢ T ⎥
⎢⎣ N123 m2×6 m1 N 223 m2×3 m2 ⎥⎦
⎡ A1T ⎤ ⎡ A1T Py ⎤ ⎡ C16 m1×1 ⎤
C( 6 m1 +3m2 )×1 = ⎢ T⎥ P y = ⎢ T ⎥ = ⎢ ⎥
⎣ 2⎦
A A Py ⎢C
⎣ 2 ⎦ ⎣ 3 m2×1 ⎥⎦
2
52
Reduction of the Normal Equation Matrix
N116 m1×6 m1 xˆ16 m1×1 + N126 m1×3 m2 xˆ 23 m2×1 = C16 m1×1
N12T 3 m ×6 m xˆ16 m ×1 + N 223 m ×3 m xˆ23 m ×1 = C23 m ×1
2 1 1 2 2 2 2
= (N ) (C )
−1
xˆ23 m ×1 223 m2×3 m2 − N12T 3 m ×6 m N11−16 m ×6 m N126 m ×3 m 23 m2×1 − N12T 3 m ×6 m N11−16 m ×6 m C16 m ×1
= (N )
2 2 1 1 1 1 2 2 1 1 1 1
−1 −1
xˆ16 m ×1 116 m1×6 m1 C16 m ×1 − N 116 m1×6 m1 N126 m ×3 m xˆ23 m ×1
1 1 1 2 2
−1 −1
xˆ23 m ×1 223 m2×3 m2 C23 m ×1 − N 223 m2×3 m2 N T
12 3 m2×6 m1 16 m1×1
2 2
53
Reduction of the Normal Equation Matrix
(
D{xˆ16 m1×1 } = σ o2 N116 m1×6 m1 − N126 m1×3 m2 N 22−13 m2×3 m2 N12T 3 m2×6 m1 )
−1
(
D{xˆ23 m ×1 } = σ o2 N 223 m ×3 m − N12T 3 m ×6 m N11−16 m ×6 m N126 m ×3 m
2 2 2 2 1 1 1 1 2
)
−1
[
y2×1ij = A12×6ij A22×3ij ] ⎡ x16×1 j ⎤
⎢ x ⎥ + e2×1ij
⎢⎣ 23×1i ⎥⎦
Advanced Topics in Photogrammetry Ayman F. Habib
108
54
Normal Equation Matrix
[
y2×1ij = A12×6
ij
]
⎡ x1 ⎤
A22×3 ⎢ 6×1 j ⎥ + e2×1ij
ij
⎢⎣ x23×1i ⎥⎦
⎡ A1T6×2 ⎤
[ ]
⎡ x16×1 j ⎤ ⎡ A16×2ij ⎤
T
⎡ A1T6×2 Pij A12×6 A1T6×2 Pij A22×3 ⎤ ⎡ x16×1 ⎤ ⎡ A1T6×2 Pij y2×1ij ⎤
⎢ T ij ij
T
ij ij
⎥ ⎢ j ⎥ = ⎢ T ij ⎥
⎢⎣ 23×2ij ij 12×6ij
A P A A 23×2ij ij 2 2×3ij ⎥ ⎣
P A
⎦ ⎢ 3×1i ⎦⎥ ⎢⎣ 23×2ij ij 2×1ij ⎥⎦
x 2 A P y
⎡ A1T6×2 Pij A12×6 A1T6×2 Pij A22×3 ⎤ ⎡ x16×1 ⎤ ⎡ A1T6×2 Pij y2×1ij ⎤
⎢ T ij ij
T
ij ij
⎥ ⎢ j⎥ = ⎢ T ij ⎥
⎢⎣ A23×2ij Pij A12×6ij A23×2ij Pij A22×3ij ⎥⎦ ⎢⎣ x23×1i ⎥⎦ ⎢⎣ A23×2ij Pij y2×1ij ⎥⎦
⎡ N11ij N12ij ⎤ ⎡ x16×1 j ⎤ ⎡ C1ij ⎤
⎢ T ⎥ ⎢x ⎥ = ⎢C ⎥
⎣⎢ N12ij N 22ij ⎦⎥ 9×9 ⎣⎢ 23×1i ⎦⎥ 9×1 ⎣⎢ 2ij ⎦⎥ 9×1
55
Normal Equation Matrix
N11 - Matrix
⎡ m2 ⎤
⎢∑ N11i1 0 0 L L 0⎥
⎢i = 1 ⎥
⎢ ⎥
m2
⎢ 0 ∑N 11i 2 0 L L 0 ⎥
⎢ i =1
⎥
=⎢ 0 0 ⎥⎥
m2
N11( 6 m1×6 m1 )
⎢ 0 ∑N
i =1
11i 3 L L
⎢ ⎥
⎢ M M M M M M ⎥
⎢ M M M M M M ⎥
⎢ m2 ⎥
⎢ 0 0 0 L L ∑ N11im1 ⎥
⎢⎣ i =1 ⎥⎦
• If all the points are not common to all the images:
• The summation should be carried over all the points
that appear in the image under consideration.
Advanced Topics in Photogrammetry Ayman F. Habib
112
56
N22 - Matrix
⎡ m1 ⎤
⎢ ∑ N 221 j 0 0 L L 0⎥
⎢ j =1 ⎥
⎢ ⎥
m1
⎢ 0 ∑N 22 2 j 0 L L 0 ⎥
⎢ j =1
⎥
=⎢ 0 ⎥
m1
N 22( 3 m2×3 m2 )
⎢ 0 ∑N
j =1
223 j L L 0 ⎥
⎢ ⎥
⎢ M M M M M M ⎥
⎢ M M M M M M ⎥
⎢ m1 ⎥
⎢ 0 0 0 L L ∑ N 22m2 j ⎥
⎢⎣ j =1 ⎥⎦
• If all the points are not common to all the images:
• The summation should be carried over all the images
within which the point under consideration appears.
Advanced Topics in Photogrammetry Ayman F. Habib
113
N12 - Matrix
57
C - Matrix
⎡ m2 ⎤ ⎡ m1 ⎤
⎢ ∑ C1i1 ⎥ ⎢ ∑ C21 j ⎥
⎢ im= 1 ⎥ ⎢ jm= 1 ⎥
⎢ 2 ⎥ ⎢ 1 ⎥
⎢ ∑ C1i 2 ⎥ ⎢ ∑ C2 2 j ⎥
⎢ im=21 ⎥ ⎢ jm=11 ⎥
⎢
= ∑ C1 ⎥ C23 m ×1 = ⎢ ∑ C2 ⎥
C16 m1×1
⎢ i = 1 i3 ⎥
2 ⎢ j =1 3j ⎥
⎢ ⎥
⎢ ⎥ ⎢ M ⎥
⎢ M ⎥ ⎢ M ⎥
⎢ M ⎥ ⎢ m1 ⎥
⎢ m2 ⎥ ⎢ ∑ C2m2 j ⎥
⎢∑ C1im1 ⎥ ⎣⎢ j = 1 ⎦⎥
⎢⎣ i = 1 ⎥⎦
• Once again, we assumed that all the points are common to all
the images.
Advanced Topics in Photogrammetry Ayman F. Habib
115
58
Accuracy of Bundle Block Adjustment
σ XY = ± 3µ m
σ Z = ± 0.003% of the camera principal distance (NA and WA cameras)
σ Z = ± 0.004% of the camera principal distance (SWA cameras)
These accuracies are given in the image space
Camera Classification
59
Advantages of Bundle Block Adjustment
60
Strip Triangulation: Final Remarks
61
Bundle Adjustment: Final Remarks
Special Cases
• Resection.
• Intersection.
• Stereo-pair orientation.
• Relative orientation.
– Discussed in chapter 1.
62
Resection
• We are dealing with one image.
• We would like to determine the EOP of this image
using GCP.
• Q: What is the minimum GCP requirements?
– At least 3 non-collinear GCP are required to estimate
the 6 EOP.
– At least 5 non-collinear (well distributed in 3-D) GCP
are required to estimate the 6 EOP and the 3 IOP (xp,
yp, c).
• Critical surface:
– The GCP and the perspective center lie on a common
cylinder.
Advanced Topics in Photogrammetry Ayman F. Habib
125
Resection
exterior orientation
interior orientation
63
Resection - Critical Surface
Intersection
• We are dealing with two images.
• The EOP of these images are available.
• The IOP of the involved camera(s) are also
available.
• We want to estimate the ground coordinates of
points in the overlap area.
• For each tie point, we have:
– 4 Observation equations.
– 3 Unknowns.
– Redundancy = 1.
• Non-linear model: approximations are needed.
Advanced Topics in Photogrammetry Ayman F. Habib
128
64
Intersection
a a´
PC PC
Vl Vr
⎡X ⎤
⎢Y ⎥
⎢ ⎥
⎣⎢ Z ⎦⎥
Advanced Topics in Photogrammetry Ayman F. Habib
130
65
Intersection: Linear Model
⎡ X − X Ol ⎤
r ⎢ Or ⎥
B = ⎢ YOr − YOl ⎥ • These vectors are given w.r.t.the
ground coordinate system.
⎢ ZO − ZO ⎥
⎣ r l ⎦
⎡ xl − x p ⎤
r
Vl = λ R(ωl , φl , κ l ) ⎢⎢ yl − y p ⎥⎥
⎢⎣ − c ⎥⎦
⎡ xr − x p ⎤
r
Vr = µ R(ωr , φr , κ r ) ⎢⎢ yr − y p ⎥⎥
⎢⎣ − c ⎥⎦
Advanced Topics in Photogrammetry Ayman F. Habib
131
66
Intersection: Linear Model
⎡ X ⎤ ⎡ X Ol ⎤ ⎡ xl − x p ⎤
⎢Y ⎥ = ⎢ Y ⎥ + λ R ⎢y − y ⎥
⎢ ⎥ ⎢ Ol ⎥ (ωl ,φl , κ l ) ⎢ l p⎥
⎢⎣ Z ⎥⎦ ⎢⎣ Z Ol ⎥⎦ ⎢⎣ − c ⎥⎦
Or:
⎡ X ⎤ ⎡ X Or ⎤ ⎡ xr − x p ⎤
⎢Y ⎥ = ⎢ Y ⎥ + µ R ⎢y − y ⎥
⎢ ⎥ ⎢ Or ⎥ ( ω r , φr , κ r ) ⎢ r p⎥
⎢ ⎥
⎢⎣ Z ⎥⎦ ⎣ Z Or ⎦ ⎢⎣ − c ⎥⎦
Stereo-pair Orientation
• Given:
– Stereo-pair: two images with at least 50% overlap.
– Image coordinates of some tie points.
– Image and ground coordinates of control points.
• Required:
– The ground coordinates of the tie points.
– The EOP of the involved images.
• Mini-Bundle Adjustment Procedure.
67
Stereo-pair Orientation
• Example:
– Given:
• 1 Stereo-pair.
• 20 tie points.
• No ground control points.
– Question:
• Can we estimate the ground coordinates of the tie points as
well as the exterior orientation parameters of that stereo-pair?
– Answer:
• NO.
68