is any
other UMVUE, then P
((T) = T
) = 1 for all
.
Proof Let W be any unbiased estimator of
(). Then by the Rao-Blackwell Theorem,
(T) = E(W|T) is such that
Var
((T)) Var
(W) .
Let
W be any other unbiased estimator and
(T) = E(
W|T). Then
E
[(T)
(T)] = 0 ,
and by completeness of T it follows that
P
((T) =
(T)) = 1
Hence, (T) is the unique UMVUE.
107
Note: When T is complete and sucient, the
Lehmann-Schee Theorem implies that there
is at most one function of T thats unbiased
for ().
Application of Lehmann-Schee
1. Find a complete sucient statistic T.
2. If we can nd an unbiased estimator V (T),
weve found the UMVUE.
3. Otherwise, nd any unbiased estimator
W(X) and then compute (T) = E(W|T).
108
Completeness of the Exponential Family
k-parameter exponential family:
f(x|) = exp
_
_
k
i=1
c
i
()T
i
(x) +d() +S(x)
_
_
I
A
(x),
where A doesnt depend on .
Theorem 4 Let {f(x|) : } be a k-par-
ameter exponential family. Suppose the range
of (c
1
(), . . . , c
k
()) contains an open k-rectang-
le. Then (T
1
(X), . . . , T
k
(X)) is complete as
well as sucient. (Bickel and Doksum, p. 123)
Open rectangle:
{(u
1
, . . . , u
k
) : a
i
< u
i
< b
i
, 1 i k}
109
Example 22 (cont.)
f(x|, ) = exp
_
_
1
2
2
n
i=1
x
2
i
+
2
n
i=1
x
i
n
2
2
2
nlog
n
2
log(2)
_
c
1
(, ) = (2
2
)
1
c
2
(, ) =
2
The range of (c
1
, c
2
) is
{(a, b) : a < 0, < b < },
which obviously contains an open rectangle.
So, (
n
i=1
X
2
i
,
n
i=1
X
i
) is a complete sucient
statistic.
For known constants a and b, recall that
a = a
_
_
1
n
n
i=1
X
2
i
X
2
_
_
1/2
and
b = b
1
n
n
i=1
|X
i
X|
are UEs of .
110
Since a is unbiased and a function of the
complete sucient statistic, it is the unique
UMVUE of .
Interestingly, note that it must be true that
E(b |
X,
n
i=1
X
2
i
) = a .
Example 26 Let X
1
, . . . , X
n
be i.i.d. Poisson(),
and dene
() = P(X
1
= 3) =
e
3
3!
.
Find an UMVUE for (). Let
U(X
1
) =
_
1, if X
1
= 3
0, otherwise.
We have
E
[U(X
1
)] = P(X
1
= 3) = (),
and so U(X
1
) is a UE of ().
111
We know that T =
n
i=1
X
i
is a complete, suf-
cient statistic. Why?
Well now use Lehmann-Schee to nd the
UMVUE. Need to compute E(U(X
1
)|T), and
so we need the conditional distribution of X
1
given T = t.
P(U(X
1
) = 1|T = t) =
P(U(X
1
) = 1, T = t)
P(T = t)
We know that the sum of k i.i.d. Poisson()
random variables has a Poisson(k) distribu-
tion.
P(U(X
1
) = 1, T = t) =
P(X
1
= 3, X
2
+ +X
n
= t 3) =
_
0, t 2
()
e
(n1)
[(n1)]
t3
(t3)!
, t 3.
112
This leads to
P(U(X
1
) = 1|T = t) =
_
0, t = 0, 1, 2
_
t
3
_
(1/n)
3
(1 1/n)
t3
, t = 3, 4, . . ..
Obviously, E(U(X
1
)|T = t) = P(U(X
1
) = 1|T =
t), and so weve found the UMVUE. Dene
(T) =
_
T
3
__
1
n
_
3
_
1
1
n
_
T3
,
where
_
T
3
_
= 0 for T < 3. Then (T) is a UE
of (), and by the Lehmann-Schee Theorem,
(T) is the unique UMVUE.
113