Stein's Lemma

Stein's lemma, named in honor of Charles Stein, may be characterized as a theorem of probability theory that is of interest primarily because of its application to statistical inference -- in particular, its application to James-Stein estimation and empirical Bayes methods.

Statement of the lemma

Suppose X is a normally distributed random variable with expectation μ and variance σ2. Further suppose g is a function for which the two expectations E( g(X) (X − μ) ) and E( g ′(X) ) both exist (the existence of the expectation of any random variable is equivalent to the finiteness of the expectation of its absolute value). Then
E(g(X)(X-\mu))=\sigma^2 E(g'(X)).
In order to prove this lemma, recall that the probability density function for the normal distribution with expectation 0 and variance 1 is
\varphi(x)={1 \over \sqrt{2\pi}}e^{-x^2/2}
and that for a normal distribution with expectation μ and variance σ2 is
{1\over\sigma}\varphi\left({x-\mu \over \sigma}\right).
Then use integration by parts.

 

<< PreviousWord BrowserNext >>
amrica, buenos aires
dwyfor
paremata
seattle liberation front
the royal regiment of canada
quilmes partido
daniel kirkwood
merrie amsterburg
william john duane
godsbane
jos napolen duarte
vitosha
colson whitehead
john langalibalele dube
anti piracy
quilmes
david dubinsky
paul dubois
vicente lpez partido
olivos, buenos aires
lee alvin dubridge
war of the quadruple alliance
alfonso de borbn dampierre
kolya
komjatice
simone perrotta
martin petrov
bruria hutner david
james h. duff
e3
mattias jonson
market fundamentalism
lucie duff gordon
charles gavan duffy
raoul dufy
michael dugan
uss san juan (cl 54)
winston joseph dugan
james duggan
rockhurst high school
ion n. petrovici
benjamin newton duke
joe young
ticonderoga class cruiser