Let X1,X2,…,Xn be random variables, and define the sample mean as Xˉ=n1∑i=1nXi.
-
Assume the variables are i.i.d. with
E[Xi]=μ
and
Var(Xi)=σ2
. Derive
E[Xˉ]
and
Var(Xˉ)
.
-
Now remove the independence assumption. Derive
Var(Xˉ)
in terms of the covariance matrix of
(X1,…,Xn)
.
-
As a special case, assume each variable has variance
σ2
and every pair
(Xi,Xj)
for
i=j
has the same correlation
ρ
. Simplify the variance formula and explain how positive or negative correlation affects the precision of the sample mean.