Exercise: Effective sample size and weight diagnostics
The effective sample size (ESS) for a weighted IS estimator with weights is
It estimates "how many equivalent unweighted samples" you have.
Tasks
-
Show that exactly when all weights are equal, and when one weight equals and others are zero (extreme case).
-
Bound on the variance. Prove that the standard error of the IS estimator is bounded approximately by where is the (typical) standard deviation of on the support of . Use the Cauchy-Schwarz argument.
-
Diagnostic threshold. Practitioners flag IS results as unreliable when (less than 5% effective). Why is this a useful threshold?
-
Numerical example. For the deep OTM call from the previous exercise, compute for where . At which is the IS most efficient?