CONTENTS

Exercise: Effective sample size and weight diagnostics

The effective sample size (ESS) for a weighted IS estimator with weights w1,,wNw_1, \dots, w_N is

Neff=(iwi)2iwi2.N_{\text{eff}} = \frac{(\sum_i w_i)^2}{\sum_i w_i^2}.

It estimates "how many equivalent unweighted samples" you have.

Tasks

  1. Show that Neff=NN_{\text{eff}} = N exactly when all weights are equal, and Neff=1N_{\text{eff}} = 1 when one weight equals wi\sum w_i and others are zero (extreme case).

  2. Bound on the variance. Prove that the standard error of the IS estimator is bounded approximately by σf/Neff\sigma_f / \sqrt{N_{\text{eff}}} where σf\sigma_f is the (typical) standard deviation of ff on the support of qq. Use the Cauchy-Schwarz argument.
  3. Diagnostic threshold. Practitioners flag IS results as unreliable when Neff/N<0.05N_{\text{eff}}/N < 0.05 (less than 5% effective). Why is this a useful threshold?
  4. Numerical example. For the deep OTM call K=200K = 200 from the previous exercise, compute Neff/NN_{\text{eff}}/N for μ{0,z,z+1,z+3}\mu \in \{0, z^*, z^* + 1, z^* + 3\} where z3.22z^* \approx 3.22. At which μ\mu is the IS most efficient?