Exercise: Selecting Ridge Alpha by CV
Prerequisites: Cross-Validation
Problem
Validation MSEs for alphas 0.01, 0.1, 1.0 are 0.42, 0.35, 0.38. Which alpha is selected?
Hint
Start by naming the invariant, validation split, or numerical guarantee involved. Jump to the solution when you're ready.