Exercise: Choosing Alpha with Validation
Prerequisites: Regularisation: L1 vs L2
Problem
How should alpha be chosen without using the test set?
Hint
Start by naming the invariant, validation split, or numerical guarantee involved. Jump to the solution when you're ready.