Exercise: Forward Pass for a Tiny Network
Prerequisites: Neural Networks from Scratch
Problem
For
X(5,2), W1(2,4), b1(4,), and W2(4,1), give the shapes of z1, h, and y_hat.Hint
Start by naming the invariant, validation split, or numerical guarantee involved. Jump to the solution when you're ready.