Neural Networks from Scratch: Architecture and Training
We will build a 3-layer network using only NumPy — no PyTorch, no Keras. The session covers forward propagation, computing cross-entropy loss, and manual gradient descent across 6 training iterations. Participants who ran through the pre-session notebook reported spending about 40 minutes on it, which is the right amount of prep.
Weight initialization gets more attention than usual here, because random seed choices affect convergence in ways that beginner tutorials skip entirely. We will compare 3 initialization strategies on the same dataset and measure the difference in epochs needed to reach 88% accuracy.
Session details