AI Fundamentals: Understanding Activation Functions (Part 1)
Author(s): The Build Log Originally published on Towards AI. AI Fundamentals: Understanding Activation Functions (Part 1) Let’s make a case for non-linearity in neural networks, and understand the Universal Approximation Theorem Stacking a hundred layers in a neural network without non-linear activation …