Gradient Descent: How to Find the Lowest Point in a Valley While Completely Blindfolded

You're lost in a foggy mountain valley. You can't see anything. But you CAN feel the ground beneath your feet. That's enough to find your way down. This is exactly how neural networks learn.