Tagged
#Backpropagation
2 posts.
- Backpropagation Goes Mainstream, 1986: The Algorithm That Refused to Die
The most important algorithm in modern AI was discovered at least three times before anyone paid attention. The full story of backpropagation — its multiple independent inventions, the decades it spent in the shadows of the symbolic AI winter, and the specific confluence of people, ideas, and timing that produced the 1986 paper that changed everything. How an algorithm refused to die, and what happened when the world finally listened.
- Geoffrey Hinton: The Stubborn Godfather
He kept working on neural networks when everyone told him it was a dead end. He developed backpropagation, built the research group that produced AlexNet, and triggered the deep learning revolution. Then he quit Google to warn the world that he was afraid of what he had built. The full story of the most important AI researcher of his generation — and the journey from stubborn optimist to frightened sage.