🪄 Neural networks work but we don't know why

Neural networks are mysterious and impressively dumbfounding.

They're built by imitating a fundamental mechanism observed in our brains.

But we don't know yet how this design emerged or how to approach it from first principles.

We couldn't come up with neural networks from scratch. Right now they're a copy of nature's design.

It's a a bit like how we imitated wings by observing birds and built the first planes and then we figured out the physics underneath it.

The “physics” of neural networks are yet to be discovered.