Compression Is Prediction
From Pointer · subscribed via aiste.ulozaite@gmail.com · original ↗ · unsubscribe
I was reading about compression recently when I stumbled upon something crazy: that compressors and LLMs are, at their core, trying to solve the exact same problem. In this post, I’m going to walk us through the basics of compression to understand its deep relationship with language modeling. It’s probably going to blow your mind.
Couldn’t fetch the full article — read it on the original site ↗.