Lossy Compression Model of AI
Definition
Ted Chiang’s metaphor comparing Large Language Models to a blurry JPEG of the web: statistical models compress vast amounts of cultural training data into lossy approximations, retaining general patterns while losing precision, intent, and conscious insight.