𝗜𝘀 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 𝗝𝘂𝘀𝘁 𝗖𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻? 𝗔𝗻𝗱 𝗪𝗵𝗮𝘁 𝗔𝗯𝗼𝘂𝘁 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲?

𝗜𝘀 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 𝗝𝘂𝘀𝘁 𝗖𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻? 𝗔𝗻𝗱 𝗪𝗵𝗮𝘁 𝗔𝗯𝗼𝘂𝘁 𝗘𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲?

I was listening to Machine Learning Street Talk (MLST) “The Real Reason Huge AI Models Actually Work” [1]. Many interesting take-aways, a lot to still be digested by me. But really this stuck to my mind.

In AI research, a fascinating concept has emerged: “𝗖𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻 𝗶𝘀 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲.” The idea — one theoretical lens, not a settled definition — is that intelligence can be measured by how well a system compresses information—finding patterns and structures to represent data in fewer bits. On this view, the ability to simplify and predict effectively is taken as evidence of understanding and problem-solving skill.

On the other hand, Andy Jassy — then CEO of AWS — famously said [2], “𝗧𝗵𝗲𝗿𝗲 𝗶𝘀 𝗻𝗼 𝗰𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻 𝗮𝗹𝗴𝗼𝗿𝗶𝘁𝗵𝗺 𝗳𝗼𝗿 𝗲𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲.” This reminds us that while data and knowledge can be compressed into insights, acquiring real-world experience is a different thing: it takes time, trial, and the complex nuances of practice. You can compress the record of experience, not the living of it.

𝗢𝗻 𝘁𝗵𝗲 𝗳𝗶𝗿𝘀𝘁 𝗴𝗹𝗮𝗻𝗰𝗲, 𝘁𝗵𝗶𝘀 𝘀𝗲𝗲𝗺𝘀 𝘁𝗼 𝗯𝗲 𝗮 𝗰𝗼𝗻𝗳𝗹𝗶𝗰𝘁 - 𝗶𝘀𝗻’𝘁 𝗶𝘁?

These ideas sit intriguingly side by side:   •  Compression reflects intelligence as measured in models: finding structure that represents data in fewer bits.   •  Experience points to what that measure leaves out: the time and interaction it takes to acquire real-world skill.

𝗛𝗼𝘄 𝗱𝗼 𝘆𝗼𝘂 𝘀𝗲𝗲 𝘁𝗵𝗲𝘀𝗲 𝘁𝘄𝗼 𝗰𝗼𝗻𝗰𝗲𝗽𝘁𝘀 𝗶𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗻𝗴 𝗶𝗻 𝘆𝗼𝘂𝗿 𝘄𝗼𝗿𝗸 𝗼𝗿 𝗹𝗲𝗮𝗿𝗻𝗶𝗻𝗴?  𝗖𝗮𝗻 𝗲𝘅𝗽𝗲𝗿𝗶𝗲𝗻𝗰𝗲 𝗶𝘁𝘀𝗲𝗹𝗳 𝗲𝘃𝗲𝗿 𝗯𝗲 𝗺𝗲𝗮𝗻𝗶𝗻𝗴𝗳𝘂𝗹𝗹𝘆 𝗰𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗲𝗱 𝗯𝘆 𝗔𝗜 𝗼𝗿 𝗽𝗿𝗼𝗰𝗲𝘀𝘀𝗲𝘀?  𝗢𝗿 𝗶𝘀 𝗶𝘁 𝗳𝗼𝗿𝗲𝘃𝗲𝗿 𝗱𝗶𝘀𝘁𝗶𝗻𝗰𝘁 𝗳𝗿𝗼𝗺 𝗽𝘂𝗿𝗲 𝗶𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲?

𝗪𝗼𝘂𝗹𝗱 𝗹𝗼𝘃𝗲 𝘁𝗼 𝗵𝗲𝗮𝗿 𝘆𝗼𝘂𝗿 𝘁𝗵𝗼𝘂𝗴𝗵𝘁𝘀!

#AI #Intelligence #Experience #Learning #MachineLearning #Leadership

[1] Machine Learning Street Talk, “The Real Reason Huge AI Models Actually Work” (with Prof. Andrew Wilson), Sep 19, 2025 - https://www.youtube.com/watch?v=M-jTeBCEGHc

[2] CNBC, “AWS CEO Andy Jassy: No compression algorithm for experience,” Nov 29, 2017 - https://www.cnbc.com/video/2017/11/29/aws-ceo-andy-jassy-no-compression-algorithm-for-experience.html