Llama 405b: Full 92 page Analysis, and Uncontaminated SIMPLE Benchmark Results

Llama 3.1 is here, and if anything, it’s paper is even more impressive. It’s like Meta want to reveal the secret sauce of LLMs. I go through the highlights of all 92 pages and test Llama 405B on the SIMPLE bench, my new private, vetted general intelligence benchmark, against GPT 4o and Turbo, Gemini 1.5 Pro and Claude 3.5 Sonnet.
Weights and Biases Link: wandb.me/ai_ex...
AI Insiders: / aiexplained
Llama 3.1 Paper: scontent-lhr6-...
Llama 405B Web Release: ai.meta.com/bl...
Zuckerberg Money Run Out Interview: • Mark Zuckerberg on Lla...
Zuckerberg Llama 4: • Meet The New Mark Zuck...
OpenAI Losses: www.theinforma...
Nvidia Nims: build.nvidia.c...
Open Source Definition: opensource.org...
Data Disappearing: www.nytimes.co...
Infinite Bench: arxiv.org/pdf/...
ARC-A12 Challenge: www.semanticsc...
Adversarial Examples: arxiv.org/pdf/...
‘Systemic Risk’: x.com/deanwbal...
Zuckerberg-Hawley Letter: www.hawley.sen...
Groq Demo: x.com/Jonathan...
Altman Letter: www.washington...
Lmsys Response: x.com/lmsysorg...
Scale Private Leaderboard: scale.com/lead...
AI Insiders: / aiexplained
Non-hype Newsletter: signaltonoise....
GenAI Hourly Consulting: www.theinsider...