In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
AWS re:Invent 2024 showcased major AI advancements including the 3-nanometer Trainium 3 chip, Nova 2 foundation models, three new autonomous Frontier Agents for coding, DevOps, and security, and Database Savings Plans offering up to 35% cost reductions.
Warner Music Group settled its copyright lawsuit with AI music startup Suno and formed a licensing partnership that gives artists control over how their work is used in AI-generated music, while Suno acquired WMG's Songkick platform and will launch new licensed models in 2026.
Anthropic has released Claude Opus 4.5, its most capable model for coding and agents with state-of-the-art performance on software engineering benchmarks, dramatically improved token efficiency, and reduced pricing to $5/$25 per million tokens.
Comments