In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
AI INFRA SUMMIT 5 takes place May 1, 2026 in Sunnyvale. Data Phoenix offers a limited number of application-based Builders Passes for AI builders. Apply now.
DataPhoenix Events Digest is back with new show formats and live streaming coverage. This issue features 7 upcoming AI events in the Bay Area from mid-April through early May 2026.
NVIDIA-backed SiFive raised $400 million at a $3.65 billion valuation to accelerate its open-source RISC-V chip designs for AI data centers, positioning itself as an alternative to proprietary x86 and ARM architectures in the data center solutions market.
Meta launched Muse Spark, its first model from the newly created Meta Superintelligence Labs. Meta claims Muse Spark marks the beginning of a "ground-up overhaul" of its AI strategy, which aims to fix the performance gap between the company's models and similar offerings from its competitors.
Arcee AI, a tiny US startup that recently developed a completely open contender to Meta's Llama 4 Maverick, recently released Trinity-Large-Thinking, an open weights reasoning model claimed to be "the strongest open model ever released outside of China."
Comments