In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
The PyTorch Foundation now hosts Ray, the open source distributed computing framework originally developed by Anyscale. Alongside PyTorch and vLLM, Ray enables scaling workloads from single machines to clusters without requiring fragmented workflows or locking developers into proprietary tools.
Fal.ai, a startup providing infrastructure for hosting multimodal AI models, raised approximately $250 million at a valuation exceeding $4 billion—nearly tripling its value in just three months—driven by explosive demand for video and image generation applications.
Microsoft announced new AI features for Windows 11, including wake and goodbye words for Copilot Voice, global availability of Copilot Vision, and experimental agentic capabilities through Copilot Labs and Windows Insiders that enable autonomous task completion and third-party service integrations.
Comments