In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
Ai2 released Molmo 2, an open-source multimodal model family with state-of-the-art video understanding capabilities including object tracking and temporal reasoning, trained on significantly less data than comparable models while outperforming proprietary systems like Gemini 3 on key benchmarks.
The Allen Institute for AI released OLMo 3.1 less than a month after OLMo 3's November launch, featuring two new 32B checkpoints with substantially improved reasoning and instruction-following capabilities achieved through extended reinforcement learning training.
Databricks raised $4 billion at a $134 billion valuation while reporting a $4.8 billion revenue run-rate and over 55% year-over-year growth. Databricks' reported revenue run-rate was fueled by its AI products and data warehousing businesses, each exceeding $1 billion in revenue run-rate.
Comments