In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
Firecrawl, an open-source web crawling platform used by 350,000 developers, raised $14.5 million in Series A funding to improve AI's access to web data while building a marketplace that pays content creators when their work is used to train AI systems.
DeepMind's Genie 3 preview; ElevenLabs' Eleven Music launch; Ukraine launches a sovereignty-preserving AI Factory, NVIDIA's new resources for robotics applications; Datumo raises a Series B to become a contender in the training data market; and much more.
Spanish AI startup Multiverse Computing released two ultra-small AI models called SuperFly (94M parameters) and ChickBrain (3.2B parameters) that can run offline on devices from smartphones to IoT appliances while matching or exceeding the performance of their larger parent models.
Comments