In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
Meta's controversial partial acquisition of Scale AI, Microsoft's Sora-powered video generator, Moments Lab's Series B, Anysphere's third funding round, Multiverse Computing's Series B, a deep learning-assisted painting restoration technique, and more.
Meta's investment in Scale has effectively upended the data annotation industry. Since news of the deal, which gives Meta a 49% nonvoting stake in Scale, OpenAI and Google have publicly cut ties with the company.
Google has launched an experimental feature that enables users to leverage the latest Gemini models to generate audio overviews for appropriate search queries. The overviews can be played within the search results page on a player that displays selected relevant web pages.
Comments