In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
Microsoft AI announced the availability of three foundational models for transcription and voice and image generation. The launch highlights these models' competitive pricing and practical business value as Microsoft shifts its AI strategy towards business and productivity solutions.
Mistral raised $830 million in debt financing from a consortium of seven banks to purchase 13,800 Nvidia GPUs for its first data center near Paris, positioning itself as Europe's sovereign AI alternative to US proprietary models.
Mercor recently confirmed it was victim to a security incident related to the compromise of the popular open-source project LiteLLM. Extortion group Lapsus$ has claimed responsibility for the attack, allegedly posting a sample of the stolen data on its leak site.
Legal tech startup Harvey has recently confirmed that it successfully raised $200 million at an $11 billion valuation. The round was co-led by returning investors GIC and Sequoia, with participation from Andreessen Horowitz, Coatue, Conviction Partners, and Elad Gil, among others.
Wikipedia has implemented a new policy that bans AI-generated article creation and substantial rewrites. The ban on LLM usage was voted by Wikipedia's editor community, who found themselves increasingly overwhelmed by the non-stop flood of AI slop making its way into the encyclopedia.
Comments