Data Phoenix icon
  • Home Home
  • News News
  • Articles Articles
  • Digest Digest
  • Events Events
  • Videos Videos
  • Pictures Pictures
    • Tech Talks
    • Demo Stage
    • Research Talks
Sign In
Data Phoenix cover image

Subscribe

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn’t arrive within 3 minutes, check your spam folder.

  • Home Home
  • News News
  • Articles Articles
  • Digest Digest
  • Events Events
  • Videos Videos
  • Pictures Pictures
    • Tech Talks Tech Talks
    • Demo Stage Demo Stage
    • Research Talks Research Talks
Sign In
Data Phoenix cover image

Subscribe

success-filled

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn’t arrive within 3 minutes, check your spam folder.

Videos
Let's build GPT: from scratch, in code, spelled out
Videos

Let's build GPT: from scratch, in code, spelled out

In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!

Sophia
· Jan 27, 2023
Let's build GPT: from scratch, in code, spelled out
Sophia
by Sophia
Jan 27, 2023

Subscribe

success-filled

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn’t arrive within 3 minutes, check your spam folder.

Featured Posts
Meta unveils Muse Spark, the first step in its "ground-up overhaul" of its AI strategy
News Meta unveils Muse Spark, the first step in its "ground-up overhaul" of its AI strategy
Arcee AI releases Trinity-Large-Thinking, a very capable open-weights reasoning model
News Arcee AI releases Trinity-Large-Thinking, a very capable open-weights reasoning model
Microsoft has launched three new models heavily marketed towards business use cases
News Microsoft has launched three new models heavily marketed towards business use cases

Comments

Read Next

Featured post
News

Meta unveils Muse Spark, the first step in its "ground-up overhaul" of its AI strategy

Meta launched Muse Spark, its first model from the newly created Meta Superintelligence Labs. Meta claims Muse Spark marks the beginning of a "ground-up overhaul" of its AI strategy, which aims to fix the performance gap between the company's models and similar offerings from its competitors.

Apr 09, 2026
by Ellie Ramirez-Camara
Featured post
News

Arcee AI releases Trinity-Large-Thinking, a very capable open-weights reasoning model

Arcee AI, a tiny US startup that recently developed a completely open contender to Meta's Llama 4 Maverick, recently released Trinity-Large-Thinking, an open weights reasoning model claimed to be "the strongest open model ever released outside of China."

Apr 07, 2026
by Ellie Ramirez-Camara
Featured post
News

Microsoft has launched three new models heavily marketed towards business use cases

Microsoft AI announced the availability of three foundational models for transcription and voice and image generation. The launch highlights these models' competitive pricing and practical business value as Microsoft shifts its AI strategy towards business and productivity solutions.

Apr 06, 2026
by Ellie Ramirez-Camara
Featured post
News

Mistral secures $830M in debt financing to build its first data center in France

Mistral raised $830 million in debt financing from a consortium of seven banks to purchase 13,800 Nvidia GPUs for its first data center near Paris, positioning itself as Europe's sovereign AI alternative to US proprietary models.

Apr 03, 2026
by Ellie Ramirez-Camara
Featured post
News

Mercor reports it fell victim to a cyberattack linked to the recently compromised LiteLLM

Mercor recently confirmed it was victim to a security incident related to the compromise of the popular open-source project LiteLLM. Extortion group Lapsus$ has claimed responsibility for the attack, allegedly posting a sample of the stolen data on its leak site.

Mar 31, 2026
by Ellie Ramirez-Camara
Data Phoenix icon

Data Phoenix is a live media platform for AI and Data professionals, covering technologies under the hood, best practices, and live demos from the builders shaping the industry, via original shows.

  • Shows
    • Tech Talks
    • Demo Stage
    • Research Talks
      • Home
      • News
      • Articles
      • Digest
      • Events
      • Videos
      • Pictures
  • About Us
  • Support Ukraine 🇺🇦
  • Partner with us

Copyright © 2026 Data Phoenix. Published with Ghost and Data Phoenix.
Privacy Policy | Terms of Service | Cookie Preferences