Sarah DeSouza
News
11 items
Aligning LLMs: ReFT
In this event, AI Makerspace breaks down the steps of ReFT, which consists of the warm-up stage and the reinforcement learning state. They will demonstrate how to code the core aspects of ReFT yourself in a Google Colab notebook environment, and all code will be provided directly to attendees!
Mar 11, 2024
Aligning LLMs: DPO
Join AI Makerspace on Wednesday, Feb. 28, at 10 AM PT! For a workshop on DPO. Come learn how it differs from the techniques of RLHF and why all indications are showing it's rapidly becoming the new industry standard.
Feb 26, 2024
Aligning LLMs: RLAIF
AI Makerspace presents part 2 of the Alignment series, Aligning LLMs: RLAIF! They will tackle RLAIF, a technique that attempts to solve the fundamental bottleneck of RLHF, namely, that it’s kind of expensive to collect a ton of data directly from humans!
Feb 6, 2024
Fine-Tuning OLMo the Open Language Model
AI Makerspace is hosting a deep dive into the OLMo series of models, including a discussion of the Dolma pre-training dataset as the model architectures leveraged for each of the three newly released versions: OLMo-1B, OLMo-7B, and OLMo-7B-Twin-2T!
Feb 4, 2024
The Art of RAG Evaluation
Join AI Makerspace for a special event on RAG! Deep dive into the art of evaluating complex LLM applications that leverage Retrieval Augmented Generation (RAG), the technique that aims to ground the outputs of LLMs in fact-checkable information.
Jan 31, 2024
Aligning LLMs RLHF: Part 1
AI Makerspace is hosting a 4-part series on Aligning LLMs! In this first event on RLHF, they aim to give you some deep intuition into how models like InstructGPT and Llama 2 leveraged human feedback to align with us on what it means to be “helpful, honest, and harmless.”
Jan 30, 2024