Subscribe to Our Newsletter

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn't arrive within 3 minutes, check your spam folder.

Ok, Thanks
Google introduced Gemma, a state-of-the-art open-source model family
Gemma benchmarking results | Credit: Google

Google introduced Gemma, a state-of-the-art open-source model family

Google recently announced the availability of a state-of-the-art open-source model family named Gemma. The Gemma models share technical features with Gemini and achieve a groundbreaking performance surpassing many similar models.

Ellie Ramirez-Camara profile image
by Ellie Ramirez-Camara

Gemma comes in 7B and 2B model weights, and each is released with a pre-trained and an instruction-tuned variant. The models' release includes several developer tools, including inference and supervised fine-tuning toolchains, Colab and Kaggle notebooks, integration with popular tools such as Hugging Face, and most importantly, Google's new Responsible Generative AI Toolkit. Unlike its proprietary solutions, Gemma's license allows responsible commercial use and distribution in organizations of all sizes.

The Gemma models share some technical and infrastructure features with Gemini, which enable the former to deliver state-of-the-art performance surpassing similarly-sized models such as Mistral and Llama-2. Gemma's technical report details insights such as performance, dataset composition, and modeling methods. Gemma models were trained with data filtered of any sensitive or personally identifying information. Additionally, the models have been extensively fine-tuned and aligned via reinforcement learning from human feedback to guarantee their safety and reliability. Other safety evaluations include manual red-teaming, automated adversarial testing, and dangerous activity assessments.

The Gemma models can be used starting February 21 via Kaggle, a free tier for Colab notebooks and $300 in Google Cloud credits for first-time users. Research teams and individuals can also apply for additional $5K credit grants (up to a collective $500,000 between all selected applicants).

Ellie Ramirez-Camara profile image
by Ellie Ramirez-Camara

Data Phoenix Digest

Subscribe to the weekly digest with a summary of the top research papers, articles, news, and our community events, to keep track of trends and grow in the Data & AI world!

Success! Now Check Your Email

To complete Subscribe, click the confirmation link in your inbox. If it doesn’t arrive within 3 minutes, check your spam folder.

Ok, Thanks

Read More