Apple released eight very small open-source language models
Apple recently released the OpenELM (Open Efficient Language Model) family of models on Hugging Face. Other than the models' size, a key differentiator of the OpenELM models is the approach to non-uniform parameter allocation within each transformer model layer.