Amazon may be training an ambitious 2T-parameter LLM
Anonymous sources claim that Amazon is financing training for a 2 trillion parameter LLM codenamed 'Olympus', intending to compete with OpenAI and Google's most powerful offerings. Details of the project are scarce, and there seems to be no specific timeline for the release.