Multimodal AI
Multimodal AI systems work with more than one kind of input or output, such as text, images, audio, or video.
Follow model and application developments in speech, image, and video. Coverage looks at generation, understanding, media formats, and practical developer access.
Latest coverage
Articles
NewsElevenLabs launched a text-to-sound effects AI audio model
- News
OpenAI shared more about how it cast ChatGPT's voices
- News
Mastering sarcasm is AI's latest frontier
NewsOpenAI launched several new tools for ChatGPT along with the new GPT-4o model
NewsStable Artisan brings media generation to Discord
NewsAdobe launched Firefly Image 3 to advance its image-generation services
NewsHugging Face has released Idefics2, a multimodal model for the community
NewsReka Core is a competitive multimodal LLM accepting images, videos, and audio as input
NewsAdobe is planning to bring generative AI into Premiere Pro workloads
NewsStability AI partnered with Fireworks AI to launch the Stable Diffusion 3 API
NewsGrok just got vision: xAI announces Grok-1.5V preview
NewsStable Diffusion 3 is now available via an early preview waitlist