Everything tagged distributed inference.
IBM Research says its all-open agent factory achieved a 52-fold high-level-synthesis speedup for a quantum error-correction design at about…
iroh launched Mesh LLM, an 18 MB tool that pools GPUs across machines into a single OpenAI-compatible API endpoint for models up to 235B parameters.