News Tag
vLLM
The latest Data Phoenix news tagged vLLM.
Latest
NewsIBM makes Spyre a first-class PyTorch backend
NewsGoogle open-sources TorchTPU, bringing native PyTorch to TPUs
NewsAWS maps two vLLM KV-transfer paths to separate latency bottlenecks
NewsAWS releases MoE inference changes for SageMaker LMI and vLLM
NewsAWS bundles Ray LLM stack for multi-node inference on EKS
NewsDatabricks details Proteus harness for shape-specialized GPU kernels
NewsCohere details a megakernel serving engine for North Mini Code
NewsCohere details dynamic speculative decoding and contributes the method to vLLM
NewsBaidu's Unlimited-OCR adds vLLM support and tops Hugging Face trending