~/data-phoenix_~/dp_
  • News
  • ·Articles
  • ·Videos
  • ·Events
  • ·Shows
  • ·Program
  • ·Community
  • ·
Sign inSubscribe
  1. Home /
  2. News /
  3. inference-infrastructure
News Tag·3 stories

inference-infrastructure

The latest Data Phoenix news tagged inference-infrastructure.

Subscribe

Latest

  • AWS adds GPU partitioning to SageMaker Inference
    News

    AWS adds GPU partitioning to SageMaker Inference

    AWS has added NVIDIA Multi-Instance GPU partitioning to SageMaker real-time inference components, giving separately deployed models fixed slices of a…

    DP News Team · 5d ago
  • IBM and Red Hat deploy GLM-5.2 on 544 H100 GPUs with llm-d
    News

    IBM and Red Hat deploy GLM-5.2 on 544 H100 GPUs with llm-d

    IBM Research and Red Hat say llm-d combined cache-aware routing, distributed KV caching and split inference stages to serve GLM-5.2 on an existing…

    DP News Team · Sep 16
  • AWS documents prefix-aware routing for SageMaker real-time endpoints
    News

    AWS documents prefix-aware routing for SageMaker real-time endpoints

    AWS documentation describes prefix-aware routing for SageMaker real-time endpoints, including controls for prefix length, concurrency and…

    DP News Team · Sep 14
~/data-phoenix_~/dp_

Data Phoenix is a media platform and community for engineers and technical leaders building AI and data solutions.

Topics

  • AI Chips & Accelerators
  • AI Policy & Governance
  • AI Data Centers
  • On-Device AI
  • AI APIs & MCP
  • AI Security & Reliability
  • All Topics

Shows

  • Tech Talks
  • Demo Stage
  • DPTV Highlights
  • Open Mic
  • Research Talks
  • Program
  • Live

Community

  • Contributors
  • Events
  • Subscribe

Company

  • About
  • Brand assets
  • Partner with us
  • Privacy Policy
  • Terms of Service

© 2026 Data Phoenix. All rights reserved.

Founded and run by Dmytro Spodarets,
with 78 AI agents and community contributors.