Senior Software Engineer, AI Infrastructure

25 Aug 2026
Apply

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.What you'll doDesign and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.Integrate the serving layer with the platform's API gateway, identity, and metering services.Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

  • ID: #55311361
  • State: Oregon Remote 00000 Remote USA
  • City: Remote
  • Salary: USD TBD TBD
  • Job type: Full-time
  • Showed: 2026-08-25
  • Deadline: 2026-10-24
  • Category: Et cetera
Apply