Job Opportunities API

Inferact, founded by the creators of vLLM, is building the world's AI inference engine. This Member of Technical Staff role focuses on maintaining and scaling the CI/CD infrastructure that powers vLLM's development, testing, and release processes across diverse hardware accelerators and a rapidly growing contributor base. What You'll Do • Maintain and scale compute infrastructure for CI, release pipelines, performance benchmarking, and accuracy evaluation across diverse models and accelerators (H100/H200, B200/300, AMD MI325/355X, TPU, Intel Gaudi) • Optimize CI time-to-signal from hours to minutes through creative infrastructure and tooling improvements • Ensure comprehensive test coverage across the vLLM codebase and implement strategies to prevent regressions • Manage release processes to maintain stability and reliability of vLLM releases • Build tooling and dashboards that enable 3,000+ open-source contributors to move efficiently What You Need • Strong hands-on experience with Docker, Kubernetes, and containerized build or test environments • Proven track record building CI/CD pipelines from scratch using GitHub Actions, Buildkite, or similar systems • Deep knowledge of CI design patterns and techniques: compute orchestration, flaky test handling, dependency and environment management, caching, remote execution, and test target determination • Fluency in Python, Bash, Go, or similar languages for automation and tooling • Solid fundamentals in Linux, security, networking, storage, and package management Nice to Have • Experience setting up infrastructure for ML, inference, CUDA, ROCm, or accelerator-heavy workloads • Expertise running Buildkite at scale, including agents, queues, dynamic pipelines, test sharding, caching, and artifact management • Experience operating Kubernetes clusters for CI, batch jobs, test execution, or internal developer infrastructure • Experience managing CI/CD in large open-source projects • Building dashboards, alerts, runbooks, or tooling for CI observability S$200,000–S$400,000 annually plus equity; medical, dental, and vision coverage