Member of Technical Staff, Supercomputing Infrastructure

📋 Job Overview

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

🏢 About Inferact

Inferact runs on expensive, high-performance GPU and HPC clusters across neo-cloud and dedicated compute providers, on heterogeneous hardware that spans NVIDIA GPUs, AMD GPUs, and Google TPUs.

🎯 The Role

We're looking for a hands-on supercomputing infrastructure engineer to own and operate the high-performance compute infrastructure that keeps Inferact engineering productive. Your job is to make sure that infrastructure is healthy, available, observable, and usable around the clock.

✅ Key Responsibilities

• Take ownership of cluster health, accelerator availability, monitoring, alerting, scheduling, access, diagnostics, and incident response across the systems our engineers rely on every day.
• Work closely with engineering leadership and infrastructure owners to standardize how we provision, operate, debug, and scale compute across providers and hardware platforms.
• Your work will directly impact how fast Inferact can build, test, and improve the systems powering vLLM.

📌 Required Qualifications

• Bachelor's degree or equivalent experience in computer science, engineering, systems administration, or similar.
• Hands-on experience administering large compute clusters, HPC environments, university or research clusters, supercomputing systems, or production GPU clusters.
• Strong Linux systems administration fundamentals across networking, processes, storage, package management, shell scripting, logs, access control, and system debugging.
• Experience operating GPU servers, including driver management, GPU health monitoring, node failures, memory errors, scheduler issues, and hardware diagnostics.
• Experience with cluster scheduling and resource allocation using SLURM, Kubernetes, or equivalent tooling.
• Ability to own urgent infrastructure incidents end-to-end when compute issues are blocking engineering teams.
• Ability to automate operational workflows using Bash, Python, Ansible, Terraform, Helm, or similar tooling.

⭐ Desirable Experience

• Experience managing 1,000+ GPGPUs in production.
• Experience operating GPU compute across providers such as Lambda, CoreWeave, Crusoe, Nebius, Together, Fireworks, RunPod, or similar environments.
• Experience improving cluster utilization, reducing idle or unavailable GPU capacity, and debugging scheduling or resource contention issues.
• Familiarity with high-performance GPU networking such as InfiniBand, RoCE, NVLink / NVSwitch, RDMA, NCCL, or equivalent systems.
• Experience with storage for HPC or ML workloads, including NFS, Lustre, Ceph, distributed filesystems, or other high-throughput storage systems.
• Experience managing secure access, identity, permissions, SSH, VPNs, bastion hosts, secrets, and basic infrastructure security hygiene.
• Background in research computing, scientific computing, ML infrastructure, SRE, platform engineering, or infrastructure operations for engineering-heavy teams.

🎁 Benefits

Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity. Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.

🛂 Visa & Eligibility

Visa sponsorship: We sponsor visas on a case-by-case basis.