Senior Manager, AI Infrastructure Operations

Job Overview

Join Vultr, the world’s largest privately-held cloud infrastructure company, on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. We are seeking a Senior Manager, AI Infrastructure to lead the engineers responsible for deploying, operating, and optimizing Vultr’s AI compute clusters. In this role, you will execute the technical roadmap developed by Infrastructure leadership and ensure reliable, high-performance cluster operations at scale.

Key Responsibilities

• Lead the engineering team responsible for the day-to-day implementation, scaling, and operation of AI compute clusters.


• Translate engineering roadmaps and technical requirements from the Director of AI Infrastructure into detailed project plans and execution milestones.


• Drive delivery of cluster deployments, hardware bring-up, node configuration, and integration with orchestration and scheduling systems.


• Ensure cluster reliability, uptime, and performance through monitoring, automation, and continuous operational improvements.


• Oversee lifecycle operations for bare metal and GPU fleets, including provisioning, configuration management, firmware/driver updates, and hardware validation.


• Manage incident response for GPU and cluster infrastructure, ensuring timely resolution and root-cause analysis.


• Work closely with AI/ML, SRE, Networking, and Hardware Engineering teams to ensure cluster capabilities meet training and inference needs.


• Coordinate with Product to confirm technical requirements, feature readiness, and delivery timelines.


• Support integrations across networking, storage, scheduler, and resource orchestration components.


• Improve tooling and automation for cluster provisioning, observability, configuration management, and large-scale fleet operations.


• Contribute to the development and refinement of multi-tenant scheduling, workload management, and orchestration systems in partnership with senior technical staff.


• Identify performance bottlenecks and propose engineering-level optimizations.


• Coach and mentor engineers, fostering a high-performance, detail-oriented engineering culture.


• Support career development, expectations, and performance management for team members.


• Help refine engineering processes, including code reviews, testing standards, documentation, and operational runbooks.

Qualifications

6–10 years of experience in infrastructure engineering, HPC, large-scale systems, or similar fields.

Strong understanding of AI compute infrastructure, including GPU/CPU clusters, distributed training architectures, and high-performance networking (InfiniBand/RDMA).

Experience running production bare metal, GPU, or hardware fleet operations at meaningful scale.

Hands-on expertise with Linux systems, Kubernetes or Slurm, provisioning tools (Terraform, Ansible), observability platforms, and networking fundamentals.

Proven track record in cluster operations, hardware bring-up, distributed systems, or ML workload support.

Experience leading engineering teams or pods, with the ability to manage execution while staying close to technical work.

Ability to communicate effectively with cross-functional engineering teams and translate strategy into actionable engineering tasks.

Strong execution mindset with the ability to prioritize, deliver, and adapt in a fast-paced environment.

About Vultr

Vultr is on a mission to make high-performance cloud infrastructure easy to use, affordable, and locally accessible for enterprises and AI innovators around the world. With 33 global cloud data center locations, Vultr is trusted by hundreds of thousands of active customers across 185 countries for its flexible, scalable, global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions. In December 2024 Vultr announced an equity financing at a $3.5 billion valuation. Founded by David Aninowsky and self-funded for over a decade, Vultr has grown to become the world’s largest privately-held cloud infrastructure company.

Benefits

• Excellent Medical Benefits w/ 100% company-paid premiums for employee only plan + 100% company-paid dental & vision premiums


• 401(k) plan that matches 100% up to 4% with immediate vesting


• Professional Development Reimbursement of $2,500 each year


• 11 Holidays + Paid Time Off Accrual + Rollover Plan + take your birthday off


• Commitment matters to Vultr! Increased PTO at 3 year & 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year


• $500 first year remote office setup + $400 each following year for new equipment


• Internet reimbursement up to $75 per month


• Gym membership reimbursement up to $50 per month


• Company-paid Wellable subscription

Inclusion & Privacy

We are an equal opportunity employer and are committed to creating an inclusive environment for all employees. We welcome applications from individuals of all backgrounds and experiences, and we prohibit discrimination based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected status under applicable laws. Vultr will consider qualified applicants with arrest or conviction records in accordance with applicable laws and will not conduct a background check until after an offer of employment has been made.