Software Development👥 51 employees📍 San Francisco, CA, US
At Baseten we provide all the infrastructure you need to deploy and serve ML models performantly, scalably, and cost-efficiently.
Get started in minutes, and avoid getting tangled in complex depl…
Job Overview
As the Engineering Manager for Baseten's Cloud Platform team, you will directly manage a team of cloud platform engineers responsible for building the systems and processes that keep our infrastructure scalable, reliable, and efficient — from automated deployments and monitoring to performance optimization and incident response.
About Baseten
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.
Key Responsibilities
Recruit, hire, and grow a high-performing team of cloud platform engineers; provide ongoing coaching, feedback, and career development through regular 1:1s.
Set clear performance expectations, hold a high bar, and create an environment where engineers do their best work.
Foster a culture of ownership, accountability, and continuous improvement.
Drive day-to-day technical decisions through design reviews, code reviews, and architectural discussions; translate the infrastructure roadmap into clear team priorities and milestones, and hold execution against them.
Establish standards and best practices for reliability, performance, and operational excellence; ensure the team owns projects end-to-end, from specification through production.
Exercise and encourage good judgment on tooling and architectural tradeoffs, with a bias against unnecessary complexity.
Partner with product and engineering teams to align infrastructure work with business priorities; represent your team's progress, capacity, and technical tradeoffs clearly to leadership.
Serve as the escalation point for major incidents; drive resolution with urgency, ensure the team learns systematically, and stay connected to users so those learnings feed back into infrastructure improvements.
Required Qualifications
Proven experience directly managing engineers in a cloud infrastructure, platform engineering, or SRE context (not managing managers).
Extensive hands-on experience with Kubernetes, with the ability to engage credibly in architectural discussions and code reviews.
Strong background building and maintaining scalable, production infrastructure.
Familiarity with infrastructure-as-code tools (e.g., Terraform, CloudFormation, Pulumi) and CI/CD tooling (e.g., GitHub Actions, GitLab CI, CircleCI, Jenkins).
Demonstrated ability to drive projects end-to-end — from specification to execution — and coach your team to do the same.
Strong written and verbal communication skills; able to influence across teams without direct authority.
Track record of recruiting and growing engineering talent.
Openness to learning about ML infrastructure; prior machine learning experience is not required.
Nice to Have
Experience with OSS observability tooling (Prometheus, ELK stack, Grafana, OpenTelemetry).
Background in multi-cloud environments or GPU infrastructure.
Experience building and managing on-call rotations and incident response processes.
Benefits
Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Please let Baseten know that you found this role at devopsprojectshq.com as a way to support us, so we can keep providing you with awesome DevOps jobs.
Never miss a job
Join 2,000+ DevOps developers getting weekly alerts for remote and US/EU roles, Kubernetes, AWS, Terraform, filtered for your stack.
🔒 Need an IP to whitelist?
Get a dedicated static EU outbound IP for Banks, payments, EHRs, APIs, AI.