Cloud Infrastructure Engineer

Help us build the future of AI!

Join our team to pioneer the future of Large Language Model (LLM) applications.

Values we are looking for:

• Integrity, alignment and passion

• Adaptability and the ability to work with limited resources

• Intellectual horsepower (smart x get things done)

• Level up the people around you

• Domain specific knowledge

About the Role:

The Platform team at LlamaIndex owns the foundations that our product is built upon as well as many of the tools that enable engineers to develop, ship, and observe their code. We are responsible for designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications. We are looking for team members who love building enabling systems that empower our engineers and power our rapidly growing product.

LlamaIndex holds a slightly different philosophy about infrastructure. We leverage software engineering principles to build and iterate on our systems and tools. More so than yaml configs and deployment management, our Platform team values building scalable, maintainable foundations for the company.

We’re looking for folks with experience managing cloud infrastructure, working through various stages of scale, and helping the broader Engineering team be more effective and productive. Some traits that are important to our company culture: customer-obsessed, collaborative, hard-working, and optimistic. And we’re looking for owners, so we hope you’ll help us expand this list.

Responsibilities:

• Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth.

• Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments.

• Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance.

• Optimize and improve the release and deployment processes to enhance efficiency and reliability.

• Ensure compliance with relevant regulations and implement robust security measures across different deployment environments.

Qualifications:

• You have 5+ years of engineering experience.

• You’ve worked on Platform or Infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, test infrastructure, release management, observability, etc.)

• You can balance speed and pragmatism and build the appropriate solutions for each stage of the company’s growth.

• You have experience in optimizing cloud resource utilization.

• Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency.

• You enjoy collaborating with other engineering teams to deliver great customer outcomes.

• You are willing to help build LlamaIndex’s engineering culture as we grow.

Preferred Qualifications:

• Experience building out infrastructure from the ground up at a fast-growing startup.

• Experience with observability tools like Prometheus, Grafana, and New Relic.

• Experience with GitOps tools like ArgoCD and Flux for continuous deployment.

• Experience with security compliance and audits in cloud environments such as SOC2.

Benefits:

• Competitive compensation

• Meaningful equity options in a rapidly growing company

• Comprehensive medical/dental/vision coverage for you and your family

• Unlimited paid time off policy

• Daily catered lunch and snacks in the San Francisco office

Location:

We offer a hybrid-friendly culture based out of our downtown San Francisco office.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Compensation Range: $100K - $300K