Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation models and end-to-end AI products designed to solve real-world business problems. We partner closely with …
Job Overview
Join Cohere as a Site Reliability Engineer, Inference Infrastructure and help scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents.
Key Responsibilities
Build self-service systems that automate managing, deploying and operating services, including custom Kubernetes operators that support language model deployments
Automate environment observability and resilience
Enable all developers to troubleshoot and resolve problems
Ensure defined SLOs are hit, including participation in an on-call rotation
Build strong relationships with internal developers and influence the Infrastructure team’s roadmap
Develop our team through knowledge sharing and an active review process
Required Qualifications
5+ years of engineering experience running production infrastructure at a large scale
Experience designing large, highly available distributed systems with Kubernetes and GPU workloads
Experience with Kubernetes dev and production coding and support
Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
Experience in compute/storage/network resource and cost management
Excellent collaboration and troubleshooting skills to build mission-critical systems
Familiarity with computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators)
Strong understanding or working experience with distributed systems
Experience in Golang, C++ or other languages designed for high-performance scalable servers
About Cohere
Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products.
Benefits
🤝 An open and inclusive culture and work environment
🧑💻 Work closely with a team on the cutting edge of AI research
