AI DevOps Engineer

Job Overview

Capco is looking for an experienced AI DevOps Engineer (AWS) to help design, build, and operate the cloud infrastructure that powers our Artificial Intelligence and Generative AI capabilities. Working within our Technology & Engineering Practice, you will enable AI Engineers and Data Scientists to deploy, scale, and manage AI solutions securely, reliably, and efficiently.

This is a senior individual contributor opportunity for someone who enjoys hands-on engineering, automation, cloud-native technologies, and solving complex platform challenges while working alongside multidisciplinary teams delivering innovative solutions for leading financial institutions.

Key Responsibilities

• Design, build, and maintain scalable AWS cloud infrastructure supporting AI, Machine Learning, and Generative AI platforms.
• Deploy, manage, and optimize containerized workloads using Docker and Kubernetes (Amazon EKS preferred), supporting AI model deployment and lifecycle management.
• Implement monitoring, logging, observability, security, and governance across cloud environments while optimizing reliability, scalability, performance, and cost efficiency.
• Collaborate with AI Engineers, Data Scientists, Data Engineers, and Solution Architects to continuously improve platform engineering, automation, and operational excellence.

Required Qualifications

• 5–7 years of experience in DevOps, Cloud Engineering, Platform Engineering, or Site Reliability Engineering, supported by a Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent practical experience.
• Strong hands-on experience with AWS cloud services, Infrastructure as Code (Terraform preferred), CI/CD tooling, Docker, Kubernetes, Linux administration, and cloud networking fundamentals.
• Experience supporting AI, Machine Learning, data platforms, or MLOps environments, with strong scripting skills in Python and/or Bash.
• Experience implementing monitoring, observability, IAM, secrets management, cloud security, governance, and operational best practices using tools such as CloudWatch, Prometheus, Grafana, Datadog, or Splunk.
• Strong troubleshooting, communication, collaboration, and stakeholder engagement skills with the ability to work effectively across cross-functional engineering teams.

Bonus Points For

• Experience with Microsoft Azure and/or Google Cloud Platform.
• Experience supporting Generative AI, Large Language Models (LLMs), MLOps, MLflow, SageMaker, Kubeflow, or similar technologies.
• Familiarity with vector databases, AI inference platforms, or modern model deployment architectures.
• Experience working within Financial Services or other highly regulated industries.
• AWS Certified DevOps Engineer – Professional, AWS Solutions Architect, or Azure/Google Cloud certifications.

Why Join Capco

Deliver high-impact technology solutions for Tier 1 financial institutions. Work in a collaborative, flat, and entrepreneurial consulting culture. Access continuous learning, training, and industry certifications. Be part of a team shaping the future of digital financial services. Help shape the future of digital transformation across Financial Services and Energy.

Benefits

Medical, Dental, and Vision coverage. 401(k) with company match, Health Savings Account (HSA), Flexible Spending Account (FSA), and commuter benefits. Maternity and paternity leave, dependent care support, and tuition reimbursement. Wellness reimbursement and Working Advantage employee discount marketplace. A people-first culture focused on continuous learning, career growth, and professional development.