Senior AI Systems Engineer (LLM Inference & Infra Optimization)

Job Overview

We're seeking a senior-level DevOps engineer and systems engineer to lead our efforts in deploying and optimizing large language models on high-end GPU hardware. This role is ideal for someone skilled in C++, CUDA, and Python, and experienced in multi-cloud environments and infrastructure-as-code.

Key Responsibilities

Systems and Infrastructure Engineering

• Optimize inference pipelines for large language models, focusing on quantization and memory efficiency.
• Develop and maintain low-level systems in C++/CUDA to enhance GPU performance.
• Implement and manage multi-cloud environments using Pulumi or Terraform.
• Design real-time, low-latency systems for AI-driven applications.
• Develop tools and interfaces to enable other engineers to contribute to the ML systems layer.

Technical Skills and Expertise

• Advanced proficiency in C++, CUDA, and Python.
• Deep understanding of GPU architectures and model serving optimizations.
• Experience with infrastructure-as-code tools and ML deployment frameworks.
• Familiarity with DevOps practices, including Docker and CI/CD pipelines.

About the Company

Join Sully.ai, a pioneering company at the intersection of AI and healthcare. We leverage cutting-edge technology to develop AI solutions that enhance clinical practices and patient care.

Why Join Us

• Work alongside a highly skilled team tackling complex problems in AI and healthcare.
• Engage with state-of-the-art GPU infrastructure to push the boundaries of what's possible in AI.
• Contribute to a product that significantly improves clinical workflows and patient outcomes.

Compensation

Salary Range: $200,000 - $230,000 per year

Benefits

Sully.ai offers comprehensive benefits including health, dental, and vision insurance, a competitive retirement plan, and a supportive work environment focused on innovation and growth.

Equal Opportunity Employer

Sully.ai is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.