Staff Machine Learning Engineer

📋 Job Overview

A late-stage, venture-backed enterprise AI company is hiring a Staff ML Engineer to set the technical direction for its agent systems. This is model and systems work that ships to large enterprise customers, not a thin layer over someone else's API.

🏢 About The Mural Group

Mural Group is recruiting for this role on behalf of a client.

🎯 The Role

You will be responsible for designing multi-step LLM systems, owning evaluation from offline benchmarks to online experiments, finding and fixing failure modes, setting quality, latency and cost targets, and mentoring senior engineers.

✅ Key Responsibilities

• Design multi-step LLM systems: reasoning, retrieval, planning and tool use
• Own evaluation, from offline benchmarks to online experiments and model-graded review
• Find and fix failure modes such as hallucination and tool misuse
• Set the quality, latency and cost targets the team builds against
• Mentor senior engineers and shape how the group works

📌 Required Qualifications

• 7+ years shipping ML in production, including LLMs at scale
• Led the design of complex, multi-step LLM systems
• Depth in transformers, embeddings and retrieval
• Evaluation experience beyond single prompts
• PyTorch or similar, on distributed cloud infrastructure
• BS in CS or a related field; MS or PhD a plus

⭐ Desirable Experience

• ML shipped before LLMs, then moved into generative AI
• Detailed retrieval work (chunking, reranking, evals)

🎁 Benefits

Salary: $230,000–$300,000 + bonus + equity

🛂 Visa & Eligibility

Remote (US) location implies US work authorization eligibility.