Senior LLMOps Engineer
Heidi
Senior LLMOps Engineer
Heidi is seeking a Senior LLMOps Engineer to join the model team in Melbourne, Australia. The role involves building the operational layer around production LLMs, including deployment health dashboards, tracing, feedback flywheels, and per-model unit economics. Candidates should have 2-3 years of hands-on LLMOps experience at an AI company operating at or beyond Heidi's maturity.
Senior LLMOps Engineer
Heidi is seeking a Senior LLMOps Engineer to join the model team in Melbourne, Australia. The role involves building the operational layer around production LLMs, including deployment health dashboards, tracing, feedback flywheels, and per-model unit economics. Candidates should have 2-3 years of hands-on LLMOps experience at an AI company operating at or beyond Heidi's maturity.
Salary
Core Qualifications
Technical (Must-have)
Soft Skills
Preferred Qualifications
Technical (Nice-to-have)
Key Responsibilities
- Build the deployment health dashboard with live visibility into every model in production.
- Make every incident traceable with complete session-to-model lineage.
- Stand up the improvement flywheel using Intercom tickets and CSAT feedback.
- Surface the full story by retrieving execution traces for flagged sessions and generating summaries.
- Close the loop by filtering high-value feedback into training data and monitoring post-deployment performance.
- Own per-model P&L by measuring revenue against inference cost.
- Raise the LLMOps bar by bringing proven practices from mature AI companies.
- Partner across the model team to ensure observability is built in.