Principal Research Scientist - Evaluations
Canva
Principal Research Scientist - Evaluations
Canva is seeking a Principal Research Scientist to lead evaluation strategy for generative AI quality across the company. This role involves defining evaluation frameworks, linking metrics to user outcomes, and mentoring teams globally. The position is remote-friendly, based in Sydney, and requires deep expertise in multimodal generative models and reward modeling.
Principal Research Scientist - Evaluations
Canva is seeking a Principal Research Scientist to lead evaluation strategy for generative AI quality across the company. This role involves defining evaluation frameworks, linking metrics to user outcomes, and mentoring teams globally. The position is remote-friendly, based in Sydney, and requires deep expertise in multimodal generative models and reward modeling.
Salary
Core Qualifications
Technical (Must-have)
Soft Skills
Preferred Qualifications
Technical (Nice-to-have)
Key Responsibilities
- Establish evaluation gates that inform launch decisions
- Diagnose anomalous evaluation results during production training runs
- Partner with Design Generation, Foundation Models and Agents teams
- Work with designers, creators and product teams to turn subjective creative judgement into measurable criteria
- Mentor senior research scientists and engineers
- Represent Canva's evaluation vision to senior leadership and industry