Staff AI Engineer (Orchestration)

Salary

Core Qualifications

Preferred Qualifications

Key Responsibilities

• •Define the end-to-end architecture for literature and guideline ingestion, normalization, metadata extraction, de-duplication, and versioning.
• •Build hybrid search and retrieval: lexical + vector + re-ranking, with tight latency budgets and cost controls.
• •Design grounding and answer synthesis that cite sources, preserve provenance, and expose confidence and abstention.
• •Lead model work across prompting, fine-tuning, distillation, and tool use to improve faithfulness, coverage, and utility.
• •Stand up gold-standard evaluation: offline IR metrics (nDCG, MAP, recall), factuality/faithfulness audits, and human review with adjudication.
• •Run online experiments at scale. Define guardrails, KPIs, and ship A/Bs to measure impact on clinician workflows.
• •Productionize services with observability, tracing, canaries, rollbacks, and incident playbooks.
• •Set data governance for medical content: access control, PHI handling, audit logs, and retention policies.
• •Partner with clinicians to define intents, schemas, and acceptance criteria. Convert ambiguous questions into testable specs.
• •Coach engineers and scientists. Raise the technical bar through design docs, reviews, and reusable components.