3 days ago

Staff Data Engineer

Commonwealth Bank

Melbourne

3 days ago

Apply

Staff Data Engineer

The Staff Data Engineer is a senior technical contributor responsible for designing and delivering scalable, reliable and secure data solutions. The role provides technical leadership across data engineering, analytical pipelines, data ontology, data matching, data cleansing, MLOps and automation. A key focus is transforming complex source data into trusted, reusable and dashboard-ready data products, while automating their development, deployment, testing and ongoing management.

AI-enabledOn-siteFull-timePrincipalPythonR

Staff Data Engineer

Apply

AI-enabledOn-siteFull-timePrincipalPython

Salary

Not specified

Work Location

Melbourne, Victoria, Australia, AU

Work Model

On-site

Employment Type

Full-time

Experience Level

Staff

Core Qualifications

Technical (Must-have)

PythonRSQLGitHub ActionsCI/CDData ModelingData OntologyData MatchingEntity ResolutionData CleansingData QualityData ObservabilityMLOpsBig DataDistributed Processing

Soft Skills

Technical LeadershipMentoringCommunication

Preferred Qualifications

Technical (Nice-to-have)

Open-weight ModelsRetrieval-Augmented GenerationEmbeddingsVector DatabasesModel ServingAI AgentsCyber SecurityIdentity and Access ManagementIdentity Governance

Key Responsibilities

•Design and build scalable batch, streaming and analytical data pipelines.
•Transform source data into trusted, reusable and analysis-ready datasets.
•Create curated data layers, semantic models and reusable data products for dashboards, reporting and analytics.
•Automate the dashboard data lifecycle, including ingestion, transformation, testing, deployment, monitoring, refresh and issue remediation.
•Design and implement agentic workflows that coordinate data preparation, quality validation, metadata generation, dashboard updates and operational support.
•Build and maintain CI/CD pipelines using GitHub Actions.
•Design data models, ontologies, taxonomies and common data definitions.
•Implement data matching, entity resolution, deduplication and data cleansing solutions.
•Build automated data quality, validation, reconciliation and observability controls.
•Develop solutions for large and complex datasets using big data and distributed processing technologies.
•Support the productionisation and monitoring of machine learning and open-weight models.
•Develop production-grade solutions using Python and/or R.
•Establish engineering standards, mentor engineers and provide technical guidance.
•Ensure data solutions meet security, privacy, resilience and governance requirements.

Data EngineeringStaff EngineerFinancial ServicesInformation TechnologyPythonRSQLMLOpsCI/CDBig Data

Key Responsibilities

•Design and build scalable batch, streaming and analytical data pipelines.

•Transform source data into trusted, reusable and analysis-ready datasets.

•Create curated data layers, semantic models and reusable data products for dashboards, reporting and analytics.

•Automate the dashboard data lifecycle, including ingestion, transformation, testing, deployment, monitoring, refresh and issue remediation.

•Design and implement agentic workflows that coordinate data preparation, quality validation, metadata generation, dashboard updates and operational support.

•Build and maintain CI/CD pipelines using GitHub Actions.

•Design data models, ontologies, taxonomies and common data definitions.

•Implement data matching, entity resolution, deduplication and data cleansing solutions.

•Build automated data quality, validation, reconciliation and observability controls.

•Develop solutions for large and complex datasets using big data and distributed processing technologies.

•Support the productionisation and monitoring of machine learning and open-weight models.

•Develop production-grade solutions using Python and/or R.

•Establish engineering standards, mentor engineers and provide technical guidance.

•Ensure data solutions meet security, privacy, resilience and governance requirements.