Sydney
1 week ago
Staff Data Engineer
Commonwealth Bank
Sydney
1 week ago
Staff Data Engineer
Staff Data Engineer role at CommBank in Sydney, part of one of the largest and most advanced Data Engineering teams in the country. Requires expertise in AWS Cloud, Data Mesh, Gen AI, and building scalable data products using Python, PySpark, SQL, Spark, and Scala.
AI-enabledHybridFull-timePrincipalAWSGen AI
Staff Data Engineer
Staff Data Engineer role at CommBank in Sydney, part of one of the largest and most advanced Data Engineering teams in the country. Requires expertise in AWS Cloud, Data Mesh, Gen AI, and building scalable data products using Python, PySpark, SQL, Spark, and Scala.
AI-enabledHybridFull-timePrincipalAWS
Salary
Not specified
Core Qualifications
Technical (Must-have)
AWSGen AIData LakeData MeshPythonPySparkSQLApache SparkScalaAWS GlueAWS LambdaAmazon RedshiftAmazon AthenaAmazon KinesisAmazon EMRAWS DataZoneAWS Lake FormationAWS IAMTerraformAWS CloudFormationGitOpsSnowflakeApache IcebergAPI Gateway
Soft Skills
Passion for staying ahead of technology trendsAI-first thinkingProblem solvingLearning mindsetCollaborationQuality focusOpennessContinuous improvementCommunicationStakeholder management
Key Responsibilities
- Design and build next-gen data platforms and pipelines using Python, PySpark, or Scala
- Integrate data from diverse sources into centralised lakes and cloud platforms
- Create technology blueprints and engineering roadmaps for long-term transformation
- Ensure data security, governance, and compliance
- Deliver end-to-end solutions that meet business needs and minimise risk
- Build high-quality, scalable data products from scratch
- Communicate effectively with stakeholders and contribute to team-wide engineering practices
- Define and evolve shared semantic models and metric definitions to ensure consistent meaning and reusable data across products and domains
- Drive adoption of catalogues, glossaries, and stewardship practices that promote discoverability, accountability, and self-service
- Embed policy-as-code for data access, classification, and retention ensuring compliance with internal and regulatory standards
- Implement automated testing, observability, and end-to-end lineage to improve data trust, traceability, and incident resolution speed
Data EngineeringFinancial ServicesAWSData MeshGen AIStaffHybridSydneyFull-time