Data Engineer - Data Operations

• You are elegant at delivering solutions using Hadoop & AWS! 

• We are a team consisting of visionary thinkers dedicated to shaping the future of banking

• We are one of Australia’s most advanced big data operations teams 

 Do work that matters

To us, data is everything. It powers our cutting-edge features and enables us to provide seamless experiences for millions of customers from app to branch.

We are one of Australia’s most advanced big data operations teams, doing work that matters. Here, you’ll be part of a team of engineers transitioning from existing technology stacks into cloud-based, future-ready technologies and agile, DevSecOps ways of working.

See yourself in our team

We’re responsible for CommBank’s key analytics capabilities and work to create world-leading capabilities for analytics, information management, and decisioning. We work across the Group Data Warehouse, Hadoop Big Data Platform, Pega Decisioning, SAS, R, Tableau, Ab Initio, and Data Stage.

We’re interested in hearing from people who

• Have solid hands-on experience in building ETL applications and commendable production support experience in deploying and managing large-scale, complex big data applications on a Hadoop platform

• Strong knowledge of data governance areas such as data lineage, technical metadata, data quality, and reconciliation

• Pride themselves on their Big Data and Hadoop expertise and experience with focus on Spark, Hive, Abinitio (or other query engines), big data storage formats (such as Parquet, ORC, Avro) and data pipeline orchestration tools like Airflow 

• ​Are confident with Spark SQL, with proven ability in tuning and optimisation

• ​Are knowledge and have proven hands-on experience in implementing data integration tools (such as Abinitio, DataStage or Informatica) and data warehouses

• ​Pride themselves on their AWS Experience - any or all of EC2, S3, RDS, EMR

• ​Strong Data Architecture expertise including different data modelling techniques

• Are constantly communicating with a variety of technical and non-technical stakeholders

• Are confident in production support with a passion for providing data-driven platform solutions

• Are constantly ahead of trends and work at the forefront of Big Data platforms

• Pride themselves on their execution of state-of-the-art ITIL practices, driving high-quality outcomes to solve core business objectives and minimising risks

• Possess problem-solving abilities with a strategic approach to tackling data-related challenges

Tech skills:

We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but experience or exposure with some of these (or equivalents) will set you up for success in this team 

• Building and supporting Data pipelines using Bigdata Hadoop 

• Strong scripting knowledge in Unix, SQL

• AWS EMR, GLUE

• Streaming frameworks such as Kafka 

• Optimisation of Bigdata ETL Pipelines

Working with us

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with us is for you.

We support our people with the flexibility to balance where work is done with at least half their time connecting in our Sydney office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. We’re looking for people who truly live our values: Care, Courage and Commitment and we’ll offer you great opportunities to develop your career with us.

If this sounds like you, apply now!

Advertising End Date: 16/05/2025