Staff Data Engineer - Data Mesh

Posted 9 Days Ago
Be an Early Applicant
Area, Viveiro, Lugo, Galicia
Mid level
Fintech • Financial Services
The Role
As a Staff Data Engineer in our IB&M Data Engineering team, you will design and implement cloud-native data architectures using AWS services, focusing on data mesh and automation. You will collaborate with stakeholders, develop blueprints for data transformation programs, and integrate machine learning into data pipelines.
Summary Generated by Built In
  • You are passionate about modern data architectures, automation, and driving business value through data democratisation.

  • We are a team of big thinkers who are engineering the future of banking

  • Together we will build tomorrow’s bank today, using world-leading technology and innovation

Do work that matters  

We're building tomorrow’s bank today, which means we need creative and diverse engineers to help us redefine what customers expect from a bank. Envisioning new technologies that are still waiting to be invented and reimagining products that support our customers and help build a brighter future for Australia.

Here, you will be empowered to deliver world-class, competitive banking products and services with unparalleled levels of service and reliability.  

See yourself in our team

You will be joining our IB&M Data Engineering team driving the Solution Architecture with expertise in Data Mesh. Working with our stakeholders in the Data and Platform crew, you will help drive our commitments in our Data Strategy to achieve our vision of becoming the best AI Bank in the world to better serve our customers.

You will collaborate with industry leaders to drive forward our mission of revolutionising the fintech landscape. As part of our team, you will be designing and implementing cloud-native, scalable, and federated data architectures using AWS Services.

We are interested in hearing from people who

  • Pride themselves on their experience and knowledge with building data mesh architectures with AWS services.

  • Have hands-on experience designing and deploying cloud architecture on AWS

  • Are knowledgeable with the Domain Driven Design (DDD) principles applied to data architectures.

  • Are confident creating blueprints and engineering roadmaps for multi-year data transformational programs.

  • Have experience in building domain-agnostic data infrastructure and pipelines.

  • Are knowledgeable in integrating machine learning models into data pipelines for advanced analytics and predictive modelling.

  • Have familiarity with tools like Hadoop, Spark, Kafka, and other distributed processing frameworks for handling large datasets.

  • Bring hands-on experience working with Infrastructure as Code using tools such as Terraform, CloudFormation, CDK for repeatable AWS deployments.

  • Are constantly thinking outside the box and breaking boundaries to solve complex technical problems and core business objectives.

  • Are knowledgeable of financial markets and, or corporate & institutional lending products is advantageous
     

Tech Skills
We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team!

  • AWS Certified Solutions Architect – Professional

  • AWS technologies including Lake Formation, Redshift, S3, Glue and IAM

  • Data warehousing with Snowflake, Redshift and Amazon RDS for OLTP

  • Infrastructure as code using CloudFormation or Terraform

  • Deep understanding of event-driven architectures using Apache Kafka, AWS Kinesis, Firehouse or similar

  • Experience with AWS EKS/ECS and containerisation (Docker, Kubernetes) 

  • Experience with Alation, Glue Data Catalogue & AWS DataZone

  • Experience with Parquet File Format, Iceberg tables

  • Observability tools (i.e. Observe, Splunk or Prometheus/Grafana)

  • Strong knowledge of CI/CD and automation tools like GitHub, GitHub Actions, TeamCity, CI/CD pipeline

Working with us

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.   

We support our people with the flexibility to balance where work is done with at least half your time each month connecting in our Sydney office. We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few. Talk to us about how these arrangements might work for you.

Here, you’ll thrive. You’ll be supported when faced with challenges and empowered to tackle new opportunities. We’re hiring engineers from across Australia and have opened technology hubs in Melbourne and Perth. We really love working here, and we think you will too.  

If this sounds like you, apply now!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 14/03/2025

Top Skills

AWS
CloudFormation
Hadoop
Kafka
Spark
Terraform
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sydney, New South Wales
52,000 Employees
On-site Workplace
Year Founded: 1911

What We Do

Australia’s leading provider of financial services including retail, premium, business and institutional banking, funds management, superannuation, insurance, investment and sharebroking products and services.

We are a business with more than 800,000 shareholders and over 52,000 employees. We offer a full range of financial services to help all Australians build and manage their finances.

Similar Jobs

Commonwealth Bank Logo Commonwealth Bank

Senior Data Engineer

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees

Commonwealth Bank Logo Commonwealth Bank

Staff Data Engineer

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees

Commonwealth Bank Logo Commonwealth Bank

Data Engineer

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees

Commonwealth Bank Logo Commonwealth Bank

Staff Data Engineer Design

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees

Similar Companies Hiring

Bectran, Inc Thumbnail
Software • Machine Learning • Information Technology • Fintech • Automation • Artificial Intelligence
Schaumburg, IL
51 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account