Senior Data Engineer

Posted 4 Days Ago
Be an Early Applicant
Area, Viveiro, Lugo, Galicia
Senior level
Fintech • Financial Services
The Role
As a Senior Data Engineer, you'll design, build, and optimize data solutions, focusing on compliance and financial crime prevention using AWS, Hadoop, and Data Lake technologies.
Summary Generated by Built In

Senior Data Engineer

  • You are passionate to stay ahead of the latest AWS Cloud, and Data Lake technologies.

  • We're one of the largest and most advanced Data Engineering teams in the country.

  • Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.

Do work that matters:

As a Senior Data Engineer you’ll be part of the Engineering Chapter building Data Assets for the Financial Crime domain. We work across the AWS Cloud, Teradata Group Data Warehouse, Hadoop Big Data Platform, Ab Initio technologies, which is why we’re the perfect fit for you. Here, you’ll be part of a team of engineers going above and beyond to improve the standard of digital banking, using the latest tech to solve our customers’ most complex data-centric problems.

See yourself in our team:

The Financial Crime Domain within CBA focuses on compliance and measures to prevent financial crimes. This domain is crucial for ensuring that the bank adheres to regulatory requirements and maintains the integrity of its operations.

Data Engineering in the Financial Crime Domain focuses on Data Collection and Integration, Data Analysis and Modelling, Compliance and Reporting and Data Controls.

We are interested in hearing from people who have:

  • Worked in an Agile environment to solve problems and achieve common objectives in the data engineering space

  • Experienced designing, building, and delivering optimised enterprise-wide data ingestion, data integration solutions for Cloud-based, Big Data and Data warehouse platforms with comprehensive test coverage

  • Experience building group data products, by integrating large sets of data derived from internal and external sources and publishing them for downstream consumption (eg File, Reporting Tools, Events, etc.) whilst maintaining controls to ensure completeness and accuracy

  • Hands-on experience in end-to-end testing of ETL process, data lakes and test data preparation/ creation, validating data accuracy, completeness, transformation logic, data quality and perform root cause analysis for data mismatches

  • Experience with automating test cases and testing process

  • Experience productionising and building ML/AI models leveraging tools like H2O to derive insights and categorisations from unstructured human entered raw text

  • Ability to run projects independently end to end - from Data Analysis to deployment, utilising the DevSecOps model.

We are seeking people who are:

  • Passionate about building next generation data platforms and data pipeline solution across the bank

  • Are data enthusiastic in providing solutions that source data from various enterprise data platform into data lake, transform and process the source data to produce data products, transform and egression to other data platforms like SQL Server, Oracle, Teradata and other cloud platforms

  • Constantly thinking creatively and breaking boundaries to solve complex data problems

  • Have a natural drive to educate, communicate and coordinate with different internal stakeholders

Key Skills & Experience:

  • Experience in building data solution in Hadoop and BigData platforms, using Spark framework, Ab Initio and Python.

  • Experience with AWS Technologies including Redshift, Iceberg tables, EMR, Glue, Athena, S3.

  • Data Analysis: Expertise in using tools like Zepplin, Alation, JupyterHub

  • Data Processing: Strong expertise in Python, SQL, Spark

  • Data Governance & Security: Experience with AWS DataZone, Lake Formation, IAM, encryption.

  • Marketplace & APIs: Exposure to AWS Marketplace, API Gateway, and data monetization strategies.

  • Automation & CI/CD: Experience with CloudFormation, GitOps, and serverless frameworks.

  • Experience is using test management tools like JIRA, version control Git

  • Performance Optimization: Ability to fine-tune ETL jobs, query performance, and cost efficiencies.

Nice to Have:

· Experience with Snowflake, or Apache Iceberg.

· Knowledge of data product thinking and data mesh principles

Working with us: 

Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.   

  

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace with flexible work locations. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.  

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 12/05/2025

Top Skills

Ab Initio
Alation
Athena
AWS
Aws Datazone
CloudFormation
Emr
Gitops
Glue
Hadoop
Iam
Jupyterhub
Lake Formation
Python
Redshift
S3
Spark
SQL
Teradata
Zepplin
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sydney, New South Wales
52,000 Employees
On-site Workplace
Year Founded: 1911

What We Do

Australia’s leading provider of financial services including retail, premium, business and institutional banking, funds management, superannuation, insurance, investment and sharebroking products and services.

We are a business with more than 800,000 shareholders and over 52,000 employees. We offer a full range of financial services to help all Australians build and manage their finances.

Similar Jobs

Commonwealth Bank Logo Commonwealth Bank

Senior Data Engineer

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees
2 Locations
52000 Employees

Similar Companies Hiring

Bectran, Inc Thumbnail
Software • Machine Learning • Information Technology • Fintech • Automation • Artificial Intelligence
Schaumburg, IL
51 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account