Data Engineer (Databricks)

Have you ever envisioned a world where data seamlessly transforms into insights, propelling businesses forward? Imagine being at the forefront of this data-driven revolution, crafting sophisticated data pipelines and harnessing the power of visualizations. What if you could not only excel in AWS and Azure proficiency but also elevate your skills in Tableau, Kibana, and PowerBI, sculpting a narrative that speaks volumes in every dashboard? Join us, where your passion for data engineering meets limitless possibilities!

About Sharesource:

We are a social enterprise dedicated to connecting global opportunities with talented individuals. Currently, we serve Australian clients and aim to empower businesses to thrive by accessing the talent they need worldwide. Our mission is to support individuals in achieving success in their careers while fostering a company culture that embodies our values.
https://www.sharesource.com.au/

What are we looking for?
We are in search of a dynamic Data Engineer, passionate about leveraging technology to deliver exceptional value to customers. As a crucial part of our team, you'll be responsible for designing and implementing data pipelines, ensuring high-quality data integration, and contributing to innovative solutions.
What are you expected to do?

• Design and implement data pipelines for extracting and loading data into a central data store
• Collaborate with stakeholders to understand business requirements and design data models
• Optimise and enhance existing data pipelines for high performance and reliability
• Develop and maintain data quality checks to ensure accuracy and completeness
• Monitor and maintain data pipelines, identifying areas for improvement
• Participate in code reviews and collaborate with other engineers to maintain high-quality code
• Create visualisations using tools like Power BI
• Stay updated with industry trends, recommending new tools and technologies for data infrastructure improvement
• Participate in discovery workshops and solutions design activities with customers

You’ll be a great fit if:

• You have at least 5 years of related experience
• You have strong experience with Databricks, Snowflake, Redshift, or Synapse
• You demonstrate proficiency in AWS and/or Azure
• You possess extensive knowledge of ETL processes and data integration
• You showcase expertise in data warehousing, modelling, and lake house architecture
• You possess strong programming skills in Python, SQL, and Spark
• You excel in communication and collaboration
• You have hands-on experience with Python (Pyspark, Lambda, Batch, Glue, DataFlow, etc)
• You work with customers to elicit requirements and scope projects
• You demonstrate proficiency in data transformation and migration
• You understand Data Governance concepts (MDM, Metadata management, Data Security, Data Quality, etc)
• You continuously monitor and maintain data pipelines, ensuring they run smoothly and identifying areas for improvement

We will be absolutely thrilled if you also have the following:

• You possess visualization skills with an eye for aesthetics
• You demonstrate descriptive Data Analytics skills with PowerBI
• You have experience in Data Lake establishment and/or data pipeline development
• Your dashboard proficiency includes Tableau, Kibana, Quicksight, PowerBI
• You are familiar with commercial ETL tools like DBT, Talend, Informatica, or Attunity
• You have exposure to Infrastructure as code and cloud deployment
• You are familiar with Bitbucket, GitHub, Azure DevOps

Here are the benefits of joining our team:

• Competitive salary and professional development
• Collaborative client partnerships and a fun, inclusive work environment
• Opportunities for leadership, expertise, and global client exposure
• Monthly coaching, training, and career development
• Remote work flexibility and a flexible hybrid model
• Engage in social impact activities and industry impact
• Achieve work-life balance and flexibility to support personal commitments
• Comprehensive HMO coverage with one free dependent

___________________

Why work for Sharesource?

Our clients come from all walks of life and so do we. We hire hundreds of skillful individuals from a wide variety of backgrounds, genders, ages, and personalities to live out our diverse culture and make a positive impact on the world!

Our 5 Values:

• Make a social impact: We balance our work for client teams and for society by constantly making a positive impact.
• Be proactive: We encourage brave thinking and continuous improvement, and drive change through action.
• Create value: We create measurable values for our stakeholders: our teams, partners, suppliers, investors, and communities.
• Be fair, open and honest: We foster equality and inclusivity in a supportive environment that embraces diversity and celebrates achievements.
• Add fun, passion and love: We prioritise fun and passion, fostering higher engagement and a positive can-do attitude.

What makes us different?

Our culture code. You will be a part of our vibrant company culture and experience a workplace where your contributions are valued, your growth is encouraged, and your opinion is respected:

• Challenged, autonomous, momentum
• Learning, growth mindset
• Lead by our values
• Heard, cared for, make good friends

___________________
What happens after you submit your application?

The whole process takes around 4 weeks:

• There will be 3-4 interviews and a possible assessment from our client partner. You will undergo an initial interview, a culture interview, and 1-2 interviews with our cool client. This will run for about 1-2 weeks but we will let you know if we need to ramp it up. Be yourself and have fun.
• We will constantly communicate with you as to the development of your application. You can also directly communicate with us to ask us about the status of your application.
• If all goes well, we complete the reference check and provide other necessary requirements so we can offer you the job right away.

We would be grateful if you have these already:

1. Fit to Work/Health Card (Basic 5 employment medical tests)
2. NBI Clearance
3. Social IDs - PHIC, SSS, HDMF, TIN 
4. Character references with contact info

At Sharesource, we believe in the value of diversity and inclusion. We are committed to creating a diverse, respectful, and inclusive workplace, and we do not discriminate based on factors such as race, gender, religion, sexual orientation, or disability.