(Senior) Data Engineer
We are looking for a (Senior) Data Engineer based in our Malaysia location to join the global Data Science & Engineering team in ROCKWOOL to support the development of our global data platform for factory data collecting datasets from IoT infrastructure from our plants. This role involves working on a platform built on Azure, leveraging Databricks, Airflow, Docker, Blob Storage, and MongoDB. You will address technical challenges, implement new features, streamline CI/CD pipelines, automate processes, and enhance governance and monitoring. We are also planning a migration to a new tech stack most likely based on Databricks, Azure EventHub and Kafka, and you may contribute to tasks related to the new platform in the future.
You will join the operational part of a global Data & AI team where you will collaborate with colleagues in Poland and Denmark. The operational team in Malaysia will contain data scientists, data engineers and ML engineers and there will be a lot of collaboration with other parallel teams in other locations.
Key Requirements
- Technical Skills:
- 3-5+ years of experience in data engineering focused on data integration, ETL, and data warehousing,
- Proficiency in Databricks and Spark.
- Experience with Azure services and platform.
- Programming expertise in Python.
- Familiarity with DevOps/DataOps practices.
- Communication:
- Fluency in English (C1).
- Personal Attributes:
- Proactive and self-reliant in task execution.
- Capable of proposing solutions and effectively collaborating with stakeholders.
Big Advantages
- Technical Expertise:
- Experience with MongoDB and NoSQL databases.
- Knowledge of scheduling tools, especially Airflow.
- Proficiency in containerization using Docker.
- Familiarity with advanced Databricks features like Unity Catalog or DLT.
- Expertise in SQL databases.
- Experience managing on-premises or cloud-based servers.
- Understanding of programming structures and algorithms.
- Version control expertise (Git, preferably GitHub).
- Advanced understanding of data pipelines and data architecture (data warehouses, lakes, vaults).
- Experience with IaC concepts and tools, preferably Terraform.
- Familiarity with LLM tools (e.g., ChatGPT, GitHub Copilot) to enhance productivity.
- Nice to Have:
- Experience with data modeling,
- Knowledge of additional programming languages (e.g., C#, Java, Scala),
- DBT,
- Snowflake,
- Kafka.
Other Expectations
- Familiarity with Scrum/Kanban methodologies and tools like Jira.
- Ability to independently gather requirements and collaborate with business stakeholders.
- Experience working in an international team.
Top Skills
What We Do
We release the natural power of stone to enrich modern living.
ROCKWOOL Group is a focused industrial company with leading positions in insulation, acoustic ceilings and horticultural growing media based on proprietary stone wool technology. We harness the properties that nature has given us to create products for quality living.
Our products touch most aspects of everyday life. We offer carefully designed, innovative sustainable solutions for your comfort, safety and for the benefit of the environment.
ROCKWOOL Group's business portfolio consists of:
* ROCKWOOL® insulation solutions for buildings.
* ROCKWOOL® technical insulation solutions to both industry, marine and offshore.
* ROCKWOOL® core solutions tailor made stone wool products to be integrated into finished systems.
* Rockfon® acoustic ceilings and wall solutions.
* Rockpanel® cladding material.
* Grodan® growing media solutions for plants.
* Lapinus® solutions for applications such as friction, water management, tracks, coatings, gaskets.
At ROCKWOOL Group, we are committed to enriching the lives of everyone who experiences our product solutions. Our expertise is perfectly suited to tackle many of today’s biggest sustainability and development challenges, from energy consumption and noise pollution to fire resilience, water scarcity and flooding. Our range of products reflects the diversity of the world’s needs, supporting our stakeholders in reducing their own carbon footprint along the way.
Stone wool is a versatile material and forms the basis of all our businesses. With around 12,200 colleagues in 40 countries, we are the world leader in stone wool solutions, from building insulation to acoustic ceilings, external cladding systems to horticultural solutions, engineered fibres for industrial use to insulation for the process industry and marine & offshore
