Data Engineer
Company Overview:
Maersk is a global leader in container shipping and logistics, dedicated to connecting and simplifying the supply chain. We offer a wide range of services to support our customers' businesses and help them grow. As a Python Developer at Maersk, you will have the opportunity to work on cutting-edge technology and make a significant impact on our digital transformation efforts.
Job Overview
We are seeking a talented Engineer with experience in Microsoft Azure and proficiency in Python development. The ideal candidate will also have strong software development skills and experience with various open-source technologies. This role involves designing, implementing, and maintaining data pipelines and architectures to support data-driven initiatives across the organization.
Responsibilities and Duties
- Design and Implement Data Solutions: Utilize Azure services such as Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB to create scalable data storage solutions.
- Develop and Maintain Data Pipelines: Build robust ETL processes using Azure Data Factory, integrating open-source tools like Apache Kafka or Spark for data processing.
- Data Transformation: Use Python and libraries such as Pandas and NumPy for data cleansing, transformation, and analysis to ensure high-quality data delivery.
- Collaborate with Cross-Functional Teams: Work closely with software developers, data analysts, and data scientists to align on data initiatives and ensure effective data delivery.
- Automate Tasks and Deploy Code: Implement automation for repetitive tasks and deploy production-ready code using CI/CD practices.
- Monitor and Optimize Performance: Regularly monitor data pipelines for performance issues, troubleshoot problems, and optimize processes for efficiency.
Additional Software Development Skills
- Programming Languages: Proficient in Python; familiarity with other languages such as Java or C# is a plus.
- Open Source Technologies: Experience with tools such as Apache Spark, Apache Airflow, or Elastic Stack for data processing and analytics.
- Containerization: Knowledge of Docker and Kubernetes (AKS) for deploying applications in a microservices architecture.
- Version Control Systems: Experience with Git for source code management and collaboration.
- Database Management: Strong SQL skills; experience with NoSQL databases like MongoDB or Cassandra is advantageous.
- Data Modeling: Understanding of data modeling principles and schema design to optimize performance.
Qualifications
- Education: Bachelor’s degree in computer science, Engineering, or a related field.
- Experience: 5+ years of experience in a Data Engineering role with a focus on Azure technologies and open-source solutions.
Maersk is committed to a diverse and inclusive workplace, and we embrace different styles of thinking. Maersk is an equal opportunities employer and welcomes applicants without regard to race, colour, gender, sex, age, religion, creed, national origin, ancestry, citizenship, marital status, sexual orientation, physical or mental disability, medical condition, pregnancy or parental leave, veteran status, gender identity, genetic information, or any other characteristic protected by applicable law. We will consider qualified applicants with criminal histories in a manner consistent with all legal requirements.
We are happy to support your need for any adjustments during the application and hiring process. If you need special assistance or an accommodation to use our website, apply for a position, or to perform a job, please contact us by emailing [email protected].
Top Skills
What We Do
A.P. Moller - Maersk is an integrated transport and logistics company; going all the way, together, for our customers and society. ALL THE WAY is our commitment to connect the world so that everyone has both the possibility and the ability to trade, grow and thrive.
The company employs roughly 110.000 employees across operations in 130 countries.
