Senior Data Engineer

We are looking for an experienced Senior Data Engineer to join our team.

In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, architectures, and complex data systems. You will work closely with other stakeholders to ensure data is accessible, reliable, and optimized for business intelligence, analytics, and machine learning applications.

Key Responsibilities:

- Design, implement, and maintain robust ETL (Extract, Transform, Load) pipelines to ingest and process large volumes of structured and unstructured data.

- Optimize and manage databases (both SQL and NoSQL) for performance, scalability, and security, ensuring efficient storage and retrieval of large datasets.

- Architect, build, and scale data storage solutions, ensuring high availability, fault tolerance, and efficient data processing.

- Implement data validation, cleaning, and transformation processes to ensure high-quality, trustworthy data. Monitor data pipelines to detect and resolve issues.

- Optimize queries and data processing performance, focusing on reducing costs and improving system efficiency.

What do you bring:

- 5+ years of experience as a Data Engineer or similar role, with hands-on experience building data pipelines and architectures.

- Proficiency in SQL, Python, and/or Java for building ETL pipelines and data integration.

- Knowledge of data modelling, schema design, and best practices in database management.

- Experience with big data frameworks such as Hadoop, Apache Spark, Flink, or Kafka.

- Strong understanding of relational databases and NoSQL databases.

- Experience with data warehousing solutions.

- Proficiency with workflow orchestration tools.

- Experience with containerization technologies and orchestration tools.

Preferred Qualifications:

- Familiarity with machine learning infrastructure and MLOps.

- Knowledge of data governance, security, and compliance (GDPR, CCPA, etc.).