iiDENTIFII - Data Engineering Technical Lead

Posted 23 Days Ago
Be an Early Applicant
Cape Town, Western Cape
Senior level
Big Data • Information Technology • Consulting • Big Data Analytics
The Role
The Data Engineering Technical Lead will lead the implementation of a next-generation data platform, refine current data practices, and mentor a data team. Responsibilities include designing data pipelines, ensuring data security, collaborating with stakeholders, and implementing best data governance practices.
Summary Generated by Built In

Calybre is recruiting for a very dynamic entrepreneurial digital services company in fintech offering critical services to major financial services. Work directly with the CTO to drive their data strategy and turn vision into innovation with the team.

In this role, you will:

  • Lead and Innovate: Drive our Data Engineering Team, guiding projects while staying hands-on.
  • Architect the Future: Build our modern Data Platform using the latest architecture and best practices.
  • Mentor and Grow: Guide and inspire the team, helping them become experts.
  • Stay hands-on: Continue to code and solve problems as the team’s top engineer.

The Team:

The team works in the Fintech space, focusing on real-time biometric verification and secure data authentication. We’re a group of innovative, entrepreneurial engineers with a dynamic, people-centred culture. While we work remotely for flexibility, we value in-person connections and regularly gather to strengthen our relationships.

Our Data Engineering Team is crucial to our success. Comprised of passionate data analysts and engineers, they drive customer success through data. We need a leader and mentor to help grow the team’s impact as the company advances in data maturity.

Key Role and Responsibilities

You'll work closely with the companies' leaders, senior engineers, and architects, aligning with our technology roadmap. Leading the Data Team, you'll drive daily delivery activities, producing valuable data products and reports for the business.

Your main responsibilities include:

  • Leading the design and engineering of data pipelines for batch and real-time processing.
  • Ensuring best practices in data engineering, monitoring, and observability using tools like Databricks, Microsoft SQL, Azure Data Factory, Synapse, or Airflow.
  • Mentoring junior team members to help them grow into experts.
  • Collaborating with executives and stakeholders to scale data platform capabilities and integrate them with other digital products.
  • Driving the development and performance management of the Data Engineering team.

In our Data team, we focus on quick, efficient automation. We tackle problems head-on and work seamlessly together. Our job is to support teammates and stakeholders by promoting shared data ownership and practical governance rules. These values help us meet Analytics and Reporting needs, ensuring stakeholders thrive with the companies data insights.

We're looking for someone who:

  • Is customer-focused and values delivering impact
  • Owns the team's systems, ensuring good data practices and platform reliability
  • Sets up efficient data processes across teams
  • Is a great mentor and helps junior colleagues grow
  • Works well with other teams to unblock projects
  • Collaborates with leadership to improve and scale the Data platform
  • Has excellent communication skills
  • Leads the team towards growth and success

Required experience:

  • Leadership: 2+ years with proven ability of leading and mentoring teams and driving performance and delivery of quality outputs
  • Data Engineering: 5+ years of building modern, cloud-native data platforms, with ability in:
  • Designing scalable pipelines using Apache Spark and Databricks
  • Orchestrating data workflows with Airflow, Databricks Jobs, Azure Synapse, or Azure Data Factory
  • Working with streaming platforms like Kafka, RabbitMQ, or Azure Event Hubs
  • Developing metadata-driven pipelines
  • Understanding data security, governance, and architecture
  • Linux, Python programming, and scripting for data automation
  • Implementing DevOps, DataOps, and CI/CD pipelines
  • Database administration and optimization in Microsoft or Azure SQL
  • Cloud Technology: 3-5 years with Microsoft Azure
  • Real-Time Processing: Experience with streaming platforms using Kafka, Event Hubs
  • BI & Visualisation: 2+ years with tools like Power BI, Grafana
  • Monitoring & Observability: Familiarity with tools like Application Insights, Azure Monitor, and Grafana

Additional Skills/Experience (Beneficial):

  • Data Model Design: Familiar with data lakes, data warehousing, and Kimball Dimensional Modelling
  • Data Development Lifecycle (DDLC): Experience guiding teams from requirements to deployment
  • Mentorship & Documentation: Ability to coach team members and create high-quality documentation
  • DevOps & Security: Experience with DevEx in Agile environments and knowledge of the ISO 27001 security framework

Come and be a part of the companies journey in advancing data capabilities and shaping the future of cloud tech. If you're up for a new challenge in a supportive and growth-focused environment, we'd love to hear from you!

    Top Skills

    Python
    The Company
    Sheffield
    64 Employees
    On-site Workplace
    Year Founded: 2022

    What We Do

    Calybre is a rapidly growing global company focused on building a passionate team of excellent technology-agnostic data consultants across the full range of the data domain.With headquarters in the UK and a growing presence in South Africa, Calybre is well-positioned to access and develop great talent and provide these capabilities to customers across the globe, servicing the growing need for this high demand capability.Calybre is all about people…..People who are, first and foremost, passionate about data; who approach their work with confidence, passion, grit and energy and are continually excited by the opportunities we create for each other by working together. We strive to create a work environment and culture of belonging where people can thrive; we support continuous learning, leading our consultants on clearly defined career paths and focusing on the whole person with as much emphasis on power skills as on technical knowledge. We lead by example and with empathy, ensuring high trust and partnership between all Calybrians.Our customers are typically mid-sized to large businesses, enterprise organisations and consulting partners. We journey with our customers on their quest to build and improve their data assets, to develop their data capabilities and to create value from their data, independent of technology, industry or geography.

    Similar Jobs

    NBCUniversal Logo NBCUniversal

    Senior Mobile Software Engineer (Flutter Developer)

    AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
    Hybrid
    Cape Town, Western Cape, ZAF
    68000 Employees

    Euromonitor International Logo Euromonitor International

    Cloud Engineer

    Other • Analytics • Business Intelligence
    Cape Town, Western Cape, ZAF
    2154 Employees
    Century City, City of Cape Town, Western Cape, ZAF
    39055 Employees

    Absa Group Logo Absa Group

    Lead AI Engineer

    Financial Services
    Century City, City of Cape Town, Western Cape, ZAF
    39055 Employees

    Similar Companies Hiring

    Jobba Trade Technologies, Inc. Thumbnail
    Software • Professional Services • Productivity • Information Technology • Enterprise Web • Consulting • Cloud
    Chicago, IL
    45 Employees
    InCommodities Thumbnail
    Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
    Austin, TX
    234 Employees
    HERE Thumbnail
    Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
    Amsterdam, NL
    6000 Employees

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account