Senior Data Engineer

Posted 9 Hours Ago
Be an Early Applicant
London, Greater London, England
Senior level
AdTech • Digital Media • Marketing Tech
The Role
The Senior Data Engineer will lead the design and optimization of data pipelines and systems, focusing on scalability and performance. Responsibilities include managing Python development projects, automating workflows, mentoring junior engineers, and collaborating across teams to deliver innovative data-driven solutions.
Summary Generated by Built In

WHO ARE WE:

We’re Mediahub, the industry’s best-kept secret. This year we got our first Campaign School Report, coming in at number one for building the most ethnically diverse team in the industry.  

COMvergence rank us as the UK's fastest-growing media agency for the second year running.

We bring a challenger mindset to everything we do.  Brands choose to work with us to disrupt category norms.

We offer the best of both worlds.  A start-up culture backed by Mediabrands.

Just some of the brands we work with – New Balance, Pinterest, Celebrity Cruises.

Role Overview:

As a Senior Data Engineer, you will lead the design, development, and optimisation of data pipelines and systems, ensuring scalability, reliability, and performance. This role involves managing Python-based development projects, automating workflows, and creating frameworks that empower analytics and data science teams. You will collaborate across teams, mentor junior engineers, and take ownership of key initiatives, including infrastructure migration and the development of analytics solutions.

This position is ideal for an experienced data engineer with a passion for innovation, problem-solving, and delivering impactful data-driven solutions.

Key Responsibilities:

Python Development and CI/CD Practices:

  • Collaborate on Python-based projects, ensuring adherence to best coding practices and standards.
  • Implement and manage CI/CD pipelines to streamline development workflows and support scalable systems.
  • Utilise Git/GitHub for version control and team collaboration, promoting efficient development processes.

Data Pipeline Design and Optimisation:

  • Design, build, and optimise data pipelines within Databricks and MySQL Warehouse to meet client, analyst, and data scientist needs.
  • Leverage PySpark to enable high-performance data processing and analytics at scale.

Automation and Standardisation:

  • Champion automation-first solutions to solve complex challenges, including integrating machine learning models and developing bespoke tools.
  • Create and maintain Python packages to standardise systems across projects, reducing redundancy and enhancing scalability.

Quality Assurance and Debugging:

  • Establish comprehensive QA systems to enforce data integrity and streamline debugging processes across pipelines and projects.

Project Leadership and Team Management:

  • Take ownership of multiple concurrent projects, managing priorities, client expectations, and technical challenges.
  • Mentor and guide junior engineers and analysts, fostering professional growth and technical excellence within the team.

Stakeholder Management and Communication:

  • Effectively communicate technical and project updates with stakeholders, ensuring clarity and alignment across all initiatives.
  • Coordinate efforts between internal teams (data infrastructure and internal tools) and external clients (analytics and measurement frameworks).

Experience & Skills Required:

  • Technical Expertise: Proficient in Python, PySpark, and SQL, with experience in CI/CD pipelines and version control using Git/GitHub.
  • Data Engineering: Strong background in designing and optimising data pipelines within Databricks and MySQL Warehouse.
  • Automation: Proven ability to develop scalable, reusable Python packages to enhance efficiency and standardisation across projects.
  • Data Analytics and Reporting: Skilled in creating insights dashboards using Google Data Studio and Power BI, and conducting correlation analysis.
  • Infrastructure Migration: Experience leading large-scale infrastructure migration projects, particularly within cloud-based environments like Databricks.
  • Media and AdTech Ecosystems: Familiarity with media adtech platforms, ecosystems, and measurement frameworks.
  • Communication and Leadership: Strong verbal and written communication skills, with experience mentoring team members and managing stakeholder relationships.
  • Project Management: Ability to manage complex projects, prioritising tasks and delivering high-quality results under tight deadlines.

Ideal Candidate Profile

We are seeking a skilled and motivated Senior Data Engineer with a proven track record of delivering innovative data solutions. The ideal candidate will thrive in a collaborative and dynamic environment, bringing technical excellence, leadership, and a passion for driving impactful change through data engineering. If you are ready to lead transformative projects and mentor a growing team, we would love to hear from you.

Employee Transparency 

At IPG Mediabrands, we celebrate differences and believe this makes us stronger. IPG Mediabrands are equal-opportunity employers committed to championing an inclusive culture that provides a sense of belonging for all our employees. We do not discriminate against any applicant based on age, disability, race, colour, ethnicity, national origin, gender, sexual orientation, gender identity, religion, belief, marital status or any other characteristic protected by law. 

Please reach out to our Talent Inclusion Specialist Jess at [email protected] if you would like to have a confidential conversation regarding any adjustments that would ensure our recruitment process is accessible for you. Please note requesting a reasonable adjustment will not affect your application. 

The Perks 

We aim to provide all our people with a supportive and fun work environment where you can develop your full potential and benefit from the broad range of opportunities within the agency. When you join us, we want to make sure you feel valued – and that you are rewarded for your fantastic work. So, we also offer a range of benefits: 

  • Flexi–leave, with 25 days annual leave to be taken as minimum. In addition to your holiday entitlement, the office usually closes between Christmas & New Year 
  • Free breakfast and free lunch
  • Early finish Fridays 
  • Core Hours (Mon-Thurs, flexible start/finish times)  
  • Retail discounts 
  • Wellbeing programme 
  • Interest free season ticket loan 
  • Paid time off for Volunteering 
  • Group Income Protection 
  • Life Assurance 
  • Private Medical Insurance or Health Cash Plan (dependent on level) 
  • Group Personal Pension Plan with matched contributions from 3-6% 
  • Generous Parental Leave & Pay  
  • Independent mortgage advice 
  • Financial education 
  • Employee Assistance Programme 
  • Free eye tests 
  • Flexible benefits including Dental, Travel insurance, Cycle to Work, Gym Discounts and many more! 

Top Skills

Pyspark
Python
SQL
The Company
HQ: New York, New York
10,936 Employees
On-site Workplace

What We Do

IPG Mediabrands is the media and marketing solutions division of Interpublic Group (NYSE: IPG). IPG Mediabrands manages over $47 billion in marketing investment globally on behalf of its clients across its full-service agency networks UM, Initiative and Mediahub and through its award-winning specialized business units Healix, KINESSO, MAGNA, Mediabrands Content Studio, Orion Holdings, Rapport, and the IPG Media Lab. IPG Mediabrands clients include many of the world’s most recognizable and iconic brands from a broad portfolio of industry sectors including automotive, personal finance, consumer product goods (CPG), pharma, health and wellness, entertainment, financial services, energy, toys and gaming, direct to consumer and e-commerce, retail, hospitality, food and beverage, fashion and beauty. The company employs more than 18,000 diverse marketing communication professionals in more than 130 countries. Learn more at www.ipgmediabrands.com

Similar Jobs

Capco Logo Capco

Senior Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
London, England, GBR
6000 Employees

DRW Logo DRW

Senior Data Center Engineer

Fintech • Financial Services
London, Greater London, England, GBR
1825 Employees
London, Greater London, England, GBR
617 Employees

Zego (zego.com) Logo Zego (zego.com)

Senior Data Engineer

Automotive • Information Technology • Insurance
London, Greater London, England, GBR
388 Employees

Similar Companies Hiring

Artlist Thumbnail
Social Media • Other • Music • Digital Media
Tel Aviv, IL
450 Employees
bet365 Thumbnail
Software • Gaming • Esports • Digital Media • Automation
Denver, Colorado
9000 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account