Head of Data Engineering

Posted Yesterday
Be an Early Applicant
London, England
65-130
Senior level
Financial Services
The Role
Lead the development of Pantheon Data Platform, overseeing data infrastructure, governance, and analytics to support decision-making and driving investment excellence.
Summary Generated by Built In

Pantheon has been at the forefront of private markets investing for more than 40 years, earning a reputation for providing innovative solutions covering the full lifecycle of investments, from primary fund commitments to co-investments and secondary purchases, across private equity, real assets and private credit.

We have partnered with more than 650 clients, including institutional investors of all sizes as well as a growing number of private wealth advisers and investors, with approximately $65bn in discretionary assets under management (as of December 31, 2023).

Leveraging our specialized experience and global team of professionals across Europe, the Americas and Asia, we invest with purpose and lead with expertise to build secure financial futures.

For further details please visit www.pantheon.com

Purpose of Position:

The Head of Data Engineering will lead the development and evolution of the Pantheon Data Platform, establishing it as the core enabler of analytics and insight across the firm. This role focuses on the design, implementation, and optimization of robust, scalable data infrastructure—including data pipelines, data lakes, and integration frameworks—that power the firm’s decision-making capabilities. The successful candidate will ensure the platform delivers high-quality, timely, and accessible data to internal stakeholders, enabling self-service analytics and driving operational and investment excellence.

Key Responsibilities: 

  • Partner with leaders from Technology, Transformation Office, Investment Team & Portfolio Management and Investor Relations groups to refine and execute on the firm’s data engineering strategy.
  • Stay updated on private markets industry trends, regulatory needs, software vendor offerings, and investment team feedback to guide product decisions and maintain Pantheon’s competitive edge.
  • Align our data strategy with firm priorities, establish the data sources, identify the tools needed, and oversee data governance and quality standards.
  • Enhance the existing Pantheon Data Platform, including data lake, data pipelines and reporting infrastructure.
  • Partner with the Change Office to deliver & enhance Pantheon’s data & analytics product (“Prism”) as required by strategic transformation & change initiatives or by projects initiated within the Pantheon Innovation Lab.
  • Champion a user-centric approach to data pipelines and scalable data platforms, focusing on usability, intuitiveness, and overall user satisfaction.
  • Establish relevant KPIs that measure the outcomes and impacts of our various data initiatives. Conduct regular monitoring and usage to validate and improve existing solutions, and deliver outcome-oriented impact analysis to stakeholders and leadership team.
  • Manage the data team, which may include data analysts, data engineers, and related data professionals.
  • Provide leadership, mentorship, and professional development opportunities for team members, fostering a culture of innovation and continuous improvement.
  • Spearhead the deployment and operationalization of Azure Databricks and lakehouse architecture for scalable data processing.
  • Build and nurture a community of data platform users across teams to foster adoption and data-driven decision making.
  • Establish and manage end-to-end data engineering practices for acquiring, processing, and delivering structured and unstructured data.

Knowledge & Experience Required:

  • Bachelor’s degree in Engineering, Technology, Data Science or a related field; an advanced degree is preferred
  • Track record of working with and organizing data within financial services, asset management, private markets
  • Crucial to have experience in deploying, managing and optimising Azure Databricks environments, with metadata management principles, and data governance best practices
  • Strong experience managing work requests using the Scrum framework and utilising Azure DevOps to facilitate that work.
  • Proficient in programming languages, such as Python, R, or SQL; frameworks, such as Teraform, PySpark, Spark and analytics tools such as Azure Synapse, and reporting platforms such as PowerBI & Tableau
  • Proficiency in managing processes involving acquiring, storing, processing and delivering structured and unstructured data for analytical applications
  • Demonstrated expertise in data governance, data quality management, and the implementation of analytics platforms. Ideally utilising the Unity Catalog functionality in Azure Databricks.
  • Strong experience in managing and developing high-performing teams, with the ability to inspire and drive cross-functional collaboration. Experience leading and developing globally distributed internal teams
  • Strong analytical and strategic thinking skills, with a focus on translating data into actionable business insights
  • Strong problem-solving skills, attention to detail, and an ability to navigate complex data processes and organizations
  • Excellent communication and interpersonal skills, with the ability to engage and influence stakeholders at all levels of the organization
  • Experience with change management and leading digital transformation initiatives within an organization
  • Experience in leading cross-functional initiatives, with strong communication skills, project management abilities, and organizational skills
  • Comfort with industry leading private markets software products (e.g. pipeline management, portfolio company monitoring, investment book of record, portfolio construction, planning & reporting etc.). eFront experience is a plus.
  • Experience using industry standard product management tools and technologies, e.g. Aha, Miro & Visio

This job description is not to be construed as an exhaustive statement of duties, responsibilities, or requirements. You may be required to perform other job-related duties as reasonably requested by your manager.

Pantheon is an Equal Opportunities employer, we are committed to building a diverse and inclusive workforce so if you're excited about this role but your past experience doesn't perfectly align we'd still encourage you to apply.



Top Skills

Azure Databricks
Azure Synapse
Power BI
Pyspark
Python
R
Spark
SQL
Tableau
Teraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
London
449 Employees
On-site Workplace
Year Founded: 1982

What We Do

Pantheon is a leading global private markets firm currently investing on behalf of more than 800 investors, including public and private pension plans, insurance companies, endowments and foundations. Pantheon has an established reputation across private market asset classes, including private equity, infrastructure and real assets, private debt and real estate, and covering all stages and geographies. As of September 30, 2021 Pantheon had $81.2 billion assets under management and advice and the firm currently has around 400 employees, including more than 115 investment professionals, located across its 10 global offices in London, San Francisco, New York, Chicago Hong Kong, Seoul, Bogotá, Tokyo, Dublin and Berlin.

Similar Jobs

Hybrid
London, Greater London, England, GBR
724 Employees
Hybrid
Bournemouth, Dorset, England, GBR
289097 Employees

TravelPerk Logo TravelPerk

Senior iOS Engineer

HR Tech • Software • Travel
Easy Apply
Hybrid
London, Greater London, England, GBR
1400 Employees
200K-200K

Citadel Logo Citadel

Site Reliability Engineer

Information Technology • Software • Financial Services • Big Data Analytics
London, Greater London, England, GBR
4000 Employees
105K-300K Annually

Similar Companies Hiring

EDGE Thumbnail
Software • Fintech • Financial Services • Analytics
Chicago, IL
20 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
78 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account