Lead Data Engineer

Posted 21 Days Ago
12 Locations
140K-205K Annually
Senior level
Information Technology • Legal Tech
The Role
The Lead Data Engineer will design, implement, and maintain scalable data pipelines and architecture while ensuring data governance and compliance. Responsibilities include collaborating with stakeholders, optimizing data processing, and supporting AI initiatives.
Summary Generated by Built In

Lead Data Engineer

Cooley is seeking a Lead Data Engineer to join the Data Science & Engineering team.

Position summary: As the leading technology law firm in the world, Cooley is determined to become a leader in the digital practice of law. Reporting to the Director of Data Science and Engineering, the Lead Data Engineer will focus on designing, developing, and maintaining a data lake and scalable data pipelines and architectures in support of Cooley’s data-driven goals. This role will be instrumental in establishing the foundational data lake infrastructure and supporting downstream AI and analytics initiatives. Specific duties and responsibilities include, but are not limited to, the following:

 Position responsibilities:

  • Design, develop, and implement scalable data pipelines to ingest, transform, and store structured and unstructured data
  • Analyze, optimize, and tune existing data pipelines for performance, reliability, and efficiency
  • Lead collaboration with stakeholders to understand business requirements and deliver technical solutions
  • Implement and enforce data governance and security measures, including compliance with regulatory standards
  • Apply expertise in data lakes to ensure robust data architecture.
  • Lead troubleshooting and resolution of  issues related to data processing, performance, and system reliability
  • All other duties as assigned or required

Skills and experience:

Required:

  • After orientation at Cooley LLP, exhibit proficiency in the Microsoft Office suite, iManage and other firm applications
  • Ability to work extended and/or weekend hours, as required
  • Ability to travel, as required
  • 5+ years of experience working with data lakes (e.g. Databricks, Unity Catalog, Delta Sharing, Auto Loader, Delta Live Tables, Snowflake) or similar data engineering platforms (e.g., Spark, Hadoop, Hive)
  • Extensive experience with SQL Databases and programming languages
  • Strong knowledge of data engineering concepts, ETL processes, and data architecture principles.
  • Proficiency in Python / PySpark and SQL for data transformation and querying
  • Experience with both structured and unstructured data and familiarity with cloud-based data storage solutions
  • Ability to manage and optimize large-scale data environments for performance and reliability
  • Familiarity with systems such as Salesforce
  • Strong understanding of cloud computing principles
  • Experience implementing and maintaining security measures and data governance standards

Preferred:

  • Bachelor’s degree or higher in Computer Science, Engineering, or a related field
  • Familiarity with data modeling, data warehousing, and governance
  • Knowledge of RESTful APIs and their implementation
  • Data Engineer certification or equivalent
  • Exposure to machine learning and Generative AI concepts

Competencies:

  • Comfortable assuming leadership roles in cross-functional, matrixed teams
  • Excellent communication and interpersonal skills, with the ability to translate complex technical concepts to non-technical audiences
  • Ability to influence and collaborate with multiple stakeholders across various departments (legal, IS, etc.)
  • Exhibit analytical and critical thinking in day-to-day tasks
  • Excellent problem-solving and communication skills with the ability to convey complex technical concepts to non-technical stakeholders

Cooley offers a competitive compensation and excellent benefits package and is committed to fair and equitable employment practices.

EOE.

The expected annual pay range for this position with a full-time schedule is $140,000 - $205,000. Please note that final offer amount will be dependent on geographic location, applicable experience and skillset of the candidate.

We offer a full range of elective benefits including medical, health savings account (with applicable medical plan), dental, vision, health and/or dependent care flexible spending accounts, pre-tax commuter benefits, life insurance, AD&D, long-term care coverage, backup care for children and/or adults and other parental support benefits. In addition to elective benefit options, benefited employees receive firm-paid life insurance, AD&D, LTD, short term medical benefits as well as 21 days of Paid Time Off (“PTO”) and 10 paid holidays each year. We provide generous parental leave and fertility benefits. New employees will attend a detailed benefit orientation to learn more about our many benefits and resources.

Top Skills

Auto Loader
Databricks
Delta Live Tables
Delta Sharing
Hadoop
Hive
Pyspark
Python
Snowflake
Spark
SQL
Unity Catalog
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Palo Alto, CA
3,345 Employees
On-site Workplace
Year Founded: 1920

What We Do

Clients partner with Cooley on transformative deals, complex IP and regulatory matters, and high-stakes litigation, where innovation meets the law.

Cooley has 1,300+ lawyers across 19 offices in the United States, Asia and Europe, and a total workforce of more than 3,000.

Attorney Advertising: This content is provided for general informational purposes only, and your access or use of the content does not create an attorney-client relationship between you and Cooley LLP, Cooley (UK) LLP, Cooley SG LLP, Cooley HK or any other Cooley entity (collectively referred to as “Cooley”). By reviewing this content, you agree that the information provided does not constitute legal or other professional advice. This content is not a substitute for obtaining legal advice from a qualified attorney licensed in your jurisdiction and you should not act or refrain from acting based on this content. This content may be changed without notice, and it is not guaranteed to be complete, correct or up to date, and it may not reflect the most current legal developments. This content may be considered attorney advertising. Do not send any confidential information to Cooley, as we do not have any duty to keep it confidential.

Cooley’s privacy policy: https://bit.ly/CooleyLLPprivacy

Similar Jobs

CapTech Logo CapTech

Lead Data Engineer (AWS, Azure, GCP)

Information Technology • Consulting
Denver, CO, USA
1100 Employees
115K-180K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Software Data Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
2 Locations
4600 Employees
117K-176K Annually

Belvedere Trading Logo Belvedere Trading

Senior Data Engineer - Automated Trading

Fintech • Information Technology • Other • Software • Financial Services
Easy Apply
Hybrid
2 Locations
265 Employees

The Aerospace Corporation Logo The Aerospace Corporation

Computer Science/Data Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
Colorado Springs, CO, USA
4600 Employees
117K-227K Annually

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Enterprise Web • Consulting • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account