Principal Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Arlington, VA
Senior level
Big Data • Professional Services • Business Intelligence • Consulting
The Role
As a Principal Data Engineer at Lovelytics, you will design and implement data pipelines using Databricks, architect data lakes and warehouses, and ensure project milestones are met. You will also lead technical engagements, translate business requirements into solutions, and collaborate with teams to optimize data governance and security.
Summary Generated by Built In

We are seeking an accomplished & Databricks Certified Principal Consultant with specialized expertise in delivering strategic Databricks and data engineering solutions for our clients at Lovelytics. As a pivotal member of our team, you will serve as a data and analytics solution architect, leading technical engagement and architecture initiatives encompassing data warehousing, ETL development, data integrations, and data modeling.

Location: This role is open to remote candidates in the following states: AZ, CA, DC, VA, MA, MD, FL, GA, IL, IN, KS, NC, NJ, NY, PA, OR, TN, TX, WA

Primary Responsibilities:

  • Design end-to-end data pipelines leveraging Databricks for ETL, streaming, and batch processing.
  • Architect data lakes and warehouses on Databricks, ensuring scalability, reliability, and performance.
  • Collaborate with stakeholders and other capability team members to translate business requirements into technical specifications and scalable solutions.
  • Implement best practices for data governance, security, and optimization within the Databricks environment.
  • Collaborate with Technical Directors to identify market trends, implement internal initiatives, and contribute thought leadership through blogs and innovative solutions.
  • Apply deep technical knowledge to address client challenges and expand business opportunities, and at times, engage in client-facing pre-sales and pursuit activities.
  • Manage projects, ensuring milestones are achieved within set timelines and budgetary constraints.
  • Provide technical guidance and support across various project facets, from data integration to troubleshooting.

Required Skills & Experience:

  • Bachelor's degree in Computer Science or related field.
  • 8+ years of data engineering experience within cloud-based analytics architectures, with at least 4 years in a traditional consulting environment and role.
  • Proven experience as a Solution Architect or Data Engineer, with a focus on Databricks.
  • Strong proficiency in building and optimizing big data pipelines using Databricks Delta and Apache Spark.
  • Solid understanding of cloud platforms (Azure, AWS, or GCP) and their integration with Databricks.
  • Expertise in SQL, Python, or Scala for data manipulation and analysis.
  • Familiarity with Machine Learning model development or ML Ops is advantageous.
  • Excellent communication skills, crucial for effective client interaction and management.
  • Relevant certifications such as Databricks Data Engineer Professional and Databricks Machine Learning Professional are desirable.

What We Offer:

  • Exciting projects with diverse clients across various industries globally.
  • Collaborative environment fostering rapid skill development and innovation.
  • Opportunity to work alongside seasoned data engineers and grow professionally.
  • Encouragement to challenge norms, develop new technologies, and refine methodologies.
  • A vibrant, diverse team of data enthusiasts, experience seekers, and entrepreneurial minds dedicated to continuous improvement.

Lovelytics is an Equal Opportunity Employer. This means you don’t have to worry about whether your application process will be fair. We consider all applicants without regard to race, color, religion, age, ancestry, ethnicity, gender, gender identity, gender expression, sexual orientation, veteran status, or disability. 

Top Skills

Python
Scala
The Company
HQ: Arlington, VA
70 Employees
Hybrid Workplace
Year Founded: 2017

What We Do

Lovelytics is a data and analytics consultancy. We partner with people, teams, and organizations to deliver services and build solutions that drive outcomes while promoting self-sufficiency through hands-on enablement.

Similar Jobs

Capital One Logo Capital One

Senior Manager, Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
McLean, VA, USA
55000 Employees

Capital One Logo Capital One

Lead Data Engineer (Bank Tech)

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Richmond, VA, USA
55000 Employees
201K-230K Annually

Capital One Logo Capital One

Senior Lead Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Richmond, VA, USA
55000 Employees
235K-268K Annually

Capital One Logo Capital One

Lead Data Engineer, Card Tech

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
McLean, VA, USA
55000 Employees
188K-230K Annually

Similar Companies Hiring

Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account