Databricks, Senior Data Engineer

Posted 10 Days Ago
Hiring Remotely in USA
Remote
Senior level
Cloud
The Role
As a Senior Data Engineer at Zencore, you will leverage Databricks to assist clients with data application modernization and cloud migration, driving transformation by acting as a trusted advisor on various topics including ETL, data modeling, security, and governance. You will develop production-ready Spark applications, utilize the Databricks tech stack, and implement data pipeline best practices.
Summary Generated by Built In

Zencore is a fast growing company founded by former Google Cloud leaders, architects and engineers. We are looking for candidates that have significant experience with Google Cloud to join our team. Our engagements are designed to unblock, remove risk and accelerate timelines for customers that are migrating to Google or need help with data and application modernization. We embed into customer teams to help with strategy, technology decisions and co-development style execution.


What you will do...


As a member of our Data Engineering team, you will be working with fast paced innovative companies, leveraging Databricks as the key driver of their transformation. They will look at you as their trusted advisor, someone they can rely on and who will be there to help them along their journey on Databricks. You will be expected to cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, Streaming Data systems, Data Modeling, Data Security & Governance, and BI/AI.

Who we need...

  • 5+ years of experience serving in a data engineering capacity
  • 2+ years of experience working with Databricks
  • Preferred candidates will have the Databricks’ Data Engineer Associate or Data Engineer Professional certification
  • Familiarity with the Databricks tech stack related to data engineering: notebooks, clusters, jobs, workflows, serverless sql, unity catalog, repos, dashboards, DLT, etc.
  • Experience developing production Spark applications
  • Strong skills with Python, PySpark and Spark SQL
  • Strong understanding of Delta Lake technology and best practices to apply its capabilities during the data pipeline development lifecycle
  • Experience with Spark Structured Streaming and Databricks Delta Live Tables (DLT)
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Understanding of incremental update patterns and technologies available on Databricks such as CDC, SCD#2, autoloader, change data feed (CDF), DLT, Delta Lake ACID, etc.

Why work here...

  • We are professionals you can Trust. Our people have the extensive experience to get the job done 
  • We share unbiased opinions and are comfortable with the hard truths. You are the subject matter experts for our customers. 
  • We are the Missing Link. You will connect our customers to Google and move quickly when others can’t
  • We remove uncertainty and risk by clearly outlining the process of cloud migration for our customers
  • We accelerate timelines and do not dwell on a challenge. You’ll move faster and expose “unknown unknowns” for our customers 
  • We show empathy. Our customers believe in us because we can relate to their complexities.

How to succeed...

  • First rule at Zencore - Be Kind 
  • Own the process - own your customer’s success by proactive practices 
  • Work hard to reach the destination, but make sure to enjoy the journey 
  • Champion a consistent collaborative culture 
  • Be receptive to Feedback
  • Challenge the Status Quo

Top Skills

Pyspark
Python
Spark Sql
The Company
HQ: San Francisco, CA
36 Employees
On-site Workplace
Year Founded: 2021

What We Do

We are a team of former Google Cloud Architects and Engineers. Headquartered in San Francisco, Zencore is a Google Cloud Premier Partner.

Our team has extensive experience with some of Google’s largest and most complex customer engagements. That experience and focus on creating deep engineer to engineer relationships is why we are the best choice for managed solutions and migration services.

Similar Jobs

Arcadia Logo Arcadia

Data Engineer

Big Data • Healthtech • Software • Analytics
Remote
USA
370 Employees

Place Exchange Logo Place Exchange

Senior Data Engineer

AdTech • Digital Media • Marketing Tech • Other • Analytics
Remote
USA
60 Employees
150K-165K Annually

Multi Media, LLC Logo Multi Media, LLC

Lead Data Platform Engineer

Consumer Web • Digital Media • Information Technology • News + Entertainment • Social Media
Remote
United States
270 Employees
180K-215K Annually

CapTech Logo CapTech

Lead Data Engineer (AWS, Azure, GCP)

Information Technology • Consulting
Remote
Charlotte, NC, USA
1100 Employees

Similar Companies Hiring

Fulcrum GT Thumbnail
Software • Legal Tech • Cloud
Hoffman Estates, Illinois
501 Employees
Eastwall Thumbnail
Software • Information Technology • Consulting • Cloud • Big Data Analytics • Artificial Intelligence • App development
Denver, CO
20 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account