Big Data Engineer with Databricks

Reposted 21 Hours Ago
Hiring Remotely in USA
Remote
Mid level
Artificial Intelligence • Information Technology • Machine Learning • Software • Virtual Reality • Analytics
The Role
The Big Data Engineer will develop technical plans for data migration, design data pipelines, ensure data quality, provide team guidance, and stay updated on cloud computing trends. Responsibilities include data ingestion, storage, and implementing validation mechanisms.
Summary Generated by Built In

Company Description

👋🏼 We're Nagarro.

We are a digital product engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (17 500+ experts across 37 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!

By this point in your career, it is not just about the tech you know or how well you can code. It is about what more you want to do with that knowledge. Can you help your teammates proceed in the right direction? Can you tackle the challenges our clients face while always looking to take our solutions one step further to succeed at an even higher level? Yes? You may be ready to join us.

Job Description

  • Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control within Azure’s Data Factory and data lake.
  • Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
  • Develop scalable and reusable frameworks for data ingestion.
  • Ensure data quality and integrity throughout the data pipeline, implementing robust data validation and cleansing mechanisms.
  • Work with event-based and streaming technologies to ingest and process data.
  • Provide technical guidance and support to the team, resolving technical challenges or issues during the migration and post-migration phases.
  • Stay current with advancements in cloud computing, data engineering, and analytics technologies, recommending best practices and industry standards for implementing data lake solutions.

Qualifications

  • 4 to 8 years of experience in Data Engineering or similar roles. 
  • Experience working with Azure Databricks.
  • Expertise in Data Modeling and Source System Analysis.
  • Proficiency with PySpark.
  • Mastery of SQL.
  • Knowledge of Azure components: Azure Data Factory, Azure Data Lake, Azure SQL DW, and Azure SQL.
  • Experience with Python programming for data engineering purposes.
  • Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
  • Experience with data visualization and exploration tools.

Top Skills

Azure Data Factory
Azure Data Lake
Azure Databricks
Azure Sql Dw
Pyspark
Python
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
19,994 Employees
On-site Workplace
Year Founded: 1996

What We Do

Nagarro helps future-proof your business through a forward-thinking, fluidic, and CARING mindset. We excel at digital engineering and help our clients become human-centric, digital-first organizations, augmenting their ability to be responsive, efficient, intimate, creative, and sustainable. Today, we are 19,000 experts across 36 countries, forming a Nation of Nagarrians, ready to help our customers succeed.

Similar Jobs

Capital One Logo Capital One

Lead Data Engineer - Capital One Software (Remote)

Fintech • Machine Learning • Payments • Software • Financial Services
Remote
Hybrid
Richmond, VA, USA
55000 Employees
176K-201K Annually

Multi Media, LLC Logo Multi Media, LLC

Data Platform Lead

Consumer Web • Digital Media • Information Technology • News + Entertainment • Social Media
Remote
United States
270 Employees
180K-215K Annually

Adswerve, Inc. Logo Adswerve, Inc.

Data Engineer, IT

AdTech • Cloud • Digital Media • Marketing Tech • Analytics • Consulting
Easy Apply
Remote
United States
250 Employees

AVM Consulting Logo AVM Consulting

Sr. Data Engineer with AWS experience

Information Technology • Software • Consulting
Remote
Los Angeles, CA, USA
100 Employees
100K-220K Annually

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account