Lead Azure Data Engineer (Databricks) || 8+yrs || RR/1303/2024

Posted 15 Days Ago
Be an Early Applicant
Bangalore, Bengaluru, Karnataka
Senior level
Healthtech • Information Technology • Other • Software • Analytics
The Role
The Lead Azure Data Engineer will design and optimize data pipelines in Databricks, develop ETL workflows, implement Delta Lake, and collaborate with architects for scalable data solutions. Key responsibilities include managing data quality and leveraging machine learning tools as needed.
Summary Generated by Built In

Role : Azure Data Engineer - Lead 

Exp: 8+ yrs

Loc: Bangalore / Noida (Hybrid)

Job Description :

  1. Data Engineering with Databricks:
  • Design, implement, and optimize data pipelines in Databricks to process large-scale structured and unstructured data.
  • Develop ETL workflows for data ingestion, transformation, and integration using Databricks and other cloud-based tools.
  • Implement Delta Lake for efficient data management and real-time data processing.
  • Collaborate with data architects and stakeholders to build scalable and reusable data solutions.
  • Leverage Databricks' MLflow for managing and deploying machine learning workflows, if required.
  • Ensure data quality, integrity, and compliance with organizational standards and governance policies.

Required Skills & Qualifications:

  • Education: Bachelor’s or master’s degree in computer science, Data Analytics, Information Technology, or a related field.
  • Technical Proficiency:
    • Hands-on experience with Databricks: Spark, Pyspark, Scala, or SQL
    • Strong understanding of database concepts and working experience with SQL/NoSQL databases.
  • Analytical Skills: Strong ability to analyse, interpret, and visualize large datasets.
  • Problem Solving: Demonstrated ability to troubleshoot complex data workflows and reporting challenges.
  • Soft Skills: Strong written and verbal communication, collaboration, and stakeholder management.



Top Skills

Pyspark
Scala
Spark
SQL
The Company
HQ: Franklin, TN
2,100 Employees
On-site Workplace
Year Founded: 1999

What We Do

emids is healthcare's digital transformation leader, delivering business and tech solutions that help payers, providers and tech-enablers maximize technology to deliver care better.

As a global partner headquartered in Nashville, TN, emids helps bridge the critical gaps in accessible, affordable, high-quality healthcare by providing advisory consulting services, custom application development, and data solutions. Services include EHR application deployment and management, analytics, data integration and governance, software development and testing, and business intelligence.

Similar Jobs

Fractal Logo Fractal

Azure Data Engineer

Artificial Intelligence • Consulting
Bengaluru, Karnataka, IND
5262 Employees

emids Logo emids

Azure Data Engineer (Databricks) || 4+ yrs || RR/1294/2024

Healthtech • Information Technology • Other • Software • Analytics
Bangalore, Bengaluru, Karnataka, IND
2100 Employees

Fractal Logo Fractal

Azure Data Engineer

Artificial Intelligence • Consulting
Bengaluru, Karnataka, IND
5262 Employees

Haleon Logo Haleon

Azure Data Engineer

AdTech • Consumer Web • eCommerce
Bengaluru, Bengaluru Urban, Karnataka, IND
14788 Employees

Similar Companies Hiring

Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees
HERE Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account