Data Architect (Azure and Databricks)

Posted 15 Days Ago
Be an Early Applicant
Hiring Remotely in Gurgaon, Gurugram, Haryana
Remote
Senior level
Cloud • Information Technology • Software
The Role
As a Data Architect, you will design modern data architectures on the Databricks platform, oversee data migration initiatives, implement CI/CD practices, and ensure compliance with industry standards.
Summary Generated by Built In

Overview 

We are seeking an experienced Data Architect with extensive expertise in designing and implementing modern data architectures. This role requires strong software engineering principles, hands-on coding abilities, and experience building data engineering frameworks. The ideal candidate will have a proven track record of implementing Databricks-based solutions in the healthcare industry, with expertise in data catalog implementation and governance frameworks. 

 

About the Role 

As a Data Architect, you will be responsible for designing and implementing scalable, secure, and efficient data architectures on the Databricks platform. You will lead the technical design of data migration initiatives from legacy systems to modern Lakehouse architecture, ensuring alignment with business requirements, industry best practices, and regulatory compliance. 

 

Key Responsibilities 


Design and implement modern data architectures using Databricks Lakehouse platform 

Lead the technical design of Data Warehouse/Data Lake migration initiatives from legacy systems 

Develop data engineering frameworks and reusable components to accelerate delivery 

Establish CI/CD pipelines and infrastructure-as-code practices for data solutions 

Implement data catalog solutions and governance frameworks 

Create technical specifications and architecture documentation 

Provide technical leadership to data engineering teams 

Collaborate with cross-functional teams to ensure alignment of data solutions 

Evaluate and recommend technologies, tools, and approaches for data initiatives 

Ensure data architectures meet security, compliance, and performance requirements 

Mentor junior team members on data architecture best practices 

Stay current with emerging technologies and industry trends 


Qualifications 

Extensive experience in data architecture design and implementation 

Strong software engineering background with expertise in Python or Scala 

Proven experience building data engineering frameworks and reusable components 

Experience implementing CI/CD pipelines for data solutions 

Expertise in infrastructure-as-code and automation 

Experience implementing data catalog solutions and governance frameworks 

Deep understanding of Databricks platform and Lakehouse architecture 

Experience migrating workloads from legacy systems to modern data platforms 

Strong knowledge of healthcare data requirements and regulations 

Experience with cloud platforms (AWS, Azure, GCP) and their data services 

Bachelor's degree in Computer Science, Information Systems, or related field; advanced degree preferred 


Technical Skills 

Programming languages: Python and/or Scala (required) 

Data processing frameworks: Apache Spark, Delta Lake 

CI/CD tools: Jenkins, GitHub Actions, Azure DevOps 

Infrastructure-as-code (optional): Terraform, CloudFormation, Pulumi 

Data catalog tools: Databricks Unity Catalog, Collibra, Alation 

Data governance frameworks and methodologies 

Data modeling and design patterns 

API design and development 

Cloud platforms: AWS, Azure, GCP 

Container technologies: Docker, Kubernetes 

Version control systems: Git 

SQL and NoSQL databases 

Data quality and testing frameworks 


Optional - Healthcare Industry Knowledge 

Healthcare data standards (HL7, FHIR, etc.) 

Clinical and operational data models 

Healthcare interoperability requirements 

Healthcare analytics use cases 

Top Skills

Alation
Spark
AWS
Azure
Azure Devops
CloudFormation
Collibra
Databricks Unity Catalog
Delta Lake
Docker
GCP
Github Actions
Jenkins
Kubernetes
NoSQL
Pulumi
Python
Scala
SQL
Terraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Antonio, TX
7,509 Employees
On-site Workplace
Year Founded: 1998

What We Do

At Rackspace Technology, we accelerate the value of the cloud during every phase of digital transformation. By managing apps, data, security and multiple clouds, we are the best choice to help customers get to the cloud, innovate with new technologies and maximize their IT investments. As a recognized Gartner Magic Quadrant leader, we are uniquely positioned to close the gap between the complex reality of today and the promise of tomorrow. Passionate about customer success, we provide unbiased expertise, based on proven results, across all the leading technologies. And across every interaction worldwide, we deliver Fanatical Experience TM — the best customer service experience in the industry. Rackspace has been honored by Fortune, Forbes, Glassdoor and others as one of the best places to work.

Similar Jobs

CrowdStrike Logo CrowdStrike

Engineer III - Reliability (7AM - 4PM IST) (Remote, IND)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote
16 Locations
10000 Employees

GitLab Logo GitLab

Zuora IT Enterprise Applications Engineer

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
5 Locations
2350 Employees

Atlassian Logo Atlassian

Principal Software Engineer, JSM

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
India
11000 Employees

Capco Logo Capco

QA - ESG - Finreq

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote
Hybrid
India
6000 Employees

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account