Senior Data Engineer - Azure Databricks

Posted 2 Days Ago
Be an Early Applicant
Hyderabad, Telangana
Senior level
Database • Analytics
The Role
The Senior Data Engineer will lead technical teams to deliver data-driven applications using microservices architecture, with a focus on Python and FastAPI. Responsibilities include managing client relationships, developing CI/CD pipelines, API design, and ensuring system reliability through monitoring solutions.
Summary Generated by Built In

Company Description

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients

Job Description

• Extensive experience in guiding technical teams and delivering data-driven applications using microservice architecture.

• Strong background in Python and FastAPI, with demonstrated expertise in microservices principles, including scalability, resilience, service discovery, API gateways, and robust error handling..

• Proficient in containerization technologies (Docker, Kubernetes) and experienced in orchestrating large-scale deployments.

• Extensive experience engaging with and managing relationships with senior client stakeholders, ensuring alignment with business goals and fostering collaborative partnerships to drive project success

Qualifications

  • Deep understanding of Pydantic and advanced data validation techniques within FastAPI and Azure, Databricks with Spark.
  • Solid experience in setting up and maintaining CI/CD pipelines.
  • Expert in API design and implementation, with a focus on optimization and performance.
  • Skilled in monitoring and logging solutions (e.g., Prometheus, Grafana) to ensure system reliability and observability.
  • Well versed in security best practices in microservices architecture.
  • Advanced knowledge of version control systems (e.g., Git) and experience leading collaborative development workflows

Nice to have

  • Experience implementing Retriever models with optimal chunking strategies.
  • Knowledge of vector databases and experience with high-performance data querying for LLM models.
  • Expertise in prompt engineering techniques and strategies across diverse use cases.

Top Skills

Python
The Company
HQ: Columbia, MD
390 Employees
On-site Workplace
Year Founded: 2016

What We Do

Our Vision is to build a company of world-class people that helps our clients optimize business performance through data, technology and analytics.

Blend360 has two divisions:
Data Science Solutions: We work at the intersection of data, technology and analytics.
Talent Solutions: We live and breathe the digital and talent marketplace.

Similar Jobs

Envoy Global, Inc. Logo Envoy Global, Inc.

Senior Data Analytics Engineer

HR Tech • Legal Tech • Software
Easy Apply
Hyderabad, Telangana, IND
355 Employees

ServiceNow Logo ServiceNow

Senior Analyst - FP&A

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Hyderabad, Telangana, IND
26000 Employees

ServiceNow Logo ServiceNow

ITAM Content Analyst

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Hyderabad, Telangana, IND
26000 Employees

ServiceNow Logo ServiceNow

Manager - Data and Analytics Support

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Hyderabad, Telangana, IND
26000 Employees

Similar Companies Hiring

SAG LLC Thumbnail
Virtual Reality • Generative AI • Business Intelligence • Big Data Analytics • App development • Analytics • Agriculture
Minot, ND
4 Employees
JuiceMedia.AI Thumbnail
Marketing Tech • Machine Learning • Digital Media • Big Data Analytics • Analytics • Agency • AdTech
Marina Del Rey, CA
68 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account