Senior Data Engineer - Databricks

Posted Yesterday
Be an Early Applicant
Mumbai, Maharashtra
Senior level
Artificial Intelligence • Big Data • Machine Learning
The Role
In this role, you will deliver data solutions, implement Databricks for data pipelines using PySpark, and perform data integration projects. You'll utilize advanced SQL for query optimization and build cloud-based solutions leveraging various data sources while adhering to best practices.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Must have skills:

  • 3+ years’ of hands-on experience in delivering data solutions

  • Experience with Databricks implementations - developing data pipelines using PySpark

  • Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs

  • Experience in Python, Scala

  • Experience in advanced SQL and Query optimization 

  • Experience in implementing data integration projects using ETL 

  • Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2 

Good to have skills : 

  • Experience with AWS services - S3,Redshift,Secrets Manager

  • Experience in implementing data integration projects using ETL (preferably Qlik Replicate & QlikCompose)

  • Experience in using Airflow or Step Functions for orchestration

  • Exposure to IaC tools like Terraform and to CI/CD tools

  • Prior experience in migrating (on-prem to cloud)  and processing large amounts of data

  • Experience in implementing data lake and data warehouse on cloud

  • Experience in implementing the industry's best practices

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

Python
Scala
SQL
The Company
HQ: Marlborough, MA
3,494 Employees
On-site Workplace
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business.
Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Similar Jobs

Cencora Logo Cencora

Data Engineer II - Data Engineering

Healthtech • Logistics • Pharmaceutical
Pune, Maharashtra, IND
46000 Employees

LogicMonitor Logo LogicMonitor

Senior Data Engineer

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
Easy Apply
Pune, Maharashtra, IND
1100 Employees

Capco Logo Capco

Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote
Pune, Maharashtra, IND
6000 Employees
Pune, Maharashtra, IND
428 Employees

Similar Companies Hiring

RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
HERE Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account