Senior Data Engineer

Posted Yesterday
Be an Early Applicant
2 Locations
Senior level
Insurance • Financial Services
The Role
The Senior Data Engineer will develop and maintain APIs using Python and frameworks like Flask and FastAPI. They will work on data pipelines, cloud data warehousing, and collaborate with Data Science teams. Key responsibilities include ensuring best software engineering practices, utilizing CI/CD tools, and familiarity with machine learning processes.
Summary Generated by Built In

Job Description:4+ years of relevant experience in API development in Python. Good experience and Proficient in software development lifecycle and software engineering practices.
Rich working experience in Pythonic API development frameworks like Flask / FastAPI. Experience in using containerization frameworks like Docker / Kubernetes.
Proficiency in understanding of REST APIs, experience in using different types of APIs to either extract data or perform a functionality exposed by APIs.
One working in close collaboration with Data Science team is preferred.Qualifications:

You Have

Bachelor’s or master’s degree with 8+ years of experience in Computer Science, Data Science, Engineering, or a related field.
5+ years of experience in API development in Python. Good experience and Proficient in software development lifecycle and software engineering practices.
Rich working experience in Pythonic API development frameworks like Flask / FastAPI. Experience in using containerization frameworks like Docker / Kubernetes.
Proficiency in understanding of REST APIs, experience in using different types of APIs to either extract data or perform a functionality exposed by APIs. 
One working in close collaboration with Data Science team is preferred.
3+ years of experience in developing and maintaining robust data pipelines for both structured and unstructured data to be used by Data Scientists to build ML Models.
3+ years of experience working with Cloud Data Warehousing (Redshift, Snowflake, Databricks SQL or equivalent) platforms and experience in working with distributed frameworks like Spark.
2+ years of hands-on experience in using Databricks platform for data engineering. Detailed knowledge of Delta Lake, Databricks Workflow, Job Clusters, Databricks CLI, Databricks Workspace etc.
Hands-on experience in building and maintaining tools and libraries which have been used by multiple teams across organization. e.g. Creating Data Engineering common utility libraries, DQ Libraries etc.
Proficient in understanding and incorporating software engineering principles in design & development process.
Hands on experience with using CI/CD tools (e.g., Jenkins or equivalent), version control (Github, Bitbucket), Orchestration (Airflow, Prefect or equivalent)
Solid understanding of machine learning life cycle, data mining, and ETL techniques.
Familiarity with commonly used machine learning libraries (like scikit-learn, xgboost) in terms of exposure and handling of code base which makes use of these libraries for model training & scoring.
Excellent communication skills and ability to work and collaborate with cross functional teams across technology and business.

Location:

This position can be based in any of the following locations:

Chennai, Gurgaon

Current Guardian Colleagues: Please apply through the internal Jobs Hub in Workday

Top Skills

Python
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
8,709 Employees
On-site Workplace
Year Founded: 1860

What We Do

Who we are

Guardian makes a difference in the lives of people when they need us most. With over 160 years of stability and fiscal integrity, we are a trusted resource to generations of families and business owners, inspiring well-being and helping build financial confidence.

Today, we stand behind 29 million consumers, helping them prepare and plan for a bright future for themselves and their families. We help business owners care for their employees. And we help people recover and thrive in times of unexpected loss.

As a modern mutual insurance company, we believe in driving value beyond dividends. We invest in our colleagues and are building a progressive, innovative and inclusive culture. We uplift individuals and communities through thoughtful social and environmental programs.

What we stand for

In 1860, a community of immigrants joined together to insure and protect their businesses and families. They were guided by powerful ideals that we’ve continued to stand behind and evolved throughout the years: we do the right thing, we believe people count, we courageously shape the future together, and we go above and beyond for the people we serve.

Guardian employees embrace and live by these values every day. They remind us to put people at the heart of all we do so that we can help protect what matters most to you. Want to help bring these values to life? Join us for a rewarding career and the opportunity to shape the future.

Disclosures:
Financial information concerning Guardian as of December 31, 2022, on a statutory basis: Admitted assets = $76.0 billion; liabilities = $67.2 billion (including $55.0 billion of reserves); and surplus = $8.8 billion. Dividends are not guaranteed. They are declared annually by Guardian’s Board of Directors.
Guardian® is a registered trademark of The Guardian Life Insurance Company of America. © Copyright 2023 The Guardian Life Insurance Company of America 2023-156184 Exp. 5/25

Similar Jobs

Barclays Logo Barclays

Abinitio/Pyspark Sr Data Engineer

Fintech • Financial Services
Chennai, Tamil Nadu, IND
83500 Employees
Chennai, Tamil Nadu, IND
10001 Employees

Citi Logo Citi

Senior Big Data Developer

Fintech • Financial Services
2 Locations
223850 Employees

Similar Companies Hiring

EDGE Thumbnail
Software • Fintech • Financial Services • Analytics
Chicago, IL
20 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
MassMutual India Thumbnail
Insurance • Information Technology • Fintech • Financial Services • Big Data
Hyderabad, Telangana

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account