The Role
The Senior Software Engineer will design and implement scalable data solutions utilizing AWS services, develop data pipelines with Databricks and Snowflake, and manage ETL/ELT processes. Responsibilities include optimizing queries, ensuring data quality, and using CI/CD tools for deployment automation.
Summary Generated by Built In
Position : Sr Data Engineer.
Location : Bangalore/Hyderabad/Noida.
Immediate joiners preferred.
Required:
- Extensive experience in data engineering with a strong focus on designing and implementing complex and scalable data solutions using AWS services like MWAA and Lambda, RDS (7+ years).
- Proficient in Databricks (5+ years) using pyspark, Delta tables, Unity catalog, SQL Warehouse for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
- Proficient in Snowflake (4+ years) and Snowpark for optimizing queries, schemas, and implementing security layers.
- Strong architectural knowledge coupled with RBAC concepts
- Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries.
- Demonstrated problem-solving skills with the ability to analyze, diagnose, and resolve technical issues efficiently.
- Experience in developing and maintaining ETL/ELT processes to ensure data is accurately and efficiently loaded into data warehouses and data lakes.
- Knowledge of data quality frameworks, exception handling and adherence to common standards and compliance.
- Experience using CI/CD tools such as CDK, CloudFormation, and Terraform to automate deployments both IaaC and DAGs across environments.
Top Skills
AWS
Pyspark
Snowflake
SQL
The Company
What We Do
emids is healthcare's digital transformation leader, delivering business and tech solutions that help payers, providers and tech-enablers maximize technology to deliver care better.
As a global partner headquartered in Nashville, TN, emids helps bridge the critical gaps in accessible, affordable, high-quality healthcare by providing advisory consulting services, custom application development, and data solutions. Services include EHR application deployment and management, analytics, data integration and governance, software development and testing, and business intelligence.
