Data Engineer (AWS Glue and PySpark)

Job Summary

Synechron is seeking a skilled Data Engineer with expertise in AWS Glue and PySpark to join our dynamic data team. As a Data Engineer, you will be instrumental in designing, developing, and managing data pipelines that ensure data accessibility, reliability, and timeliness for our analytics and business intelligence needs. Your contributions will directly support Synechron's commitment to leveraging data for strategic decision-making and operational efficiency.

Software Requirements

• Required:

  • Proficiency in AWS Glue and PySpark
  • Experience with ETL processes and tools
  • Knowledge of data ingestion strategies and data quality assurance

• Preferred:

  • Familiarity with additional AWS services
  • Experience with other data processing frameworks

Overall Responsibilities

• Design, develop, and maintain scalable ETL processes using AWS Glue and PySpark
• Collaborate with data architects and data scientists to understand data requirements and deliver solutions that meet business needs
• Implement data ingestion strategies for various data sources, ensuring data quality and integrity
• Optimize and monitor data pipelines for performance, scalability, and cost efficiency
• Troubleshoot and resolve data issues, ensuring data accuracy and timeliness
• Document data pipelines, processes, and architecture to enable knowledge sharing within the team
• Stay updated with industry trends and best practices in data engineering and cloud technologies

Technical Skills (By Category)

• Programming Languages:

  • Essential: Proficiency in PySpark
  • Preferred: Knowledge of Python

• Databases/Data Management:

  • Essential: Experience with ETL processes and data quality management

• Cloud Technologies:

  • Essential: AWS Glue
  • Preferred: Familiarity with other AWS services

• Frameworks and Libraries:

  • Essential: PySpark

• Development Tools and Methodologies:

  • Essential: Experience with data pipeline optimization and monitoring

Experience Requirements

• Minimum of [X] years of experience in data engineering or a related role
• Proven experience with AWS Glue, PySpark, and ETL processes
• Experience in designing and managing data pipelines for analytics and business intelligence

Day-to-Day Activities

• Develop and manage scalable data pipelines using AWS Glue and PySpark
• Collaborate with data architects and scientists to deliver data solutions
• Implement and optimize data ingestion strategies for performance and cost efficiency
• Troubleshoot data issues and ensure data integrity
• Document data processes and architecture for team knowledge sharing
• Engage in regular meetings to align on project objectives and progress

Qualifications

• Educational Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or a related field
  • Equivalent experience may be considered

• Certifications:

  • Relevant certifications in AWS or data engineering are a plus

Professional Competencies

• Strong critical thinking and problem-solving capabilities
• Excellent communication and stakeholder management skills
• Ability to work effectively in a team environment
• Adaptability and proactive learning orientation
• Innovation mindset with attention to detail
• Strong time and priority management skills

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice