Senior Data Engineer (Cloud/EDA/Kafka)

Posted 10 Days Ago
Be an Early Applicant
Naperville, IL
Hybrid
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning
The Role
Join a team of data engineers at Egen, a data engineering and cloud modernization firm, to build scalable data platforms and fault-tolerant pipelines using Python, SQL, Linux, Bash, and cloud services. Responsibilities include leading data engineering teams, designing data pipelines, consulting with teams, preparing documentation, and facilitating data migrations. Requires a Bachelor's degree in a related field, experience with EDA leveraging Kafka, data warehousing knowledge, and strong programming skills in SQL, Python, and Bash.
Summary Generated by Built In

About Egen: 


Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.


Want to learn more about life at Egen? Check out these resources in addition to the job description.


-> Meet Egen 

-> Life at Egen

-> Culture and Values at Egen

-> Career Development at Egen

About the job:

  • Lead and develop passionate data engineering teams to design and develop distributed and event-driven data pipelines with cloud-native data stores such as Snowflake, Redshift, Big Query, or ADW.
  • Design, document, and lead development of end-to-end data product pipelines
  • Consult business, product, and data science teams to understand end-user requirements or analytics needs to implement the most appropriate data platform technology and scalable data engineering practices.
  • Prepare data mapping, data flow, production support, and pipeline documentation for all projects.
  • Lead data engineering and/or operations teams in delivering completeness of source system data by performing a profiling analysis and triaging issues reported in production systems. 
  • Facilitate fast and efficient data migrations through a deep understanding of design, mapping, implementation, management, and support of distributed data pipelines.

About you:

  • Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
  • You have productionized real-time data pipelines through EDA leveraging Kafka or a similar service.
  • You know what it takes to build and run resilient data pipelines in production and have experience implementing ETL/ELT to load a multi-terabyte enterprise data warehouse.
  • You have a strong understanding and exposure to data mesh principles in building modern data-driven products and platforms
  • You have a strong background in distributed data warehousing with Snowflake, Redshift, Big Query, and/or Azure Data Warehouse.
  • You have expert programming/scripting knowledge in building and managing ETL pipelines using SQL, Python, and Bash.
  • You have implemented analytics applications using multiple database technologies, such as relational, multidimensional (OLAP), key-value, document, or graph.

EEO and Accommodations:


Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.

Top Skills

Python
SQL
The Company
HQ: Naperville, IL
240 Employees
Hybrid Workplace
Year Founded: 2000

What We Do

Egen is a data engineering and cloud modernization firm partnering with leading Chicagoland companies to launch, scale, and modernize industry-changing technologies. We are catalysts for change who create digital breakthroughs at warp speed. Our team of cloud and data engineering experts are trusted by top clients in pursuit of the extraordinary.

Our mission is to be an enabler of amazing possibilities for companies looking to use the power of cloud and data. We want to stand shoulder to shoulder with clients, as true technology partners, and make sure they succeed at what they have set out to do. We want to be disruptors, game-changers, and innovators who have played an important part in moving the world forward.

Jobs at Similar Companies

Silverfort Logo Silverfort

Commercial Sales Manager- East

Information Technology • Sales • Security • Cybersecurity • Automation
Remote
8 Locations
357 Employees

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Senior Back End Developer

Cloud • Information Technology • Productivity • Professional Services • Software
Remote
Hybrid
Chicago, IL, USA
45 Employees

Similar Companies Hiring

Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
GB
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account