Senior Software Engineer, Data Ingestion

Astronomer designed Astro, an industry-leading, orchestration-first DataOps platform for data teams. Powered by Airflow, Astro accelerates building reliable data products that unlock insights, unleash AI value, and drive data-driven applications.

We’re a globally-distributed and rapidly growing venture-backed team of learners, innovators and collaborators. Our mission is to empower data teams to bring mission-critical analytics, AI, and software to life.  As a member of our team, you will be at the forefront of the industry as we strive to deliver the world's data. 

Your background may be unconventional; as long as you have the essential qualifications, we encourage you to apply. While having "bonus" qualifications makes for a strong candidate, Astronomer values diverse experiences. Many of us at Astronomer haven't followed traditional career paths, and we welcome it if yours hasn't either.

About this role

At Astronomer, our R&D team is dedicated to providing an exceptional experience in managing Apache Airflow at scale. As a leading player in the industry, we are seeking an experienced Software Engineer to work on our data observability product - Astro Observe. Astro Observe is a critical component of our expansion strategy built on top of OpenLineage events. You will play a pivotal role in driving the success of Astro Observe by leading the design and implementation of our OpenLineage data collection and ingestion efforts. Your contributions will directly impact our ability to scale and deliver exceptional value to our customers.

What you get to do:

• Contribute to the OpenLineage and Airflow Open Source community to enhance the data collection and extraction of OpenLineage events from Airflow.

• Contribute to the design, development and vision of Astro Observe’s ingestion pipelines.

• Collaborate with cross-functional teams to understand user requirements, implement and iterate on the observability and governance features to help our customers gain visibility into their data pipelines and data products.

• Contribute to the overall platform usability, reliability, and scalability.

What you bring to the role:

• A strong focus on helping customers gain more visibility and actionable insights through our observability offerings.

• Proven experience with Python.

• Strong written and verbal communication skills, with the ability to find middle ground.

• 5+ years of engineering experience.

• Experience with fast-paced startup environments.

• Experience with software development best practices, such as code reviews, testing, CI/CD, version control, automation and debugging.

Bonus points if you have:

• Experience with OpenLineage.

• Experience with Apache Airflow.

• Experience with data observability products.

• Experience with Golang.

• Experience with SQL and OLAP databases.

• Experience with distributed systems and stream processing.

The estimated salary for this role ranges from $180,000 - $210,000 based on leveling and geography, along with an equity component and a comprehensive benefits package. This range is merely an estimate; actual compensation may deviate from this range based on skills, experience, and qualifications.

#LI-Remote

At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.  Astronomer is a remote-first company.