Senior Data Infrastructure Engineer

Posted 6 Days Ago
Be an Early Applicant
Tel Aviv
3-5 Years Experience
Artificial Intelligence • Gaming • Machine Learning • Software • Virtual Reality • Design • Metaverse
Unity is the world’s leading platform for creating and operating real-time 3D (RT3D) content.
The Role
The Senior Data Infrastructure Engineer will manage SuperSonic's data-lake and tools, ensuring operational stability and performance. Responsibilities include creating ETL tools, developing infrastructure with AWS, and managing big data databases. The role emphasizes real-time and batch data processing and requires proficiency in multiple programming languages and cloud technologies.
Summary Generated by Built In

The opportunity

Our Data Infrastructure Engineers team is in charge of all the SuperSonic data-lake and data tools. Working across all SuperSonic R&D Teams: R&D, BI, BA & Data science Our focus is on ensuring the operational stability, performance, and cost-efficiency of our cloud-hosted data infrastructures, serving both internal and external users. 

We’re working on a large scale of Data (PetaByte +) , Creating and maintaining Data-Lake infrastructure:

  • Based on AWS services.
  • Orchestrating with Airflow
  • Developing automatic ETL tools.
  • Processing Presto/Trino over EMR. 

Incharge of real-time log server events with ~1.5B per day, including log-servers written in Go-lang and Kinesis Streaming

Working with realtime and batch data.

Using Terraform/Docker as an infrastructure

Maintaining BigData databases like druid, Singlestore and others.

Designing and implementing API on top of our data using GraphQL, written in Go-lang.

What you'll be doing

  • Write Airflow Dags using Python to pull data from different API's (Facebook, google, tiktok etc..) and develop our automatic ETL tools
  • Improve stability of Druid, Streaming, Parquet, Trino, Data infrastructures
  • Focus on monitoring, cost reduction and performance improvements
  • Implementing API on top of the data using GraphQL, written in Go.
  • Develop Terraform & AWS infrastructure

What we're looking for

  • Proficient in programming languages such as Python, Go & SQL. Experience with AWS
  • Hive, Presto/Spark/Trino/Druid skills are highly important.
  • Good knowledge of Unix/Linux environment & Docker / Terraform
  • B.A/B.Sc degree in Computer Science /industrial engineering /military service in a relevant technological unit

You might also have

  • Experience with API GraphQL
  • Knowledge with Snowflake
  • Working with Real-Time Data streaming

Additional information

  • Relocation support is not available for this position.
  • International relocation support is not available for this position.
  • Work visa/immigration sponsorship is not available for this position.

Life at Unity

Unity [NYSE: U] is the world's leading platform of tools for creators to build and grow real-time games, apps, and experiences across multiple platforms. Creators, ranging from game developers to artists, architects, automotive designers, infrastructure experts, filmmakers, and more, use Unity to bring their imaginations to life across multiple platforms, from mobile, PC, and console, to spatial computing.

As of the fourth quarter of 2023, more than 69% of the top 1,000 mobile games are made with Unity as derived from a blended number of the top 1,000 games in the Google Play Store and iOS App Store. In 2023, Made with Unity applications had an average of 3.7 billion downloads per month. For more information, please visit www.unity.com.

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know.

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English. Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.

Your privacy is important to us. Please take a moment to review our Prospect and Applicant Privacy Policies. Should you have any concerns about your privacy, please contact us at [email protected].

#LI-AG1 #SEN

Top Skills

Go
Python
SQL
The Company
HQ: San Fransisco, CA
5,500 Employees
Hybrid Workplace
Year Founded: 2004

What We Do

Unity is the world’s leading platform for creating and operating real-time 3D (RT3D) content. Creators, ranging from game developers to artists, architects, automotive designers, filmmakers, and others, use Unity to make their imaginations come to life.

Why Work With Us

We believe the world is a better place with more creators in it. We're powering the real-time revolution, expanding beyond games and breaking into other industries including film, architecture, engineering and more. Apps developed by Unity creators were downloaded more than three billion times per month in 2019 more than two billion unique devices

Gallery

Gallery

Jobs at Similar Companies

bet365 Logo bet365

Junior Sports Analyst

Digital Media • Gaming • Software • eSports • Automation
Denver, CO, USA
6100 Employees
55K-80K Annually

Jobba Trade Technologies, Inc. Logo Jobba Trade Technologies, Inc.

Customer Success Specialist

Cloud • Information Technology • Productivity • Professional Services • Software
Hybrid
Chicago, IL, USA
45 Employees

Similar Companies Hiring

TrainingPeaks (A Peaksware Company) Thumbnail
Software • Fitness
Louisville, CO
69 Employees
bet365 Thumbnail
Software • Gaming • eSports • Digital Media • Automation
Denver, Colorado
6100 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account