Engineering Manager - Query Engine

Posted 10 Days Ago
Be an Early Applicant
Lisbon
Senior level
Big Data • Software
The Role
Dremio is looking for an Engineering Manager for their Query Engine team to enhance their query engine focusing on Iceberg table format and file scans. Responsibilities include team growth, mentorship, ensuring scalability and performance in a distributed environment, overseeing file scan optimizations, and providing strategic direction on database systems.
Summary Generated by Built In
Be Part of Building the Future

Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost.  Learn more at www.dremio.com.

About the role

We are seeking a talented and motivated Engineering Manager to join our Datalake team within the Query Engine organization. In this role, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format, efficient scans of various file formats, as well as various complementary features to move data in and out of Dremio. This is an exciting opportunity to contribute to cutting-edge technology in the big data ecosystem.

What you’ll be doing

  • Growing the team by recruiting, interviewing, and hiring new team members
  • Developing the future leaders of Dremio by providing continuous mentorship, coaching, and growth opportunities
  • Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment
  • Working with and contributing to open-source projects like Apache Iceberg, Parquet and Arrow
  • Overseeing the optimization of file scan operations for various file formats, including Parquet, Avro, and others
  • Designing and delivering architectures that run optimally on public clouds like Azure, AWS, and GCP
  • Maintaining and enhancing compliance with the Iceberg table format specification
  • Providing strategic direction on concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment
  • Conducting and overseeing code reviews, providing constructive feedback to team members

What we’re looking for

  • B.S. or M.S. in Computer Science or in a related technical field
  • 5+ years of software engineering experience, with a focus on database systems, query execution or related fields
  • 3+ years of engineering management experience
  • Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems
  • Familiarity with cloud object stores, such as AWS S3, ADLS or GCS.
  • Familiarity with Apache Iceberg, Parquet, AVRO and/or Delta
  • Demonstrated ability to lead and motivate a fast-moving team in a startup environment
  • Strong desire to learn and grow, both individually and as a team leader

Bonus points if you have

  • Experience working with and contributing to open source projects

#LI-JF1 #LI-Remote 

What we value 

At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.

Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.

Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice. 

Important Security Notice for Candidates

At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.

Top Skills

Apache Arrow
Apache Iceberg
Avro
Parquet
The Company
Santa Clara, CA
258 Employees
On-site Workplace
Year Founded: 2015

What We Do

Dremio is the Data Lake Engine. Created by veterans of open source and big data technologies, and the creators of Apache Arrow, Dremio is a fundamentally new approach to data analytics that helps companies get more value from their data, faster. Dremio makes data engineering teams more productive, and data consumers more self-sufficient. For more information, visit www.dremio.com.
Founded in 2015, Dremio is headquartered in Mountain View, CA. Investors include Lightspeed Venture Partners, Redpoint, and Norwest Venture Partners. Connect with Dremio on GitHub, LinkedIn, Twitter, and Facebook.

Similar Jobs

Easy Apply
2 Locations
1100 Employees
Easy Apply
3 Locations
1100 Employees

Cloudflare Logo Cloudflare

Threat Advisory Solutions Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
Lisbon, PRT
3900 Employees

Riskified Logo Riskified

Fullstack Developer

Big Data • eCommerce • Fintech • Machine Learning • Payments • Software
Lisbon, PRT
700 Employees

Similar Companies Hiring

Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
Charlotte, North Carolina
53 Employees
Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account