ML Compiler Software Engineering Technical Lead

Posted Yesterday
Be an Early Applicant
Santa Clara, CA
Senior level
Artificial Intelligence • Machine Learning • Software
The Role
As the MLIR Software Engineering Technical Lead, you'll design and implement a compiler framework for NLP models on multi-chiplet architectures. Responsibilities include overseeing compiler development, collaborating with multiple teams on project milestones, and ensuring efficient task scheduling and data movement.
Summary Generated by Built In

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution.  Ready to come find your playground? Together, we can help shape the endless possibilities of AI. 

Location:

Hybrid, working onsite at our Santa Clara, CA headquarters 3 days per week.

The role: MLIR Software Engineering Technical Lead / Principal

What you will do:

The Compiler Technical Lead role is driving the design and implementation of the MLIR-based compiler framework. In this role, you will be overseeing the development of the compiler that partitions and maps large-scale NLP models to our scalable, multi-chiplet, parallel processing architecture with hundreds of digital in-memory tensor processors, vector processors, data shaping processors and both on-chip and off-chip memory. The compiler will also coordinate the scheduling of parallel tasks onto the processors, data movements and inter processor synchronization. The many-pass compiler architecture requires graph optimization passes, constant folding, data reshaping, padding, tiling and various other backend-specific operations. The software will support a split offline/online mapping process with just-in-time mapping to chiplets, processors and DDR memory channels.

This role requires collaborating with the HW and SW architecture team, the Pytorch front-end pre-processing team, the data science numerics team, AI kernel team, SW test group, the benchmark group and the teams developing the various simulator and emulation platforms. It is central to the overall efficiency of the solution. As such, we are seeking an AI compiler expert with experience in the TVM, Glow or preferably, the MLIR project. Also important is familiarity with the LLVM project. Experience mapping graph operations to many-core processors (or spatial fabrics) would be desirable.

This role does NOT require hardware design or verification experience. That said, an understanding of the trade-offs made by processor architects when implementing accelerators for DNNs, DCNNs, transformer models and attention mechanisms is useful - especially when it comes to mapping very large NLP models to such architectures.

What you will bring:

Minimum:

  • BS / MS Preferred in Computer Science or equivalent with 12+ years in ML Compiler.

  • Experience establishing, growing and/or developing engineering teams (and software teams in particular).

  • Experience with leading agile development methods is preferable including coordinating scrums, managing sprints and project task tracking with Kanban boards or similar.

  • Experience running code reviews, bug tracking meetings, familiarity and experience with CI/CD flows.

  • Managing interdependencies with other teams in order to meet milestones and target levels of performance.

  • Excellent documentation and presentation skills.

This role includes technical leadership aspects: specifically the motivation, engagement, goal setting, performance tracking, objective setting and performance management.

#LI-DL1

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.

Top Skills

Llvm
Mlir
PyTorch
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
102 Employees
On-site Workplace

What We Do

d-Matrix is building a new way of doing datacenter AI inferencing using in-memory computing (IMC) techniques with chiplet level scale-out interconnects. Founded in 2019, d-Matrix has attacked the physics of memory-compute integration using innovative circuit techniques, ML tools, software and algorithms; solving the memory-compute integration problem, which is the final frontier in AI compute efficiency.

Similar Jobs

Easy Apply
Hybrid
San Francisco, CA, USA
1100 Employees

d-Matrix Logo d-Matrix

ML Compiler Software Engineering Technical Lead

Artificial Intelligence • Machine Learning • Software
Santa Clara, CA, USA
102 Employees
Mountain View, CA, USA
2359 Employees
238K-302K Annually
San Jose, CA, USA
2298 Employees
157K-243K Annually

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account