Rust Systems Engineer - Inference

Posted 4 Days Ago
Be an Early Applicant
San Francisco, CA
160K-240K
Mid level
Artificial Intelligence • Information Technology
The Role
As a Rust Systems Engineer, you'll optimize AI inference systems and collaborate with researchers to enhance performance and resource efficiency.
Summary Generated by Built In

About the Role

Together AI is seeking a Rust Systems Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems.  If you are passionate about developing high-performance systems, we want to hear from you. This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solutions. Join us in shaping the future at Together AI!

Required Qualifications

  • Demonstrated proficiency in Rust programming language and ecosystem
  • Strong experience with Rust frameworks namely axum, tokio, jemalloc, serde, rayon, and/or crossbeam
  • Deep understanding of concurrent programming and multiprocessing patterns
  • Experience developing and optimizing orchestration and scheduling algorithms
  • Knowledge of distributed systems principles and design
  • Experience interfacing Rust services with RPC components
  • Ability to optimize systems for performance, reliability, and resource efficiency
  • Solid understanding of memory management and performance profiling.

Preferred Qualifications

  • Experience with one or more ML inference frameworks (HuggingFace TGI, NVIDIA Dynamo, Candle, Pixi, uv, llguidance)
  • Background in designing and implementing high-throughput, low-latency systems
  • Knowledge of disaggregated serving architectures and continuous batching algorithms for ML workloads
  • Familiarity with ML/AI inference systems and performance optimization techniques
  • Experience with system benchmarking and performance analysis

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society. Together, we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI. Our team has been behind technological advancements such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey to build the next-generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other competitive benefits. The US base salary range for this full-time position is $160,000 - $240,000 + equity + benefits. Our salary ranges are determined by location, level, and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunities to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy  

Top Skills

Axum
Candle
Crossbeam
Huggingface Tgi
Jemalloc
Llguidance
Ml Inference Frameworks
Nvidia Dynamo
Pixi
Rayon
Rust
Serde
Tokio
Uv
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
San Francisco, California
84 Employees
On-site Workplace
Year Founded: 2022

What We Do

Together AI is a research-driven artificial intelligence company. We contribute leading open-source research, models, and datasets to advance the frontier of AI. Our decentralized cloud services empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models. We believe open and transparent AI systems will drive innovation and create the best outcomes for society

Similar Jobs

Crusoe Energy Systems Logo Crusoe Energy Systems

Senior+ Software Engineer, Storage

Cloud • Greentech • Other • Energy
Hybrid
San Francisco, CA, USA
667 Employees
155K-250K

PwC Logo PwC

AI Solutions Engineering Delivery Lead

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Remote
Hybrid
67 Locations
370000 Employees
167K-410K Annually

Relativity Space Logo Relativity Space

Propulsion Integration & Test Engineer II

3D Printing • Aerospace • Hardware • Robotics • Software • Manufacturing
Easy Apply
Hybrid
Long Beach, CA, USA
1300 Employees
112K-143K Annually
Hybrid
San Francisco, CA, USA
667 Employees
215K-250K Annually

Similar Companies Hiring

Stepful Thumbnail
Software • Healthtech • Edtech • Artificial Intelligence
New York, New York
60 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account