Senior Performance Engineer - Deep Learning

Posted 3 Days Ago
Be an Early Applicant
2 Locations
Remote
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
The Senior Performance Engineer at NVIDIA will develop and optimize open-source libraries for Deep Learning, enhance training workloads on large scales, support community benchmarks, and improve performance for Deep Learning models using NVIDIA GPUs. The role involves collaboration with multiple teams and evolving new hardware and software designs.
Summary Generated by Built In

NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and TensorFlow. We work with multiple teams both inside and outside of NVIDIA across fields, as well as collaborate with the open-source community to optimize the best AI platform in the world!

What you will be doing:

  • Develop and optimize open-source libraries, like Transformer Engine, which enables the fastest training of Large Language Models using low precision data formats, and TensorFlow Distributed Embeddings, providing ability to easily scale training of huge recommender systems on multiple GPUs.

  • Study and tune Deep Learning training workloads at large scale, including important enterprise models.

  • Build and support NVIDIA submissions to community benchmarks like MLPerf.

  • Optimize the performance of influential, modern Deep Learning models coming out of academic and industry research, for NVIDIA GPUs and systems.

  • Explore new technologies and advise design of new hardware generations and core platform software components.

What we need to see:

  • BS in Computer Science, Electrical Engineering or a related field (or equivalent experience).

  • Demonstrated ability with 6+ years of C++ and Python programming.

  • Strong background with parallel programming, preferably on GPUs.

  • Knowledge of Computer Architecture and/or Operating Systems.

  • Proven experience developing large software projects.

  • Excellent verbal and written communication skills.

Ways to stand out from the crowd:

  • Experience with Deep Learning Frameworks, like PyTorch, JAX, Tensorflow or MXNet.

  • Experience training language models.

  • Background with performance analysis and profiling of workloads.

  • Participation in the open-source community.

  • Proven experience working with multidisciplinary teams.

The base salary range is 184,000 USD - 425,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning

Top Skills

C++
Python
The Company
HQ: Santa Clara, CA
21,960 Employees
On-site Workplace
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Wasabi Technologies Logo Wasabi Technologies

Senior Salesforce Developer

Cloud • Information Technology
Remote
United States
400 Employees
Easy Apply
Remote
United States
850 Employees
127K-219K Annually

Atlassian Logo Atlassian

Principal Software Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Remote
San Francisco, CA, USA
11000 Employees
171K-274K Annually

Block Logo Block

Senior Systems Engineer, Oracle Supply Chain Planning & Manufacturing

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Remote
Hybrid
7 Locations
12000 Employees
139K-245K Annually

Similar Companies Hiring

Stepful Thumbnail
Software • Healthtech • Edtech • Artificial Intelligence
New York, New York
60 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account