Senior AI Infrastructure Engineer

Posted 5 Hours Ago
Be an Early Applicant
Toronto, ON
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
The Senior AI Infrastructure Engineer will define and deploy AI/ML applications for chip design, collaborating with hardware teams to understand infrastructure needs. Responsibilities include developing tools, integrating advanced AI technologies, and resolving technical challenges.
Summary Generated by Built In

We are now looking for a Senior AI Infrastructure Engineer! NVIDIA is looking to tap onto AI to define next generation of chip design ! NVIDIA is seeking a passionate, highly motivated, and creative senior software engineer to be part of its CPU SOC Infrastructure team. We develop methodologies and craft tools to streamline the design/verification of NVIDIA's CPU, memory and SOC designs.

This position offers the opportunity to have real impact in a dynamic, technology-focused company impacting product lines ranging from consumer graphics to self-driving cars and the growing field of artificial intelligence. We are creating a team of outstanding people stretching around the globe, whose mission is to push the frontiers of what is possible today and define the platform for the future of computing. Come, join us today!

What you’ll be doing:

  • Define and deploy AI and ML applications to aid chip design, debug & testing stages.

  • Collaborate closely with our hardware chip design teams to understand their infrastructure needs and map them onto AI/LLM solutions.

  • Architect and develop novel tools, user interfaces, and creative applications.

  • Stay on top of latest advancements in AI/ML technologies and frameworks (transformers, RL, RAG, GenAI) and advocate for their integration within the company.

  • Troubleshoot and resolve critical technical or productivity obstacles that impact team’s performance.

What we need to see:

  • BS/MS in Computer Science or Computer Engineering or Electrical Engineering or equivalent experience

  • 6+ years of relevant work experience

  • Strong software architecture, development, & testing experience

  • Solid understanding of Linux and proficient in programming & scripting skills (ex. Python/Shell)

  • Prior exposure to RAGs (Retrieval-Augmented Generation) and LangGraph based workflows for AI agent integration

  • Strong problem-solving abilities and a passion for debugging

  • Excellent communication and interpersonal skills

Ways to stand out from the crowd:

  • Exposure to RTL design/verification tools (VCS or equivalent simulation tools, debug tools like Verdi) and computer architecture.

  • Experience in creating scalable AI/LLM based applications for a wide user base.

  • Experience with running workloads using PyTorch, interfacing with REST APIs or webservers.

  • A strong passion for continual learning and keeping abreast of new technologies and approaches in AI/ML infrastructure.

  • Experience administering CI systems (ex. Jenkins, k8s, LSF) and containers (Docker).

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and dedicated people in the world working for us. If you are creative, autonomous and love a challenge, we want to hear from you.

The base salary range is 127,500 CAD - 273,000 CAD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

Top Skills

Python
The Company
HQ: Santa Clara, CA
21,960 Employees
On-site Workplace
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Remote
Hybrid
10 Locations
2674 Employees

KUBRA Logo KUBRA

Android Developer - 12 month contract

Artificial Intelligence • eCommerce • Information Technology • Mobile • Payments • App development • Utilities
Easy Apply
Hybrid
Mississauga, ON, CAN
600 Employees

KUBRA Logo KUBRA

Analytics Engineer

Artificial Intelligence • eCommerce • Information Technology • Mobile • Payments • App development • Utilities
Easy Apply
Hybrid
Mississauga, ON, CAN
600 Employees

UL Solutions Logo UL Solutions

Engineering Project Handler - Toronto

Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Hybrid
Toronto, ON, CAN
15000 Employees

Similar Companies Hiring

HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees
True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
52 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account