AI Runtime Engineer

Posted 4 Days Ago
Be an Early Applicant
28 Locations
Remote
Mid level
Artificial Intelligence • Hardware • Software
The Role
The AI Runtime Engineer will develop and optimize the execution stack for AI accelerators, focusing on efficient deep learning model execution and collaboration with hardware and AI framework teams.
Summary Generated by Built In

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

About the Role

EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments. 

Responsibilities

  • Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.

  • Implement task scheduling, memory management, and kernel execution strategies for efficient computation.

  • Optimize data movement between host and device using PCIe, DMA, shared memory.

  • Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM

  • Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.

  • Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.

  • Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments. 

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.

  • 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.

  • Strong proficiency in C/C++ and low-level systems programming.

  • Deep understanding of task scheduling, concurrency, and memory hierarchy.

  • Experience with hardware-aware optimizations and dataflow architectures.

  • Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).

  • Experience with low-latency, high-throughput workload execution for AI models.

  • Strong debugging and profiling skills for optimizing AI execution performance.

  • Exposure to AI model deployment pipelines (Triton, TensorFlow Serving). 

EnchargeAI is an equal employment opportunity employer in the United States.

Top Skills

C/C++
Dma
Onnx Runtime
Openvino
Pcie
Tensorrt
Tvm
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
31 Employees
On-site Workplace
Year Founded: 2022

What We Do

EnCharge AI is a leader in advanced AI hardware and software systems for edge computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

Similar Jobs

Smartling Logo Smartling

Machine Learning Engineer

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Natural Language Processing • Software
Easy Apply
Remote
28 Locations
95 Employees

GitLab Logo GitLab

Senior Fullstack Engineer, Technical Writing

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
30 Locations
2350 Employees
118K-252K Annually

GitLab Logo GitLab

Principal Engineer (Go), Analytics

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
31 Locations
2350 Employees

Chainlink Labs Logo Chainlink Labs

Software Engineer, Foundations

Blockchain • Internet of Things • Payments • Cryptocurrency • Web3
Remote
8 Locations
680 Employees

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account