Senior Staff Machine Learning Engineer – End-to-End Autonomous Driving

Posted 6 Days Ago
Be an Early Applicant
2 Locations
Senior level
Automotive
The Role
Research, implement, and evaluate deep learning algorithms for autonomous driving vehicle systems, develop efficient neural network architectures, and work on real-world multimodal data integration.
Summary Generated by Built In

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.

 

We are seeking Deep Learning Engineers with strong expertise in machine learning (ML) and deep learning (DL) system design, along with solid software development skills. In this role, you will research, implement, and evaluate a unified end-to-end onboard model leveraging state-of-the-art technologies, including transformer-based architectures, diffusion models, reinforcement learning, and Vision-Language-Action (VLA) models. You will collaborate with a world-class team of experts in computer vision, AI systems, and software engineering to push the boundaries of autonomous vehicle performance. Your work will be powered by vast amounts of real-world multimodal data from our autonomous fleet, enabling the development of next-generation AI-driven driving solutions.

 

Job Responsibilities:

  • Research and develop cutting-edge deep learning algorithms for a unified, end-to-end onboard model that seamlessly integrates perception, prediction, and planning, replacing traditional modular model pipelines.

  • Research and develop Vision-Language-Action (VLA) models to enable context-aware, multimodal decision-making, allowing the model to understand visual, textual, and action-based cues for enhanced driving intelligence.

  • Design and optimize highly efficient neural network architectures, ensuring they achieve low-latency, real-time execution on the vehicle’s high-performance computing platform, balancing accuracy, efficiency, and robustness.

  • Develop and scale an offline machine learning (ML) infrastructure to support rapid adaptation, large-scale training, and continuous self-improvement of end-to-end models, leveraging self-supervised learning, imitation learning, and reinforcement learning.

  • Deliver production-quality onboard software, working closely with sensor fusion, mapping, and perception teams to build the industry’s most intelligent and adaptive autonomous driving system.

  • Leverage massive real-world datasets collected from our autonomous fleet, integrating multi-modal sensor data to train and refine state-of-the-art end-to-end driving models.

  • Design, conduct, and analyze large-scale experiments, including sim-to-real transfer, closed-loop evaluation, and real-world testing to rigorously benchmark model performance and generalization.

  • Collaborate with system software engineers to deploy high-performance deep learning models on embedded automotive hardware, ensuring real-world robustness and reliability under diverse driving conditions.

  • Work cross-functionally with AI researchers, computer vision experts, and autonomous driving engineers to push the frontier of end-to-end learning, leveraging advances in transformer-based architectures, diffusion models, and reinforcement learning to redefine the future of autonomous mobility.

 

Minimum Skill Requirements:

  • MS or PhD level education in Engineering or Computer Science with a focus on Deep Learning, Artificial Intelligence, or a related field, or equivalent experience.

  • Strong experience in applied deep learning including model architecture design, model training, data mining, and data analytics.

  • 5 - 8 years + of experience working with DL frameworks such as PyTorch, Tensorflow.

  • Strong Python programming experience with software design skills.

  • Solid understanding of data structures, algorithms, code optimization and large-scale data processing.

  • Excellent problem-solving skills.

 

Preferred Skill Requirements:

  • Hands on experience in developing DL based planning engine for autonomous driving.

  • Experience in applying CNN/RNN/GNN, attention model, or time series analysis to real world problems.

  • Experience in other ML/DL applications, e.g., reinforcement learning.

  • Experience in DL model deployment and optimization tools such as ONNX and TensorRT.

 

What do we provide:

  • A fun, supportive and engaging environment

  • Opportunity to make significant impact on transportation revolution by the means of advancing autonomous driving

  • Opportunity to work on cutting edge technologies with the top talent in the field

  • Competitive compensation package

  • Snacks, lunches and fun activities

 

The base salary range for this full-time position is $244,140-$413,160, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.

 

We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.

Top Skills

AI
Deep Learning
Machine Learning
Onnx
Python
PyTorch
TensorFlow
Tensorrt
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Palo Alto, CA
993 Employees
On-site Workplace
Year Founded: 2014

What We Do

Xpeng Motors is a leading Chinese electric vehicle and technology company that designs and manufactures intelligent automobiles that are seamlessly integrated with the Internet and utilize the latest advances in artificial intelligence. Focusing on China’s young and tech-savvy consumer base, XPENG Motors strives to offer smart mobility solutions with technology innovation and cutting-edge R&D. The company’s initial backers include its CEO & Chairman He Xiaopeng, the founder of UCWeb Inc. and a former Alibaba executive. It was co-founded in 2014 by Henry Xia and He Tao, former senior executives at Guangzhou Auto with expertise in innovative automotive technology and R&D. It has received funding from prominent Chinese and international investors including Alibaba Group, Foxconn Group and IDG Capital. Currently with 3,000 employees, the company is headquartered in Guangzhou and has design, R&D, manufacturing and sales & marketing divisions in Silicon Valley, San Diego, Beijing, Shanghai, Zhaoqing (Guangdong Province) and Zhengzhou (Henan Province).

Similar Jobs

Hedra Logo Hedra

Applied Research Scientist

Consumer Web • Digital Media • Enterprise Web • Marketing Tech • News + Entertainment • Software • Generative AI
2 Locations
14 Employees

Hedra Logo Hedra

Senior Research Engineer

Consumer Web • Digital Media • Enterprise Web • Marketing Tech • News + Entertainment • Software • Generative AI
2 Locations
14 Employees

Hedra Logo Hedra

Research Engineer

Consumer Web • Digital Media • Enterprise Web • Marketing Tech • News + Entertainment • Software • Generative AI
San Francisco, CA, USA
14 Employees

Hedra Logo Hedra

Machine Learning Engineer

Consumer Web • Digital Media • Enterprise Web • Marketing Tech • News + Entertainment • Software • Generative AI
San Francisco, CA, USA
14 Employees

Similar Companies Hiring

Cox Enterprises Thumbnail
Software • Other • Information Technology • Greentech • Cybersecurity • Cloud • Automotive
Atlanta, GA
50000 Employees
UL Solutions Thumbnail
Software • Renewable Energy • Professional Services • Energy • Consulting • Chemical • Automotive
Chicago, IL
15000 Employees
HERE Technologies Thumbnail
Software • Logistics • Internet of Things • Information Technology • Computer Vision • Automotive • Artificial Intelligence
Amsterdam, NL
6000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account