Nvidia · posted · checked
Senior Perception AI Engineer – Autonomous Vehicles
C++Pytorch$184k – $288kOn-site · Santa ClaraSenior
Who can apply
On-site · Santa Clara
Location: US, CA, Santa Clara
Self-driving cars need to understand the road ahead in real time, even without a prior map. Our team builds the online mapping system that turns raw data from multiple sensors into an accurate, continuously updated 3D model of the driving environment. This model captures lanes, road boundaries, crosswalks, intersection layouts, and traffic control information to support decisions across the autonomous driving system. You’ll write the models, write the C++, and ship both into vehicles on the road, running on NVIDIA DRIVE Orin and Thor. The tasks you perform will be tested at scale, on real cars, with real safety requirements. NVIDIA’s autonomous driving stack spans the full range of automation, and online mapping is a core component across it, so your work will reach L2++, L3, and L4 systems. The role spans two subject areas, and we want someone who enjoys both:
Learned mapping involves training DNNs to predict map elements directly from visual sensors, laser scanning, and radar. This includes owning the GT story and collaborating with partners to provide the vital data.
Geometry and C++ engineering: building the post-processing that turns network outputs into stable, consistent, production-ready map elements.
What you’ll be doing:
Design, train, and improve PyTorch models that predict online map elements (lanes, road boundaries, crosswalks, road markings, topology) from camera, LiDAR, and/or radar, using BEV and vectorized-map representations.
Solve the hardest scenes: model intersection topology (connectivity between incoming and outgoing lanes, turn paths, merges and splits) and traffic light understanding (detection, state, and association of each light to the lanes it controls).
Write production C++ for geometry-based post-processing: curve and surface fitting, association, multi-frame fusion and tracking, topology reasoning, and consistency checks on DNN outputs.
Apply multi-view geometry, calibration, coordinate transforms, and sensor fusion to produce 3D maps that stay accurate and stable over time.
Optimize and deploy models alongside algorithms on NVIDIA DRIVE Orin and Thor under real-time and safety constraints, and get them running in vehicles.
Lead the narrative around GT and the data loop by planning datasets and defining GT and labeling requirements. Work with labeling, data, and tooling partners to produce high-quality GT. Mine data, choose metrics, and analyze failure cases to drive improvements.