Nvidia · posted · checked
Software Engineer Intern, AI and DL Kernel Libraries – 2027
C++PythonPytorchTensorflowOn-site · ChinaIntern
Who can apply
On-site · China
Location: China, Shanghai
NVIDIA is looking for outstanding Software Engineer Interns to help develop groundbreaking technologies for AI and deep learning kernel libraries. Our team builds core software that accelerates high-impact AI workloads on NVIDIA GPUs, with a strong focus on deep learning primitives, kernel libraries, and performance-critical GPU software. As an intern on the team, you will contribute to the design, development, optimization, and delivery of software that powers NVIDIA's AI platform.
This internship is centered on foundational library engineering, with opportunities to work on low-level kernels, performance primitives, and efficient implementations for modern AI and deep learning workloads. You may contribute to GPU-accelerated deep learning primitives, attention kernel implementations, runtime components, code generation systems, and other performance-critical infrastructure for large language models and advanced AI applications. You will collaborate with world-class engineers across deep learning software, compilers, GPU architecture, and open-source inference ecosystems, and your work can directly impact the performance of real-world workloads at scale.
What you'll be doing
Contribute to production-quality software that ships as part of NVIDIA's AI software stack, including cuDNN, FlashInfer, and optimized support for large language model inference workloads.
Help develop new AI systems technologies for efficient inference, with a focus on performance, scalability, maintainability, and usability.
Support the design, implementation, and optimization of kernels for high-impact AI workloads across LLM inference, generative AI, computer vision, autonomous driving, and recommender systems.
Assist in building extensible software abstractions for deep learning libraries, LLM serving engines, and runtime systems.
Contribute to just-in-time compilation, code generation, and runtime technologies for performance-critical GPU workloads.
Analyze workload performance, tune current software, and help propose improvements to future software and hardware-software interfaces.
Collaborate closely with engineers across deep learning frameworks, libraries, kernels, compilers, and GPU architecture teams at NVIDIA.