Director, System Software Engineering - Metropolis Accelerated and Inferencing Software

NVIDIA is a world leader in physical AI, powering self-driving cars, humanoid robots, intelligent environments, medical devices, and more. Our software platforms are at the core of this mission, enabling innovators to build world-changing products that save lives, improve working conditions, and elevate standards of living across the globe.NVIDIA is looking for an engineering leader who is hands-on with deep learning—comfortable reading/modeling code, not just running it. You bring strong intuition for modern architectures (e.g., transformers, diffusion, VLMs etc), deep experience tuning for NVIDIA GPUs (kernels, memory, latency/efficiency trade-offs) / SOCs, and a proven record delivering robust, low-latency inference at scale. You have led teams that turn Accelerated Computing pipelines into reliable, measurable business impact for embedded and Enterprise platforms. You will work with a cohesive, high-performing team that’s been built and refined over the past nine years. An individual well aligned to experts in the industry is a great fit for this role!

What you'll be doing:

• Lead, encourage, and develop world-class engineering and data teams distributed across Europe, Asia and the United States.

• Architect and operationalize NVIDIA’s end-to-end data Inference Acceleration strategy, powering Inferencing and continuous performance improvements.

• Drive Strategic Implementations of TensorRT, VLLM and other accelerated frameworks for inference solutions for Edge and Enterprise devices: Lead Accelerated Computing efforts and solutions for key Metropolis verticals. Set up Proofs of Readiness (PORs) and guide their implementations.

• Leading customer solutions: Collaborate with major Metropolis OEMs and Partners to architect highly accelerated and optimized custom deep learning models and inference pipelines for their specific requirements. Offer direct customer support, including debugging, technical education, and handling customer inquiries for our Metropolis partner and customers. Responsible for drafting and finalizing SOWs with internal customers and partners.

• Performance Benchmarking: Orchestrate efforts to achieve leading performance results on industry benchmarks like MLPerf on various edge and Enterprise devices.

• Technical Leadership & Influence: Function as a technical leader for deep learning across multiple teams, giving oversight and build support. Apply customer insights to influence the composition and structure of upcoming SOC / GPU deep learning hardware.

• Scaling the team: Strategically hiring to meet new demands while also mentoring and adjusting existing teams to new deep learning challenges.

• Representing Nvidia Deep learning solutions in webinars, conferences and partner events

What we need to see:

• Masters in Computer Science/Electrical Engineering or equivalent experience.

• A minimum of 8 years of meaningful involvement in machine learning/deep learning research or practical experience, coupled with 7+ years of leadership background and overall 15+ years of industry experience.

• Over 10 years of validated expertise in the embedded software sector, holding technical leadership positions accountable for delivering outstanding production software within a multifaceted setting.

• Deep Knowledge of GPU, CPU and dedicated deep learning architecture fundamentals and low-level performance optimizations using heterogeneous computing.

• Hands-on experience with VLMs, LLMs, or multimodal AI systems applied to perception, data triage, or automated labeling.

• Strong expertise in large-scale data processing, systems build, or machine learning pipelines.

• Strong communication, careful planning, and technical leadership capabilities.

Ways to Stand Out from the Crowd:

• We welcome candidates with a PhD or equivalent experience in a relevant field

• Leadership role in production deployment of Smart Spaces, Physical AI with a deep understanding of constraints and advancements of sensing, computing, and model architecture evolutions.

• Ability to lead and drive global teams across multiple continents and time zones

• Deep experience with CV, LLMs, VLMs, GenAI Models, and standards.

With a competitive salary package and benefits, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and autonomous director-level engineer who loves challenges? Do you have a genuine passion for advancing the state of Data Science across a variety of industries? If so, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.Applications for this job will be accepted at least until March 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.