What We Need To See:
- BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
- 5+ years of experience.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
C
C++
Java
Python
Kubernetes
Terraform
Go
Where the posting names them
- Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production.
- Experience in one or more of the following: Python, Go, C/C++, Java
- In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
NVIDIA is looking for an outstanding, passionate, and talented Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large scale production systems with high efficiency and availability using the combination of software and systems engineering practices. This role demands knowledge across different systems, networking, coding, database, capacity management, continuous delivery and deployment and open source cloud enabling technologies like Kubernetes and OpenStack. AI Infrastructure Engineer at NVIDIA ensures that our internal and external facing GPU cloud services run maximum reliability and uptime and at the same time making changes to the existing system through careful preparation and planning while managing capacity and performance.
NVIDIA’s culture of diversity, intellectual curiosity, problem solving and openness is important to our success.
- Ability to debug and optimize code and automate routine tasks.
- Experience in using or running large private and public cloud systems based on Kubernetes or Slurm.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. If you're creative and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services
- In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
- Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
- Distributed system experience
NVIDIA is looking for an outstanding, passionate, and talented Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large scale production systems with high efficiency and availability using the combination of software and systems engineering practices. This role demands knowledge across different systems, networking, coding, database, capacity management, continuous delivery and deployment and open source cloud enabling technologies like Kubernetes and OpenStack. AI Infrastructure Engineer at NVIDIA ensures that our internal and external facing GPU cloud services run maximum reliability and uptime and at the same time making changes to the existing system through careful preparation and planning while managing capacity and performance.
NVIDIA’s culture of diversity, intellectual curiosity, problem solving and openness is important to our success.
Our organization brings together people with a wide variety of backgrounds, experiences and perspectives. We encourage them to collaborate, think big and take risks in a blame-free environment. We promote self-direction to work on meaningful projects, while we also strive to build an environment that provides the support and mentorship needed to learn and grow.
What You’ll Be Doing:
Design, build, deploy, and run internal tooling for large scale AI training and Inferencing platform built on top of cloud infrastructure
Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters.
Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement.
Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews.
Maintain services once they are live by measuring and monitoring availability, latency and overall system health.
Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity
Practice sustainable incident response and blameless postmortems
Be part of an on call rotation to support production systems
What We Need To See:
BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
5+ years of experience.
A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others.
Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production.
Experience in one or more of the following: Python, Go, C/C++, Java
In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
Distributed system experience
Ways to stand out from the crowd:
Interest in crafting, analyzing and fixing large-scale distributed systems.
Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
Ability to debug and optimize code and automate routine tasks.
Experience in using or running large private and public cloud systems based on Kubernetes or Slurm.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. If you're creative and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services
About NVIDIA
People
About 42,000 in 2026, up 17% from the year before.Annual report (SEC Form 10-K)
Company
Listed as NVDA.
H-1B visas
978 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
Demand for AI Engineer roles
New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.