Back to jobs

Senior AI Engineer (US)

Pay
$175,000–215,000/year · BaseAnnual period assumed. Location-specific pay — pay source
Compensation & Benefits The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan. Inclusion & Belonging Statement
Read the full posting
Work setting
Remote — work setting source
Location This is a remote position in the United States. Travel
Read the full posting
Employment
Not stated

What you’ll work on

Full posting
  • Build Production AI Solutions

  • Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements.

  • Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability.

From the employer’s posting
Responsibilities Build Production AI Solutions Architect and implement applications using commercial, open-source, and customer-developed models.
Apply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability. Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements. Deliver Customer Solutions
Architect and implement applications using commercial, open-source, and customer-developed models. Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability. Evaluate models and determine when to use prompt engineering, retrieval-augmented generation, fine-tuning, or other adaptation techniques.

What you’ll bring

All qualifications

Core experience

  • 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.
  • Strong Python programming skills — testing, packaging, async, and API development, not just scripting.
  • Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
  • Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments.
  • Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders.

Preferred experience

  • Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls.
  • Experience with PyTorch and Hugging Face.
  • Experience with agentic frameworks such as LangGraph or LlamaIndex.
  • Experience with MLOps platforms such as MLflow or Kubeflow.
Qualification wording
7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.
Strong Python programming skills — testing, packaging, async, and API development, not just scripting.
Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments.
Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders.
Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls.
Experience with PyTorch and Hugging Face.
Experience with agentic frameworks such as LangGraph or LlamaIndex.
Experience with MLOps platforms such as MLflow or Kubeflow.

Benefits in the posting

Full benefits wording
  • The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan.
  • Inclusion & Belonging Statement

From the employer’s posting.

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 15, 202637 days ago
Recorded sightings
8
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 37

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,368 similar postings that came down. Coming down is not always a hire.

Smart Modular Technologies is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Azure
  • Docker
  • GCP
  • Grafana
  • Kubernetes
  • MLflow
  • SageMaker
  • Terraform
  • Hugging Face
  • PyTorch
Where the posting names them
- 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems. - Strong Python programming skills — testing, packaging, async, and API development, not just scripting. - GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack.
- Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem. - Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. - Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services.
- GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack. - Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems. - Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
- Experience deploying in sovereign, regulated, disconnected, or air-gapped environments. - Familiarity with observability and infrastructure-automation tooling (OpenTelemetry, Prometheus/Grafana, Terraform, Ansible). - Knowledge of AI governance, model risk, data privacy, and responsible-AI practices.
- Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. - Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services. - Implement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback.
- Experience with agentic frameworks such as LangGraph or LlamaIndex. - Experience with MLOps platforms such as MLflow or Kubeflow. - Experience with model fine-tuning, data preparation, or other model-adaptation techniques.
- Strong Python programming skills — testing, packaging, async, and API development, not just scripting. - GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack. - Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems.
- Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls. - Experience with PyTorch and Hugging Face. - Experience with agentic frameworks such as LangGraph or LlamaIndex.

Your next step

Complete your application on careers.penguinsolutions.com. The employer’s form will show what is required.

Applying through SAP SuccessFactors

  • Images (.jpg) aren’t accepted as a resume.

Already applied? Track this application

Job description

View original posting ↗

At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and AI cloud providers worldwide.

Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.

Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.

At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.

 

Job Overview

As an Senior AI/ML Engineer, you will be a hands-on technical expert within our post-sales delivery organization, designing, building, deploying, and troubleshooting enterprise AI solutions for our customers. You will work across AI models, agentic applications, security, MLOps, and the NVIDIA AI Enterprise software stack, supporting public-cloud, sovereign, on-premises, and hybrid environments.

This role is ideal for an experienced AI engineer who enjoys solving complex technical challenges, translating customer requirements into practical solutions, and delivering secure, production-ready AI systems.

 

 

 

Responsibilities

Build Production AI Solutions

  • Architect and implement applications using commercial, open-source, and customer-developed models.
  • Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability.
  • Evaluate models and determine when to use prompt engineering, retrieval-augmented generation, fine-tuning, or other adaptation techniques.
  • Integrate AI applications with enterprise data, APIs, tools, and business systems.

Design Enterprise AI Environments

  • Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem.
  • Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments.
  • Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services.
  • Implement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback.

Embed Security

  • Address AI-specific risks such as prompt injection, insecure tool use, sensitive-data exposure, excessive permissions, and software supply-chain vulnerabilities.
  • Apply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability.
  • Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements.

Deliver Customer Solutions

  • Translate customer requirements and constraints into practical architectures and implementations.
  • Contribute directly to technical discovery, proofs of concept, production deployments, and operational support.
  • Troubleshoot complex issues across AI applications, orchestration platforms, integrations, and infrastructure.
  • Clearly explain technical options, limitations, and tradeoffs to customers and internal stakeholders.

Qualifications

  • 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.
  • Strong Python programming skills — testing, packaging, async, and API development, not just scripting.
  • GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack.  
  • Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems.
  • Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
  • Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments.
  • Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders.

Preferred Qualifications

  • Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls.
  • Experience with PyTorch and Hugging Face.
  • Experience with agentic frameworks such as LangGraph or LlamaIndex.
  • Experience with MLOps platforms such as MLflow or Kubeflow.
  • Experience with model fine-tuning, data preparation, or other model-adaptation techniques.
  • Experience deploying in sovereign, regulated, disconnected, or air-gapped environments.
  • Familiarity with observability and infrastructure-automation tooling (OpenTelemetry, Prometheus/Grafana, Terraform, Ansible).
  • Knowledge of AI governance, model risk, data privacy, and responsible-AI practices.
  • Experience delivering in customer-facing or professional-services environments.

Location

This is a remote position in the United States.

 

Travel

Flexible (with travel to client sites and Penguin Solutions offices as needed).

 

Compensation & Benefits

The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan.   

 

Inclusion & Belonging Statement

We are committed to creating an inclusive environment that embraces differences and fosters belonging for all.

 

Equal Opportunity Statement                                                                                  

We are an Affirmative Action/Equal Opportunity Employer and strongly committed to all policies which will afford equal opportunity employment to all qualified persons without regard to age, national origin, race, ethnicity, creed, gender, disability, veteran status, or any other characteristic protected by law.

 

About Smart Modular Technologies

People
About 2,800 in 2026, down 3% from the year before.Annual report (SEC Form 10-K)
Company
Listed as PENG.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Compensation & Benefits The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan. Inclusion & Belonging Statement
Location & working pattern

United States

Job Overview As an Senior AI/ML Engineer, you will be a hands-on technical expert within our post-sales delivery organization, designing, building, deploying, and troubleshooting enterprise AI solutions for our customers. You will work across AI models, agentic applications, security, MLOps, and the NVIDIA AI Enterprise software stack, supporting public-cloud, sovereign, on-premises, and hybrid environments. This role is ideal for an experienced AI engineer who enjoys solving complex technical challenges, translating customer requirements into practical solutions, and delivering secure, production-ready AI systems.
More source context
- Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem. - Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. - Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services.

More relevant text appears in the full description.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.