Time since we first saw it
Day 37
Up longer than most. Similar jobs usually come down between day 1 and day 15.
From 1,368 similar postings that came down. Coming down is not always a hire.
United States
Live, first seen by us 37 days agoCompensation & Benefits The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan. Inclusion & Belonging StatementRead the full posting
Location This is a remote position in the United States. TravelRead the full posting
Build Production AI Solutions
Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements.
Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability.
Responsibilities Build Production AI Solutions Architect and implement applications using commercial, open-source, and customer-developed models.
Apply enterprise security practices including access controls, encryption, secrets management, network segmentation, and auditability. Support deployments with data-privacy, regulatory, sovereignty, or disconnected-environment requirements. Deliver Customer Solutions
Architect and implement applications using commercial, open-source, and customer-developed models. Build agentic solutions incorporating retrieval, tool use, workflow orchestration, memory, evaluation, guardrails, and observability. Evaluate models and determine when to use prompt engineering, retrieval-augmented generation, fine-tuning, or other adaptation techniques.
7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems.
Strong Python programming skills — testing, packaging, async, and API development, not just scripting.
Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
Experience deploying beyond a single managed cloud: multi-cloud, on-premises, or hybrid environments.
Strong communication and technical judgment, with experience explaining tradeoffs to non-specialist stakeholders.
Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls.
Experience with PyTorch and Hugging Face.
Experience with agentic frameworks such as LangGraph or LlamaIndex.
Experience with MLOps platforms such as MLflow or Kubeflow.
From the employer’s posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 37
Up longer than most. Similar jobs usually come down between day 1 and day 15.
From 1,368 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- 7+ years of experience in software engineering, ML engineering, AI infrastructure, or distributed systems. - Strong Python programming skills — testing, packaging, async, and API development, not just scripting. - GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack.
- Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem. - Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. - Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services.
- GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack. - Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems. - Hands-on experience building LLM applications that carried real production traffic — retrieval-augmented generation, agentic workflows, tool integration, evaluation, and guardrails.
- Experience deploying in sovereign, regulated, disconnected, or air-gapped environments. - Familiarity with observability and infrastructure-automation tooling (OpenTelemetry, Prometheus/Grafana, Terraform, Ansible). - Knowledge of AI governance, model risk, data privacy, and responsible-AI practices.
- Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. - Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services. - Implement reliable LLMOps and MLOps practices for testing, deployment, monitoring, governance, versioning, and rollback.
- Experience with agentic frameworks such as LangGraph or LlamaIndex. - Experience with MLOps platforms such as MLflow or Kubeflow. - Experience with model fine-tuning, data preparation, or other model-adaptation techniques.
- Strong Python programming skills — testing, packaging, async, and API development, not just scripting. - GPU model serving at scale. NVIDIA AI Enterprise (NIM, NeMo, Triton Inference Server) is what we deploy most often, and prior experience with it is a significant plus — but equivalent experience with vLLM, TGI, Ray Serve, SageMaker, or similar inference stacks is fully acceptable, and we'll support your ramp-up on the NVIDIA stack. - Production experience with Linux, Docker, Kubernetes, APIs, and distributed systems.
- Familiarity with AI-specific security risks (for example, the OWASP Top 10 for LLM Applications) and comfort partnering with security teams on enterprise controls. - Experience with PyTorch and Hugging Face. - Experience with agentic frameworks such as LangGraph or LlamaIndex.
Complete your application on careers.penguinsolutions.com. The employer’s form will show what is required.
Already applied? Track this application
At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and AI cloud providers worldwide.
Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.
Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.
At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.
Job Overview
As an Senior AI/ML Engineer, you will be a hands-on technical expert within our post-sales delivery organization, designing, building, deploying, and troubleshooting enterprise AI solutions for our customers. You will work across AI models, agentic applications, security, MLOps, and the NVIDIA AI Enterprise software stack, supporting public-cloud, sovereign, on-premises, and hybrid environments.
This role is ideal for an experienced AI engineer who enjoys solving complex technical challenges, translating customer requirements into practical solutions, and delivering secure, production-ready AI systems.
Responsibilities
Build Production AI Solutions
Design Enterprise AI Environments
Embed Security
Deliver Customer Solutions
Qualifications
Preferred Qualifications
Location
This is a remote position in the United States.
Travel
Flexible (with travel to client sites and Penguin Solutions offices as needed).
Compensation & Benefits
The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan.
Inclusion & Belonging Statement
We are committed to creating an inclusive environment that embraces differences and fosters belonging for all.
Equal Opportunity Statement
We are an Affirmative Action/Equal Opportunity Employer and strongly committed to all policies which will afford equal opportunity employment to all qualified persons without regard to age, national origin, race, ethnicity, creed, gender, disability, veteran status, or any other characteristic protected by law.
New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Compensation & Benefits The base pay range that the Company reasonably expects to pay for this position in the United States is $175,000 – 215,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan. Inclusion & Belonging Statement
United States
Job Overview As an Senior AI/ML Engineer, you will be a hands-on technical expert within our post-sales delivery organization, designing, building, deploying, and troubleshooting enterprise AI solutions for our customers. You will work across AI models, agentic applications, security, MLOps, and the NVIDIA AI Enterprise software stack, supporting public-cloud, sovereign, on-premises, and hybrid environments. This role is ideal for an experienced AI engineer who enjoys solving complex technical challenges, translating customer requirements into practical solutions, and delivering secure, production-ready AI systems.
- Design and deploy solutions using the NVIDIA AI Enterprise software stack and the broader AI ecosystem. - Build portable solutions for AWS, Azure, GCP, on-premises data centers, and hybrid environments. - Work with containers, Kubernetes, GPU-enabled infrastructure, networking, storage, identity, and platform services.
More relevant text appears in the full description.
No clear work-authorization passage found. Eligibility is unconfirmed.