Back to jobs

Senior Machine Learning Platform Engineer — Model Hosting & MLOps

Spring, Texas, United States of America

Live, first seen by us 46 days ago
Pay
USD 147,050–230,850/year — pay source
Pay & Benefits The pay range for this role is $147,050 to $230,850 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Schedule - Full time Shift -
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting

We are hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that take custom models from development into reliable production use.

You will work with model developers, application engineers, security, and cloud platform teams to turn a model artifact into a secure, scalable inference service.

  • Design and build GPU-backed LLM inference and real-time model endpoints on AWS and Azure

  • Provision and configure Kubernetes clusters and hosting infrastructure with infrastructure as code

  • Build MLOps workflows for model registration, versioning, validation, release, rollback, and retirement

  • Prototype agent workflows with application teams, including orchestration and failure recovery

  • Establish production monitoring and share incident diagnosis for latency, errors, and GPU use

From the employer’s posting
We are hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that take custom models from development into reliable production use. This is a hands-on role for someone who has hosted LLMs on GPU infrastructure, developed the cloud platform around model serving, and built MLOps pipelines that make releases repeatable and observable.
You will work with model developers, application engineers, security, and cloud platform teams to turn a model artifact into a secure, scalable inference service. The work spans serving architecture, infrastructure as code, deployment automation, model lifecycle management, and production operations across AWS and Azure, with potential integration into on-premises environments. You will also help shape agent workflows that use hosted models, so serving choices support the needs of multi-step applications. Success means teams can deploy, update, monitor, and troubleshoot models through clear, reusable platform patterns.
Design and build hosting for custom ML and AI models across AWS and Azure, with particular focus on GPU-backed LLM inference and real-time endpoints
Develop infrastructure as code and deployment automation so model-hosting environments can be provisioned, reviewed, promoted, and maintained consistently
Build MLOps workflows for model registration, versioning, validation, release, rollback, and retirement
Partner with application teams to design and prototype agent workflows, including model and tool orchestration, state handling, failure recovery, and evaluation
Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and model behavior

Before you apply

Employer’s visa record
249 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • Hands-on experience hosting LLM inference on GPU infrastructure in a production environment.
  • knowledge, skills, and experience.
  • Experience building the surrounding model-serving platform for custom models, such as inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling.
  • Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other.
  • Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.
  • Experience building or operating ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion, and rollback.
Qualification wording
Hands-on experience hosting LLM inference on GPU infrastructure in a production environment. You can explain what you personally built, how models reached production, and how you managed throughput, latency, utilization, reliability, and cost.
knowledge, skills, and experience.
Experience building the surrounding model-serving platform for custom models, such as inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling.
Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool.
Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.
Experience building or operating ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion, and rollback.

Benefits in the posting

Full benefits wording
  • Health insurance
  • Dental insurance
  • Vision insurance
  • Long term/short term disability insurance
  • Employee assistance program
  • Flexible spending account
  • Life insurance
  • 4-12 weeks fully paid parental leave based on tenure
  • 11 paid holidays
  • Additional flexible paid vacation and sick leave
  • The compensation and benefits information is accurate as of the date of this
  • with or without notice, subject to applicable law.
  • Job -
  • Software
  • Schedule -
  • Full time
  • Shift -
  • Travel -
  • No
  • Relocation -
  • HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).
  • Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

From the employer’s posting.

Apply at HP

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 7, 202646 days ago
Recorded sightings
102
Last seen by us
Nov 15, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$147K–$231K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 46

Similar jobs usually come down between day 7 and day 76.

Well past HP’s usual: its jobs come down by about day 22.

From 6,398 similar postings that came down, and 91 of HP’s. Coming down is not always a hire.

HP is hiring

55 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • ML Engineer hiring has slowed
  • Takes jobs down at a usual pace
  • 5% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Azure
  • Kubernetes
  • SageMaker
  • Terraform
Where the posting names them
- Experience building the surrounding model-serving platform for custom models, such as inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling. - Strong software engineering skills, especially Python, with experience building services, automation, and maintainable production code. - Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool.
We are hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that take custom models from development into reliable production use. This is a hands-on role for someone who has hosted LLMs on GPU infrastructure, developed the cloud platform around model serving, and built MLOps pipelines that make releases repeatable and observable. You will work with model developers, application engineers, security, and cloud platform teams to turn a model artifact into a secure, scalable inference service. The work spans serving architecture, infrastructure as code, deployment automation, model lifecycle management, and production operations across AWS and Azure, with potential integration into on-premises environments. You will also help shape agent workflows that use hosted models, so serving choices support the needs of multi-step applications. Success means teams can deploy, update, monitor, and troubleshoot models through clear, reusable platform patterns. What you will do
What you will do - Design and build hosting for custom ML and AI models across AWS and Azure, with particular focus on GPU-backed LLM inference and real-time endpoints; support batch inference where appropriate. - Package models and their dependencies into reproducible serving workloads; choose and implement suitable managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost.
- Strong software engineering skills, especially Python, with experience building services, automation, and maintainable production code. - Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool. - Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.
- Serving generative or other compute-intensive custom models beyond LLMs; selecting and tuning inference servers and runtime configurations. - AWS SageMaker or EKS; Azure Machine Learning or AKS; or equivalent managed and self-hosted model platforms. - Hybrid or on-premises model hosting, including connectivity, security boundaries, hardware constraints, and operational handoff.
- Design and build hosting for custom ML and AI models across AWS and Azure, with particular focus on GPU-backed LLM inference and real-time endpoints; support batch inference where appropriate. - Package models and their dependencies into reproducible serving workloads; choose and implement suitable managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost. - Provision and configure Kubernetes clusters or other suitable hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking integration, observability, and environment configuration.
- Package models and their dependencies into reproducible serving workloads; choose and implement suitable managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost. - Provision and configure Kubernetes clusters or other suitable hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking integration, observability, and environment configuration. - Help design secure connections and deployment patterns between cloud and on-premises environments as hosting needs evolve.
- Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool. - Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads. - Experience building or operating ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion, and rollback.

Your next step

Complete your application on hp.wd5.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

Senior Machine Learning Platform Engineer — Model Hosting & MLOps

Description -

Role summary

 

We are hiring a Senior Machine Learning Platform Engineer to build the infrastructure and engineering workflows that take custom models from development into reliable production use. This is a hands-on role for someone who has hosted LLMs on GPU infrastructure, developed the cloud platform around model serving, and built MLOps pipelines that make releases repeatable and observable.

 

You will work with model developers, application engineers, security, and cloud platform teams to turn a model artifact into a secure, scalable inference service. The work spans serving architecture, infrastructure as code, deployment automation, model lifecycle management, and production operations across AWS and Azure, with potential integration into on-premises environments. You will also help shape agent workflows that use hosted models, so serving choices support the needs of multi-step applications. Success means teams can deploy, update, monitor, and troubleshoot models through clear, reusable platform patterns.

 

What you will do

 

  • Design and build hosting for custom ML and AI models across AWS and Azure, with particular focus on GPU-backed LLM inference and real-time endpoints; support batch inference where appropriate.
  • Package models and their dependencies into reproducible serving workloads; choose and implement suitable managed services, containers, or Kubernetes-based patterns based on throughput, latency, security, reliability, and cost.
  • Provision and configure Kubernetes clusters or other suitable hosting infrastructure, including compute, storage, API access, identity and access controls, secrets, networking integration, observability, and environment configuration.
  • Help design secure connections and deployment patterns between cloud and on-premises environments as hosting needs evolve.
  • Develop infrastructure as code and deployment automation so model-hosting environments can be provisioned, reviewed, promoted, and maintained consistently.
  • Build MLOps workflows for model registration, versioning, validation, release, rollback, and retirement. Connect training or model preparation to deployment through automated pipelines and appropriate quality gates.
  • Partner with application teams to design and prototype agent workflows, including model and tool orchestration, state handling, failure recovery, and evaluation.
  • Translate agent workload patterns into hosting decisions about model selection, context length, concurrency, latency, cost, tool access, and end-to-end tracing.
  • Establish production monitoring for service health, latency, throughput, errors, GPU and other resource use, and model behavior. Share responsibility for diagnosing incidents and improving capacity, reliability, and cost.
  • Create reusable deployment templates, reference architectures, documentation, and onboarding paths that help other teams ship models safely.
  • Partner with model and application teams on practical tradeoffs such as online versus batch inference, managed versus self-hosted serving, scaling, evaluation, data handling, and operational ownership.

 

Required experience

 

  • Hands-on experience hosting LLM inference on GPU infrastructure in a production environment. You can explain what you personally built, how models reached production, and how you managed throughput, latency, utilization, reliability, and cost.
  • Experience building the surrounding model-serving platform for custom models, such as inference runtimes, deployment patterns, endpoint access, scaling, and operational tooling.
  • Strong software engineering skills, especially Python, with experience building services, automation, and maintainable production code.
  • Experience developing infrastructure for ML workloads across AWS and Azure, with deep hands-on delivery in at least one and practical ability to work in the other. You have used infrastructure as code such as Terraform or an equivalent tool.
  • Experience provisioning, configuring, and maintaining Kubernetes or another production hosting platform for containerized inference workloads.
  • Experience building or operating ML deployment pipelines with versioned artifacts, automated validation, CI/CD, environment promotion, and rollback.
  • Familiarity with LLM agent patterns, including model invocation, tool calls, and multi-step workflows, and how they affect serving capacity, reliability, and access controls.
  • Working knowledge of production concerns for inference services: scaling, latency, availability, logging and metrics, shared incident response, access control, and cost.
  • Ability to work across model development, application, platform, and security teams; turn ambiguous requirements into a working design; and document the resulting operational approach.

 

Helpful experience

 

  • Advanced GPU inference optimization, including capacity planning, batching, autoscaling, memory use, model loading, and performance tuning.
  • Serving generative or other compute-intensive custom models beyond LLMs; selecting and tuning inference servers and runtime configurations.
  • AWS SageMaker or EKS; Azure Machine Learning or AKS; or equivalent managed and self-hosted model platforms.
  • Hybrid or on-premises model hosting, including connectivity, security boundaries, hardware constraints, and operational handoff.
  • Model registries, experiment tracking, data or feature pipelines, scheduled retraining, model evaluation, and drift or quality monitoring.
  • Secure enterprise deployment patterns such as private networking, IAM/RBAC, secrets management, auditability, and handling sensitive data.
  • Building shared ML platform capabilities or self-service workflows used by multiple engineering teams.
  • Hands-on development of agent workflows, including tool integration, evaluation, tracing, or guardrails.

 

Who will thrive here

 

You are an engineer who has taken responsibility for what happens after a model is trained: how it is packaged, deployed, secured, scaled, observed, updated, and supported. You are comfortable writing code and infrastructure, investigating production failures, and making clear tradeoffs with partner teams.

 

Pay & Benefits

The pay range for this role is $147,050 to $230,850 USD annually with additional

opportunities for pay in the form of bonus and/or equity (applies to United

States of America candidates only). Pay varies by work location, job-related

knowledge, skills, and experience.

 

Benefits:

HP offers a comprehensive benefits package for this position, including:

  • Health insurance
  • Dental insurance
  • Vision insurance
  • Long term/short term disability insurance
  • Employee assistance program
  • Flexible spending account
  • Life insurance
  • Generous time off policies, including;
  • 4-12 weeks fully paid parental leave based on tenure
  • 11 paid holidays
  • Additional flexible paid vacation and sick leave
  • US benefits overview https://hpbenefits.ce.alight.com/

 

The compensation and benefits information is accurate as of the date of this

posting. The Company reserves the right to modify this information at any time,

with or without notice, subject to applicable law.

Job -

Software

Schedule -

Full time

Shift -

No shift premium (United States of America)

Travel -

No

Relocation -

No

Equal Opportunity Employer (EEO) - 

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “Know Your Rights: Workplace Discrimination is Illegal"

About HP

People
About 55,000 in 2025, down 5% from the year before.Annual report (SEC Form 10-K)
Company
Listed as HPQ.
H-1B visas
41 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Pay & Benefits The pay range for this role is $147,050 to $230,850 USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United
Location & working pattern

Spring, Texas, United States of America

- AWS SageMaker or EKS; Azure Machine Learning or AKS; or equivalent managed and self-hosted model platforms. - Hybrid or on-premises model hosting, including connectivity, security boundaries, hardware constraints, and operational handoff. - Model registries, experiment tracking, data or feature pipelines, scheduled retraining, model evaluation, and drift or quality monitoring.
Work authorization
NoEqual Opportunity Employer (EEO) - HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s). Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.