Back to jobs

Senior Machine Learning Engineer

Pay
USD 188,500–282,700/yearAnnual period assumed — pay source
US Pay Range $188,500—$282,700 USD Join Us in Securing and Accelerating the World's AI Transformation
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Train and fine-tune small language models and classifiers for real-time enforcement

  • Design multi-stage inference pipelines for real-time and batch workloads

  • Optimize GPU serving for cost and sub-second latency

  • Build synthetic data and adversarial training pipelines

  • Build online and offline evaluation systems for live model decisions

From the employer’s posting
Owning the full training lifecycle for the SLMs and classifiers in SAGE's real-time enforcement path
Designing multi-stage inference pipelines that handle both real-time enforcement
Optimizing live deployments through shared GPU pools, KV-cache-aware routing, continuous batching
Designing adversarial training pipelines like purpose-built adversarial agents and automated red-teams
Building online evaluation systems for live model decisions

Before you apply

Employer’s visa record
187 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • 2+ years of professional ML experience with demonstrable end-to-end production ownership; you have taken models from training to serving real customer traffic and stayed accountable for them through post-launch iteration.
  • Proficiency in Python and PyTorch (or equivalent) for production-grade training and evaluation.
  • Hands-on experience training, fine-tuning, or distilling language models or classifiers in a production setting, including SFT and at least one preference-optimization technique (DPO, RLAIF, or RLHF).
  • Experience designing closed-loop ML systems, including the eval, telemetry, data-curation, and synthetic-data infrastructure that turns production signals back into training data and the next model release.

Preferred experience

  • Expertise in model evaluation methodology, specifically building "LLM-as-judge" pipelines, calibration monitoring, and adversarial benchmarks that surface the subtle failure modes static metrics often overlook.
  • Experience with context-fusion and retrieval systems that synthesize disparate signals - such as data sensitivity, user identity, and behavioral history - into high-fidelity model decisions.
  • Hands-on knowledge distillation experience, successfully transferring capabilities from frontier teacher models to specialized, small-scale student models for production serving.
  • Familiarity with the agentic ecosystem, including tool-use frameworks, model gateway architectures (MCP, LiteLLM, or equivalent), and autonomous agent patterns.
Qualification wording
2+ years of professional ML experience with demonstrable end-to-end production ownership; you have taken models from training to serving real customer traffic and stayed accountable for them through post-launch iteration.
Proficiency in Python and PyTorch (or equivalent) for production-grade training and evaluation.
Hands-on experience training, fine-tuning, or distilling language models or classifiers in a production setting, including SFT and at least one preference-optimization technique (DPO, RLAIF, or RLHF).
Experience designing closed-loop ML systems, including the eval, telemetry, data-curation, and synthetic-data infrastructure that turns production signals back into training data and the next model release. You have built (not just used) at least one such loop.
Expertise in model evaluation methodology, specifically building "LLM-as-judge" pipelines, calibration monitoring, and adversarial benchmarks that surface the subtle failure modes static metrics often overlook.
Experience with context-fusion and retrieval systems that synthesize disparate signals - such as data sensitivity, user identity, and behavioral history - into high-fidelity model decisions.
Hands-on knowledge distillation experience, successfully transferring capabilities from frontier teacher models to specialized, small-scale student models for production serving.
Familiarity with the agentic ecosystem, including tool-use frameworks, model gateway architectures (MCP, LiteLLM, or equivalent), and autonomous agent patterns.
Education & alternatives
Minimum Requirements for the Position Education: A Bachelor's degree (or higher) in Computer Science, Machine Learning, Computer Engineering, Statistics, or a closely related technical field is required. Designing production SLM training and serving systems requires a deep theoretical understanding of modern deep learning, optimization, and systems performance. Specialized Technical Knowledge:
Apply at Rubrik Job Board

Posting record

Report an error

Open 5 monthsWe first saw this posting 155 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 15, 2026155 days ago
Recorded sightings
207
Last seen by us
Nov 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$189K–$283K against $166K–$237K, the middle half of what similar US postings state.

From 1,505 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 155

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 5,830 similar postings that came down. Coming down is not always a hire.

Rubrik Job Board is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Azure
  • PyTorch
Where the posting names them
- 2+ years of professional ML experience with demonstrable end-to-end production ownership; you have taken models from training to serving real customer traffic and stayed accountable for them through post-launch iteration. - Proficiency in Python and PyTorch (or equivalent) for production-grade training and evaluation. - Hands-on experience training, fine-tuning, or distilling language models or classifiers in a production setting, including SFT and at least one preference-optimization technique (DPO, RLAIF, or RLHF).
- Building memory and context harnesses that fuse data sensitivity, identity, and historical agent behavior into real-time enforcement decisions to ensure SAGE reasons from each customer's specific context. - Mining agent insights across millions of sessions to surface security gaps, which are then turned into new policy proposals, refinements to existing policies, and signals about upstream issues across the agent ecosystem (Google ADK, Azure AI Foundry, Vertex AI, and others). - Building feedback loops that turn production decisions, customer-flagged false positives, and missed violations into one-click natural-language policy refinements to drive false-positive rates down without sacrificing recall.

Your next step

Complete your application on www.rubrik.com. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

About the Team & Role:

We're building SAGE, Rubrik's Semantic AI Governance Engine, which is the first system designed to monitor, govern, and remediate autonomous AI agents in real time. SAGE powers Rubrik Agent Cloud: enterprises define governance policies in natural language, and SAGE's custom small language models act as judges on every agent action. These models are fast enough to sit in the live request path and accurate enough that customers trust them with allow/block decisions on production traffic.

At its core, SAGE is "LLM-as-judge" applied to AI governance, utilizing the same technique most teams use for offline evaluation but productionized for real-time enforcement at enterprise scale. Our first-generation SLM Policy Guard already outperforms the larger frontier models we've benchmarked against on accuracy while running approximately 5x faster on the same workload. We're hiring to push that lead even further.

As an Applied ML Engineer on the SAGE team, you'll work end-to-end across the model lifecycle: curating data, training small models, serving them at production latency, and closing the feedback loop with real customer signals. The models you build don't just enforce policies in the live request path; they will also drive Agent Rewind, Rubrik's capability to instantly and precisely undo destructive autonomous-agent actions and restore the affected data to a trusted state. 

We're a collaborative, applied team that ships models to enterprise customers within weeks, and we're passionate about proving that small, specialized models can outperform frontier LLMs at the problems that matter most for AI safety and governance.

Nature of the Specialized Duties

➢ Training, Fine-Tuning, and Distilling Production Small Language Models and Classifiers (25% of time)

  • Owning the full training lifecycle for the SLMs and classifiers in SAGE's real-time enforcement path, including base-model selection, supervised fine-tuning, preference optimization (DPO/RLAIF), and distillation from frontier teacher models.
  • Training anomaly and action-severity models that catch novel agent-side attack patterns at real-time decision latency, such as supply-chain compromises or emergent destructive behaviors not covered by any explicit policy. Severity scores route the highest-impact events to Agent Rewind for precise remediation.
  • Designing adversarial training pipelines like purpose-built adversarial agents and automated red-teams whose outputs feed directly into the next training run, turning every discovered weakness into a permanent model improvement.
  • Pushing the pareto frontier of accuracy, latency, and cost for governance-specific tasks through deliberate post-training choices (LoRA, quantization-aware training, distillation recipes, GRPO, etc.) and validating the wins on production traffic patterns.

➢ Engineering High-Performance Model Serving and Inference Infrastructure (25% of time)

  • Designing multi-stage inference pipelines that handle both real-time enforcement (inline prompt, response, and tool-call blocking) and high-throughput batch workloads (offline scoring, back-testing, corpus mining) while processing billions of tokens daily across Global 2000 customer agent fleets.
  • Optimizing live deployments through shared GPU pools, KV-cache-aware routing, continuous batching, FP8/INT8 quantization, and speculative decoding to minimize inference cost while holding sub-second P99 SLOs.
  • Building serving-layer infrastructure that lets SAGE block agent prompts, responses, and tool calls in real time without becoming a latency bottleneck. This includes model gateway design, request routing, and graceful degradation.
  • Owning canary, shadow, and A/B traffic patterns so new model variants are validated against live customer traffic before they take enforcement decisions.

➢ Building Synthetic Data Pipelines and Online + Offline Evaluation Frameworks (20% of time)

  • Designing automated data curation pipelines that mine live customer environments (with privacy and tenancy guarantees) for high-value per tenant training examples, such as long-tail violations, near-miss policy edges, or novel agent behaviors, and routing them back into the training loop for each customer.
  • Building automated policy back-testing by replaying historical agent traffic against new model and policy versions to catch regressions and recommend policy improvements before customer-visible deployment.
  • Building online evaluation systems for live model decisions, including shadow scoring, drift detection, calibration monitoring, and policy-coverage gap analysis, ensuring quality regressions surface in minutes rather than weeks.
  • Generating synthetic data using frontier teachers (adversarial prompts, policy-edge cases, multi-turn interactions) with evaluation that confirms synthetic data improves downstream quality, not just dataset size.

➢ Insights Mining, Failure Diagnosis, and Adaptive Model Improvement (15% of time)

  • Building memory and context harnesses that fuse data sensitivity, identity, and historical agent behavior into real-time enforcement decisions to ensure SAGE reasons from each customer's specific context.
  • Mining agent insights across millions of sessions to surface security gaps, which are then turned into new policy proposals, refinements to existing policies, and signals about upstream issues across the agent ecosystem (Google ADK, Azure AI Foundry, Vertex AI, and others).
  • Building feedback loops that turn production decisions, customer-flagged false positives, and missed violations into one-click natural-language policy refinements to drive false-positive rates down without sacrificing recall.
  • Diagnosing model failures end-to-end and distinguishing data, training-recipe, architecture, and serving-layer root causes so fixes land in the right layer the first time.

➢  Cross-Functional Collaboration and Translating Customer Reality into Modeling Problems (15% of time)

  • Providing technical leadership on a pillar of the SAGE model stack (training infrastructure, eval methodology, serving architecture, or insights pipeline), mentoring engineers ramping into ML, and shaping the team's technical roadmap.
  • Partnering with Product Management, customer-facing teams, and security analysts to translate customer agent-governance requirements into well-scoped modeling problems, and pushing back when ML is the wrong tool.
  • Communicating model behavior, tradeoffs, and limitations clearly to non-ML stakeholders, such as product managers and enterprise security leaders, so model decisions are made with full context.
  • Collaborating with Agent Cloud platform, security engineering, and AI research teams to integrate new SLMs into the real-time enforcement path with the right latency, observability, rollback, and tenancy guarantees.

Minimum Requirements for the Position

Education: A Bachelor's degree (or higher) in Computer Science, Machine Learning, Computer Engineering, Statistics, or a closely related technical field is required. Designing production SLM training and serving systems requires a deep theoretical understanding of modern deep learning, optimization, and systems performance.

Specialized Technical Knowledge:

  • 2+ years of professional ML experience with demonstrable end-to-end production ownership; you have taken models from training to serving real customer traffic and stayed accountable for them through post-launch iteration.
  • Proficiency in Python and PyTorch (or equivalent) for production-grade training and evaluation.
  • Hands-on experience training, fine-tuning, or distilling language models or classifiers in a production setting, including SFT and at least one preference-optimization  technique (DPO, RLAIF, or RLHF).
  • Production experience with serving frameworks (vLLM, SGLang, TensorRT-LLM, or equivalent), including optimization involving continuous batching, KV-cache strategy, and inference-time quantization.
  • Experience designing closed-loop ML systems, including the eval, telemetry, data-curation, and synthetic-data infrastructure that turns production signals back into training data and the next model release. You have built (not just used) at least one such loop.
  • Comfort operating at production scale, including debugging models that handle high QPS in safety-critical request paths where errors have customer-visible consequences.

Preferred Qualifications:

  • Deep background in AI safety and red-teaming, including hands-on experience with adversarial ML, prompt injection defense strategies, and automated evaluation suites for enterprise-grade LLM safety.
  • Expertise in model evaluation methodology, specifically building "LLM-as-judge" pipelines, calibration monitoring, and adversarial benchmarks that surface the subtle failure modes static metrics often overlook.
  • Experience with context-fusion and retrieval systems that synthesize disparate signals - such as data sensitivity, user identity, and behavioral history - into high-fidelity model decisions.
  • Production experience with low-latency inference for streaming or safety-critical request paths where model throughput and P99 SLOs are paramount.
  • Mastery of label-efficient training and data mining, utilizing weak supervision, active learning, and embedding-based retrieval to surface the production examples that drive the most significant quality improvements.
  • Hands-on knowledge distillation experience, successfully transferring capabilities from frontier teacher models to specialized, small-scale student models for production serving.
  • Familiarity with the agentic ecosystem, including tool-use frameworks, model gateway architectures (MCP, LiteLLM, or equivalent), and autonomous agent patterns.
  • Active open-source contributions to mainstream ML training, serving, or evaluation libraries.
The minimum and maximum base salaries for this role are posted below; additionally, the role is eligible for bonus potential, equity and benefits. The range displayed reflects the minimum and maximum target for new hire salaries for the role based on U.S. location. Within the range, the salary offered will be determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
US Pay Range
$188,500—$282,700 USD

Join Us in Securing and Accelerating the World's AI Transformation

Rubrik (NYSE: RBRK) is the Security and AI Operations Company, delivering one platform built at the intersection of data, identity, and AI. The platform enables agentic cyber resilience and trusted AI operations for enterprises worldwide, built to recover before disruption strikes and stay a step ahead, so security is never the reason ambition stalls.

Linkedin | X (formerly Twitter) | Instagram | Rubrik.com

Inclusion @ Rubrik

At Rubrik, we are dedicated to fostering a culture where people from all backgrounds are valued, feel they belong, and believe they can succeed. Our commitment to inclusion is at the heart of our mission to secure the world’s data.

Our goal is to hire and promote the best talent, regardless of background. We continually review our hiring practices to ensure fairness and strive to create an environment where every employee has equal access to opportunities for growth and excellence. We believe in empowering everyone to bring their authentic selves to work and achieve their fullest potential.

Our inclusion strategy focuses on three core areas of our business and culture:

  • Our Company: We are committed to building a merit-based organization that offers equal access to growth and success for all employees globally. Your potential is limitless here.

  • Our Culture: We strive to create an inclusive atmosphere where individuals from all backgrounds feel a strong sense of belonging, can thrive, and do their best work. Your contributions help us innovate and break boundaries.

  • Our Communities: We are dedicated to expanding our engagement with the communities we operate in, creating opportunities for underrepresented talent and driving greater innovation for our clients. Your impact extends beyond Rubrik, contributing to safer and stronger communities.

Equal Opportunity Employer/Veterans/Disabled

Rubrik is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, protected veteran status, or any other status protected by applicable law. Rubrik provides equal employment opportunities to employees and applicants in all terms and conditions of employment, including recruiting, hiring, promotion, compensation, training, leave, and termination.

Rubrik provides reasonable accommodations to qualified applicants and employees with disabilities in accordance with applicable law. If you need an accommodation to participate in the application process or to perform your job, please contact hr@rubrik.com. Accommodations may include changes to the application process, documents in an alternate format, a sign language interpreter, or specialized equipment.

EEO IS THE LAW

NOTIFICATION OF EMPLOYEE RIGHTS UNDER FEDERAL LABOR LAWS

About Rubrik Job Board

People
About 3,797 in 2026, up 19% from the year before.Annual report (SEC Form 10-K)
Company
Listed as RBRK.
H-1B visas
47 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
US Pay Range $188,500—$282,700 USD Join Us in Securing and Accelerating the World's AI Transformation
Location & working pattern

Palo Alto, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.