Back to jobs

Staff Machine Learning Engineer, Generative AI (Auth0)

Pay
CAD 168,000–231,000/yearAnnual period assumed — pay source
The annual base salary range for this position for candidates located in Canada is between: $168,000—$231,000 CAD The Okta Experience
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Architect and deploy production ML and GenAI systems with LLMOps pipelines

  • Build and refine structured prompting, context retrieval, and RAG workflows for Claude-based systems

  • Build automated evaluation pipelines for model quality, groundedness, and safety

  • Implement schema validation and guardrails for reliable, auditable AI outputs

  • Lead agentic application tuning and deployment with focus on reliability and security

From the employer’s posting
Architect, design, and deploy robust Machine Learning & GenAI systems, ensuring seamless integration with diverse platform services and establishing scalable LLMOps pipelines in production.
Develop and iterate on structured prompting, context retrieval, and RAG workflows that improve accuracy, safety, and cost efficiency in Claude-based systems.
Build and refine automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
Implement schema validation, structured output enforcement, and other guardrails that keep AI outputs reliable, auditable, and compliant with enterprise standards.
Lead initiatives to tune, optimize, and deploy agentic applications in production with a focus on performance, reliability, and security.

What you’ll bring

All qualifications

Core experience

  • 7+ years of software development experience, with strong programming expertise in Python
  • Experience integrating AI-driven systems with identity, authentication, or security products.
  • Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
  • Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
  • Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
  • Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.

Preferred experience

  • and familiarity with Go or Typescript a plus
Qualification wording
7+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
Experience integrating AI-driven systems with identity, authentication, or security products.
Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
Apply at Okta

Posting record

Report an error

Open 3 monthsWe first saw this posting 94 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 19, 202694 days ago
Recorded sightings
317
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 94

Up longer than most. Similar jobs usually come down between day 7 and day 76.

At Okta, jobs usually come down by about day 64.

From 6,398 similar postings that came down, and 15 of Okta’s. Coming down is not always a hire.

Okta is hiring

8 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • TypeScript
  • AWS
  • Airflow
  • FastAPI
  • PyTorch
  • TensorFlow
  • Go
Where the posting names them
What you bring: - 7+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus). - Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
- Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models. - Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.). - Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
- Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks. - Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.). - Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.

Your next step

Complete your application on www.okta.com. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

Secure Every Identity, from AI to Human

Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence.

This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk.

The Team:

Have you ever considered what powers the intelligent features behind seamless product experiences? The GenAI team is at the forefront of enabling AI-powered security and intelligent innovation across our organization. From crafting AI powered security services, to intuitive generative AI-powered chat experiences that provide instant product support, and developing the best developer experience around authentication for generative AI and AI agents, our team is instrumental in bringing the transformative power of AI to life. We collaborate closely with the Machine Learning team and various product teams to ensure the seamless and secure delivery of AI-enhanced features that provide real value to our users.

The Opportunity: 

As a Staff Machine Learning Engineer on the Generative AI team, you will help shape, architect, and accelerate our Generative AI strategy by contributing across the stack of model development, infrastructure, and platform services. You’ll drive design and implementation of production-ready AI/ML systems at scale: ranging from LLM-powered features to reusable components that other teams across Okta can build on.

You will have the opportunity to:

  • Architect, design, and deploy robust Machine Learning & GenAI systems, ensuring seamless integration with diverse platform services and establishing scalable LLMOps pipelines in production.
  • Drive technical decision making while striving to hit the right balance between factors such as simplicity, flexibility, reliability, and performance.
  • Lead initiatives to tune, optimize, and deploy agentic applications in production with a focus on performance, reliability, and security.
  • Partner with Product, Security, and Platform Engineering teams to design AI-powered experiences that are both innovative and trustworthy.
  • Design and implement scalable infrastructure and platform services for large-scale Generative AI use cases.
  • Collaborate cross-functionally with product managers, researchers, and engineers to deliver secure, high-quality, and scalable AI/ML systems.

 What you will do:

  • Spearhead the design of scalable, observable ML and Generative AI systems that integrate retrieval, inference, and evaluation pipelines.
  • Develop and iterate on structured prompting, context retrieval, and RAG workflows that improve accuracy, safety, and cost efficiency in Claude-based systems.
  • Build and refine automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
  • Implement schema validation, structured output enforcement, and other guardrails that keep AI outputs reliable, auditable, and compliant with enterprise standards.
  • Mentor and coach engineers, contributing to the growth of the team and the larger engineering community.

What you bring:

  • 7+ years of software development experience, with strong programming expertise in Python (and familiarity with Go or Typescript a plus).
  • Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
  • Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
  • Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
  • Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or other related AI agent frameworks.
  • Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and workflow orchestration tools (Airflow, etc.).
  • Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems.
  • Proven ability to collaborate with product and engineering teams to drive greenfield initiatives forward, navigate unknowns, and iterate quickly and frequently.
  • Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native world.

Nice to haves:

  • Experience integrating AI-driven systems with identity, authentication, or security products.
  • Exposure to ethical AI, model risk, or compliance frameworks.
  • Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.

Please note that we encourage candidates to apply even if you do not have experience with all of the criteria or technologies listed above; these are provided to give insight into the tech stack and general responsibilities for the role.

 

#LI-HYBRID

#LI-SH1
P-2652_3522731

 

Below is the annual salary range for candidates located in Canada. Your actual salary will depend on factors such as your skills, qualifications, and experience. In addition, Okta offers equity (where applicable), bonus, and benefits, including health, dental, and vision insurance, RRSP with a match, healthcare spending, telemedicine, and paid leave (including PTO and parental leave) in accordance with our applicable plans and policies. To learn more about our Total Rewards program, please visit: https://rewards.okta.com/can.

The annual base salary range for this position for candidates located in Canada is between:
$168,000—$231,000 CAD

The Okta Experience

We are intentional about connection. Our global community, spanning over 20 offices worldwide, is united by a drive to innovate. Your journey begins with an immersive, in-person onboarding experience designed to accelerate your impact and connect you to our mission and team from day one.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws.

If reasonable accommodation is needed to complete any part of the job application, interview process, or onboarding please use this Form to request an accommodation.

Notice for New York City Applicants & Employees: Okta may use Automated Employment Decision Tools (AEDT), as defined by New York City Local Law 144, that use artificial intelligence, machine learning, or other automated processes to assist in our recruitment and hiring process. In accordance with NYC Local Law 144, if you are an applicant or employee residing in New York City, please click here to view our full NYC AEDT Notice.

About Okta

People
About 6,366 in 2026, up 8% from the year before.Annual report (SEC Form 10-K)
Company
Listed as OKTA.
H-1B visas
24 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
The annual base salary range for this position for candidates located in Canada is between: $168,000—$231,000 CAD The Okta Experience
Location & working pattern

Toronto, Ontario, Canada

Please note that we encourage candidates to apply even if you do not have experience with all of the criteria or technologies listed above; these are provided to give insight into the tech stack and general responsibilities for the role. #LI-HYBRID #LI-SH1 P-2652_3522731
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.