Back to jobs

Staff Engineer - Machine Learning

Pay
$211,000–261,000/year · BaseLocation-specific pay — pay source
Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters. The annual base salary range for this position is $211,000 - $261,000. This role is also eligible for a target bonus. Compensation is based on a variety of factors, including but not limited to location, experience, job-related skills, and level.
Read the full posting
Work setting
Hybrid — work setting source
Additional Information Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters. The annual base salary range for this position is $211,000 - $261,000. This role is also eligible for a target bonus.
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

Before you apply

Employer’s visa record
35 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll work on

Full posting
  • Lead implementation of agent runtime orchestration services

  • Own development of APIs and SDKs for building agent workflows

  • Build stateful dialog and memory services for multi-turn agents

  • Implement and maintain RAG pipelines and vector database integrations

  • Provide code reviews and technical guidance to junior backend engineers

From the employer’s posting
Act as the lead engineer for agent runtime orchestration services
Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows
Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents
Implement and maintain RAG pipelines and integrations with vector databases
Provide technical guidance and code reviews for more junior backend engineers on the team

What you’ll bring

All qualifications

Core experience

  • 6+ years of backend engineering experience
  • 1-2+ years of hands-on experience in AI/ML platform development

Preferred experience

  • Experience with AI-driven planning systems or dialog state tracking
  • Experience working in a high-growth SaaS or startup environment
Qualification wording
6+ years of backend engineering experience
1-2+ years of hands-on experience in AI/ML platform development
Experience with AI-driven planning systems or dialog state tracking
Experience working in a high-growth SaaS or startup environment
Apply at Freshworks

Posting record

Report an error

Open 4 monthsWe first saw this posting 128 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jul 8, 2026128 days ago
Recorded sightings
519
Last seen by us
Nov 13, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 128

Up longer than most. Similar jobs usually come down between day 4 and day 77.

Well past Freshworks’s usual: its jobs come down by about day 24.

From 51 similar postings that came down, and 26 of Freshworks’s. Coming down is not always a hire.

Freshworks is hiring

4 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Takes jobs down quickly
  • 25% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • AWS
  • Kafka
  • Kubernetes
  • PostgreSQL
  • Terraform
  • Airflow
Where the posting names them
- 1-2+ years of hands-on experience in AI/ML platform development - Expert Proficiency: Strong programming skills in Java and Python - Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith
- Distributed Systems: Deep understanding of event-driven architectures, microservices, and Kubernetes - Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases - Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka
- Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases - Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka Preferred Qualifications:
- Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith - Distributed Systems: Deep understanding of event-driven architectures, microservices, and Kubernetes - Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases
- Microservices Leadership: Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures - Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow - Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring

Your next step

Complete your application on jobs.smartrecruiters.com. The employer’s form will show what is required.

Applying through SmartRecruiters

  • Uploading your resume fills in the application form for you, so check what it filled before you send.

Already applied? Track this application

Has Freshworks posted this job before?

Yes. We’ve followed 2 other Staff Engineer - Machine Learning jobs there since September 2026. One came down after 15 days. One is still up.

  1. This jobUp 128 days so far, first seen Jul 8
  2. BengaluruCame down after 15 days, first seen Sep 30
  3. BengaluruStill up after 30 days, first seen Oct 15

About Freshworks

People
About 250 in 2025, about the same as the year before.Annual report (SEC Form 10-K)
Company
Listed as FRSH.
H-1B visas
9 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 134% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 2. The fewest in a week was 7, the most 65, and the latest week had 65.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Job description

View original posting ↗

Job Description

We are seeking a Machine Learning Staff Engineer to lead the development of core backend services powering our Agentic AI Platform. In this role, you will be the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows.

You will collaborate with the Principal AI Architect to bridge the gap between high-level design and scalable implementation. You will own the development of high-performance APIs and orchestration runtimes, integrating frameworks like LangChain, LangGraph, and LangSmith. This role is highly hands-on and requires a technical leader who can navigate a fast-paced environment while maintaining high engineering standards.

Key Responsibilities

Platform Backend Development

  • Lead Implementation: Act as the lead engineer for agent runtime orchestration services, focusing on reasoning, planning, and tool invocation
  • API & SDK Design: Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows
  • State & Memory Management: Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents
  • Agent Communication: Implement multi-agent communication (A2A) protocols and shared context systems

System Architecture & Execution

  • Microservices Leadership: Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures
  • Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow
  • Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring

Integrations & Data Services

  • Data Pipeline Ownership: Implement and maintain RAG pipelines and integrations with vector databases (e.g., Pinecone, Weaviate, FAISS)
  • Telemetry Integration: Ensure all backend services support LangSmith-based evaluation and comprehensive observability

Security & Reliability

  • Tenant Isolation: Implement RBAC, API authentication, and multi-tenant isolation logic
  • Engineering Excellence: Set the standard for automated testing (unit, integration, load) and implement OpenTelemetry for full system visibility
  • Mentorship: Provide technical guidance and code reviews for more junior backend engineers on the team

Qualifications

Required Qualifications:

  • 6+ years of backend engineering experience
  • 1-2+ years of hands-on experience in AI/ML platform development
  • Expert Proficiency: Strong programming skills in Java and Python
  • Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith
  • Distributed Systems: Deep understanding of event-driven architectures, microservices, and Kubernetes
  • Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases
  • Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka

Preferred Qualifications:

  • Experience with AI-driven planning systems or dialog state tracking
  • Background in enterprise security (RBAC, SSO, OAuth2)
  • Experience working in a high-growth SaaS or startup environment
  • Active contributions to open-source backend or AI frameworks

Additional Information

Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters. 

The annual base salary range for this position is $211,000 - $261,000. This role is also eligible for a target bonus. 

Compensation is based on a variety of factors, including but not limited to location, experience, job-related skills, and level. 

Freshworks offers multiple options for dental, medical, vision, disability, and life insurance. Equity + ESPP, flexible PTO, flexible spending, commuter benefits, and wellness benefits are also offered. Freshworks also offers adoption and parental leave benefits. 

At Freshworks, we have fostered an environment that enables everyone to find their true potential, purpose, and passion, welcoming colleagues of all backgrounds, genders, sexual orientations, religions, and ethnicities. We are committed to providing equal opportunity and believe that diversity in the workplace creates a more vibrant, richer environment that boosts the goals of our employees, communities, and business. Fresh vision. Real impact. Come build it with us.

Company Description

Organizations everywhere struggle under the crushing costs and complexities of “solutions” that promise to simplify their lives. To create a better experience for their customers and employees. To help them grow. Software is a choice that can make or break a business. Create better or worse experiences. Propel or throttle growth. Business software has become a blocker instead of ways to get work done.

There’s another option. Freshworks. With a fresh vision for how the world works.

Freshworks Inc. builds uncomplicated service software that delivers exceptional employee and customer experiences. Our people-first approach to AI eliminates friction, helping businesses reduce complexity, lower cost-to-serve, and deliver faster, more human support through enterprise-grade yet easy-to-use CX and IT solutions. Nearly 75,000 companies, including Bridgestone, New Balance, Nucor, S&P Global, and Sony Music, trust Freshworks to power their Employee Experience (EX) and Customer Experience (CX) operations.

Fresh vision. Real impact. Come build it with us.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters. The annual base salary range for this position is $211,000 - $261,000. This role is also eligible for a target bonus. Compensation is based on a variety of factors, including but not limited to location, experience, job-related skills, and level.
Location & working pattern

San Mateo, United States

Additional Information Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters. The annual base salary range for this position is $211,000 - $261,000. This role is also eligible for a target bonus.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.