Back to jobs

Senior AI Product Engineer, Backend

Pay
$125,000–225,000/yearPlus equity — pay source
First-hand experience working with large language models (LLMs) or developing AI products. The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness. While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.
Read the full posting
Work setting
Remote — work setting source
Listed location: Remote (United States)
Read the full posting
Employment
Not stated

What you’ll work on

Full posting
  • Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.

  • Build high-volume and highly available analytics systems.

  • Design and build APIs specific to our customers’ Machine Learning and LLM workflows.

From the employer’s posting
What You’ll Do Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript. Build high-volume and highly available analytics systems.
Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript. Build high-volume and highly available analytics systems. Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
Build high-volume and highly available analytics systems. Design and build APIs specific to our customers’ Machine Learning and LLM workflows. Prototype, optimize, and maintain scalable backend services that power the Arize core platform.

Before you apply

Employer’s visa record
1 H-1B petition approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

About Arize AI

As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems.

In the employer’s words · Read in context

Apply at Arize AI

Posting record

Report an error

Open 7 monthsWe first saw this posting 238 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Mar 28, 2026238 days ago
Recorded sightings
248
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 238

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,371 similar postings that came down. Coming down is not always a hire.

Arize AI is hiring

5 open jobs

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • TypeScript
  • AWS
  • Azure
  • GCP
  • Kafka
  • Kubernetes
  • Go
Where the posting names them
The Opportunity Our Backend Engineering team builds all of the highly scalable distributed services that power Arize’s ML observability platform. While Go is our primary language for these distributed systems, the team also maintains services and tools written in Python, Java, and TypeScript. The expectation and scope of every individual on this team is high, whether it’s finding the most efficient way to compute model evaluation metrics across billions of data points, designing the next generation of our OLAP database architecture, or researching and implementing the latest dimensionality reduction techniques – you will never lack a technical challenge. You will be a part of the core team that drives product innovation at Arize. You will be challenged with understanding how some of the most impactful engineering teams are developing AI and LLM-powered applications, and how to build the right tools to enable them to do their best work. Our product solutions range from clean APIs that magically instrument applications, interactive playgrounds for prompt engineering and agent development, or scaling up real-time evaluation infrastructure to handle millions of annotations per second.
What You’ll Do - Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript. - Build high-volume and highly available analytics systems.
- 5+ years of experience working with high-performance backend systems. - Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages. - Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
- Previous work building and operating highly complex SaaS platforms/systems. - Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc. Bonus Points, But Not Required
Bonus Points, But Not Required - Experience with distributed stream processing - Kafka, Gazette, or similar. - Experience with OLAP systems.

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize unifies build, test, and run in a single workspace, so teams can ship faster with confidence.

Arize serves a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Our Backend Engineering team builds all of the highly scalable distributed services that power Arize’s ML observability platform. While Go is our primary language for these distributed systems, the team also maintains services and tools written in Python, Java, and TypeScript. The expectation and scope of every individual on this team is high, whether it’s finding the most efficient way to compute model evaluation metrics across billions of data points, designing the next generation of our OLAP database architecture, or researching and implementing the latest dimensionality reduction techniques – you will never lack a technical challenge.

You will be a part of the core team that drives product innovation at Arize. You will be challenged with understanding how some of the most impactful engineering teams are developing AI and LLM-powered applications, and how to build the right tools to enable them to do their best work. Our product solutions range from clean APIs that magically instrument applications, interactive playgrounds for prompt engineering and agent development, or scaling up real-time evaluation infrastructure to handle millions of annotations per second.

What You’ll Do

  • Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript.
  • Build high-volume and highly available analytics systems.
  • Design and build APIs specific to our customers’ Machine Learning and LLM workflows.
  • Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
  • Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks.
  • Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
  • Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
  • Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
  • Contribute to the build our own in-house AI Agents

What We’re Looking For

  • 5+ years of experience working with high-performance backend systems.
  • Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
  • Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies.
  • Previous work building and operating highly complex SaaS platforms/systems.
  • Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Bonus Points, But Not Required

  • Experience with distributed stream processing - Kafka, Gazette, or similar.
  • Experience with OLAP systems.
  • Familiarity with system observability tooling like Prometheus.
  • Working knowledge of Machine Learning and/or Data Science.
  • First-hand experience working with large language models (LLMs) or developing AI products.

The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
First-hand experience working with large language models (LLMs) or developing AI products. The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness. While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.
Location & working pattern

Remote (United States)

The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package. Actual compensation is determined based on a variety of job-related factors that may include transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness. While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces. More About Arize
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.