Back to jobs

Senior AI Engineer - Conversational AI & Semantic Search (Databricks / LangChain)

Pay
Pay not listed
Work setting
Remote — work setting source
Work setup in the employer’s posting: TELECOMMUTE
From the employer’s posting
Employment
Not stated

Tools in this posting

  • Python
  • Azure
  • Databricks
  • Delta Lake
  • MLflow
  • FastAPI
  • Flask
Source — Tool mentions in context
We are looking for a Senior AI Engineer to architect, develop, and launch an AI-driven chatbot/agent on Databricks, following a design similar to an existing internal tool (LangGraph/LangChain orchestration combined with vector database semantic search), but tailored to a new business scenario. The right candidate will be able to operate autonomously, infer and adapt concepts from previous builds, and take full ownership of the project from initial prototype to full production release. Responsibilities Architect and develop a conversational AI/agentic application leveraging LangChain and/or LangGraph, hosted on Databricks Build semantic search and retrieval-augmented generation (RAG) pipelines using vector embeddings paired with a vector database (such as Databricks Vector Search, Chroma, Pinecone, or FAISS) Establish and refine similarity-matching logic, including embedding model selection, distance metrics, thresholds, and ranking of "% match" results Connect to various data sources (Databricks Unity Catalog tables, Delta Lake, APIs) to build and prepare the knowledge base/corpus Manage the complete ML/LLMOps lifecycle, covering experimentation, evaluation, versioning, deployment, and production monitoring of the chatbot Partner with business stakeholders to convert new use cases into clear technical specifications Produce clean, well-documented, maintainable Python code while setting up testing and CI/CD workflows for the application Guarantee proper data privacy practices, access control, and cost oversight (covering token usage and compute resources) Requirements A minimum of 3 years in software/ML engineering, including at least 1 year working with LLM-based applications Strong Python skills, covering the ability to build, debug, and refactor production-level code Deep knowledge of LLM orchestration frameworks like LangChain and/or LangGraph, encompassing agent design, chains, tool calling, and state/memory handling Hands-on experience with vector databases, embeddings, and semantic search, including generating embeddings, indexing within a vector store, and building similarity search or RAG retrieval systems Working knowledge of the Databricks platform, including notebooks, jobs, clusters, and Unity Catalog Practical experience integrating and prompt-engineering with LLM providers such as OpenAI, Anthropic, and Azure OpenAI A Bachelor's degree in Computer Science, Data Science, Engineering, or a related discipline (or equivalent hands-on experience) Excellent communication abilities, capable of navigating ambiguous requirements with minimal documentation support English language skills at B2 level or above Nice to have Exposure to MLOps/LLMOps tools such as MLflow, along with model/prompt versioning and LLM output evaluation frameworks Experience in API/backend development using frameworks like FastAPI or Flask to deploy the chatbot as a service Understanding of front-end/chat interface integration, connecting a backend agent to a chat UI
Check the employer’s page ↗

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 1, 202620 days ago
Recorded sightings
21
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 20

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,371 similar postings that came down. Coming down is not always a hire.

EPAM Systems is hiring

892 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

Your next step

Check the employer’s posting for the current role and application details.

Already applied? Track this application

Has EPAM Systems posted this job before?

Yes. We’ve followed one other Senior AI Engineer - Conversational AI & Semantic Search (Databricks / LangChain) job there since November 2026. It is still up.

  1. Place not statedStill up after 21 days, first seen Nov 1
  2. This jobUp 21 days so far, first seen Nov 1

Job description

View original posting ↗

We are looking for a Senior AI Engineer to architect, develop, and launch an AI-driven chatbot/agent on Databricks, following a design similar to an existing internal tool (LangGraph/LangChain orchestration combined with vector database semantic search), but tailored to a new business scenario. The right candidate will be able to operate autonomously, infer and adapt concepts from previous builds, and take full ownership of the project from initial prototype to full production release. Responsibilities Architect and develop a conversational AI/agentic application leveraging LangChain and/or LangGraph, hosted on Databricks Build semantic search and retrieval-augmented generation (RAG) pipelines using vector embeddings paired with a vector database (such as Databricks Vector Search, Chroma, Pinecone, or FAISS) Establish and refine similarity-matching logic, including embedding model selection, distance metrics, thresholds, and ranking of "% match" results Connect to various data sources (Databricks Unity Catalog tables, Delta Lake, APIs) to build and prepare the knowledge base/corpus Manage the complete ML/LLMOps lifecycle, covering experimentation, evaluation, versioning, deployment, and production monitoring of the chatbot Partner with business stakeholders to convert new use cases into clear technical specifications Produce clean, well-documented, maintainable Python code while setting up testing and CI/CD workflows for the application Guarantee proper data privacy practices, access control, and cost oversight (covering token usage and compute resources) Requirements A minimum of 3 years in software/ML engineering, including at least 1 year working with LLM-based applications Strong Python skills, covering the ability to build, debug, and refactor production-level code Deep knowledge of LLM orchestration frameworks like LangChain and/or LangGraph, encompassing agent design, chains, tool calling, and state/memory handling Hands-on experience with vector databases, embeddings, and semantic search, including generating embeddings, indexing within a vector store, and building similarity search or RAG retrieval systems Working knowledge of the Databricks platform, including notebooks, jobs, clusters, and Unity Catalog Practical experience integrating and prompt-engineering with LLM providers such as OpenAI, Anthropic, and Azure OpenAI A Bachelor's degree in Computer Science, Data Science, Engineering, or a related discipline (or equivalent hands-on experience) Excellent communication abilities, capable of navigating ambiguous requirements with minimal documentation support English language skills at B2 level or above Nice to have Exposure to MLOps/LLMOps tools such as MLflow, along with model/prompt versioning and LLM output evaluation frameworks Experience in API/backend development using frameworks like FastAPI or Flask to deploy the chatbot as a service Understanding of front-end/chat interface integration, connecting a backend agent to a chat UI

About EPAM Systems

People
About 3,012 in 2024.Benefit plan filings (Form 5500)
Company
Listed as EPAM.
H-1B visas
21 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Location not supplied.

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

AI answers unavailable

We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting