Back to jobs

Principal AI Solution Engineer

Pay
Pay not listed
Work setting
Remote — work setting source
Work setup in the employer’s posting: TELECOMMUTE
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting
  • You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform.

From the employer’s posting
We are seeking a Principal AI Solution Engineer to join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform. Responsibilities Set architecture for systems that span squads; write the decision down and defend it Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify Own the reference RAG and agent architecture other teams build against Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind Requirements 5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms At least 1 year of relevant leadership experience Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM Familiarity with Kubernetes on Azure Skills in at least one infrastructure language: Go, Rust, Java or Kotlin Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration Excellent command of written and spoken English (B2+ level) Nice to have Showcase of pgvector or Qdrant at production scale Experience with Arabic-language, voice or conversational AI Background in AI or mission-critical delivery in regulated environments such as government, defence or financial services Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI Understanding of Langfuse, Grafana, Prometheus and Terraform
Apply at EPAM Systems

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 1, 202620 days ago
Recorded sightings
21
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 20

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,376 similar postings that came down. Coming down is not always a hire.

EPAM Systems is hiring

892 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Kotlin
  • Python
  • Rust
  • Azure
  • Grafana
  • Kubernetes
  • PostgreSQL
  • Terraform
  • FastAPI
  • Go
Where the posting names them
We are seeking a Principal AI Solution Engineer to join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform. Responsibilities Set architecture for systems that span squads; write the decision down and defend it Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify Own the reference RAG and agent architecture other teams build against Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind Requirements 5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms At least 1 year of relevant leadership experience Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM Familiarity with Kubernetes on Azure Skills in at least one infrastructure language: Go, Rust, Java or Kotlin Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration Excellent command of written and spoken English (B2+ level) Nice to have Showcase of pgvector or Qdrant at production scale Experience with Arabic-language, voice or conversational AI Background in AI or mission-critical delivery in regulated environments such as government, defence or financial services Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI Understanding of Langfuse, Grafana, Prometheus and Terraform

Your next step

Complete your application on careers.epam.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

We are seeking a Principal AI Solution Engineer to join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform. Responsibilities Set architecture for systems that span squads; write the decision down and defend it Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify Own the reference RAG and agent architecture other teams build against Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind Requirements 5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms At least 1 year of relevant leadership experience Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM Familiarity with Kubernetes on Azure Skills in at least one infrastructure language: Go, Rust, Java or Kotlin Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration Excellent command of written and spoken English (B2+ level) Nice to have Showcase of pgvector or Qdrant at production scale Experience with Arabic-language, voice or conversational AI Background in AI or mission-critical delivery in regulated environments such as government, defence or financial services Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI Understanding of Langfuse, Grafana, Prometheus and Terraform

About EPAM Systems

People
About 3,012 in 2024.Benefit plan filings (Form 5500)
Company
Listed as EPAM.
H-1B visas
21 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Location not supplied.

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.