Back to jobs

Principal Manager, ML Solutions Architecture - Token Factory

Pay
USD 228,000–285,000/year · BaseAnnual period assumed — pay source
Base Compensation Range $228,000—$285,000 USD Benefits & Perks:
Read the full posting
Work setting
Remote — work setting source
Listed location: Remote - United States
Read the full posting
Employment
Not stated

What you’ll work on

Full posting
  • Manage four Solutions Architects: 1:1s, goals, reviews, promotions, growth plans

  • Review benchmarks, serving configs and closure documents before customers see them

  • Track PoC-to-endpoint time, success-criteria hit rate and post-production relationship quality

  • Maintain team documentation, runbooks and the ticket tracker as the system of record

  • Escalate platform blockers to development and product teams and call infeasible requirements early

From the employer’s posting
Manage a team of 4 Solutions Architects, with continued growth planned: 1:1s, goal setting, performance reviews, promotion cases, and individual growth plans
Review technical work before it reaches the customer: benchmarking methodology, serving configurations, results, closure documents
time from PoC kick-off to first optimized dedicated endpoint, success-criteria hit rate, and the quality of the technical relationship after the customer goes to production
Maintain and extend the team's documentation: responsibilities, runbooks, guides, onboarding, definitions of done, engagement closure templates
Call infeasibility early and with evidence, rather than letting the team burn iterations against requirements the platform cannot meet today

About Nebius

Nebius is leading a new era in cloud infrastructure for the global AI economy.

In the employer’s words · Read in context

Apply at Nebius

Posting record

Report an error

Open 3 monthsWe first saw this posting 94 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 19, 202694 days ago
Recorded sightings
159
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 94

Up longer than most. Similar jobs usually come down between day 1 and day 15.

At Nebius, jobs usually come down by about day 64.

From 1,371 similar postings that came down, and 61 of Nebius’s. Coming down is not always a hire.

Nebius is hiring

21 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Takes jobs down at a usual pace
  • 5% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SAS
  • AWS
  • Azure
  • Docker
  • GCP
  • Kubernetes
  • SageMaker
  • Transformers
Where the posting names them
- Enough technical judgment to review someone else's benchmark and find the flaw in the methodology, not just in the conclusion - Python strong enough to read and review your team's code - Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives, including in front of enterprise customers under pressure
Preferred technical stack: - Programming languages: Python - ML frameworks and libraries: vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs
This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack. Our Solutions Architects own the technical delivery of customer engagements: deploying open-source models, tuning the serving stack, benchmarking against the customer's success criteria, and carrying the technical relationship through to production. Sales Engineers qualify and scope the opportunity; SAs execute it. Technical Account Managers take it from production onward. We're looking for a Principal Manager, ML Solutions Architecture to lead our US regional SA teams. Your scope is PoC delivery and post-sales technical support: the people who do it, the standard they do it to, and the operating cadence that keeps it predictable. You will report to the Head of Solutions Architecture and partner with a peer manager in the other region.
- Onboard new joiners through to their first independently delivered engagement - Coach SAs into stronger engineers and stronger communicators, and make deliberate calls about who is ready for more scope Own delivery
- MLOps and DevOps tools: Kubernetes (K8s), Docker, Git - Cloud platforms: AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure (Azure ML) Pay Transparency
- Work with multimodal AI models (vision-language, speech) - Proficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code Preferred technical stack:
- ML frameworks and libraries: vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs - MLOps and DevOps tools: Kubernetes (K8s), Docker, Git - Cloud platforms: AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure (Azure ML)
- Programming languages: Python - ML frameworks and libraries: vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs - MLOps and DevOps tools: Kubernetes (K8s), Docker, Git

Your next step

Complete your application on careers.nebius.com. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Has Nebius posted this job before?

Yes. We’ve followed one other Principal Manager, ML Solutions Architecture - Token Factory job there since August 2026. It is still up.

  1. EuropeStill up after 94 days, first seen Aug 19
  2. This jobUp 94 days so far, first seen Aug 19

Job description

View original posting ↗

About Nebius:

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role

This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack.

Our Solutions Architects own the technical delivery of customer engagements: deploying open-source models, tuning the serving stack, benchmarking against the customer's success criteria, and carrying the technical relationship through to production. Sales Engineers qualify and scope the opportunity; SAs execute it. Technical Account Managers take it from production onward.

We're looking for a Principal Manager, ML Solutions Architecture to lead our US regional SA teams. Your scope is PoC delivery and post-sales technical support: the people who do it, the standard they do it to, and the operating cadence that keeps it predictable. You will report to the Head of Solutions Architecture and partner with a peer manager in the other region.

We expect you to push people when they need pushing, make the uncomfortable call when deliverables don't land even though the effort was real, and take ownership of the documentation work: implement and monitor the following of the guidelines, ticket hygiene, and making sure the team actually uses all three.

You're welcome to work remotely from the United States.

Your responsibilities will include: 

Lead the team

  • Manage a team of 4 Solutions Architects, with continued growth planned: 1:1s, goal setting, performance reviews, promotion cases, and individual growth plans
  • Build an accurate picture of each SA's strengths, gaps, and preferences, and allocate accounts and engagements against both expertise and interest
  • Run the cadence that surfaces blockers early, then take them to the development, product, and business teams that can clear them, and stay on them until they do
  • Hold people to outcomes: distinguish effort from delivered results, say so plainly when the two diverge, and reflect it in ratings and compensation decisions
  • Onboard new joiners through to their first independently delivered engagement
  • Coach SAs into stronger engineers and stronger communicators, and make deliberate calls about who is ready for more scope

Own delivery

  • Be accountable for your team's delivery outcomes: time from PoC kick-off to first optimized dedicated endpoint, success-criteria hit rate, and the quality of the technical relationship after the customer goes to production
  • Review technical work before it reaches the customer: benchmarking methodology, serving configurations, results, closure documents; catch the wrong conclusion drawn from a metrics artifact before a customer sees it
  • Ensure staffing and escalation coverage across accounts and timezones, including post-sales request load that does not respect sprint boundaries
  • Call infeasibility early and with evidence, rather than letting the team burn iterations against requirements the platform cannot meet today

Own the operating system of the team

  • Maintain and extend the team's documentation: responsibilities, runbooks, guides, onboarding, definitions of done, engagement closure templates. Keep it accurate and reachable; link, don't copy
  • Get it used, not just written: documentation nobody reads is a cost, not an asset
  • Keep the ticket tracker the system of record, so PoC and production status is readable without asking anyone
  • Instrument the work: define and report the metrics that show whether delivery is getting faster and more reliable over time

Work across teams

  • Development and research teams: convert recurring customer pain into prioritized platform work, and represent the customer's technical reality in roadmap discussions
  • Pre-sales: hold the scoping-to-execution boundary: push back on under-scoped engagements, and feed feasibility signal back upstream
  • Account management: make production handoffs uneventful, and keep post-sales technical requests moving
  • Business and leadership: give a straight read on account health, technical feasibility, and capacity needs

We expect you to have: 

  • 3+ years managing technical teams, including performance management and difficult conversations
  • Experience managing a customer-facing team. Running a team whose work is visible to customers, on customer timelines, with customer escalations.
  • Strong ML knowledge: LLM architectures, fine-tuning approaches (SFT/LoRA, RL-based), evaluation design, and a working command of inference internals — quantization, KV-cache management, batching, routing, speculative decoding — and of the frameworks the team works in (vLLM, SGLang, TensorRT-LLM)
  • Enough technical judgment to review someone else's benchmark and find the flaw in the methodology, not just in the conclusion
  • Python strong enough to read and review your team's code
  • Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives, including in front of enterprise customers under pressure
  • Genuine tolerance for operational work: documentation, process design, reporting, and the follow-through that makes them stick
  • Comfort operating with ambiguity across distributed teams and timezones, and a bias toward writing things down

It would be an added bonus if you have: 

  • References from both former managers and former direct reports
  • Experience scaling a team through rapid growth (5 → 15+) without losing delivery quality
  • Prior experience in a customer-facing technical function at a cloud, inference, or AI infrastructure provider
  • Experience defining process and documentation for a team that had none
  • Hands-on background running LLMs in production and debugging inference workloads at the framework level
  • Work with multimodal AI models (vision-language, speech)
  • Proficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code

Preferred technical stack:

  • Programming languages: Python
  • ML frameworks and libraries: vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs
  • MLOps and DevOps tools: Kubernetes (K8s), Docker, Git
  • Cloud platforms: AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure (Azure ML)

Pay Transparency

We offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.

Base Compensation Range
$228,000—$285,000 USD

Benefits & Perks:

  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

What's it like to work at Nebius:

Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI 

Equal Opportunity Statement:

Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.

Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire. 

If you need accommodations during the application process, please let us know.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Base Compensation Range $228,000—$285,000 USD Benefits & Perks:
Location & working pattern

Remote - United States

Working pattern and location restrictions need checking in the full posting.

Work authorization
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law. Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire. If you need accommodations during the application process, please let us know.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.