Back to jobs

Senior Principal AI Engineer

Reads like an ML Engineer role: training models and running them in production.

Pay
$229,800–298,700/year · BaseAnnual period assumed. Location-specific pay — pay source
Pay Transparency Statement: US Base Salary Range: $229,800.00 - $298,700.00 Base pay offered to new hires may vary based upon factors including relevant industry and job-related skills and experience, geographic location, and business needs.* The range displayed does not encompass the full potential of the role, which allows for further growth and career progression.
Read the full posting
Work setting
Remote — work setting source
Listed location: Remote USA
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Design retrieval/RAG systems end to end — chunking strategies, embeddings, vector stores, hybrid search, re-ranking, context assembly, and memory.

  • Drive build-versus-buy, model and vendor selection, and long-term architectural bets, anticipating where the field is heading and preparing the organization to adopt it.

  • Optimize the performance, cost (token and inference economics), scalability, and reliability of AI workloads in partnership with Security, Cloud Platform, and SRE teams.

From the employer’s posting
Architect the orchestration and abstraction layers of the central AI system that connect LLMs to tools, data, and sub-agents, and set standards for MCP servers, tool-surface design (optimal number of tools exposed per LLM and APIs per server), and when to use specialized sub-agents versus direct tool exposure. Design retrieval/RAG systems end to end — chunking strategies, embeddings, vector stores, hybrid search, re-ranking, context assembly, and memory. Own the enterprise evaluation, observability, and safety strategy for AI systems, including offline and online evaluation, tracing, red-teaming, guardrails, and responsible-AI and compliance requirements.
Own the enterprise evaluation, observability, and safety strategy for AI systems, including offline and online evaluation, tracing, red-teaming, guardrails, and responsible-AI and compliance requirements. Drive build-versus-buy, model and vendor selection, and long-term architectural bets, anticipating where the field is heading and preparing the organization to adopt it. Optimize the performance, cost (token and inference economics), scalability, and reliability of AI workloads in partnership with Security, Cloud Platform, and SRE teams.
Drive build-versus-buy, model and vendor selection, and long-term architectural bets, anticipating where the field is heading and preparing the organization to adopt it. Optimize the performance, cost (token and inference economics), scalability, and reliability of AI workloads in partnership with Security, Cloud Platform, and SRE teams. Multiply the organization: mentor and grow Principal and Staff engineers and raise the AI engineering bar.

Before you apply

Employer’s visa record
40 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • 15+ years in AI/ML software engineering with demonstrated Senior Principal-level (or equivalent) impact delivering production AI at enterprise scale.
  • Deep expertise in distributed systems, cloud-native architecture, and large-scale data and feature pipelines.
  • Proven ability to design developer platforms, APIs, reusable SDKs, MCP servers, and multi-agent orchestrations that many teams depend on.
  • Expertise with cloud platforms (Azure strongly preferred) and a track record of optimizing AI workload cost, performance, scalability, and reliability.
  • Demonstrated ability to set technical strategy and influence decisions across many teams without direct authority, and to mentor Principal- and Staff-level engineers.
  • Experience operating in regulated SaaS environments and meeting security and compliance requirements.

Preferred experience

  • Bachelor's degree in Computer Science, Engineering, or a related discipline; advanced degree preferred.
  • Experience with vector databases and retrieval optimization at scale.
Qualification wording
15+ years in AI/ML software engineering with demonstrated Senior Principal-level (or equivalent) impact delivering production AI at enterprise scale.
Deep expertise in distributed systems, cloud-native architecture, and large-scale data and feature pipelines.
Proven ability to design developer platforms, APIs, reusable SDKs, MCP servers, and multi-agent orchestrations that many teams depend on.
Expertise with cloud platforms (Azure strongly preferred) and a track record of optimizing AI workload cost, performance, scalability, and reliability.
Demonstrated ability to set technical strategy and influence decisions across many teams without direct authority, and to mentor Principal- and Staff-level engineers.
Experience operating in regulated SaaS environments and meeting security and compliance requirements.
Bachelor's degree in Computer Science, Engineering, or a related discipline; advanced degree preferred. An equivalent combination of education, training, and relevant professional experience is accepted in lieu of a formal degree.
Experience with vector databases and retrieval optimization at scale.
Apply at Vertex

Posting record

Report an error

Open 4 monthsWe first saw this posting 127 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jul 17, 2026127 days ago
Recorded sightings
65
Last seen by us
Nov 16, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$230K–$299K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 127

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,389 similar postings that came down. Coming down is not always a hire.

Vertex is hiring

4 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Azure
Where the posting names them
- Rigorous, demonstrated approach to AI evaluation, observability and tracing, and responsible-AI guardrails. - Expertise with cloud platforms (Azure strongly preferred) and a track record of optimizing AI workload cost, performance, scalability, and reliability. - Demonstrated ability to set technical strategy and influence decisions across many teams without direct authority, and to mentor Principal- and Staff-level engineers.

Your next step

Complete your application on vertexinc.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

Job Description:

This position is a senior-level role responsible for leading the design, implementation, and maintenance of scalable, secure, and high-performance software systems across multiple projects. The position emphasizes architectural leadership, technical mentorship, and strategic collaboration to drive innovation, ensure consistency, and align solutions with organizational goals

 

Job Description:

  • Serve as the most senior individual-contributor engineer and principal technical authority within the Commercial AI Center of Excellence (CAI CoE), owning the technical vision for AI-as-a-Service (AIaaS) enablement at enterprise scale. 
  • Operate as a full-spectrum AI engineer fluent across the entire lifecycle — data, model training and fine-tuning, retrieval, orchestration, evaluation, and production operations — able to go as deep as any specialist and to compose the pieces into coherent, production-grade systems. 
  • This role requires both traditional AI/ML, GenAI product engineering, and traditional software architecture skillsets. 
  • Establish reference architectures, paved-road patterns, and enterprise technical standards for agentic orchestration, tool and MCP design, retrieval, model training, and responsible AI across production systems. 
  • Lead the most complex, ambiguous, cross-team initiatives spanning multiple value streams, and review and influence AI designs across product teams to ensure alignment with enterprise standards. 
  • Set long-term technical direction while remaining deeply hands-on with the most critical AI infrastructure and services. 

 

Key Responsibilities 

  • Set the multi-year technical vision, reference architectures, and enterprise standards for AIaaS across PDD, and act as the final technical authority and escalation point for the organization's hardest AI problems. 
  • Define and own the enterprise model-training strategy across traditional AI/ML and LLMs, and personally train, fine-tune (e.g., QLoRA, LoRA, PEFT, and full fine-tuning), and evaluate models when the problem demands it. 
  • Establish standards for how and where training data from Commercial AI products is sourced, cleaned, versioned, stored, and governed (lineage, licensing/consent, and PII), and architect the large-scale data and feature pipelines behind them. 
  • Architect the orchestration and abstraction layers of the central AI system that connect LLMs to tools, data, and sub-agents, and set standards for MCP servers, tool-surface design (optimal number of tools exposed per LLM and APIs per server), and when to use specialized sub-agents versus direct tool exposure. 
  • Design retrieval/RAG systems end to end — chunking strategies, embeddings, vector stores, hybrid search, re-ranking, context assembly, and memory. 
  • Own the enterprise evaluation, observability, and safety strategy for AI systems, including offline and online evaluation, tracing, red-teaming, guardrails, and responsible-AI and compliance requirements. 
  • Drive build-versus-buy, model and vendor selection, and long-term architectural bets, anticipating where the field is heading and preparing the organization to adopt it. 
  • Optimize the performance, cost (token and inference economics), scalability, and reliability of AI workloads in partnership with Security, Cloud Platform, and SRE teams. 
  • Multiply the organization: mentor and grow Principal and Staff engineers and raise the AI engineering bar. 

 

Required Qualifications 

  • 15+ years in AI/ML software engineering with demonstrated Senior Principal-level (or equivalent) impact delivering production AI at enterprise scale. 
  • Full-lifecycle, hands-on mastery across both specialist domains: (a) training and fine-tuning traditional AI/ML models and LLMs — including parameter-efficient methods (QLoRA/LoRA/PEFT), quantization, distributed training, and rigorous evaluation; and (b) LLM orchestration, agentic systems, tool/MCP design, and retrieval/RAG in production. 
  • Deep expertise in distributed systems, cloud-native architecture, and large-scale data and feature pipelines. 
  • Strong command of data management and governance: dataset storage architecture, versioning, lineage, quality, PII handling, and licensing/consent for training data. 
  • Proven ability to design developer platforms, APIs, reusable SDKs, MCP servers, and multi-agent orchestrations that many teams depend on. 
  • Rigorous, demonstrated approach to AI evaluation, observability and tracing, and responsible-AI guardrails. 
  • Expertise with cloud platforms (Azure strongly preferred) and a track record of optimizing AI workload cost, performance, scalability, and reliability. 
  • Demonstrated ability to set technical strategy and influence decisions across many teams without direct authority, and to mentor Principal- and Staff-level engineers. 
  • Experience operating in regulated SaaS environments and meeting security and compliance requirements. 

 

Preferred Qualifications 

  • Bachelor's degree in Computer Science, Engineering, or a related discipline; advanced degree preferred. An equivalent combination of education, training, and relevant professional experience is accepted in lieu of a formal degree. 
  • Industry experience in tax or other regulated domains (insurance, fintech, or healthcare). 
  • Experience with vector databases and retrieval optimization at scale. 
  • FinOps for GenAI: experience modeling and optimizing LLM token and inference costs. 
  • Data science or classical AI background beyond prompt engineering (statistics, feature engineering, and model evaluation). 
  • Contributions to open-source AI tooling, published research, patents, or recognized technical thought leadership. 
  • Strong executive communication and technical storytelling skills. 

 

Disclaimer:

The above statements describe the general nature and level of work performed in this role. Other duties may be assigned.


COMMENTS:

The above statements are intended to describe the general nature and level of work being performed by individuals in this position. Other functions may be assigned, and management retains the right to add or change the duties at any time.



Vertex Values: Together We Win

We're building a team of people who are passionate about making an impact for our customers and committed to how that impact is achieved. Our values define the behaviors, mindset, and culture that make Vertex a great place to grow and do meaningful work.


Play to Win or We Don't Play — If we choose to do something, we're choosing to do it because we plan to win. That mindset raises our bar on product quality, customer outcomes, and how we show up for one another.


Work As a Team, Putting the Customer At the Core — Our customers are our true north. Whatever your role, ask: how will this help a customer succeed today? We earn trust through outcomes, not promises.


Achieve Excellence With Integrity, Speed, and Agility — The market isn't slowing down. We'll move faster, adapt quickly, and never compromise on doing things the right way — for teammates, customers, and partners.


Innovate Boldly With a Growth Mindset — Progress demands smart risk. We'll try new approaches, learn fast, and keep pushing the boundaries — especially where AI can remove friction and unlock value.


Communicate with Care, Candor and Transparency — Honest, constructive conversations make us better. Let's speak plainly about what's working and what isn't and help each other improve.

Pay Transparency Statement:

US Base Salary Range: $229,800.00 - $298,700.00

Base pay offered to new hires may vary based upon factors including relevant industry and job-related skills and experience, geographic location, and business needs.* The range displayed does not encompass the full potential of the role, which allows for further growth and career progression.

In addition, as a part of our total compensation package, this role may be eligible for the Vertex Bonus Plan (VOB), a role-specific sales commission/bonus, and/or equity grants.

Learn more about Life at Vertex and connect with your recruiter for more details regarding Vertex's compensation and benefit programs.

*In no case will your pay fall below applicable local minimum wage requirements.

About Vertex

People
About 2,100 in 2025, up 11% from the year before.Annual report (SEC Form 10-K)
Company
Listed as VERX.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Pay Transparency Statement: US Base Salary Range: $229,800.00 - $298,700.00 Base pay offered to new hires may vary based upon factors including relevant industry and job-related skills and experience, geographic location, and business needs.* The range displayed does not encompass the full potential of the role, which allows for further growth and career progression.
Location & working pattern

Remote USA

- Architect the orchestration and abstraction layers of the central AI system that connect LLMs to tools, data, and sub-agents, and set standards for MCP servers, tool-surface design (optimal number of tools exposed per LLM and APIs per server), and when to use specialized sub-agents versus direct tool exposure. - Design retrieval/RAG systems end to end — chunking strategies, embeddings, vector stores, hybrid search, re-ranking, context assembly, and memory. - Own the enterprise evaluation, observability, and safety strategy for AI systems, including offline and online evaluation, tracing, red-teaming, guardrails, and responsible-AI and compliance requirements.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.