Pay
In line with similar jobs
$200K–$260K against $166K–$237K, the middle half of what similar US postings state.
From 1,505 postings in the last year. Stated ranges, not salaries paid.
Reads like an ML Engineer role: training models and running them in production.
Palo Alto, CA
Live, first seen by us 30 days agoWe’re playing offense to win! Our product market fit and our world-class employees make us the leader in our space. We’re building something cool and people like it here. The base salary range for this position is $200,000-$260,000/year. Final compensation will be determined based on factors including experience and qualifications. Vantaca offers comprehensive benefits including medical, dental, and vision insurance through Blue Cross Blue Shield of North Carolina and Principal; Health Savings and Flexible Spending Accounts; a 401(k) plan with company match (up to 3% after one year, with Vantaca covering all administrative fees); and at no cost to you: life and short term disability insurance, telemedicine through Teladoc, and an Employee Assistance Program providing 24/7 access to counseling, financial planning, legal services, and family support resources. We receive many resumes for our open positions and each one is reviewed by a human being on our recruiting team. We will compare your background with the qualifications and requirements for the position.Read the full posting
Work setup in the employer’s posting: HybridFrom the employer’s posting
Employment type in the employer’s posting: FULL_TIMEFrom the employer’s posting
We run millions of AI tasks in production and are hiring a Senior AI Engineer, Evaluation & Optimization to own the systems, experiments, and feedback loops that determine how those tasks use AI models.
AI models are improving rapidly, but model capability alone does not determine production performance.
You will build evaluation and observability infrastructure, benchmark models and configurations, analyze production behavior, and translate findings into production improvements.
We run millions of AI tasks in production and are hiring a Senior AI Engineer, Evaluation & Optimization to own the systems, experiments, and feedback loops that determine how those tasks use AI models.
AI models are improving rapidly, but model capability alone does not determine production performance. Model choice, prompts, context, tool use, routing, retries, and execution design all affect whether a task succeeds and what that success costs.
AI models are improving rapidly, but model capability alone does not determine production performance. Model choice, prompts, context, tool use, routing, retries, and execution design all affect whether a task succeeds and what that success costs. Your mandate is to maximize successful task completion per dollar while meeting our quality, reliability, and latency requirements. You will build evaluation and observability infrastructure, benchmark models and configurations, analyze production behavior, and translate findings into production improvements. You will also design optimization loops that search for better prompts, model configurations, routing policies, agent strategies, and execution plans. This is an engineering-heavy, highly empirical role. You will work across model providers, prompts, agent architectures, routing strategies, production traces, and optimization systems to determine what works at scale for our workloads. TypeScript is the primary implementation language.
Experience building production systems that use LLMs or other machine-learning models.
Experience operating high-volume or high-reliability services.
Experience designing and running rigorous model evaluations.
Strong understanding of modern LLM APIs and model behavior.
Experience working with production traces, datasets, and experimentation infrastructure.
Ability to reason quantitatively about quality, latency, reliability, and cost.
Experience in one or more of the following areas is helpful:
Experience with CUDA, GPU kernels, vLLM, TensorRT-LLM, or low-level inference optimization is useful but not required.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
In line with similar jobs
$200K–$260K against $166K–$237K, the middle half of what similar US postings state.
From 1,505 postings in the last year. Stated ranges, not salaries paid.
Day 30
Similar jobs usually come down between day 7 and day 76.
From 5,756 similar postings that came down. Coming down is not always a hire.
2 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Ability to keep systems reliable while their prompts, models, or execution policies change continuously. - Python experience is useful for analysis and evaluation tooling, but TypeScript is the primary language for production systems in this role. Preferred Experience
- Ability to reason quantitatively about quality, latency, reliability, and cost. - Strong SQL and data-analysis skills. - Experience designing controlled experiments and interpreting noisy results.
Your mandate is to maximize successful task completion per dollar while meeting our quality, reliability, and latency requirements. You will build evaluation and observability infrastructure, benchmark models and configurations, analyze production behavior, and translate findings into production improvements. You will also design optimization loops that search for better prompts, model configurations, routing policies, agent strategies, and execution plans. This is an engineering-heavy, highly empirical role. You will work across model providers, prompts, agent architectures, routing strategies, production traces, and optimization systems to determine what works at scale for our workloads. TypeScript is the primary implementation language. What You Will Own
- Build the infrastructure required to measure, operate, and improve millions of AI tasks reliably. - Build TypeScript services and libraries for model execution, routing, retries, fallbacks, and structured outputs. - Instrument AI workflows for quality, latency, reliability, token usage, and cost.
Requirements - Strong software engineering skills in TypeScript and Node.js. - Experience building production systems that use LLMs or other machine-learning models.
Complete your application on jobs.gem.com. The employer’s form will show what is required.
Already applied? Track this application
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
We’re playing offense to win! Our product market fit and our world-class employees make us the leader in our space. We’re building something cool and people like it here. The base salary range for this position is $200,000-$260,000/year. Final compensation will be determined based on factors including experience and qualifications. Vantaca offers comprehensive benefits including medical, dental, and vision insurance through Blue Cross Blue Shield of North Carolina and Principal; Health Savings and Flexible Spending Accounts; a 401(k) plan with company match (up to 3% after one year, with Vantaca covering all administrative fees); and at no cost to you: life and short term disability insurance, telemedicine through Teladoc, and an Employee Assistance Program providing 24/7 access to counseling, financial planning, legal services, and family support resources. We receive many resumes for our open positions and each one is reviewed by a human being on our recruiting team. We will compare your background with the qualifications and requirements for the position.
Palo Alto, CA
- 401K with Company Match. - Remote Flexible - come to the office when needed. - Great parental leave benefits.
No clear work-authorization passage found. Eligibility is unconfirmed.