Pay
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Redmond, WA, US
Live, first seen by us 8 days ago#evals #LLM #coding #appliedscience Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-payRead the full posting
Employment type in the employer’s posting: FULL_TIMEFrom the employer’s posting
Design and run LLM evaluation frameworks across the product lifecycle, from prototyping to post-launch monitoring
Build evaluation methods for LLM, agentic, retrieval-augmented, and multimodal AI systems
Develop offline experimentation pipelines to compare models, prompts, and retrieval strategies
Define success metrics and quality bars for AI launches, including scorecards and regression testing
Mentor scientists and engineers and set cross-team best practices for AI development
Design and operationalize LLM evaluation frameworks across the product development lifecycle
Build evaluation methodologies for LLM-based, agentic, retrieval-augmented, and multimodal AI systems
Develop robust offline experimentation and evaluation pipelines to compare models, prompts, system designs, retrieval strategies
Establish quality bars and decision-making frameworks for AI launches, including evaluation scorecards, regression testing
Mentor scientists and engineers, raise the technical bar, and influence cross-team best practices for AI development
Hands-on experience with large language models, including prompt engineering, RAG, agents, tool use, model comparison, failure analysis, and evaluation-driven iteration.
Deep understanding of LLM evaluation throughout the development lifecycle, including dataset creation, annotation strategies, automated and human evaluation, benchmark design, regression testing, launch criteria, and production monitoring.
Experience designing offline experiments and interpreting results to inform model, system, and product decisions.
Experience evaluating multimodal AI systems or AI experiences involving multiple input/output modalities.
Qualifications Required Qualifications: - Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)- OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) - OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)
- Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics predictive analytics, research)- OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) - OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research) - OR equivalent experience.
Preferred Qualifications: - PhD in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) - OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research)
- PhD in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) - OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) - OR equivalent experience.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Day 8
Similar jobs usually come down between day 7 and day 76.
At Microsoft, jobs usually come down by about day 13.
From 6,250 similar postings that came down, and 208 of Microsoft’s. Coming down is not always a hire.
84 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume to compare the role’s scope, tools and requirements with your experience.
Complete your application on apply.careers.microsoft.com. The employer’s form will show what is required.
Already applied? Track this application
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
#evals #LLM #coding #appliedscience Applied Sciences IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Redmond, WA, US
Working pattern and location restrictions need checking in the full posting.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.