Back to jobs

Principal Applied AI Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll bring

All qualifications

Preferred experience

  • Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field.
  • Experience architecting and shipping multi-agent orchestration systems or agentic AI services in production.
  • Experience with AI evaluation systems, including rubrics, golden datasets, judge models, simulation, adversarial testing, and offline and online evaluation.
  • Experience with Azure AI Foundry, Azure OpenAI, Microsoft Agent Framework, or similar enterprise AI platforms.
Qualification wording
Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field.
Experience architecting and shipping multi-agent orchestration systems or agentic AI services in production.
Experience with AI evaluation systems, including rubrics, golden datasets, judge models, simulation, adversarial testing, and offline and online evaluation.
Experience with Azure AI Foundry, Azure OpenAI, Microsoft Agent Framework, or similar enterprise AI platforms.
Education & alternatives
Qualifications Basic Qualifications • Bachelor's degree in Computer Science, Engineering, or a related technical field. • 12+ years of professional software engineering experience designing, building, and operating production software systems.
Preferred Qualifications • Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field. • Experience architecting and shipping multi-agent orchestration systems or agentic AI services in production.
Apply at Microsoft

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 19, 202633 days ago
Recorded sightings
93
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 33

Up longer than most. Similar jobs usually come down between day 1 and day 15.

Well past Microsoft’s usual: its jobs come down by about day 13.

From 1,376 similar postings that came down, and 244 of Microsoft’s. Coming down is not always a hire.

Microsoft is hiring

75 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • AI Engineer hiring is picking up
  • Takes jobs down at a usual pace
  • 9% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C#
  • Python
  • Azure
Where the posting names them
Responsibilities • Architect and build production agentic AI systems: Design and implement scalable AI agents and services, including LLM orchestration, multi-agent workflows, RAG pipelines, tool integrations, memory and state management, and human-in-the-loop experiences. Lead through hands-on engineering: Write, review, and maintain production-quality C# and Python code. Build critical components, reference implementations, prototypes, and reusable platform capabilities that accelerate delivery across the engineering organization. • Own end-to-end technical delivery: Translate ambiguous customer support scenarios into clear technical requirements and take solutions from architecture and experimentation through implementation, deployment, operation, and continuous improvement.
• 12+ years of professional software engineering experience designing, building, and operating production software systems. • Proficiency in C# and/or Python, with demonstrated ability to design and implement production-quality services and distributed systems. • Experience serving as a technical architect or technical lead for complex, cross-team engineering initiatives.
Overview Are you a customer-obsessed software engineer and technical architect who is passionate about applying AI to complex, real-world problems? The Engineering Operations (EngOps) team's mission is to transform Microsoft Cloud customers into fans. Through our deep engineering engagements with customers and teams across Microsoft, we analyze and amplify customer needs and drive the vision to improve cloud quality, security, and reliability. Our culture of growth mindset and empowerment is central to who we are and how we work. Our ACES CODE engineering team is building domain-specific agents and services that are fundamentally transforming Azure customer support, moving from reactive, human-only workflows to AI-first systems that resolve customer issues at Azure scale. We are seeking a Principal Applied AI Engineer to serve as a hands-on technical architect and developer for production agentic AI services. You will define and implement the architecture for next-generation AI agents, including LLM orchestration, multi-agent coordination, retrieval-augmented generation (RAG), tool integration, and evaluation systems. You will write production code, lead complex technical initiatives, establish engineering standards, and guide engineers across organizational boundaries through technical influence rather than people management.
• Make consequential technical decisions: Evaluate models, frameworks, platforms, and architectural approaches using evidence from experiments and production telemetry. Balance solution quality with reliability, maintainability, latency, cost, and operational complexity. • Influence product and platform roadmaps: Partner with product managers, researchers, platform engineers, and Azure service teams to shape technical strategy and platform capabilities. Translate customer support patterns and operational signals into durable engineering investments. • Drive measurable customer and business impact: Instrument systems and use data to improve automation accuracy, case volume reduction, resolution time, engineering efficiency, and customer satisfaction. Connect architectural investments to measurable outcomes.
• Experience with applied AI systems, including LLM-based applications, prompt engineering, RAG architectures, agent frameworks, or machine learning services. • Experience with cloud platforms, preferably Azure, and cloud-native engineering practices including microservices, APIs, containers, CI/CD, infrastructure as code, and observability. • Demonstrated success owning the full engineering lifecycle, from problem definition and architecture through implementation, deployment, and production operations.
• Experience with AI evaluation systems, including rubrics, golden datasets, judge models, simulation, adversarial testing, and offline and online evaluation. • Experience with Azure AI Foundry, Azure OpenAI, Microsoft Agent Framework, or similar enterprise AI platforms. • Deep knowledge of RAG design, including indexing, retrieval, ranking, grounding, citation, knowledge freshness, and access control.

Your next step

Complete your application on apply.careers.microsoft.com. The employer’s form will show what is required.

Applying through Eightfold

  • You sign in, with Microsoft, LinkedIn, Google, Facebook or a new account, before the application opens.

Already applied? Track this application

Job description

View original posting ↗

Overview
Are you a customer-obsessed software engineer and technical architect who is passionate about applying AI to complex, real-world problems? The Engineering Operations (EngOps) team's mission is to transform Microsoft Cloud customers into fans. Through our deep engineering engagements with customers and teams across Microsoft, we analyze and amplify customer needs and drive the vision to improve cloud quality, security, and reliability. Our culture of growth mindset and empowerment is central to who we are and how we work.
 
Our ACES CODE engineering team is building domain-specific agents and services that are fundamentally transforming Azure customer support, moving from reactive, human-only workflows to AI-first systems that resolve customer issues at Azure scale. We are seeking a Principal Applied AI Engineer to serve as a hands-on technical architect and developer for production agentic AI services.
 
You will define and implement the architecture for next-generation AI agents, including LLM orchestration, multi-agent coordination, retrieval-augmented generation (RAG), tool integration, and evaluation systems. You will write production code, lead complex technical initiatives, establish engineering standards, and guide engineers across organizational boundaries through technical influence rather than people management.
This is a deeply technical individual contributor role with broad architectural scope and direct accountability for production outcomes. You will turn ambiguous customer and business problems into scalable systems, make critical design decisions, build foundational components, and help teams ship secure and reliable AI services that handle thousands of customer cases per month.
Every day, our customers stake their business and reputation on our cloud. You can help EngOps ACES provide our customers with the world-class cloud services they need to succeed.
Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
 


Responsibilities

• Architect and build production agentic AI systems: Design and implement scalable AI agents and services, including LLM orchestration, multi-agent workflows, RAG pipelines, tool integrations, memory and state management, and human-in-the-loop experiences.

Lead through hands-on engineering: Write, review, and maintain production-quality C# and Python code. Build critical components, reference implementations, prototypes, and reusable platform capabilities that accelerate delivery across the engineering organization.

• Own end-to-end technical delivery: Translate ambiguous customer support scenarios into clear technical requirements and take solutions from architecture and experimentation through implementation, deployment, operation, and continuous improvement.

• Define technical architecture and engineering standards: Establish architecture patterns, API and data contracts, code quality expectations, evaluation practices, deployment strategies, and observability standards for AI services. Drive technical consistency while allowing teams to evolve their solutions.

• Advance evaluation-driven AI development: Design and implement evaluation frameworks using rubrics, golden datasets, simulation, judge models, and offline and online evaluation. Define quality thresholds and graduation criteria for moving agents from experimentation through shadow mode and into autonomous operation.

• Own production quality and reliability: Ensure AI services meet demanding standards for correctness, availability, latency, scalability, cost, and safety. Diagnose complex production issues, lead technical incident response and root cause analysis, and engineer systemic improvements.

• Design for responsible and secure AI: Embed responsible AI principles, privacy protections, prompt-injection defenses, tool authorization, data boundaries, action controls, auditability, and fail-safe behavior into system architecture and implementation.

• Make consequential technical decisions: Evaluate models, frameworks, platforms, and architectural approaches using evidence from experiments and production telemetry. Balance solution quality with reliability, maintainability, latency, cost, and operational complexity.

• Influence product and platform roadmaps: Partner with product managers, researchers, platform engineers, and Azure service teams to shape technical strategy and platform capabilities. Translate customer support patterns and operational signals into durable engineering investments.

• Drive measurable customer and business impact: Instrument systems and use data to improve automation accuracy, case volume reduction, resolution time, engineering efficiency, and customer satisfaction. Connect architectural investments to measurable outcomes.

• Provide technical leadership across teams: Lead architecture reviews, resolve complex technical disagreements, and align engineers and partner organizations around shared designs. Communicate clearly with engineering teams, leaders, and non-technical stakeholders.

• Raise the engineering capability of the organization: Mentor engineers in system design, software engineering, applied AI, and evaluation-driven development. Create reusable guidance and help teams develop the judgment to determine where AI agents should and should not act autonomously.



Qualifications
Basic Qualifications
 
• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 12+ years of professional software engineering experience designing, building, and operating production software systems.
• Proficiency in C# and/or Python, with demonstrated ability to design and implement production-quality services and distributed systems.
• Experience serving as a technical architect or technical lead for complex, cross-team engineering initiatives.
• Experience with applied AI systems, including LLM-based applications, prompt engineering, RAG architectures, agent frameworks, or machine learning services.
• Experience with cloud platforms, preferably Azure, and cloud-native engineering practices including microservices, APIs, containers, CI/CD, infrastructure as code, and observability.
• Demonstrated success owning the full engineering lifecycle, from problem definition and architecture through implementation, deployment, and production operations.
• Profilency in software architecture, distributed systems, data structures, algorithms, API design, security, testing, and service reliability.
• Proven ability to influence technical direction and align multiple teams without direct management authority.
 
Preferred Qualifications
 
• Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related technical field.
• Experience architecting and shipping multi-agent orchestration systems or agentic AI services in production.
• Experience with AI evaluation systems, including rubrics, golden datasets, judge models, simulation, adversarial testing, and offline and online evaluation.
• Experience with Azure AI Foundry, Azure OpenAI, Microsoft Agent Framework, or similar enterprise AI platforms.
• Deep knowledge of RAG design, including indexing, retrieval, ranking, grounding, citation, knowledge freshness, and access control.
• Experience implementing agent security patterns such as prompt-injection defense, identity propagation, least-privilege tool access, data-boundary enforcement, approval gates, and auditable actions.
• Experience building highly available distributed services with rigorous standards for performance, scalability, resiliency, observability, and cost efficiency.
• Experience leading architecture and co-development efforts involving multiple product, platform, research, and partner engineering teams.
• Demonstrated ability to move between strategic architecture and detailed implementation, including debugging complex interactions across models, prompts, tools, data, and distributed services.
• Business acumen and experience connecting technical investments to measurable customer outcomes such as case volume reduction, resolution time, automation quality, and customer satisfaction.
• Track record of mentoring engineers and raising engineering standards across teams without formal people management responsibilities.
• Background in customer support engineering, supportability, diagnostics, or customer experience platforms is a plus.
 
#EngOps #EngOpsACES
 

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

About Microsoft

People
About 223,000 in 2026, down 2% from the year before.Annual report (SEC Form 10-K)
Company
Listed as MSFT.
H-1B visas
2,075 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Hyderabad, TS, IN

Working pattern and location restrictions need checking in the full posting.

Work authorization
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.