> job detail
S
👽Other
Senior AI/ML Engineer
Sap · Palo Alto, CA, US, 94304
// classified as
Other (Adjacent or hard to classify.)
posted
<1d ago
location
Palo Alto, CA, US, 94304
languages
python
tools
—
> stack
python
> education
msphd
> description
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">We help the world run better</span></strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black"><br>At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. </span></p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"> </p><div>
<div>
<p><strong><span>Summary</span><span> </span></strong></p>
</div>
<div>
<p><span>We're building specialized foundation models and AI agents that accelerate SAP customers' data transformation journeys.</span><span> </span></p>
</div>
<div>
<p><span>The agents you build will directly power SAP's Autonomous Enterprise, where AI runs core business processes end-to-end across finance, supply chain, HR, and procurement at global scale.</span><span> </span></p>
</div>
<div>
<p><span>You'll set technical direction, define how we architect and scale multi-agent systems, and raise the engineering bar across a global team. You'll work directly with pretraining and fine-tuning team leads in Europe, India, and early-adopter customers.</span><span> </span></p>
</div>
<div>
<p><span>We want someone who has shipped agentic systems in production and knows where they break.</span><span> </span></p>
</div>
<div>
<p><span><img width="624" height="0"></span><span> </span></p>
</div>
<div>
<p><strong><span>What you'll do</span><span> </span></strong></p>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Architect and lead multi-agent systems: design, orchestration patterns, failure modes, memory, planning, and human-in-the-loop</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Own the path from prototype to production: containerization, guardrails, cost and latency optimization, scalable serving</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Define the team's evaluation strategy: offline/online harnesses, trajectory quality, tool-call accuracy, regression testing, CI/CD eval gates</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Lead instrumentation and observability: tracing, span capture, automated scoring, closing the trace → eval → fix loop</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Drive tool integration architecture via MCP across multiple product teams</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Mentor junior and mid-level engineers through code and architecture reviews; set engineering standards</span><span> </span></p>
</li>
</ul>
</div>
<div>
<p><span><img width="624" height="0"></span><span> </span></p>
</div>
<div>
<p><strong><span>What you bring</span><span> </span></strong></p>
</div>
<div>
<p><span>Education:</span><span> BS, MS, or PhD in Computer Science, ML, or a related field.</span><span> </span></p>
</div>
<div>
<p><span>Experience:</span><span> 6+ years building and shipping ML systems, with 3+ years hands-on with LLMs and agents in production.</span><span> </span></p>
</div>
<div>
<p> </p>
<p><span>Core technical skills</span><span> </span></p>
</div>
</div>
<div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Expert Python; strong fundamentals: system design, testing, modularity, async, API design</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>PyTorch; working knowledge of fine-tuning and PEFT methods (LoRA, QLoRA)</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>LLM application development: prompting, structured outputs, tool calling, context management</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Inference optimization: vLLM, TensorRT-LLM, quantization (int8, int4, GPTQ, AWQ)</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Human-in-the-loop annotation workflows at scale</span><span> </span></p>
</li>
</ul>
</div>
<div>
<p> </p>
<p><span>Agent frameworks and orchestration</span><span> (production experience with at least three)</span><span> </span></p>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>LangGraph / LangChain</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>CrewAI, AutoGen/AG2, or equivalent</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>MCP (Model Context Protocol)</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Coding agents: Claude Code, OpenCode, or similar</span><span> </span></p>
</li>
</ul>
</div>
<div>
<p> </p>
<p><span>Evaluation and observability</span><span> (production experience with at least two)</span><span> </span></p>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Langfuse, LangSmith, Arize, or equivalent</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>LLM-as-judge evaluators, CI/CD eval gates</span><span> </span></p>
</li>
</ul>
</div>
<div>
<p> </p>
<p><span>Leadership</span><span> </span></p>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Demonstrated track record mentoring engineers and raising team technical quality</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Drives decisions in ambiguous, fast-moving environments</span><span> </span></p>
</li>
</ul>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Writes design docs that earn buy-in across teams</span><span> </span></p>
</li>
</ul>
</div>
<div>
<p><span><img width="624" height="0"></span><span> </span></p>
</div>
<div>
<p><span>Nice to have</span><span> </span></p>
</div>
<div>
<ul style="list-style-type:disc">
<li>
<p><span>Continued pretraining or fine-tuning pipelines (SFT, DPO, RLHF)</span><span> </span></p>
</li>
</ul>
</div>
</div>
<div>
<p><span><img width="624" height="0"></span><span> </span></p>
</div>
<div>
<p><strong><span>Meet your team</span><span> </span></strong></p>
</div>
<div>
<p><span>The Foundation Model team is part of the Generative AI foundation within Business AI at SAP. We build domain-specialized foundation models on SAP business data through continued pretraining and fine-tuning, and we build the agentic layer that brings them into SAP products.</span></p>
</div><p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">Bring out your best</span></strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black"><br>SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best. <br><br><strong>We win with inclusion</strong><br>SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.<br><br>SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.<br><br>For SAP employees: Only permanent roles are eligible for the </span><span style="font-size:10.0pt;font-family:Arial, sans-serif"><a href="https://one.int.sap/me@sap/jobs_and_hiring/employee_referral/region/0000/lang/en">SAP Employee Referral Program</a><span style="color:black">, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.<br><br></span></span></p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability.</span></p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"> </p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">Compensation Range Transparency</span></strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">: SAP believes the value of pay transparency contributes towards an honest and supportive culture and is a significant step toward demonstrating SAP’s commitment to pay equity. SAP provides the annualized compensation range inclusive of base salary and variable incentive target for the career level applicable to the posted role. The targeted annual combined range for this position is <span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">148600-306300USD</span>. The actual amount to be offered to the successful candidate will be within that range, dependent upon the key aspects of each case which may include education, skills, experience, scope of the role, location, etc. as determined through the selection process. Any SAP variable incentive includes a targeted dollar amount and any actual payout amount is dependent on company and personal performance. Please reference this link for a summary of SAP benefits and eligibility requirements: </span><span style="font-size:10.0pt;font-family:Arial, sans-serif"><a href="https://www.sapnorthamericabenefits.com/en/public/welcome">SAP North America Benefits</a><span style="color:black">.<br><br></span></span></p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><strong><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">AI Usage in the Recruitment Process</span></strong></p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">For information on the responsible use of AI in our recruitment process, please refer to our </span><span style="font-size:10.0pt;font-family:Arial, sans-serif"><a href="https://jobs.sap.com/content/Ethical_usage_of_AI_in_the_recruiting_process/?locale=en_US">Guidelines for Ethical Usage of AI in the Recruiting Process</a></span><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">. </span></p>
<p style="margin:0.0in;font-size:12.0pt;font-family:'Times New Roman', serif"><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black">Please note that any violation of these guidelines may result in disqualification from the hiring process.</span><span style="font-size:10.0pt;font-family:Arial, sans-serif;color:black"><br><br>Requisition ID: 457595 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid<br><br><br></span></p>