Senior Data Scientist - AI Agents Team
Tel Aviv
What you’ll work on
Full postingBuild robust evaluation frameworks for agent behavior, model quality, and product impact.
Lead applied AI initiatives from early experimentation through production.
Collaborate with AI engineers, backend engineers, and product managers to deploy scalable and observable AI systems.
From the employer’s posting
Design and scale the continuous-learning ecosystem behind advanced AI agents, combining benchmarks, automated evaluations and feedback loops to drive measurable improvements in quality, reliability, and performance. Build robust evaluation frameworks for agent behavior, model quality, and product impact. Lead applied AI initiatives from early experimentation through production.
Build robust evaluation frameworks for agent behavior, model quality, and product impact. Lead applied AI initiatives from early experimentation through production. Collaborate with AI engineers, backend engineers, and product managers to deploy scalable and observable AI systems.
Lead applied AI initiatives from early experimentation through production. Collaborate with AI engineers, backend engineers, and product managers to deploy scalable and observable AI systems. Stay current with developments in LLMs and agentic AI, translating relevant advances into practical product improvements.
See how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.
Pay, work setup, and employment type unconfirmed
Not confirmed in this saved copy: pay, work setup, employment type. Check the full posting
Tools in this posting
- python
- pytorch
Source — Tool mentions in context
- Proven experience building and shipping AI or ML systems to production. - Strong proficiency in Python and experience with modern ML and LLM tooling. - Hands-on experience with LLM evaluation, prompting, embeddings, RAG, tool use, and agent workflows.
Nice To Have - Experience with PyTorch, Hugging Face, LangGraph, LangChain, or similar tools. - Experience with fine-tuning, recommendation systems, search, or information retrieval.
Find answers in the posting
AIAlready applied? Track this application
About applying
Apply opens the employer’s site in a new tab. Add your outcome here after you submit.
Source details & eligibility
Before you apply
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
Tel Aviv
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
Posting history
- Status in our records
- Active
- First seen by us
- Sep 8, 2026
- Recorded sightings
- 1
These dates show when we found the listing. Check the employer’s website to confirm it is still accepting applications.
Report an errorJob description
Surf AI is the agentic operations platform for enterprise security teams. We don't just surface risk, we close it. Our platform connects context across identity, cloud, HR, IT, and SaaS systems, and uses specialized AI agents to drive remediation end-to-end, with human oversight at every step.
We're backed by Accel, Cyberstarts, and Boldstart Ventures, and trusted by Fortune 500 enterprises already deploying Surf in production.
Our team is small and senior, with deep roots in identity, security, and enterprise infrastructure. We work at the intersection of agentic AI and applied security - and we take seriously what it means to build systems that act in real enterprise environments.
Who are we looking for?
We’re looking for a Senior Data Scientist with strong experience in LLMs, NLP, and agentic systems to join our AI team.
You’ll help build the data, evaluation, and learning systems behind advanced AI agents. This is a hands-on role for someone who combines data science rigor with strong engineering instincts and product thinking.
We’re looking for someone who is deeply engaged with the rapid evolution of AI—actively experimenting with new models and tools, understanding their limitations, and turning emerging capabilities into reliable production systems.
What you'll do
- Design and scale the continuous-learning ecosystem behind advanced AI agents, combining benchmarks, automated evaluations and feedback loops to drive measurable improvements in quality, reliability, and performance.
- Build robust evaluation frameworks for agent behavior, model quality, and product impact.
- Lead applied AI initiatives from early experimentation through production.
- Collaborate with AI engineers, backend engineers, and product managers to deploy scalable and observable AI systems.
- Stay current with developments in LLMs and agentic AI, translating relevant advances into practical product improvements.
Required Skills & Experience
- 5+ years of experience in data science, applied machine learning
- Proven experience building and shipping AI or ML systems to production.
- Strong proficiency in Python and experience with modern ML and LLM tooling.
- Hands-on experience with LLM evaluation, prompting, embeddings, RAG, tool use, and agent workflows.
- Strong understanding of experimentation, benchmarking, metrics, data analysis, and model performance.
- The ability to write production-quality code and work closely with engineering teams.
- Strong technical judgment, curiosity, and a hands-on approach to exploring new AI capabilities.
Nice To Have
- Experience with PyTorch, Hugging Face, LangGraph, LangChain, or similar tools.
- Experience with fine-tuning, recommendation systems, search, or information retrieval.
- Experience building evaluation, observability, or continuous-learning infrastructure for AI agents.
Why Join Us?
If you want to work on foundational systems, ship AI into production, and help define how agentic security actually operates, this is an opportunity to do it early and with real ownership.