Time since we first saw it
Day 11
Similar jobs usually come down between day 7 and day 60.
From 12,339 similar postings that came down. Coming down is not always a hire.
Own evals strategy: pre-release testing, production monitoring, and conversation judges
Run continuous error analysis on agent traces and rank improvement opportunities
Turn findings into fixes and new evals, then measure results with before-and-after methods
Calibrate and validate LLM judges against human review
Write production-quality Python and TypeScript for evals and analysis tools
Own the evals strategy for our agents: pre-release behavioral testing, production monitoring, and the judges that score conversations.
Run continuous error analysis on agent traces at scale. Find failure patterns, attribute them to skills, prompts or releases, and rank improvement opportunities by impact.
Close the loop. Turn findings into fixes and new evals, ship them, and measure the result with sound before-and-after and causal methods.
Calibrate and validate LLM judges against human review.
Write production-quality Python and TypeScript for evals and analysis tooling, with tests and CI
Actively hiringFirst seen by us 11 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 11
Similar jobs usually come down between day 7 and day 60.
From 12,339 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Calibrate and validate LLM judges against human review. Measure their stability, report their limits, and set the bar for what counts as evidence at Yalo. - Write production-quality Python and TypeScript for evals and analysis tooling, with tests and CI, so it can live in a shared codebase. - Mentor data scientists and engineers on measurement, experimentation and evaluation practice.
- Hands-on experience evaluating LLM-based systems or agents: eval design, LLM-as-judge, rubric design, and judge calibration. - Expert in Python and SQL. Comfortable in TypeScript, or ready to be. - Strong production engineering habits: version control, code review, testing, CI/CD, and shipping tools others use.
- Causal inference and experimentation skills: A/B tests, difference-in-differences, pre/post analysis, and the judgment to say what the data can't show. - Exposure to MLOps or LLMOps platforms (Vertex, SageMaker, MLflow, or similar) and big data tools. - Familiarity with AI safety and responsible AI practices.
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Already applied? Track this application
Hi! This is Yalo! We are on a mission to bring conversational commerce to the world...
Remember how it used to be to interact with businesses that knew and understood you, that could recommend exactly what you needed, and that with a simple message could get you what you wanted??? Yep... neither do we. That is why at Yalo we are marrying the scale of digital commerce with the personalization and simplicity of conversations to help companies delight their users.
We know that traditional SAAS companies focus on first-world problems... we don't! Having started in Latin America, our roots are in Emerging Markets and therefore we care about bringing amazing experiences to a population that traditionally has been underserved, such as the small shop owner in Brazil who is ordering online for the first time.
If you're looking for a place to make things happen, learn fast, and impact emerging markets in a way that hasn't been done before, look no further. 💫
Come Join us in our mission of improving billions of lives through the power of conversational commerce!
As a Staff Data Scientist, you make our AI agents measurably better, and you prove it. You own how Yalo evaluates agents: evals, trace and error analysis, and the improvement loop that turns what we find in production into fixes to our agent skills, harness, CLI and customers' conversational flows. You work with Product, Engineering, Delivery and Customer Success. Your job is to show what moved the metric, not to guess.
Job Requirements (Must have)
What do we offer?
We care,
We keep it simple,
We make it happen,
We strive for excellence.
At Yalo, we are dedicated to creating a workplace that embodies our core values: caring, initiative, excellence, and simplicity. We believe in the power of diversity and inclusivity, where everyone's unique perspectives, experiences, and talents contribute to our collective success. As we embrace and respect our differences, we strive to create something extraordinary for the benefit of all.
We are proud to be an Equal Opportunity Employer, providing equal opportunities to individuals regardless of race, color, religion, national or ethnic origin, gender, sexual orientation, gender identity or expression, age, disability, protected veteran status, or any other legally protected characteristic. Our commitment to fairness and equality is a fundamental pillar of our company.
At Yalo, we uphold a culture of excellence. We constantly challenge ourselves to go above and beyond, delivering remarkable results and driving innovation. We encourage each team member to take initiative and make things happen, empowering them to bring their best ideas forward and contribute to our shared goals.
New Data Scientist postings at the employers we follow are up 3% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Scientist, by the work the posting describes.
Data scientists use statistics and models to answer harder questions, such as whether a change worked, what demand will look like next quarter, or which customers are likely to leave.
Postings usually ask for Python or R, SQL, statistics, experiment design and common machine learning methods.
Unlike an ML engineer, a data scientist's main output is often an analysis or a first model, not software running inside a product.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-2051.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
LATAM
- Competitive rewards on the market range - Remote working is available (-+3 hours CT) - Flexible time (driven by results)
No clear work-authorization passage found. Eligibility is unconfirmed.