Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 7 and day 76.
From 6,398 similar postings that came down. Coming down is not always a hire.
Berlin · Freiburg · New York · Berlin, Germany
Open 5 months, first seen by us 172 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: Engineering & Science › EngineeringFrom the employer’s posting
You will have ownership over designing, building, and scaling the core systems that bring Prior Labs' foundation models to the world.
TabPFN does its learning in the forward pass, and it now handles datasets in the millions of rows.
Own inference serving end-to-end: latency, throughput, batching and cost per prediction
Design robust, scalable, secure backend systems and production-grade APIs for foundation models
Develop high-quality, maintainable code for core backend services
Design, deploy and manage core cloud infrastructure focused on reliability and observability
Build GDPR-compliant systems for data storage, access control, usage tracking and quotas
You will have ownership over designing, building, and scaling the core systems that bring Prior Labs' foundation models to the world. This is a unique opportunity to make fundamental architectural decisions, establish engineering best practices from the ground up, and profoundly shape the technical direction for serving state-of-the-art AI.
TabPFN does its learning in the forward pass, and it now handles datasets in the millions of rows. Making that fast, reliable, and affordable is an exciting engineering challenge.
Own the serving path end-to-end: latency, throughput, batching, memory behavior on large inputs, and cost per prediction.
Design robust, scalable, and secure backend systems and production-grade APIs for serving our foundation models.
Develop high-quality, maintainable code for core backend services.
Design, deploy, and manage core infrastructure on cloud platforms, focusing on reliability, monitoring, observability, and cost-efficiency.
Implement secure, GDPR-compliant systems, including data storage, access control, usage tracking, and quota management.
Foundation models transformed text and images.
In the employer’s words · Read in context · Company website ↗
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 7 and day 76.
From 6,398 similar postings that came down. Coming down is not always a hire.
4 open jobs
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Significant experience with containerization and orchestration technologies (Docker, Kubernetes). - Proficiency in Python. What sets you apart
- Strong, hands-on experience with Infrastructure as Code (IaC) using tools like Terraform. - Significant experience with containerization and orchestration technologies (Docker, Kubernetes). - Proficiency in Python.
- Strong, hands-on experience designing and building production-grade APIs and backend services. - Significant experience building and operating services on cloud platforms, with GCP preferred. - Strong, hands-on experience with Infrastructure as Code (IaC) using tools like Terraform.
- Significant experience building and operating services on cloud platforms, with GCP preferred. - Strong, hands-on experience with Infrastructure as Code (IaC) using tools like Terraform. - Significant experience with containerization and orchestration technologies (Docker, Kubernetes).
- Deep experience with inference optimization (quantization, compilation, dynamic batching, caching strategies, interplay with distributed computing). - Experience with PyTorch and FastAPI specifically. - Contributions to relevant open-source projects.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Foundation models transformed text and images. Structured data - the largest and most consequential data format in the world - stayed untouched, until now. What LLMs did for language, we're doing for tables.
We pioneered tabular foundation models: TabPFN v2 was a Nature cover story, has passed 3.5M+ downloads and 7,500+ GitHub stars, and runs in production from detecting lung disease with Oxford Cancer Analytics to preventing train failures with Hitachi. The hardest problems - millions of rows, real-time inference, entirely new modalities - are still open, and no one else is working on them at this level.
We're a small, highly selective team of 40+ with backgrounds from Google, DeepMind, Meta, Apple, Amazon, Jane Street, and CERN, led by Frank Hutter, Noah Hollmann, and Sauraj Gambhir, and advised by Bernhard Schölkopf and Turing Award winner Yann LeCun.
In July 2026, less than 18 months after our €9M pre-seed, we joined SAP as an independent frontier AI lab - same team, mission, and open-weights models, now backed by more than €1 billion over four years.
About the roleYou will have ownership over designing, building, and scaling the core systems that bring Prior Labs' foundation models to the world. This is a unique opportunity to make fundamental architectural decisions, establish engineering best practices from the ground up, and profoundly shape the technical direction for serving state-of-the-art AI.
TabPFN does its learning in the forward pass, and it now handles datasets in the millions of rows. Making that fast, reliable, and affordable is an exciting engineering challenge.
You'll work directly with world-class AI researchers, translating cutting-edge models into scalable production systems. This role offers significant autonomy and impact, with clear paths to specialize in areas you're passionate about (like inference optimization and core backend systems) or grow into a technical leadership position as our team expands. You won't just be implementing features; you'll be building the backbone of our company.
What you'll work on:
Own Inference: Own the serving path end-to-end: latency, throughput, batching, memory behavior on large inputs, and cost per prediction. Our models serve through our managed API, inside customer VPCs, and as self-hosted open weights, and you’ll have an impact across the board.
Architect & Design: Design robust, scalable, and secure backend systems and production-grade APIs for serving our foundation models.
Build & Implement: Develop high-quality, maintainable code for core backend services.
Own Infrastructure: Design, deploy, and manage core infrastructure on cloud platforms, focusing on reliability, monitoring, observability, and cost-efficiency.
Ensure Compliance & Security: Implement secure, GDPR-compliant systems, including data storage, access control, usage tracking, and quota management.
Champion Best Practices: Drive high standards for testing, CI/CD, documentation, and security within the engineering team.
You may be a good fit if you have:
3+ years of professional experience in machine learning and backend engineering, with a proven track record of managing production infrastructure.
Proven experience deploying and operating machine learning models in production, with a strong understanding of how models behave and fail under real traffic.
Strong, hands-on experience designing and building production-grade APIs and backend services.
Significant experience building and operating services on cloud platforms, with GCP preferred.
Strong, hands-on experience with Infrastructure as Code (IaC) using tools like Terraform.
Significant experience with containerization and orchestration technologies (Docker, Kubernetes).
Proficiency in Python.
What sets you apart
Experience building or managing infrastructure specifically for machine learning (MLOps, model serving frameworks, feature stores, data pipelines).
Deep experience with inference optimization (quantization, compilation, dynamic batching, caching strategies, interplay with distributed computing).
Experience with PyTorch and FastAPI specifically.
Contributions to relevant open-source projects.
You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right.
Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together.
The best products and teams are built by people with a wide range of perspectives and backgrounds. We welcome applications from all identities and walks of life - especially if you've ever felt discouraged by "not checking every box" - and provide equal opportunities regardless of gender, sexual orientation, origin, disability, or any other trait that makes you who you are.
We care about how your data is handled - see our Recruiting Data Privacy page
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Berlin, Germany
You'll work alongside researchers and builders who hold themselves to a very high bar - in the quality of their work and in how they work with each other. We move fast and still take the time to do things right. Our teams are based in Berlin, Freiburg, and New York - when you're working on something as hard as TabPFN, being in the same room matters. But great people come from everywhere, and in exceptional cases we're open to remote, which usually means frequent travel to one of our offices. Wherever you're based, the whole company comes together regularly for offsites to build and celebrate together. Our Commitments
No clear work-authorization passage found. Eligibility is unconfirmed.