Pay
Higher than most similar jobs
$220K–$280K against $166K–$237K, the middle half of what similar US postings state.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
San Francisco (United States) · San Francisco, CA, United States
Actively hiring, first seen by us 19 hours agoBase Annual Salary: US $220,000 - $280,000 USD + Equity Note: We may use AI-assisted tools to help organize applications. All hiring decisions are always made by our team.Read the full posting
Location type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: EngineeringFrom the employer’s posting
Develop ML models and systems to detect harmful or illegal content across modalities
Integrate detection models into a large-scale production serving pipeline with infra
Handle customer requests and feedback on moderation behavior and adjust quickly
Design moderation policies with legal, policy, and product teams that are feasible and effective
Develop ML models and systems to detect harmful and/or illegal content across a variety of classes and modalities
Collaborate with our core infrastructure team to integrate these models into a large-scale production serving pipeline
Handle customer requests and feedback on our moderation behavior, and make quick adjustments in response
Collaborate with our legal, policy, and product teams to design moderation policies that are technically feasible and effective while preserving a positive user experience
Experience deploying VLMs at scale for the classification of multimodal content
Experience building AI systems around state-of-the-art open-source VLMs
Experience tuning models for classification tasks, including building eval sets, reasoning about precision/recall at threshold, and monitoring for drift
Comfort with the full stack of ML engineering: from research and experimentation to large-scale deployment
We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.
In the employer’s words · Read in context · Company website ↗
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Higher than most similar jobs
$220K–$280K against $166K–$237K, the middle half of what similar US postings state.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Day 0
Early. Similar jobs usually come down between day 7 and day 76.
From 5,975 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume to compare the role’s scope, tools and requirements with your experience.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
We’re the team building the foundational layer for visual intelligence: multimodal models trained jointly on images, video, audio, and action to see, generate, and understand the world.
Our founding team pioneered latent diffusion and Stable Diffusion, the breakthroughs that made generative AI accessible to millions. With FLUX, we're pushing into generative media at scale, machines that act in the physical world, and emerging applications in computer use.
Our FLUX models top public benchmarks and run in production in some of the world's biggest platforms. We're a small, fast growing research lab competing with the largest companies in the world. From our labs in Freiburg to San Francisco, we're building what comes next.
Black Forest Labs’ products arm individuals with great creative power to produce novel media across a range of modalities. The quality of our models inevitably also gives bad actors the opportunity to create harmful, copyright-infringing, or illegal content.
In this role you will develop and improve our moderation system: a multilayered stack of detection models. Succeeding in this role requires creativity and familiarity with a large range of ML techniques. An effective solution that balances accuracy, cost, latency, and scalability will vary case-by-case, from classical ML fine-tuning, to RAG-based agents, to simple, lightweight semantic embeddings.
Our ideal candidate is able to work across the full stack of ML engineering, collaborate cross-functionally with many teams, including legal, policy, go-to market, and infra, and has a real interest in the domains of AI safety and integrity.
Develop ML models and systems to detect harmful and/or illegal content across a variety of classes and modalities
Collaborate with our core infrastructure team to integrate these models into a large-scale production serving pipeline
Handle customer requests and feedback on our moderation behavior, and make quick adjustments in response
Collaborate with our legal, policy, and product teams to design moderation policies that are technically feasible and effective while preserving a positive user experience
Experience deploying VLMs at scale for the classification of multimodal content
Experience building AI systems around state-of-the-art open-source VLMs
Experience tuning models for classification tasks, including building eval sets, reasoning about precision/recall at threshold, and monitoring for drift
Comfort with the full stack of ML engineering: from research and experimentation to large-scale deployment
Comfort with the adversarial nature of generative AI moderation: prompt obfuscation, jailbreaks, output laundering, and evasion generally
Experience in moderation/safety space, preferably across a range of modalities (text, image, video, audio)
Experience optimizing VLM inference latency at scale
Experience with non-VLM solutions for safety classification (e.g., classical ML)
Domain knowledge and experience with content copyright and/or child safety moderation systems
We’re a distributed team with real offices that people actually use. This role is based in San Francisco, and you’ll join us in the office at least 2 days a week, or one full week every other week.
Everything we do is grounded in four values:
Obsessed. We are a frontier research lab. The science has to be right, the understanding deep, the product beautiful.
Low Ego. The work speaks. The best idea wins, no matter who said it. Credit is shared. Nobody is above any task.
Bold. We take the ambitious bet. We ship, we do not wait for conditions to be perfect.
Kind. People over politics. We treat each other with genuine warmth. Agency without empathy creates chaos.
If this sounds like work you’d enjoy, we’d love to hear from you.
Base Annual Salary:
US $220,000 - $280,000 USD + Equity
Note: We may use AI-assisted tools to help organize applications. All hiring decisions are always made by our team.
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Base Annual Salary: US $220,000 - $280,000 USD + Equity Note: We may use AI-assisted tools to help organize applications. All hiring decisions are always made by our team.
San Francisco, CA, United States
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.