Pay
$100K–$169K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 163 postings in the last year. Stated ranges, not salaries paid.
San Francisco · San Francisco, California, United States
Live, first seen by us 67 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: Software Engineering › InfrastructureFrom the employer’s posting
Matter is hiring a Signal, Data, and Evaluation Engineer to build the datasets, benchmarks, environments, and evidence that make our models and AI systems scientifically defensible.
Build versioned dataset workflows for curation, labeling, ground truth, and train-evaluation isolation
Design benchmark suites across perception, multimodal reasoning, planning, and customer tasks
Create simulation and environment infrastructure for reinforcement and imitation learning
Turn field, mission, and customer failures into datasets, benchmark cases, and environment scenarios
Build automated promotion gates and state what has been tested and what evidence supports release
Matter is hiring a Signal, Data, and Evaluation Engineer to build the datasets, benchmarks, environments, and evidence that make our models and AI systems scientifically defensible. Reporting to Ignacio Cases Martin, this individual contributor will work across data curation, simulation and learning environments, model and agent evaluation, and release-quality evidence.
Build versioned dataset workflows for collection, curation, filtering, labeling, ground truth, synthetic data, hard-negative mining, contamination controls, and train-evaluation isolation.
Design benchmark suites across perception, multimodal reasoning, physics-informed prediction, retrieval, planning, tool use, world modeling, and customer tasks.
Create simulation and environment infrastructure for reinforcement learning, imitation learning, offline learning, model-based learning, and agent training.
Turn field, mission, and customer failures into versioned datasets, benchmark cases, adversarial tests, and environment scenarios.
Build automated promotion gates and communicate clearly what has been tested, what remains unproven, and what evidence supports release.
A lawful permanent resident (green card holder)
Experience in ML evaluation, dataset engineering, reinforcement-learning environments, simulation, scientific ML, test infrastructure, or production AI systems.
Experience with dataset curation, benchmark platforms, deep reinforcement learning, world models, synthetic data, multimodal evaluation, or scientific validation.
100% employer-paid health, dental, and vision coverage
Experience converting qualitative model or agent failures into reproducible datasets, tests, or environment scenarios.
Experience with PyTorch or JAX, distributed evaluation, experiment tracking, environment frameworks, or model and agent observability.
Ability to reason across the complete data path and identify how acquisition, transformation, indexing, orchestration, and presentation affect correctness.
Welcome to Matter, where we are building the future of vision AI: pairing a world-first sensor that sees molecular chemistry, temperature, and 3D shape with a Large World Model that will be the most powerful intelligence engine for the physical world.
In the employer’s words · Read in context · Company website ↗
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$100K–$169K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 163 postings in the last year. Stated ranges, not salaries paid.
Day 67
Up longer than most. Similar jobs usually come down between day 6 and day 52.
From 2,081 similar postings that came down. Coming down is not always a hire.
4 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Strong foundations in statistics, experimental design, benchmark validity, distribution shift, calibration, reward design, and evidence-based acceptance. - Fluency in Python and modern machine-learning frameworks, with the software engineering discipline to build tested modules, data contracts, or services. - Experience converting qualitative model or agent failures into reproducible datasets, tests, or environment scenarios.
- Experience with dataset curation, benchmark platforms, deep reinforcement learning, world models, synthetic data, multimodal evaluation, or scientific validation. - Experience with PyTorch or JAX, distributed evaluation, experiment tracking, environment frameworks, or model and agent observability. - Experience with uncertainty quantification, calibration, out-of-distribution detection, conformal methods, or selective prediction.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Welcome to Matter, where we are building the future of vision AI: pairing a world-first sensor that sees molecular chemistry, temperature, and 3D shape with a Large World Model that will be the most powerful intelligence engine for the physical world. This system doesn't just see what something looks like; it understands everything from a single pixel. We call this Superintelligent Vision.
Our team has delivered technologies to Mars for NASA/JPL, designed advanced sensors for U.S. Defense, and frontier artificial intelligence systems. We are now building the next generation of space- and airborne-based sensing systems.
Matter is hiring a Signal, Data, and Evaluation Engineer to build the datasets, benchmarks, environments, and evidence that make our models and AI systems scientifically defensible. Reporting to Ignacio Cases Martin, this individual contributor will work across data curation, simulation and learning environments, model and agent evaluation, and release-quality evidence.
Build versioned dataset workflows for collection, curation, filtering, labeling, ground truth, synthetic data, hard-negative mining, contamination controls, and train-evaluation isolation.
Design benchmark suites across perception, multimodal reasoning, physics-informed prediction, retrieval, planning, tool use, world modeling, and customer tasks.
Create simulation and environment infrastructure for reinforcement learning, imitation learning, offline learning, model-based learning, and agent training.
Define repeatable evaluation methods across accuracy, calibration, generalization, robustness, safety, latency, cost, and operational outcomes.
Turn field, mission, and customer failures into versioned datasets, benchmark cases, adversarial tests, and environment scenarios.
Build automated promotion gates and communicate clearly what has been tested, what remains unproven, and what evidence supports release.
Experience in ML evaluation, dataset engineering, reinforcement-learning environments, simulation, scientific ML, test infrastructure, or production AI systems.
Strong foundations in statistics, experimental design, benchmark validity, distribution shift, calibration, reward design, and evidence-based acceptance.
Fluency in Python and modern machine-learning frameworks, with the software engineering discipline to build tested modules, data contracts, or services.
Experience converting qualitative model or agent failures into reproducible datasets, tests, or environment scenarios.
Ability to reason across the complete data path and identify how acquisition, transformation, indexing, orchestration, and presentation affect correctness.
Experience with dataset curation, benchmark platforms, deep reinforcement learning, world models, synthetic data, multimodal evaluation, or scientific validation.
Experience with PyTorch or JAX, distributed evaluation, experiment tracking, environment frameworks, or model and agent observability.
Experience with uncertainty quantification, calibration, out-of-distribution detection, conformal methods, or selective prediction.
Experience evaluating models deployed to aircraft, satellites, robotics, industrial systems, or other constrained environments.
Model and agent releases are supported by reproducible datasets, benchmarks, and clearly stated evidence.
Failures from experiments and deployments become durable test cases that improve future systems.
Evaluation results preserve scientific meaning and make capability, uncertainty, and residual risk legible to the team.
This role is based in San Francisco, CA, and requires onsite work.
To comply with U.S. export regulations, applicants must be one of the following:
A U.S. citizen or national
A lawful permanent resident (green card holder)
Eligible to obtain required authorizations from the U.S. Department of State
At Matter, we believe in rewarding high performance and providing the support you need to thrive. Our compensation and benefits package includes:
Competitive compensation based on experience
Early-stage equity package
100% employer-paid health, dental, and vision coverage
Opportunity to work on novel sensing, data, and AI systems with real-world deployment paths to the largest industries in the world
Matter Intelligence is an equal opportunity employer. We welcome candidates from all backgrounds who can raise the ambition and performance of the team.
New Data Governance postings at the employers we follow are up 164% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Governance, by the work the posting describes.
Data governance staff keep a company's data accurate, documented and used within the rules. They agree what key fields mean, set up quality checks, track who owns each dataset and look after master data.
Postings ask for SQL, a governance tool such as Collibra or Informatica, knowledge of privacy and data rules, and a lot of work with other teams.
A data engineer builds the systems that move data; governance staff set and check the standards that data has to meet.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco, California, United States
- A lawful permanent resident (green card holder) - Eligible to obtain required authorizations from the U.S. Department of State Employee Offerings and Benefits
To comply with U.S. export regulations, applicants must be one of the following: - A U.S. citizen or national - A lawful permanent resident (green card holder) - Eligible to obtain required authorizations from the U.S. Department of State