Pay
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
San Francisco · Singapore · San Francisco, California, United States
Open 3 months, first seen by us 101 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: InfrastructureFrom the employer’s posting
Source new physical data modalities and secure access via partners, vendors, and public archives
Build petabyte-scale batch and streaming pipelines (e.g. Apache Spark) into standardized training-ready form
Develop metrics for coverage, correctness, and consistency across data sources
Design automated QA checks that monitor data quality over time and own their verdicts
Write technical requirements and give actionable feedback to external data vendors
Research and source new modalities of multimodal physical data (e.g. sparse sensors, point clouds, hyperspectral imagery, radar), and secure access through partnerships, vendors, and public archives
Build petabyte-scale data pipelines (e.g. Apache Spark) that ingest each source into our storage in standardized, training-ready form, across both batch and streaming
Develop quality metrics that measure coverage, correctness, and consistency across sources
Design and implement automated QA checks that continuously measure and monitor data quality over time, and own the verdicts they produce
Write technical requirements and provide actionable feedback to external data vendors and partners
Open 3 monthsWe first saw this posting 101 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Day 101
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
4 open jobs
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Research and source new modalities of multimodal physical data (e.g. sparse sensors, point clouds, hyperspectral imagery, radar), and secure access through partnerships, vendors, and public archives - Build petabyte-scale data pipelines (e.g. Apache Spark) that ingest each source into our storage in standardized, training-ready form, across both batch and streaming — including the orchestration, storage, and monitoring they need where shared platform infrastructure doesn't yet exist - Develop quality metrics that measure coverage, correctness, and consistency across sources — and catch the subtle inconsistencies (sensor bias, drift, processing artifacts) that silently degrade models
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Our mission is general causal intelligence; AI that is capable of (1) predicting the future and (2) identifying the actions to alter it.
To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an understanding of causality required to predict and control physical systems, starting with weather.
Our founding team has built and deployed AI against the physical world in robotics, drug discovery, and particle physics at institutions like DeepMind, Waymo, Cruise, Insitro, Nabla Bio, and CERN.
We look for data engineers who are excited to tackle unsolved problems. Data is critical to any ML model but is especially consequential for our thesis to learn physics from sensory observations. The vast majority of meaningful progress in AI comes not from new architectures, but from training on data that is carefully curated with specific characteristics, quality, and scale.
Responsibilities
Your mission is to own every dataset end to end — from discovering the source and securing access, to writing the pipelines that ingest it, to guaranteeing it enters training clean, standardized, and correct.
Research and source new modalities of multimodal physical data (e.g. sparse sensors, point clouds, hyperspectral imagery, radar), and secure access through partnerships, vendors, and public archives
Build petabyte-scale data pipelines (e.g. Apache Spark) that ingest each source into our storage in standardized, training-ready form, across both batch and streaming — including the orchestration, storage, and monitoring they need where shared platform infrastructure doesn't yet exist
Develop quality metrics that measure coverage, correctness, and consistency across sources — and catch the subtle inconsistencies (sensor bias, drift, processing artifacts) that silently degrade models
Design and implement automated QA checks that continuously measure and monitor data quality over time, and own the verdicts they produce
Write technical requirements and provide actionable feedback to external data vendors and partners
Collaborate with researchers to validate that new and improved datasets translate into model performance
What we're looking for
We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.
Demonstrated experience building large-scale data pipelines, QA systems, or evaluation workflows (e.g. Spark, Ray, Beam)
Detail-oriented in identifying subtle data inconsistencies and issues that could affect quality, with the ability to understand how quality impacts model performance
Comfortable going deep on unfamiliar source material — reading format specifications, sensor documentation, and vendor manuals to get ingestion exactly right
Experience working with external data vendors and partners, from technical evaluation to ongoing feedback
Owns deliverables end-to-end, from collecting and translating requirements to autonomously driving execution
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco, California, United States
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.