Back to jobs

Software Engineer, Pretraining Data

Palo Alto, CA · Palo Alto, California, United States

Live, first seen by us 7 days ago
Pay
USD 160,000–250,000/year — pay source
Annual Salary: $160,000 - $250,000 USD Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.
The annual compensation range for this role is listed below.
Read the full posting
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering › Machine Learning — team source
Department: Engineering › Machine Learning
From the employer’s posting

What you’ll work on

Full posting
  • Build and run pipelines and tooling that make pretraining data iteration fast and reproducible

  • Build and scale web crawling systems that discover, fetch, and parse documents

  • Train and ship models that classify, rank, filter, and clean data at high throughput

  • Design and run scaling-ladder experiments on data mixture and quality

  • Add data quality signals for lineage, freshness, and pipeline health

From the employer’s posting
Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale
Build and scale the web crawling systems that discover, schedule, fetch, and parse high-quality documents across the open web for initial training
Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput
Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth
Create clear signals for data quality, lineage, freshness, and pipeline health

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you now or in the future require visa sponsorship to work in the country where this position is located?
From the employer’s application form

What you’ll bring

All qualifications

Core experience

  • At least 3 years of software engineering experience
  • Experience building distributed systems and/or large-scale data infrastructure
  • Must be able to work in person at the Palo Alto office
Qualification wording
Minimum of 3 years of software engineering experience
Software engineering experience building distributed systems and/or large-scale data infrastructure
must be able to work in person at the Palo Alto office

Benefits in the posting

Full benefits wording
  • Annual Salary:
  • Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.
  • Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

From the employer’s posting.

Apply at SpaceXSI

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 10, 20267 days ago
Recorded sightings
8
Last seen by us
Nov 17, 2026
Reposted
once since Aug 24, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.

How this job compares

Pay

Higher than most similar jobs

$160K–$250K against $127K–$190K, the middle half of what similar US postings state.

From 2,383 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 7

Similar jobs usually come down between day 6 and day 56.

At SpaceXSI, jobs usually come down by about day 73.

From 13,974 similar postings that came down, and 10 of SpaceXSI’s. Coming down is not always a hire.

SpaceXSI is hiring

11 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring is picking up
  • Its jobs tend to stay up a long time
  • 9% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume to compare the role’s scope, tools and requirements with your experience.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.

SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

SOFTWARE ENGINEER, PRETRAINING DATA

We're looking for Software Engineers to build the data systems behind our frontier models' initial training. You'll work on large-scale crawling, data platform, and pipeline infrastructure, turning raw dumps into the datasets our models train on, and making iteration with researchers fast and reliable.

RESPONSIBILITIES:

Data Platform:

  • Build the platform that turns raw web, code, multimodal, and acquired data into training-ready datasets for frontier pretraining runs

  • Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale

  • Create clear signals for data quality, lineage, freshness, and pipeline health so researchers can trust what goes into each run

  • Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas into measurable improvements in loss, evals, and model capability

Data Quality:

  • Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability. If something breaks or drifts, your systems will tell us before the training run does

  • Train and ship models that classify, rank, filter, clean, and identify data at extreme throughput. These models have to be both accurate and fast enough to sit in the critical path without becoming the bottleneck

  • Design and run scaling-ladder experiments on data-mixture, repeatability, and quality depth that turn "this dataset feels good" into hard evidence the training team can trust

  • Partner tightly with Data Acquisition to hunt down missing or low-quality sources, and with the training teams to close the loop on what actually moves loss and downstream evals

  • Treat data quality as a systems problem and a research problem. You will write performance-critical code one week and design careful experiments the next

Crawling:

  • Build and scale the web crawling systems that discover, schedule, fetch, and parse high-quality documents across the open web for initial training

  • Improve URL seeding, scoring, and fair host scheduling so crawl capacity lands on the hosts and pages that matter most for model quality

  • Raise crawl success and parsing quality, defeating antibot failures, improving extractors, and capturing content we previously could not get cleanly

  • Debug and harden complex crawl infrastructure end-to-end for availability, recovery, and ingestion lag, and automate delivery of crawl datasets into the data pipeline

  • Work independently (and alongside AI agents) and partner with Data Quality and Data Platform so new coverage shows up as better tokens in training runs

BASIC QUALIFICATIONS:

  • Minimum of 3 years of software engineering experience

  • Software engineering experience building distributed systems and/or large-scale data infrastructure

PREFERRED SKILLS AND EXPERIENCE:

  • High-slope engineer who has moved unusually fast (e.g., staff-level ownership within a few years) or brings relevant domain experience

  • Able to architect and ship end-to-end with high ownership, debug complex systems independently, and work alongside AI agents

  • Strong intuitions about large-scale distributed systems

  • Excited to learn how pre-training data shapes model quality, and want the ownership and visibility that comes with building systems that feed frontier training runs

ADDITIONAL REQUIREMENTS:

  • Onsite role: must be able to work in person at the Palo Alto office

COMPENSATION AND BENEFITS:

The annual compensation range for this role is listed below.

Annual Salary:

$160,000 - $250,000 USD

Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 861, the most 1,353, and the latest week had 1,022.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Annual Salary: $160,000 - $250,000 USD Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.
More source context
The annual compensation range for this role is listed below.
Location & working pattern

Palo Alto, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.