Pay
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
San Francisco · San Francisco, California, United States
Live, first seen by us 35 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: EngineeringFrom the employer’s posting
Build, deploy, and operate production Spark data pipelines on Databricks
Turn analytics-product needs into pipeline requirements with quality and freshness expectations
Set up monitoring and observability so pipeline reliability is measured
Diagnose performance and cost problems and fix their root causes
Recommend pragmatic standards for running pipelines as data and platform scale
Build, deploy, and operate production Spark data pipelines on Databricks.
Partner with product teams to turn analytics-product needs into pipeline requirements, including data quality and freshness expectations.
Set up monitoring and observability so pipeline reliability is measured, not assumed.
Diagnose performance and cost problems and fix their root causes.
Recommend pragmatic standards for running pipelines as our data and platform scale.
Will you now or in the future require visa sponsorship to work in the United States?From the employer’s application form
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Day 35
Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
2 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Strong SQL. - Basic programming skills in any language (Python is a plus). - Comfort working as an individual contributor, directly with product teams, and through ambiguity.
- Experience with reliability, monitoring, and observability, and the ability to explain how you diagnosed a real pipeline failure or bottleneck. - Strong SQL. - Basic programming skills in any language (Python is a plus).
- Experience building RAG pipelines. - AWS infrastructure experience. - Platform administration experience: roles, permissions, access controls, and visibility management.
The role You'll own the Spark pipelines on Databricks that power Monaco's analytics products, working directly with product teams to turn what they need into reliable, cost-conscious data. This is a hands-on individual contributor role for a mid-level to senior engineer (roughly 2–6 years of experience). What you'll do
What you'll do - Build, deploy, and operate production Spark data pipelines on Databricks. - Partner with product teams to turn analytics-product needs into pipeline requirements, including data quality and freshness expectations.
Nice to have - Familiarity with the Databricks ecosystem. - Experience with streaming pipelines and logical replication, such as replicating Postgres into Databricks.
- Familiarity with the Databricks ecosystem. - Experience with streaming pipelines and logical replication, such as replicating Postgres into Databricks. - Experience building RAG pipelines.
What you'll bring - Hands-on experience building, deploying, and maintaining production Spark pipelines. - Deep understanding of how concepts like clustering, shuffles, different join strategies, and batch versus stream processing create tradeoffs in performance, freshness, and cost.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack - CRM, sequencing, call recording, enrichment, pipeline management with one unified system, consolidating 6–10 disconnected tools into a single platform built for the AI era.
We launched publicly in Feb 2026, are already 65 people, and have strong early product-market fit generating millions in ARR within months of launch. You'll have the chance to both scale our core systems and build new features from 0 to 1.
We've raised $85M in our Series B from Founders Fund, Benchmark, and Human Capital, and our founders previously led Brex, Apollo, and Clari.
Come join us if you want to be part of a high autonomy, high pace team reinventing one of the biggest categories in enterprise software.
You'll own the Spark pipelines on Databricks that power Monaco's analytics products, working directly with product teams to turn what they need into reliable, cost-conscious data. This is a hands-on individual contributor role for a mid-level to senior engineer (roughly 2–6 years of experience).
Build, deploy, and operate production Spark data pipelines on Databricks.
Partner with product teams to turn analytics-product needs into pipeline requirements, including data quality and freshness expectations.
Set up monitoring and observability so pipeline reliability is measured, not assumed.
Diagnose performance and cost problems and fix their root causes.
Recommend pragmatic standards for running pipelines as our data and platform scale.
Hands-on experience building, deploying, and maintaining production Spark pipelines.
Deep understanding of how concepts like clustering, shuffles, different join strategies, and batch versus stream processing create tradeoffs in performance, freshness, and cost.
Experience with reliability, monitoring, and observability, and the ability to explain how you diagnosed a real pipeline failure or bottleneck.
Strong SQL.
Basic programming skills in any language (Python is a plus).
Comfort working as an individual contributor, directly with product teams, and through ambiguity.
Familiarity with the Databricks ecosystem.
Experience with streaming pipelines and logical replication, such as replicating Postgres into Databricks.
Experience building RAG pipelines.
AWS infrastructure experience.
Platform administration experience: roles, permissions, access controls, and visibility management.
San Francisco. We're an in-person team - 5 days in the office. At this stage, proximity genuinely accelerates product quality and team cohesion.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco, California, United States
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.