Back to jobs

Lead Data Engineer

Pay
$175,000–200,000/yearAnnual period assumed. Location-specific pay. Plus bonus — pay source
Experience in high-growth/pre-IPO Technology companies. The anticipated salary pay range for Metro 3 areas for this role is $175,000 - $200,000 plus company bonus. Prove follows a market driven compensation philosophy based on geographic location and respective market rates. Job offers will be aligned to location. Please speak with your recruiter if you have questions. Prove defines:
Read the full posting
Work setting
Hybrid — work setting source
FLSA Status: Exempt Location: Hybrid - New York, NY Job Summary
Read the full posting
Employment
Not stated

What you’ll work on

Full posting
  • Architect and maintain data pipelines for real-time and batch inference

  • Turn multidisciplinary domain logic into modular DAGs and execution workflows

  • Implement data governance, metadata management, and semantic ontologies

  • Serve high-integrity data extracts to data science, informatics, and product teams

  • Optimize distributed pipelines for availability, efficiency, and cost

From the employer’s posting
Architect, build, and maintain resilient data pipelines that power real-time and batch inference
Translate complex, multidisciplinary domain logic into efficient, maintainable, and modular directed acyclic graphs (DAGs) and execution workflows.
Proactively implement and advocate for robust data governance frameworks, metadata management, and semantic data ontologies.
Partner closely with data science, informatics, and product engineering teams to serve high-integrity data extracts
Optimize distributed data processing pipelines for high availability, computational efficiency, and cost governance.

What you’ll bring

All qualifications

Core experience

  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks.

Preferred experience

  • Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.
  • Experience in high-growth/pre-IPO Technology companies.
Qualification wording
7+ years of professional experience in data engineering or developing complex, data-driven software products.
Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks.
Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.
Experience in high-growth/pre-IPO Technology companies.
Education & alternatives
Preferred Qualifications: - Advanced degree (Master’s or Ph.D.) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field. - Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.

About Prove

Over 1,000 enterprise customers use Prove’s platform to process 20 billion customer requests annually across industries, including banking, lending, healthcare, gaming, crypto, e-commerce, marketplaces, and payments.

In the employer’s words · Read in context

Apply at Prove

Posting record

Report an error

Actively hiringFirst seen by us 4 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 17, 20264 days ago
Recorded sightings
6
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$175K–$200K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 4

Early. Similar jobs usually come down between day 6 and day 56.

From 14,770 similar postings that came down. Coming down is not always a hire.

Prove is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Shell
  • Prefect
  • Airflow
  • Dagster
Where the posting names them
- Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems. - Fluent and terminal-native in Linux/Unix environments, command-line utilities, and shell scripting. - Experience in high-growth/pre-IPO Technology companies.
- High intellectual curiosity and a proactive mindset toward experimentation and technological innovation. - Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks. Preferred Qualifications:

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

About Prove 

As the world moves to a mobile-first economy, businesses need to modernize how they acquire, engage with and enable consumers. Prove’s phone-centric identity tokenization and passive cryptographic authentication solutions reduce friction, enhance security and privacy across all digital channels, and accelerate revenues while reducing operating expenses and fraud losses. Over 1,000 enterprise customers use Prove’s platform to process 20 billion customer requests annually across industries, including banking, lending, healthcare, gaming, crypto, e-commerce, marketplaces, and payments. For the latest updates from Prove, follow us on LinkedIn.

Prove is driving the future of digital identity. We are looking for Provers who know how to make an impact. We’re talking self-starting professionals who thrive in a fast-paced environment, process information quickly, and make intelligent decisions. The work is challenging and requires not only smart but natural curiosity and tenacity. Teamwork is also important to us – we work together and play together.   

Prove has big plans, and we’re excited about the future. If this sounds like the place for you – come join our team! 

Title: Lead Data Engineer

Department: Data Science

Reports To: Director of Informatics

FLSA Status: Exempt

Location: Hybrid - New York, NY

Job Summary

As a Lead Data Engineer on Prove’s Data Science team, you will build the technical backbone that translates complex identity data into verified digital trust. Prove is fundamentally a data company: our identity solutions and analytical products are built on extracts spanning all tiers of data sophistication. In this role, every pipeline and architecture you design connects directly to revenue-generating products that secure transactions and prevent fraud for more than 1,000 global enterprise customers.

You will spearhead the development and maintenance of high-throughput data pipelines that power our core inference systems, taking raw intelligence and refining it into reliable scientific statements. Acting as a bridge across disciplines, you will translate multi-domain logic into resilient, highly performant directed acyclic graphs (DAGs), while proactively establishing data governance and ontology standards. This is an environment built for experimentation, offering you the autonomy to deploy modern paradigms and tools to solve intricate problems in identity resolution.

Key Responsibilities:

  • Architect, build, and maintain resilient data pipelines that power real-time and batch inference, moving data from raw intelligence to verifiable scientific statements.
  • Translate complex, multidisciplinary domain logic into efficient, maintainable, and modular directed acyclic graphs (DAGs) and execution workflows.
  • Proactively implement and advocate for robust data governance frameworks, metadata management, and semantic data ontologies.
  • Partner closely with data science, informatics, and product engineering teams to serve high-integrity data extracts that directly power revenue-generating products.
  • Continuously evaluate, benchmark, and adopt cutting-edge data engineering tools, frameworks, and storage paradigms.
  • Optimize distributed data processing pipelines for high availability, computational efficiency, and cost governance.
  • Champion engineering excellence across the team through code reviews, architectural discussions, automated testing, and CI/CD practices.
  • Promote, maintain and enhance our cultural values of humility, passion, inclusion, and leadership.
Qualifications and Experience:
  • Strong passion for learning about our products and markets through in-house and external training.
  • 7+ years of professional experience in data engineering or developing complex, data-driven software products.
  • Deep, first-principles understanding of data systems, distributed compute engines, data modeling, and modern pipeline architecture.
  • Demonstrated track record of collaborating across technical and scientific functions, with the ability to translate cross-disciplinary logic into concrete data systems.
  • High intellectual curiosity and a proactive mindset toward experimentation and technological innovation.
  • Hands-on experience with modern data orchestration (e.g., Airflow, Dagster, Prefect) and large-scale distributed frameworks.

Preferred Qualifications:

  • Advanced degree (Master’s or Ph.D.) in Computer Science, Mathematics, Statistics, Physics, or a related quantitative field.
  • Experience architecting creative solutions for identity resolution, graph data structures, or fraud prevention systems.
  • Fluent and terminal-native in Linux/Unix environments, command-line utilities, and shell scripting.
  • Experience in high-growth/pre-IPO Technology companies.

The anticipated salary pay range for Metro 3 areas for this role is $175,000 - $200,000 plus company bonus.

Prove follows a market driven compensation philosophy based on geographic location and respective market rates. Job offers will be aligned to location. Please speak with your recruiter if you have questions. Prove defines:

  • Metro 2 - NYC metro area, Seattle metro area, Los Angeles metro area, and the Miami metro area.
  • Metro 3 - all other cities across the domestic United States, with the exception of the San Francisco Bay Area.
Benefits & Perks for FTE Provers:
  • Competitive salaries & Bonus Plan (for eligible roles) and Equity Plan
  • Modern Health for financial, mental, and physical wellness
  • 401(k) Retirement Plan & Match (US Offices) and Local Country Pension (International Offices)
  • Unlimited Vacation and Flexible hours
  • Comprehensive medical benefits for you and your family ❤️
  • Emotional & Physical Wellness – Access to wellness services (EAP & Prove Well-Being Reimbursement)
  • Bottomless snacks & beverages for certain office locations
  • Daily GrubHub stipend for lunch if coming into the office (US Offices)
  • A great place to work and connect with other talented Provers like yourself!

Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. At Prove we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.

Equal Opportunity Employment:

Prove is an equal opportunity employer committed to providing equal employment opportunity for all people regardless of race, color, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics 

Privacy & Data Protection:

When you are applying for a job at Prove, we collect and use your personal information in the job application process. To understand more about how Prove uses your personal information, please see our Recruitment Privacy Policy on our website.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Experience in high-growth/pre-IPO Technology companies. The anticipated salary pay range for Metro 3 areas for this role is $175,000 - $200,000 plus company bonus. Prove follows a market driven compensation philosophy based on geographic location and respective market rates. Job offers will be aligned to location. Please speak with your recruiter if you have questions. Prove defines:
Location & working pattern

New York, NY

FLSA Status: Exempt Location: Hybrid - New York, NY Job Summary
Work authorization
Equal Opportunity Employment: Prove is an equal opportunity employer committed to providing equal employment opportunity for all people regardless of race, color, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics Privacy & Data Protection:

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.