Back to jobs

Technical Lead Manager, ML Dataset Platform

Pay
USD 200,000–280,000/year — pay source
Experience with data lineage, metadata catalogs, or feature-store systems. The US yearly salary range for this role is: $200,000 - $280,000 USD in addition to competitive perks & benefits. Waabi US Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus. Perks/Benefits:
Read the full posting
Work setting
Hybrid — work setting source
Work setup in the employer’s posting: hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type Full-time
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Lead, hire and mentor the ML Dataset Platform engineering team

  • Define APIs, tools and storage formats for ML datasets

  • Build dataset tooling for versioning and incremental updates at scale

  • Own shared dataloading tools and training-throughput observability

  • Make data lineage automatic from raw data through trained models

From the employer’s posting
Lead and grow the ML Dataset Platform team as both its technical lead and people manager: set the technical direction, define the roadmap, hire, and mentor engineers.
Define the APIs, tools and storage formats for Waabi's ML datasets
Build the tooling to manage datasets at scale, including versioning and efficient incremental updates without full rebuilds.
Own the common dataloading tools used across workloads, including observability into bottlenecks and the throughput of training jobs.
Make data lineage a first-class, fully automatic property of every dataset, from raw data through to the model trained on them.

What you’ll bring

All qualifications

Core experience

  • Experience with ML data infrastructure in autonomous driving or robotics (multi-sensor logs, LiDAR, camera, HD maps).
  • Experience with columnar and tensor storage formats (e.g., Parquet, Lance, WebDataset, Zarr) and dataset versioning tools.
  • Experience with multi-cloud or hybrid training environments and the data-movement challenges that come with them.
  • Experience with data lineage, metadata catalogs, or feature-store systems.
Qualification wording
Experience with ML data infrastructure in autonomous driving or robotics (multi-sensor logs, LiDAR, camera, HD maps).
Experience with columnar and tensor storage formats (e.g., Parquet, Lance, WebDataset, Zarr) and dataset versioning tools.
Experience with multi-cloud or hybrid training environments and the data-movement challenges that come with them.
Experience with data lineage, metadata catalogs, or feature-store systems.
Apply at Waabi

Posting record

Report an error

Actively hiringFirst seen by us 13 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 6, 202613 days ago
Recorded sightings
12
Last seen by us
Nov 19, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$200K–$280K against $155K–$227K, the middle half of what similar US postings state.

From 3,228 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 13

Similar jobs usually come down between day 8 and day 57.

From 9,715 similar postings that came down. Coming down is not always a hire.

Waabi is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Spark
  • PyTorch
Where the posting names them
- Deep ML dataset experience: You have designed and built large-scale data infrastructure for ML training (storage formats, dataset versioning, ETL, dataloading) and understand the performance characteristics of petabyte-scale sensor or multimodal data. - Strong software engineering and implementation: You have very strong Python skills and are comfortable in PyTorch training loops; you have strong software-engineering fundamentals and experience with distributed systems, cloud storage, and data processing frameworks (e.g., Spark, Ray, Beam). - Proven technical leadership: You have led a platform or infrastructure effort used by multiple teams, defined its APIs, and driven adoption across an organization.

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.
 
With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: www.waabi.ai

As TLM of the ML Datasets Platform, you will play a critical role defining the APIs, tooling, and storage formats that make datasets a shared, first-class asset at Waabi: versioned, efficiently updatable, fully traceable, and fast to load across GPU workloads. The technical challenge is to find the right abstractions so that every ML team can integrate with the platform for its model development use case without being forced into a one-size-fits-all mold, and without building its own data infrastructure on the side. You will do this as a hands-on technical leader who also grows and manages the team, sets its roadmap, and partners closely with the ML Training Platform team and the ML development teams who are the platform's customers.
 

You will…

  • Lead and grow the ML Dataset Platform team as both its technical lead and people manager: set the technical direction, define the roadmap, hire, and mentor engineers.

  • Define the APIs, tools and storage formats for Waabi's ML datasets, balancing maximal reuse of data and tooling against the specific needs of each training workload.

  • Build the tooling to manage datasets at scale, including versioning and efficient incremental updates without full rebuilds.

  • Design the APIs that let teams express training-time transformations along the continuum between fully reproducible ahead-of-time ETL and dynamic transformation within data loaders.

  • Own the common dataloading tools used across workloads, including observability into bottlenecks and the throughput of training jobs.

  • Streamline data access for multi-cloud training so that datasets are available as needed with predictable cost and latency.

  • Make data lineage a first-class, fully automatic property of every dataset, from raw data through to the model trained on them.

  • Partner with the ML Training Platform team on the boundary between data and training infrastructure, and with the ML development teams on transitioning shared-dataset tooling into the new platform.

  • Drive adoption: work directly with model teams to migrate their training data onto the platform and feed what you learn back into your team’s roadmap.

 

Qualifications:

  • Deep ML dataset experience: You have designed and built large-scale data infrastructure for ML training (storage formats, dataset versioning, ETL, dataloading) and understand the performance characteristics of petabyte-scale sensor or multimodal data.

  • Strong software engineering and implementation: You have very strong Python skills and are comfortable in PyTorch training loops; you have strong software-engineering fundamentals and experience with distributed systems, cloud storage, and data processing frameworks (e.g., Spark, Ray, Beam).

  • Proven technical leadership: You have led a platform or infrastructure effort used by multiple teams, defined its APIs, and driven adoption across an organization.

  • People leadership: You have managed or tech-led a team of engineers, including hiring and mentoring, and can balance hands-on technical contribution with roadmap ownership and stakeholder management.

  • Team player: You communicate clearly with researchers and engineers, build consensus across teams with different needs, and deliver in a fast-paced environment.


Bonus:

  • Experience with ML data infrastructure in autonomous driving or robotics (multi-sensor logs, LiDAR, camera, HD maps).

  • Experience with columnar and tensor storage formats (e.g., Parquet, Lance, WebDataset, Zarr) and dataset versioning tools.

  • Experience with multi-cloud or hybrid training environments and the data-movement challenges that come with them.

  • Experience with data lineage, metadata catalogs, or feature-store systems.

The US yearly salary range for this role is: $200,000 - $280,000 USD in addition to competitive perks & benefits. Waabi US Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.
 

Perks/Benefits:
  • Competitive compensation and equity awards.
  • Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
  • Unlimited Vacation.
  • Flexible hours and Work from Home support.
  • Daily drinks, snacks and catered meals (when in office).
  • Regularly scheduled team building activities and social events both on-site, off-site & virtually.
  • As we grow, this list continues to evolve! 
 
Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!
 
Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.

Employment type

Full-time

Demand for Data Leadership roles

New Data Leadership postings at the employers we follow are up 8% over the last 6 weeks compared with the 6 before.

Weekly new Data Leadership postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 752, the most 1,164, and the latest week had 785.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Leadership, by the work the posting describes.

Data leaders run data teams or design how a company's data fits together. Managers hire, set priorities and answer for whether the data work pays off; architects choose the systems and the shape of the data.

Expect years of hands-on data work, experience leading people or projects, and the ability to explain tradeoffs to executives.

Unlike a senior engineer or analyst, most of a data leader's week goes to people, planning and decisions rather than building.

US government figures for computer and information systems managers

Median yearly pay, May 2025
$175,140
Expected change, 2025 to 2035
15.8% more jobsagainst 3.5% for all jobs

The government has no code for data leaders, so these figures are for the closest group, computer and information systems managers, which includes data processing and data operations managers.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 11-3021.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Experience with data lineage, metadata catalogs, or feature-store systems. The US yearly salary range for this role is: $200,000 - $280,000 USD in addition to competitive perks & benefits. Waabi US Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus. Perks/Benefits:
Location & working pattern

San Francisco, CA

- Experience with columnar and tensor storage formats (e.g., Parquet, Lance, WebDataset, Zarr) and dataset versioning tools. - Experience with multi-cloud or hybrid training environments and the data-movement challenges that come with them. - Experience with data lineage, metadata catalogs, or feature-store systems.
More source context
- Daily drinks, snacks and catered meals (when in office). - Regularly scheduled team building activities and social events both on-site, off-site & virtually. - As we grow, this list continues to evolve!
Work authorization
Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact! Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know. Employment type

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.