Back to jobs

HPC Data Provenance – Postdoctoral Researcher

Pay
$143,328/year — pay source
Pay Range $143,328 Annually Additional Information
Read the full posting
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • You will work with domain scientists to validate these capabilities on leading-edge AI-for-science workflows running on Livermore Computing production systems.

From the employer’s posting
Job Description We are seeking a Postdoctoral Researcher to perform research in data provenance, multi-layer tracing, and I/O characterization for large-scale scientific and AI workflows on high-performance computing (HPC) systems. Scientists increasingly need to answer questions such as which data produced a result, what transformed it, and which downstream models and analyses are affected when that data changes. Today the evidence needed to answer these questions is fragmented across hardware, operating system, I/O, runtime, and workflow layers. You will research and develop low-overhead techniques to automatically capture provenance from heterogeneous sources (e.g., application- and workflow-level tracers, data registries, and kernel-level instrumentation such as eBPF), assign stable identities to data artifacts as they move through workflows, and normalize and temporally align these records into a common representation that supports trustworthy, auditable lineage at HPC scale. You will work with domain scientists to validate these capabilities on leading-edge AI-for-science workflows running on Livermore Computing production systems. This position is in the Center for Applied Scientific Computing (CASC) within the Computing Directorate. In this role you will

What you’ll bring

All qualifications

Core experience

  • Ability to conduct high-quality research and to develop implementations of sophisticated algorithms and systems to evaluate the results.
  • Experience programming in C/C++ and Python in a Linux environment.
  • Proficient verbal and written communication skills necessary to interact with members of a research team, author technical and scientific reports and papers, and deliver technical presentations.
  • Experience with data provenance, lineage tracking, or reproducibility of scientific or machine learning workflows.
  • Experience with operating system internals or kernel-level instrumentation (e.g., the Linux kernel, eBPF).
  • Experience with I/O tracing and characterization tools (e.g., Darshan, DFTracer, Recorder) or I/O benchmarks for deep learning.
Qualification wording
Ability to conduct high-quality research and to develop implementations of sophisticated algorithms and systems to evaluate the results.
Experience programming in C/C++ and Python in a Linux environment.
Proficient verbal and written communication skills necessary to interact with members of a research team, author technical and scientific reports and papers, and deliver technical presentations.
Experience with data provenance, lineage tracking, or reproducibility of scientific or machine learning workflows.
Experience with operating system internals or kernel-level instrumentation (e.g., the Linux kernel, eBPF).
Experience with I/O tracing and characterization tools (e.g., Darshan, DFTracer, Recorder) or I/O benchmarks for deep learning.
Education & alternatives
Qualifications - PhD in Computer Science, Computer Engineering, or related field. - Research experience in HPC I/O, storage systems, or scientific data management.
Position Information This is a Postdoctoral appointment with the possibility of extension to a maximum of three years. The postdoctoral appointment is a temporary, mentored training position intended for individuals in the early stages of their postdoctoral research careers. Consistent with the structure of the program, applicants must have received their Ph.D. (or equivalent doctorate) within five years of the anticipated start date. Why Lawrence Livermore National Laboratory?
Apply at LLNL

Posting record

Report an error

Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 17, 2026today
Recorded sightings
2
Last seen by us
Nov 18, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$143K against $119K–$194K, the middle half of what similar US postings state.

From 3,944 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 0

Early. Similar jobs usually come down between day 8 and day 60.

At LLNL, jobs usually come down by about day 14.

From 12,028 similar postings that came down, and 29 of LLNL’s. Coming down is not always a hire.

LLNL is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
  • Takes jobs down quickly
  • 17% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C
  • C++
  • Python
Where the posting names them
- Ability to conduct high-quality research and to develop implementations of sophisticated algorithms and systems to evaluate the results. - Experience programming in C/C++ and Python in a Linux environment. - Proficient verbal and written communication skills necessary to interact with members of a research team, author technical and scientific reports and papers, and deliver technical presentations.

Your next step

Complete your application on jobs.smartrecruiters.com. The employer’s form will show what is required.

Applying through SmartRecruiters

  • Uploading your resume fills in the application form for you, so check what it filled before you send.

Already applied? Track this application

Job description

View original posting ↗

Job Description

We are seeking a Postdoctoral Researcher to perform research in data provenance, multi-layer tracing, and I/O characterization for large-scale scientific and AI workflows on high-performance computing (HPC) systems. Scientists increasingly need to answer questions such as which data produced a result, what transformed it, and which downstream models and analyses are affected when that data changes. Today the evidence needed to answer these questions is fragmented across hardware, operating system, I/O, runtime, and workflow layers. You will research and develop low-overhead techniques to automatically capture provenance from heterogeneous sources (e.g., application- and workflow-level tracers, data registries, and kernel-level instrumentation such as eBPF), assign stable identities to data artifacts as they move through workflows, and normalize and temporally align these records into a common representation that supports trustworthy, auditable lineage at HPC scale. You will work with domain scientists to validate these capabilities on leading-edge AI-for-science workflows running on Livermore Computing production systems. This position is in the Center for Applied Scientific Computing (CASC) within the Computing Directorate.

In this role you will

  • Research and develop low-overhead, multi-layer provenance and I/O capture techniques for HPC workflows spanning the application, runtime, I/O library, file system, and operating system layers.
  • Research and develop methods to integrate capture with HPC resource managers (e.g., Flux, Slurm) so that provenance is collected automatically without requiring changes to user workflows.
  • Design and implement scalable registries that assign stable identities to datasets, model checkpoints, and workflow stages and reconcile the names used for them across different tools.
  • Research and develop techniques to normalize, compress, and temporally align high-volume heterogeneous trace and event streams into a common schema.
  • Characterize and minimize the performance overhead of tracing and provenance capture on large-scale deep learning and scientific workloads.
  • Develop benchmarks, ground-truth datasets, and validation methodologies to evaluate provenance correctness, coverage, and overhead.
  • Develop high-quality, open-source software that is extensible and maintainable by downstream users and developers.
  • Deploy and evaluate software on Laboratory production HPC systems and interact with application scientists to understand practical, real-world requirements and limitations.
  • Pursue independent (but complementary) research interests and interact with team members internally and externally.
  • Publish research results in external peer-reviewed scientific journals and participate in conferences and workshops.
  • Present formal and informal overview of research progress at group meetings.
  • Participate in existing division collaborations and alliances with academia and industry.
  • Perform other duties as assigned.

Qualifications

  • PhD in Computer Science, Computer Engineering, or related field.
  • Research experience in HPC I/O, storage systems, or scientific data management.
  • Research experience in tracing, profiling, or performance analysis of parallel or distributed applications.
  • Research experience with large-scale deep learning or scientific workflows, either as workloads to characterize or as tools applied to systems problems.
  • Ability to conduct high-quality research and to develop implementations of sophisticated algorithms and systems to evaluate the results.
  • Experience programming in C/C++ and Python in a Linux environment.
  • Proficient verbal and written communication skills necessary to interact with members of a research team, author technical and scientific reports and papers, and deliver technical presentations.
  • Demonstrated publication record in peer-reviewed journals and/or conferences.
  • Strong decision-making skills necessary to independently solve complex research problems.

Qualifications We Desire (optional)

  • Experience with data provenance, lineage tracking, or reproducibility of scientific or machine learning workflows.
  • Experience with operating system internals or kernel-level instrumentation (e.g., the Linux kernel, eBPF).
  • Experience with I/O tracing and characterization tools (e.g., Darshan, DFTracer, Recorder) or I/O benchmarks for deep learning.
  • Experience indexing, compressing, or analyzing large trace or event datasets.
  • Experience running workloads on leadership-class HPC systems, parallel file systems, and HPC resource managers.
  • Experience developing and maintaining open-source research software with an external user community.

Pay Range

$143,328 Annually 

Additional Information

All your information will be kept confidential according to EEO guidelines.

Position Information

This is a Postdoctoral appointment with the possibility of extension to a maximum of three years. The postdoctoral appointment is a temporary, mentored training position intended for individuals in the early stages of their postdoctoral research careers. Consistent with the structure of the program, applicants must have received their Ph.D. (or equivalent doctorate) within five years of the anticipated start date.

Why Lawrence Livermore National Laboratory?

Security Clearance

None required.  However, if your assignment is longer than 179 days cumulatively within a calendar year, you must go through the Personal Identity Verification process.  This process includes completing an online background investigation form and receiving approval of the background check.  

National Defense Authorization Act (NDAA)

The 2025 National Defense Authorization Act (NDAA), Section 3112, generally prohibits citizens of China, Russia, Iran and North Korea without dual US citizenship or legal permanent residence from accessing specific non-public areas of national security or nuclear weapons facilities.  The restrictions of NDAA Section 3112 apply to this position.  To be qualified for this position, Candidates must be eligible to access the Laboratory in compliance with Section 3112.

Pre-Employment Drug Test

External applicant(s) selected for this position must pass a post-offer, pre-employment drug test. This includes testing for use of marijuana as Federal Law applies to us as a Federal Contractor.

Wireless and Medical Devices

Per the Department of Energy (DOE), Lawrence Livermore National Laboratory must meet certain restrictions with the use and/or possession of mobile devices in Limited Areas. Depending on your job duties, you may be required to work in a Limited Area where you are not permitted to have a personal and/or laboratory mobile device in your possession.  This includes, but not limited to cell phones, tablets, fitness devices, wireless headphones, and other Bluetooth/wireless enabled devices.  

If you use a medical device, which pairs with a mobile device, you must still follow the rules concerning the mobile device in individual sections within Limited Areas.  Sensitive Compartmented Information Facilities require separate approval. Hearing aids without wireless capabilities or wireless that has been disabled are allowed in Limited Areas, Secure Space and Transit/Buffer Space within buildings.

How to identify fake job advertisements

Please be aware of recruitment scams where people or entities are misusing the name of Lawrence Livermore National Laboratory (LLNL) to post fake job advertisements. LLNL never extends an offer without a personal interview and will never charge a fee for joining our company. All current job openings are displayed on the Career Page under “Find Your Job” of our website. If you have encountered a job posting or have been approached with a job offer that you suspect may be fraudulent, we strongly recommend you do not respond.

To learn more about recruitment scams: https://www.llnl.gov/sites/www/files/2023-05/LLNL-Job-Fraud-Statement-Updated-4.26.23.pdf

Equal Employment Opportunity

We are an equal opportunity employer that is committed to providing all with a work environment free of discrimination and harassment. All qualified applicants will receive consideration for employment without regard to race, color, religion, marital status, national origin, ancestry, sex, sexual orientation, gender identity, disability, medical condition, pregnancy, protected veteran status, age, citizenship, or any other characteristic protected by applicable laws.

Reasonable Accommodation

Our goal is to create an accessible and inclusive experience for all candidates applying and interviewing at the Laboratory.  If you need a reasonable accommodation during the application or the recruiting process, please use our online form to submit a request. 

California Privacy Notice

The California Consumer Privacy Act (CCPA) grants privacy rights to all California residents. The law also entitles job applicants, employees, and non-employee workers to be notified of what personal information LLNL collects and for what purpose. The Employee Privacy Notice can be accessed here.

Company Description

Join us and make YOUR mark on the World!

Lawrence Livermore National Laboratory (LLNL) has turned bold ideas into world-changing impact advancing science and technology to strengthen U.S. security and promote global stability. 

Our mission spans four critical national security areas nuclear deterrence, threat preparedness, energy security, and multi-domain defense empowering teams to take on the toughest challenges of today and tomorrow. With a culture built on innovation and operational excellence, LLNL is a place where your expertise can make a real impact.

Demand for Data Scientist roles

New Data Scientist postings at the employers we follow are up 4% over the last 6 weeks compared with the 6 before.

Weekly new Data Scientist postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 1,402, the most 2,948, and the latest week had 1,752.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Scientist, by the work the posting describes.

Data scientists use statistics and models to answer harder questions, such as whether a change worked, what demand will look like next quarter, or which customers are likely to leave.

Postings usually ask for Python or R, SQL, statistics, experiment design and common machine learning methods.

Unlike an ML engineer, a data scientist's main output is often an analysis or a first model, not software running inside a product.

US government figures for data scientists

Median yearly pay, May 2025
$120,230
Expected change, 2025 to 2035
34.6% more jobsagainst 3.5% for all jobs

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-2051.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Pay Range $143,328 Annually Additional Information
Location & working pattern

Livermore, CA, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization
- Our values - visit https://www.llnl.gov/inclusion/our-values Security Clearance None required. However, if your assignment is longer than 179 days cumulatively within a calendar year, you must go through the Personal Identity Verification process. This process includes completing an online background investigation form and receiving approval of the background check.
More source context
National Defense Authorization Act (NDAA) The 2025 National Defense Authorization Act (NDAA), Section 3112, generally prohibits citizens of China, Russia, Iran and North Korea without dual US citizenship or legal permanent residence from accessing specific non-public areas of national security or nuclear weapons facilities. The restrictions of NDAA Section 3112 apply to this position. To be qualified for this position, Candidates must be eligible to access the Laboratory in compliance with Section 3112. Pre-Employment Drug Test

More relevant text appears in the full description.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.