Pay
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,505 postings in the last year. Stated ranges, not salaries paid.
Palo Alto, CA, United States
Live, first seen by us 66 days agoEmployment type in the employer’s posting: Full timeFrom the employer’s posting
Design, build, and maintain an end-to-end ML training platform
Run and optimize single-node and distributed GPU training workloads
Build and operate training infrastructure on Kubernetes such as EKS
Enable LLM training and fine-tuning workflows with evaluation and artifact governance
Implement observability for training systems, including alerting and runbooks
Design, build, and maintain end-to-end ML training platform.
Run and optimize GPU training workloads (single-node and distributed)
Build and operate training infrastructure on Kubernetes (e.g., EKS and other manage Kubernetes platforms)
Enable Gen AI/LLM training and fine-tuning workflows (e.g., supervised fine-tuning)
Implement observability for training systems: metrics, logs, dashboards, alerting, and operational runbooks.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,505 postings in the last year. Stated ranges, not salaries paid.
Day 66
Similar jobs usually come down between day 7 and day 76.
Well past JPMorgan Chase’s usual: its jobs come down by about day 15.
From 5,830 similar postings that came down, and 1,068 of JPMorgan Chase’s. Coming down is not always a hire.
353 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Demonstrated experience running ML training in cloud environments and debugging issues across infrastructure & code. - Strong Python skills with solid engineering practices (testing, code reviews, modular design, dependency management). - Experience building automation/CI for ML codebases (build, test, release, deployment/promotion workflows).
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorganChase within AI/ML Data Platforms, you are an integral part of an agile team that works to build and operate scalable, reliable ML training systems and pipelines on AWS and other cloud platforms. You will productionize training workloads (often GPU-based), improve performance and cost efficiency, and enable repeatable, well-governed training across environments. Job Responsibilities
- Ability to profile and optimize training systems (CPU/GPU utilization, memory, I/O throughput, networking, scheduling). - Experience with Kubernetes fundamentals for running compute-intensive workloads and AWS (eg., EKS/ECR, S3, IAM, VPC/networking, Cloudwatch, EC2) - Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
- Run and optimize GPU training workloads (single-node and distributed), improving throughput, utilization and reproducibility. - Build and operate training infrastructure on Kubernetes (e.g., EKS and other manage Kubernetes platforms), including resource management and workload troubleshooting. - Enable Gen AI/LLM training and fine-tuning workflows (e.g., supervised fine-tuning), including evaluation harnesses, artifact/version governance, and scalable GPU execution patterns aligned to enterprise controls.
- Experience optimizing training input pipelines (sharding, prefetching, caching, format choices such as Parquet/WebDataset) and working with large datasets. - Familiarity with distributed compute frameworks (Spark, Ray, Dask) for feature/dataset generation. - Familiarity with workflow orchestration tools (Airflow-like systems, Argo Workflows-like patterns) and model registry concepts.
- Familiarity with distributed compute frameworks (Spark, Ray, Dask) for feature/dataset generation. - Familiarity with workflow orchestration tools (Airflow-like systems, Argo Workflows-like patterns) and model registry concepts. - Experience optimizing training cost/performance (right-sizing, scheduling policies, interruptible capacity strategies where applicable budge guardrails, quota planning).
- Experience building automation/CI for ML codebases (build, test, release, deployment/promotion workflows). - Hands on experience with deep learning training workflows and at least one major framework (eg., PyTorch or TensorFlow). - Understanding of training performance and stability: data loading bottlenecks, mixed precision, checkpointing, reproducibility, and evaluation methodology.
Complete your application on jpmc.fa.oraclecloud.com. The employer’s form will show what is required.
Already applied? Track this application
Yes. We’ve followed one other Lead Software Engineer - Machine Learning job there since August 2026. It is still up.
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorganChase within AI/ML Data Platforms, you are an integral part of an agile team that works to build and operate scalable, reliable ML training systems and pipelines on AWS and other cloud platforms. You will productionize training workloads (often GPU-based), improve performance and cost efficiency, and enable repeatable, well-governed training across environments.
Job Responsibilities
Design, build, and maintain end-to-end ML training platform.
Run and optimize GPU training workloads (single-node and distributed), improving throughput, utilization and reproducibility.
Build and operate training infrastructure on Kubernetes (e.g., EKS and other manage Kubernetes platforms), including resource management and workload troubleshooting.
Enable Gen AI/LLM training and fine-tuning workflows (e.g., supervised fine-tuning), including evaluation harnesses, artifact/version governance, and scalable GPU execution patterns aligned to enterprise controls.
Implement observability for training systems: metrics, logs, dashboards, alerting, and operational runbooks.
Partner with data engineering and platform teams to define interfaces, standards, and guardrails (security, access, cost controls)
Improve developer experience for training: standardized containers, CI/CD, templates, documentation, and self-service workflow
Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
Required qualifications, capabilities, and skills
Formal training or certification on software engineering concepts and 5+ years applied experience.
Demonstrated experience running ML training in cloud environments and debugging issues across infrastructure & code.
Strong Python skills with solid engineering practices (testing, code reviews, modular design, dependency management).
Experience building automation/CI for ML codebases (build, test, release, deployment/promotion workflows).
Hands on experience with deep learning training workflows and at least one major framework (eg., PyTorch or TensorFlow).
Understanding of training performance and stability: data loading bottlenecks, mixed precision, checkpointing, reproducibility, and evaluation methodology.
Experience with distributed training and related concepts (e.g., DDP/FSDP/DeepSpeed concepts, collective communication basics, scaling and bottleneck analysis).
Ability to profile and optimize training systems (CPU/GPU utilization, memory, I/O throughput, networking, scheduling).
Experience with Kubernetes fundamentals for running compute-intensive workloads and AWS (eg., EKS/ECR, S3, IAM, VPC/networking, Cloudwatch, EC2)
Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices.
Preferred qualifications, capabilities, and skills
Experience running training workloads across multiple cloud platforms and managing portability, performance, and governance across environments.
Familiarity with cloud-native networking/storage patterns for high-throughput training and artifact management.
Experience optimizing training input pipelines (sharding, prefetching, caching, format choices such as Parquet/WebDataset) and working with large datasets.
Familiarity with distributed compute frameworks (Spark, Ray, Dask) for feature/dataset generation.
Familiarity with workflow orchestration tools (Airflow-like systems, Argo Workflows-like patterns) and model registry concepts.
Experience optimizing training cost/performance (right-sizing, scheduling policies, interruptible capacity strategies where applicable budge guardrails, quota planning).
Strong observability practice for training systems: metrics/logs/traces, GPU telemetry, dashboards, and alert tuning.
FEDERAL DEPOSIT INSURANCE ACT: This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase’s review of criminal conviction history, including pretrial diversions or program entries.
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Palo Alto, CA, United States
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.