Back to jobs

Software Engineer III, Machine Learning Compiler, TPU Scaling

Pay
USD 147,000–210,000/yearAnnual period assumed — pay source
Our team develops the ML Compiler (XLA) for running workloads on thousands of TPU, GPU or other accelerators. Accelerated Linear Algebra (XLA) powers all Google’s internal ML workloads and is a preferred choice for external foundational model producers and researchers for its advanced performance, usability and open source nature. As part of the team, you will be developing the compiler's ability to generate efficient communication on TPU. Your team will develop the compiler's horizontal scaling stack including collective op lowering, hiding communication latency, program sharding and more. Together these make it possible to train and serve the world's largest models efficiently on TPU.Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $147000 - $210000 (USD) + 15% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) .
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Implement and optimize collective operations (all-reduce, all-gather) in the XLA TPU backend

  • Improve compiler scheduling to overlap communication with computation

  • Analyze TPU architecture and interconnect features to improve scaling performance

  • Work with ML performance and research teams to diagnose scaling bottlenecks

From the employer’s posting
Implement and optimize collective operations (e.g., all-reduce, all-gather, reduce-scatter, all-to-all) in the XLA TPU backend
Improve compiler scheduling to overlap communication with computation, balancing latency, memory pressure and throughput.
Analyze current and upcoming TPU architecture and interconnect features and use them to improve scaling performance.
Work with ML performance and research teams to diagnose scaling bottlenecks and reach roofline performance on critical workloads.

Before you apply

Employer’s visa record
10,916 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Education & alternatives
**Minimum qualifications:** + Bachelor’s degree or equivalent practical experience. + 2 years of experience in low level systems programming languages (e.g. C++ or C).
**Preferred qualifications:** + Master's degree or PhD in Computer Science or related technical fields. + 2 years of experience with data structures and algorithms.
Apply at Google

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 14, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 17, 2026

We found this posting on the National Labor Exchange. These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$147K–$210K against $166K–$237K, the middle half of what similar US postings state.

From 1,505 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 7 and day 76.

At Google, jobs usually come down by about day 3.

From 5,795 similar postings that came down, and 523 of Google’s. Coming down is not always a hire.

Google is hiring

277 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • ML Engineer hiring is picking up
  • Takes jobs down quickly
  • 8% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C
  • C++
  • GCP
Where the posting names them
+ Bachelor’s degree or equivalent practical experience. + 2 years of experience in low level systems programming languages (e.g. C++ or C). + 1 year of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Our team develops the ML Compiler (XLA) for running workloads on thousands of TPU, GPU or other accelerators. Accelerated Linear Algebra (XLA) powers all Google’s internal ML workloads and is a preferred choice for external foundational model producers and researchers for its advanced performance, usability and open source nature. As part of the team, you will be developing the compiler's ability to generate efficient communication on TPU. Your team will develop the compiler's horizontal scaling stack including collective op lowering, hiding communication latency, program sharding and more. Together these make it possible to train and serve the world's largest models efficiently on TPU.Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $147000 - $210000 (USD) + 15% bonus target + equity + benefits

Your next step

Complete your application on www.google.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Software Engineer III, Machine Learning Compiler, TPU Scaling Share Software Engineer III, Machine Learning Compiler, TPU Scaling _corporate_fare_ Google _place_ Sunnyvale, CA, USA **Mid** Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Share Software Engineer III, Machine Learning Compiler, TPU Scaling _info_outline_ XIn most instances, this position requires in-person interviews as part of the hiring process. **Minimum qualifications:** + Bachelor’s degree or equivalent practical experience. + 2 years of experience in low level systems programming languages (e.g. C++ or C). + 1 year of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field. + 1 year of experience with end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging). + Experience in performance optimization and compiler development. **Preferred qualifications:** + Master's degree or PhD in Computer Science or related technical fields. + 2 years of experience with data structures and algorithms. + Experience developing accessible technologies. + Experience with Hardware Design, Hardware Architecture. **About the job** Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Our team develops the ML Compiler (XLA) for running workloads on thousands of TPU, GPU or other accelerators. Accelerated Linear Algebra (XLA) powers all Google’s internal ML workloads and is a preferred choice for external foundational model producers and researchers for its advanced performance, usability and open source nature. As part of the team, you will be developing the compiler's ability to generate efficient communication on TPU. Your team will develop the compiler's horizontal scaling stack including collective op lowering, hiding communication latency, program sharding and more. Together these make it possible to train and serve the world's largest models efficiently on TPU.Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $147000 - $210000 (USD) + 15% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) . **Responsibilities** + Execute solutions in one or more specialized ML areas, utilize ML infrastructure, and contribute to model optimization and data processing. + Implement and optimize collective operations (e.g., all-reduce, all-gather, reduce-scatter, all-to-all) in the XLA TPU backend, from HLO-level transformations to low-level code generation. + Improve compiler scheduling to overlap communication with computation, balancing latency, memory pressure and throughput. + Analyze current and upcoming TPU architecture and interconnect features and use them to improve scaling performance. + Work with ML performance and research teams to diagnose scaling bottlenecks and reach roofline performance on critical workloads. Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google'sApplicant and Candidate Privacy Policy (./privacy-policy) . Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See alsoGoogle's EEO Policy (https://www.google.com/about/careers/applications/eeo/) ,Know your rights: workplace discrimination is illegal (https://careers.google.com/jobs/dist/legal/EEOC\_KnowYourRights\_10\_20.pdf) ,Belonging at Google (https://about.google/belonging/) , andHow we hire (https://careers.google.com/how-we-hire/) . If you have a need that requires accommodation, please let us know by completing ourAccommodations for Applicants form (https://goo.gl/forms/aBt6Pu71i1kzpLHe2) . Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes. Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right. Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also https://careers.google.com/eeo/ and https://careers.google.com/jobs/dist/legal/OFCCP_EEO_Post.pdf If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form: https://goo.gl/forms/aBt6Pu71i1kzpLHe2.

About Google

People
About 190,820 in 2025, up 4% from the year before.Annual report (SEC Form 10-K)
Company
Listed as GOOGL.
H-1B visas
1,765 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

This passage needs a closer read in the full description.

Location & working pattern

Sunnyvale, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

This passage needs a closer read in the full description.

Open source at www.google.com ↗

This posting reached us through a job exchange.

Read the full description ↓

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.