Back to jobs

Senior Software Engineer, On-Device Machine Learning

Pay
USD 174,000–252,000/yearAnnual period assumed — pay source
Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) .
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Write and test product or system development code

  • Enable on-device deployment of Gemini Nano and Gemma across GPU, TPU, NPU and CPU

  • Improve on-device inference performance through model conversion, runtime and kernel work

  • Develop LiteRT, Google's on-device AI framework for first- and third-party use

  • Triage and resolve product issues by analyzing their sources and impact

From the employer’s posting
Write and test product or system development code.
Enable on-device deployment of key models, such as Gemini Nano and Gemma, across various accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, and more.
Improve performance of on-device model inference via optimizations in the model conversion, on-device runtime and kernel implementation.
Develop LiteRT, Google's on-device AI framework for 1P and 3P, enabling SOTA hardware acceleration and use cases on edge platforms
Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
Education & alternatives
**Minimum qualifications:** + Bachelor’s degree or equivalent practical experience. + 5 years of experience with software development in one or more programming languages.
**Preferred qualifications:** + Master's degree or PhD in Computer Science or a related technical field. + 5 years of experience with data structures and algorithms.
Apply at Google

Posting record

Report an error

Actively hiringFirst seen by us 8 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Oct 31, 20268 days ago
Recorded sightings
7
Last seen by us
Nov 8, 2026

We found this posting on the National Labor Exchange. These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$174K–$252K against $166K–$240K, the middle half of what similar US postings state.

From 1,319 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 8

Similar jobs usually come down between day 7 and day 72.

Well past Google’s usual: its jobs come down by about day 3.

From 4,655 similar postings that came down, and 486 of Google’s. Coming down is not always a hire.

Google is hiring

271 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • ML Engineer hiring is picking up
  • Takes jobs down quickly
  • 8% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • PyTorch
  • TensorFlow
Where the posting names them
+ Experience with on-device ML SDKs/tooling (e.g., TensorFlow Lite, ExecuTorch, Core ML, SNPE/QNN). + Knowledge of ML converters/compilers, and hardware-accelerated ML inference techniques and proficiency in ML frameworks (e.g., PyTorch, JAX, TensorFlow). + Understanding of Generative AI model architectures and their optimization for on-device execution.
+ 5 years of experience with data structures and algorithms. + Experience with on-device ML SDKs/tooling (e.g., TensorFlow Lite, ExecuTorch, Core ML, SNPE/QNN). + Knowledge of ML converters/compilers, and hardware-accelerated ML inference techniques and proficiency in ML frameworks (e.g., PyTorch, JAX, TensorFlow).
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. LiteRT is Google’s next generation on-device AI framework, succeeding TensorFlow Lite (TFLite). It is designed to maximize the performance, efficiency, and portability of ML models on a wide array of edge devices, from mobile phones to embedded systems. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

Your next step

Complete your application on www.google.com. The employer’s form will show what is required.

Already applied? Track this application

About Google

People
About 190,820 in 2025, up 4% from the year before.Annual report (SEC Form 10-K)
Company
Listed as GOOGL.
H-1B visas
1,765 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 5 weeks compared with the 5 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of October 26. The fewest in a week was 619, the most 1,091, and the latest week had 863.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 5 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Job description

View original posting ↗

Senior Software Engineer, On-Device Machine Learning Share Senior Software Engineer, On-Device Machine Learning _corporate_fare_ Google _place_ Sunnyvale, CA, USA **Mid** Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge within relevant area. Share Senior Software Engineer, On-Device Machine Learning _info_outline_ XIn most instances, this position requires in-person interviews as part of the hiring process. **Minimum qualifications:** + Bachelor’s degree or equivalent practical experience. + 5 years of experience with software development in one or more programming languages. + 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture. + 3 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field. + 3 years of experience with end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging). **Preferred qualifications:** + Master's degree or PhD in Computer Science or a related technical field. + 5 years of experience with data structures and algorithms. + Experience with on-device ML SDKs/tooling (e.g., TensorFlow Lite, ExecuTorch, Core ML, SNPE/QNN). + Knowledge of ML converters/compilers, and hardware-accelerated ML inference techniques and proficiency in ML frameworks (e.g., PyTorch, JAX, TensorFlow). + Understanding of Generative AI model architectures and their optimization for on-device execution. **About the job** Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. LiteRT is Google’s next generation on-device AI framework, succeeding TensorFlow Lite (TFLite). It is designed to maximize the performance, efficiency, and portability of ML models on a wide array of edge devices, from mobile phones to embedded systems. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) . **Responsibilities** + Write and test product or system development code. + Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality. + Develop LiteRT, Google's on-device AI framework for 1P and 3P, enabling SOTA hardware acceleration and use cases on edge platforms + Enable on-device deployment of key models, such as Gemini Nano and Gemma, across various accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, and more. + Improve performance of on-device model inference via optimizations in the model conversion, on-device runtime and kernel implementation. Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google'sApplicant and Candidate Privacy Policy (./privacy-policy) . Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See alsoGoogle's EEO Policy (https://www.google.com/about/careers/applications/eeo/) ,Know your rights: workplace discrimination is illegal (https://careers.google.com/jobs/dist/legal/EEOC\_KnowYourRights\_10\_20.pdf) ,Belonging at Google (https://about.google/belonging/) , andHow we hire (https://careers.google.com/how-we-hire/) . If you have a need that requires accommodation, please let us know by completing ourAccommodations for Applicants form (https://goo.gl/forms/aBt6Pu71i1kzpLHe2) . Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes. Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right. Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also https://careers.google.com/eeo/ and https://careers.google.com/jobs/dist/legal/OFCCP_EEO_Post.pdf If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form: https://goo.gl/forms/aBt6Pu71i1kzpLHe2.
Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) .
Location & working pattern

Sunnyvale, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

This passage needs a closer read in the full description.

Open source at www.google.com ↗

This posting reached us through a job exchange.

Read the full description ↓

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.