Back to jobs

Staff Software Engineer, On-Device Machine Learning

Pay
USD 207,000–300,000/yearAnnual period assumed — pay source
Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) .
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Enable on-device deployment of key models across GPU, TPU, NPU and CPU on Android and Chrome

  • Improve on-device model inference performance through model, runtime and kernel optimizations

  • Train task-specific in-app AI models and co-design Gemma model and runtime (quantization, conversion)

  • Build developer tooling for testing, evaluating and deploying models across devices

From the employer’s posting
Enable on-device deployment of key models across various accelerators (GPU/Pixel TPU/NPUs/CPU) on Android, Chrome, and more.
Improve performance of on-device model inference via optimizations in the model presentation, on-device runtime and kernel implementation.
Train task-specific models of in-app AI enabling Gemma model/runtime co-design (quantization, conversion)
Enable tooling of GTM for on-device Gemma 0-day (AI Edge Gallery), helping developers to test/eval/deploy across devices.
Education & alternatives
**Minimum qualifications:** + Bachelor’s degree or equivalent practical experience. + 8 years of experience in software development.
**Preferred qualifications:** + Master’s degree or PhD in Engineering, Computer Science, or a related technical field. + 8 years of experience with data structures and algorithms.
Apply at Google

Posting record

Report an error

Actively hiringFirst seen by us 11 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Oct 31, 202611 days ago
Recorded sightings
8
Last seen by us
Nov 10, 2026
Employer says posted
Oct 20, 2026

We found this posting on the National Labor Exchange. These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$207K–$300K against $166K–$240K, the middle half of what similar US postings state.

From 1,383 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 11

Similar jobs usually come down between day 8 and day 75.

Well past Google’s usual: its jobs come down by about day 3.

From 5,198 similar postings that came down, and 484 of Google’s. Coming down is not always a hire.

Google is hiring

233 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • ML Engineer hiring is picking up
  • Takes jobs down quickly
  • 7% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C++
  • GCP
Where the posting names them
+ 8 years of experience in software development. + 5 years of experience with software development in C++ programming language. + 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
We serve Google's flagship apps across Android, iOS and Web with infrastructure, models and solutions (YouTube Shorts/Meet/Photos/Translate/Messages, etc.). We enable GDM with 0-day Gemma launches (Gemma 3n and 4 and variants such as EmbeddingGemma), and support our platforms (Chrome/Android) and Devices (Pixel/Watch). We also enable third-party developers and the ecosystem. The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving team behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.
The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving team behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more. Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

Your next step

Complete your application on www.google.com. The employer’s form will show what is required.

Already applied? Track this application

About Google

People
About 190,820 in 2025, up 4% from the year before.Annual report (SEC Form 10-K)
Company
Listed as GOOGL.
H-1B visas
1,765 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 2. The fewest in a week was 617, the most 1,122, and the latest week had 1,122.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Job description

View original posting ↗

Staff Software Engineer, On-Device Machine Learning Share Staff Software Engineer, On-Device Machine Learning _corporate_fare_ Google _place_ Sunnyvale, CA, USA **Advanced** Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders; deep expertise in domain. Share Staff Software Engineer, On-Device Machine Learning _info_outline_ XIn most instances, this position requires in-person interviews as part of the hiring process. **Minimum qualifications:** + Bachelor’s degree or equivalent practical experience. + 8 years of experience in software development. + 5 years of experience with software development in C++ programming language. + 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture. + 5 years of experience leading ML design and optimizing end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging, fine tuning). **Preferred qualifications:** + Master’s degree or PhD in Engineering, Computer Science, or a related technical field. + 8 years of experience with data structures and algorithms. + 3 years of experience in a technical leadership role leading project teams and setting technical direction. + 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects. + Experience in deploying on-device Machine Learning models. **About the job** Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward. Google AI Edge enables developers and Google products to deploy AI across mobile, web and embedded with with our AI edge stack (ai.google.dev/edge) - from low-code APIs to hardware specific acceleration libraries to achieve leading performance and device optionality at scale. Our team focuses on cross-platform infrastructure and solutions serving all of Google AI's biz needs. We serve Google's flagship apps across Android, iOS and Web with infrastructure, models and solutions (YouTube Shorts/Meet/Photos/Translate/Messages, etc.). We enable GDM with 0-day Gemma launches (Gemma 3n and 4 and variants such as EmbeddingGemma), and support our platforms (Chrome/Android) and Devices (Pixel/Watch). We also enable third-party developers and the ecosystem. The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving team behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) . **Responsibilities** + Enable one or more areas in Google AI Edge Developer Tools such as AI Edge Gallery (Gemma's showcase app for on-device Gemma 0-day), Developer Device Platform (Device farm with AI, enabling developers to test/eval/deploy apps and models across device), and AI Edge Eval (innovative eval framework for on-device model and harness). + Train task-specific models of in-app AI enabling Gemma model/runtime co-design (quantization, conversion), build industry-leading on-device AI solutions (voice translate, generative image editing) + Enable tooling of GTM for on-device Gemma 0-day (AI Edge Gallery), helping developers to test/eval/deploy across devices. + Enable on-device deployment of key models across various accelerators (GPU/Pixel TPU/NPUs/CPU) on Android, Chrome, and more. + Improve performance of on-device model inference via optimizations in the model presentation, on-device runtime and kernel implementation. Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google'sApplicant and Candidate Privacy Policy (./privacy-policy) . Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See alsoGoogle's EEO Policy (https://www.google.com/about/careers/applications/eeo/) ,Know your rights: workplace discrimination is illegal (https://careers.google.com/jobs/dist/legal/EEOC\_KnowYourRights\_10\_20.pdf) ,Belonging at Google (https://about.google/belonging/) , andHow we hire (https://careers.google.com/how-we-hire/) . If you have a need that requires accommodation, please let us know by completing ourAccommodations for Applicants form (https://goo.gl/forms/aBt6Pu71i1kzpLHe2) . Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes. Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right. Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also https://careers.google.com/eeo/ and https://careers.google.com/jobs/dist/legal/OFCCP_EEO_Post.pdf If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form: https://goo.gl/forms/aBt6Pu71i1kzpLHe2.
Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) .
Location & working pattern

Sunnyvale, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

This passage needs a closer read in the full description.

Open source at www.google.com ↗

This posting reached us through a job exchange.

Read the full description ↓

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.