Back to jobs

ML Engineer

Melbourne · Melbourne, Victoria, Australia

Actively hiring, first seen by us 3 days ago
Pay
Pay not listed
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Base Compute — team source
Department: Base Compute
From the employer’s posting

What you’ll work on

Full posting
  • Build and scale the custom inference engine, including weight loading, KV-cache and request scheduling

  • Write and tune custom kernels for Apple Silicon, NVIDIA, AMD, Snapdragon and other edge hardware

  • Develop low-latency C++ serving runtimes with continuous batching and novel decoding strategies

  • Profile the full stack and remove bottlenecks, from memory bandwidth limits to kernel interleaving

From the employer’s posting
Building and scaling our custom inference engine, handling everything from weight loading and KV-cache management to efficient request scheduling
Writing and tuning custom kernels and leveraging hardware-specific instructions to squeeze maximum performance out of diverse architectures
Developing robust, low-latency serving runtimes in C++ to manage model routing, continuous batching, and novel decoding strategies
Identifying and eliminating bottlenecks across the entire stack, from memory bandwidth ceilings to kernel interleaving

About Base Compute

We believe in a world where everyone has access to intelligence: fast, private and always available on your device.

In the employer’s words · Read in context · Company website ↗

Apply at Base Compute

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026
Employer says posted
Jul 3, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

Base Compute is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C
  • C++
  • Rust
Where the posting names them
What We’re Looking For - 3+ years of experience in ML engineering or systems programming (Rust, C/C++), with a strong track record of building performance-critical software - Expertise in GPU programming and hardware optimization across various platforms (CUDA, ROCm, Metal, Triton, or similar)
- Cross-platform silicon optimization: Writing and tuning custom kernels and leveraging hardware-specific instructions to squeeze maximum performance out of diverse architectures, including Apple Silicon, NVIDIA, AMD, Snapdragon, and other edge platforms - Systems architecture: Developing robust, low-latency serving runtimes in C++ to manage model routing, continuous batching, and novel decoding strategies under strict thermal and memory constraints - Performance profiling: Identifying and eliminating bottlenecks across the entire stack, from memory bandwidth ceilings to kernel interleaving

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About Us

Base Compute is an AI inference lab. Our mission is to bring AGI on device. We believe in a world where everyone has access to intelligence: fast, private and always available on your device.

We’re building the infrastructure for the next generation of on-device AI, from silicon-level optimizations to distributed inference systems.

We’re working on hard problems at the intersection of inference efficiency, model intelligence and autonomous research.

The Role

We’re looking for an ML Engineer to work at the frontier of on-device AI. This role is for someone who lives at the intersection of systems engineering and machine learning, turning state-of-the-art research into hyper-optimized, production-ready infrastructure.

You’ll have significant ownership over our entire inference stack and direct influence on the technical bets the company makes.

What You’ll Work On

  • Inference engine development: Building and scaling our custom inference engine, handling everything from weight loading and KV-cache management to efficient request scheduling

  • Cross-platform silicon optimization: Writing and tuning custom kernels and leveraging hardware-specific instructions to squeeze maximum performance out of diverse architectures, including Apple Silicon, NVIDIA, AMD, Snapdragon, and other edge platforms

  • Systems architecture: Developing robust, low-latency serving runtimes in C++ to manage model routing, continuous batching, and novel decoding strategies under strict thermal and memory constraints

  • Performance profiling: Identifying and eliminating bottlenecks across the entire stack, from memory bandwidth ceilings to kernel interleaving

What We’re Looking For

  • 3+ years of experience in ML engineering or systems programming (Rust, C/C++), with a strong track record of building performance-critical software

  • Expertise in GPU programming and hardware optimization across various platforms (CUDA, ROCm, Metal, Triton, or similar)

  • Solid understanding of modern LLM architectures, including parsing formats and implementing optimization techniques (quantization, speculative decoding, etc.)

  • A strong sense of ownership and autonomy: the ability to take ambiguous architectural challenges and drive them from research translation directly into production-ready infrastructure

  • Good communication: the ability to explain complex architectural decisions simply, give honest feedback and document systems cleanly

  • Nice-to-haves:

    • Familiarity with ML compilers (torch.compile, custom operators)

    • Experience with low-precision inference (INT8/FP8/FP4)

    • Knowledge of Edge LLMOps

What We Offer

  • Equity and strong base salary

  • Direct influence on technical direction: your ideas will shape the roadmap

  • Work on genuinely hard problems that haven't been solved yet

  • Small team, fast iteration, low bureaucracy

Location

The team is based in Melbourne and Berlin and works in-person from the office most days. We require strong written and spoken English, since the team collaborates across time zones.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Melbourne, Victoria, Australia

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.