Back to jobs

AI Developer

Reads like an ML Engineer role: training models and running them in production.

Pay
Pay not listed
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting

We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments.

You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure.

  • Fine-tune open-source LLMs such as LLaMA, Mistral, and Qwen using SFT and LoRA/Q-LoRA

  • Build end-to-end RAG pipelines for document-grounded question answering

  • Develop MCP server integrations so LLMs can access tools, APIs, and data

  • Optimize and quantize models (GGUF, GPTQ, AWQ) and their GPU usage

  • Deploy and maintain models fully offline in air-gapped environments

From the employer’s posting
We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, requiring expertise across Python ML stacks, model optimization, local inference frameworks, RAG (Retrieval-Augmented Generation) architectures, MCP (Model Context Protocol) integrations, and DevOps workflows tailored for offline systems.
You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure. If you enjoy working with cutting-edge open-source LLMs, building context-aware AI systems, and designing reliable backend pipelines, this role is for you.
Train and fine-tune LLMs using supervised fine-tuning (SFT).
Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines for document-grounded question answering and knowledge retrieval.
Develop and maintain MCP (Model Context Protocol) server integrations to enable LLMs to interact dynamically with tools, APIs, and external data sources.
Perform model optimization and quantization (GGUF, GPTQ, AWQ, bitsandbytes).
Deploy, run, and maintain models fully offline and in air-gapped environments.

What you’ll bring

All qualifications

Core experience

  • Strong experience in Python for backend and ML development.
  • Experience building agentic systems using MCP in production or near-production environments.
  • Strong ownership mindset and problem-solving ability.
  • Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas.
  • Familiarity with advanced RAG techniques such as HyDE, re-ranking, or multi-hop retrieval.
  • Ability to work effectively in distributed teams across time zones.
Qualification wording
Strong experience in Python for backend and ML development.
Experience building agentic systems using MCP in production or near-production environments.
Strong ownership mindset and problem-solving ability.
Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas.
Familiarity with advanced RAG techniques such as HyDE, re-ranking, or multi-hop retrieval.
Ability to work effectively in distributed teams across time zones.

About Salvo Software

Salvo Software is a global firm that provides cost-effective software solutions to guide enterprises and startups through digital transformation.

In the employer’s words · Read in context

Apply at Salvo Software

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
5
Last seen by us
Nov 22, 2026
Employer says posted
Aug 7, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

Salvo Software is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Azure
  • Docker
  • MySQL
  • Hugging Face
  • pandas
  • PyTorch
  • scikit-learn
  • TensorFlow
  • Transformers
  • PostgreSQL
Where the posting names them
Role Overview We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, requiring expertise across Python ML stacks, model optimization, local inference frameworks, RAG (Retrieval-Augmented Generation) architectures, MCP (Model Context Protocol) integrations, and DevOps workflows tailored for offline systems. You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure. If you enjoy working with cutting-edge open-source LLMs, building context-aware AI systems, and designing reliable backend pipelines, this role is for you.
- Parse and process structured and semi-structured data, including XML/XSD files. - Implement document parsing solutions for Office formats (python-docx, OpenXML). RAG & Context-Aware Systems
Backend & DevOps - Build backend services in Python for ML training and inference workflows. - Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers.
Technical Skills - Strong experience in Python for backend and ML development. - Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas.
- Experience managing ML model registries in offline environments. - Familiarity with AWS for hybrid deployments. - Experience with secure environments, restricted networks, or enterprise compliance requirements.
- Use Docker and Git for reliable development and deployment pipelines. - Use Azure DevOps for CI/CD, including local runners when applicable. Requirements
- Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers. - Use Docker and Git for reliable development and deployment pipelines. - Use Azure DevOps for CI/CD, including local runners when applicable.
- Solid knowledge of Postgres or MySQL for data storage. - Experience with Docker, Git, and DevOps best practices. - Hands-on expertise with LLM training, fine-tuning, and optimization.
- Build backend services in Python for ML training and inference workflows. - Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers. - Use Docker and Git for reliable development and deployment pipelines.
- Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas. - Solid knowledge of Postgres or MySQL for data storage. - Experience with Docker, Git, and DevOps best practices.
- Implement and optimize data preprocessing workflows, including tokenization and long-context handling. - Use and extend Hugging Face Transformers & Datasets for training and inference. - Parse and process structured and semi-structured data, including XML/XSD files.
- Hands-on expertise with LLM training, fine-tuning, and optimization. - Experience with Hugging Face Transformers & Datasets. - Familiarity with XML/XSD and Office document parsing tools.
- Strong experience in Python for backend and ML development. - Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas. - Solid knowledge of Postgres or MySQL for data storage.

Your next step

Complete your application on apply.workable.com. The employer’s form will show what is required.

Applying through Workable

  • No account needed. You can import your resume to fill in the form, or skip that and fill it in yourself.

Already applied? Track this application

Has Salvo Software posted this job before?

Yes. We’ve followed one other AI Developer job there since November 2026. It is still up.

  1. Place not statedStill up after 3 days, first seen Nov 18
  2. This jobUp 3 days so far, first seen Nov 18

Job description

View original posting ↗

About Salvo Software

Salvo Software is a global firm that provides cost-effective software solutions to guide enterprises and startups through digital transformation. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence.

Role Overview

We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, requiring expertise across Python ML stacks, model optimization, local inference frameworks, RAG (Retrieval-Augmented Generation) architectures, MCP (Model Context Protocol) integrations, and DevOps workflows tailored for offline systems.

You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure. If you enjoy working with cutting-edge open-source LLMs, building context-aware AI systems, and designing reliable backend pipelines, this role is for you.

Key Responsibilities

Core LLM Development

  • Train and fine-tune LLMs using supervised fine-tuning (SFT).
  • Work with open-source models such as LLaMA, Mistral, Qwen, and similar architectures.
  • Build LoRA / Q-LoRA pipelines for efficient fine-tuning.
  • Implement and optimize data preprocessing workflows, including tokenization and long-context handling.
  • Use and extend Hugging Face Transformers & Datasets for training and inference.
  • Parse and process structured and semi-structured data, including XML/XSD files.
  • Implement document parsing solutions for Office formats (python-docx, OpenXML).

RAG & Context-Aware Systems

  • Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines for document-grounded question answering and knowledge retrieval.
  • Build and maintain vector stores and embedding pipelines using tools such as FAISS, Chroma, Weaviate, or pgvector.
  • Optimize retrieval strategies including hybrid search, re-ranking, and chunking approaches tailored for domain-specific corpora.
  • Develop and maintain MCP (Model Context Protocol) server integrations to enable LLMs to interact dynamically with tools, APIs, and external data sources.
  • Design agentic workflows that leverage MCP to give models structured access to internal systems and context in a controlled, auditable manner.

Offline / On-Prem Model Expertise

  • Deploy, run, and maintain models fully offline and in air-gapped environments.
  • Perform model optimization and quantization (GGUF, GPTQ, AWQ, bitsandbytes).
  • Build and maintain inference systems using frameworks like vLLM, TGI, and Ollama.
  • Optimize GPU usage (CUDA, cuDNN, VRAM-aware batching).
  • Maintain local CI/CD pipelines for ML models without cloud dependencies.
  • Manage local model registries, versioning, and artifacts.
  • Ensure RAG and MCP components are fully operational in offline and restricted network environments.

Backend & DevOps

  • Build backend services in Python for ML training and inference workflows.
  • Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers.
  • Use Docker and Git for reliable development and deployment pipelines.
  • Use Azure DevOps for CI/CD, including local runners when applicable.

Requirements

Technical Skills

  • Strong experience in Python for backend and ML development.
  • Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas.
  • Solid knowledge of Postgres or MySQL for data storage.
  • Experience with Docker, Git, and DevOps best practices.
  • Hands-on expertise with LLM training, fine-tuning, and optimization.
  • Experience with Hugging Face Transformers & Datasets.
  • Familiarity with XML/XSD and Office document parsing tools.
  • Experience deploying models with vLLM, TGI, or Ollama.
  • Understanding of quantization techniques (GGUF/GPTQ/AWQ).
  • Experience working with GPU optimization and the CUDA stack.
  • Ability to build solutions for offline, on-prem, and air-gapped environments.
  • Hands-on experience designing and implementing RAG pipelines, including embedding models, vector stores (FAISS, Chroma, Weaviate, or pgvector), and retrieval optimization strategies.
  • Experience building or integrating MCP (Model Context Protocol) servers to connect LLMs with external tools, APIs, and structured data sources.

Nice to Have

  • Experience building agentic systems using MCP in production or near-production environments.
  • Familiarity with advanced RAG techniques such as HyDE, re-ranking, or multi-hop retrieval.
  • Experience managing ML model registries in offline environments.
  • Familiarity with AWS for hybrid deployments.
  • Experience with secure environments, restricted networks, or enterprise compliance requirements.

Soft Skills

  • Strong ownership mindset and problem-solving ability.
  • Ability to work effectively in distributed teams across time zones.
  • Clear communication when discussing complex technical topics with both technical and non-technical stakeholders.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Bengaluru, Karnataka, India

- Build and maintain vector stores and embedding pipelines using tools such as FAISS, Chroma, Weaviate, or pgvector. - Optimize retrieval strategies including hybrid search, re-ranking, and chunking approaches tailored for domain-specific corpora. - Develop and maintain MCP (Model Context Protocol) server integrations to enable LLMs to interact dynamically with tools, APIs, and external data sources.
More source context
- Experience managing ML model registries in offline environments. - Familiarity with AWS for hybrid deployments. - Experience with secure environments, restricted networks, or enterprise compliance requirements.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.