Time since we first saw it
Day 3
Early. Similar jobs usually come down between day 7 and day 76.
From 6,398 similar postings that came down. Coming down is not always a hire.
Reads like an ML Engineer role: training models and running them in production.
Bengaluru, Karnataka, India
Actively hiring, first seen by us 3 days agoWork setup in the employer’s posting: On-siteFrom the employer’s posting
Employment type in the employer’s posting: Full-timeFrom the employer’s posting
We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments.
You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure.
Fine-tune open-source LLMs such as LLaMA, Mistral, and Qwen using SFT and LoRA/Q-LoRA
Build end-to-end RAG pipelines for document-grounded question answering
Develop MCP server integrations so LLMs can access tools, APIs, and data
Optimize and quantize models (GGUF, GPTQ, AWQ) and their GPU usage
Deploy and maintain models fully offline in air-gapped environments
We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, requiring expertise across Python ML stacks, model optimization, local inference frameworks, RAG (Retrieval-Augmented Generation) architectures, MCP (Model Context Protocol) integrations, and DevOps workflows tailored for offline systems.
You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure. If you enjoy working with cutting-edge open-source LLMs, building context-aware AI systems, and designing reliable backend pipelines, this role is for you.
Train and fine-tune LLMs using supervised fine-tuning (SFT).
Design and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines for document-grounded question answering and knowledge retrieval.
Develop and maintain MCP (Model Context Protocol) server integrations to enable LLMs to interact dynamically with tools, APIs, and external data sources.
Perform model optimization and quantization (GGUF, GPTQ, AWQ, bitsandbytes).
Deploy, run, and maintain models fully offline and in air-gapped environments.
Strong experience in Python for backend and ML development.
Experience building agentic systems using MCP in production or near-production environments.
Strong ownership mindset and problem-solving ability.
Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas.
Familiarity with advanced RAG techniques such as HyDE, re-ranking, or multi-hop retrieval.
Ability to work effectively in distributed teams across time zones.
Salvo Software is a global firm that provides cost-effective software solutions to guide enterprises and startups through digital transformation.
In the employer’s words · Read in context
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Early. Similar jobs usually come down between day 7 and day 76.
From 6,398 similar postings that came down. Coming down is not always a hire.
5 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Role Overview We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, requiring expertise across Python ML stacks, model optimization, local inference frameworks, RAG (Retrieval-Augmented Generation) architectures, MCP (Model Context Protocol) integrations, and DevOps workflows tailored for offline systems. You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure. If you enjoy working with cutting-edge open-source LLMs, building context-aware AI systems, and designing reliable backend pipelines, this role is for you.
- Parse and process structured and semi-structured data, including XML/XSD files. - Implement document parsing solutions for Office formats (python-docx, OpenXML). RAG & Context-Aware Systems
Backend & DevOps - Build backend services in Python for ML training and inference workflows. - Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers.
Technical Skills - Strong experience in Python for backend and ML development. - Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas.
- Experience managing ML model registries in offline environments. - Familiarity with AWS for hybrid deployments. - Experience with secure environments, restricted networks, or enterprise compliance requirements.
- Use Docker and Git for reliable development and deployment pipelines. - Use Azure DevOps for CI/CD, including local runners when applicable. Requirements
- Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers. - Use Docker and Git for reliable development and deployment pipelines. - Use Azure DevOps for CI/CD, including local runners when applicable.
- Solid knowledge of Postgres or MySQL for data storage. - Experience with Docker, Git, and DevOps best practices. - Hands-on expertise with LLM training, fine-tuning, and optimization.
- Build backend services in Python for ML training and inference workflows. - Work with relational databases (Postgres/MySQL) and vector databases for RAG storage layers. - Use Docker and Git for reliable development and deployment pipelines.
- Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas. - Solid knowledge of Postgres or MySQL for data storage. - Experience with Docker, Git, and DevOps best practices.
- Implement and optimize data preprocessing workflows, including tokenization and long-context handling. - Use and extend Hugging Face Transformers & Datasets for training and inference. - Parse and process structured and semi-structured data, including XML/XSD files.
- Hands-on expertise with LLM training, fine-tuning, and optimization. - Experience with Hugging Face Transformers & Datasets. - Familiarity with XML/XSD and Office document parsing tools.
- Strong experience in Python for backend and ML development. - Expertise with ML frameworks such as PyTorch or TensorFlow, scikit-learn, and pandas. - Solid knowledge of Postgres or MySQL for data storage.
Complete your application on apply.workable.com. The employer’s form will show what is required.
Already applied? Track this application
Yes. We’ve followed one other AI Developer job there since November 2026. It is still up.
About Salvo Software
Salvo Software is a global firm that provides cost-effective software solutions to guide enterprises and startups through digital transformation. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence.
Role Overview
We are seeking a highly skilled AI Developer with a strong backend and machine learning engineering background to design, train, optimize, and deploy LLM models in on-prem and offline environments. This role is deeply technical and hands-on, requiring expertise across Python ML stacks, model optimization, local inference frameworks, RAG (Retrieval-Augmented Generation) architectures, MCP (Model Context Protocol) integrations, and DevOps workflows tailored for offline systems.
You will work closely with our engineering and product teams to build end-to-end LLM pipelines — including data preprocessing, supervised fine-tuning, model quantization, evaluation, RAG pipeline design, and deployment using local or air-gapped infrastructure. If you enjoy working with cutting-edge open-source LLMs, building context-aware AI systems, and designing reliable backend pipelines, this role is for you.
Key Responsibilities
Core LLM Development
RAG & Context-Aware Systems
Offline / On-Prem Model Expertise
Backend & DevOps
Requirements
Technical Skills
Nice to Have
Soft Skills
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bengaluru, Karnataka, India
- Build and maintain vector stores and embedding pipelines using tools such as FAISS, Chroma, Weaviate, or pgvector. - Optimize retrieval strategies including hybrid search, re-ranking, and chunking approaches tailored for domain-specific corpora. - Develop and maintain MCP (Model Context Protocol) server integrations to enable LLMs to interact dynamically with tools, APIs, and external data sources.
- Experience managing ML model registries in offline environments. - Familiarity with AWS for hybrid deployments. - Experience with secure environments, restricted networks, or enterprise compliance requirements.
No clear work-authorization passage found. Eligibility is unconfirmed.