Back to jobs

AI Engineer (Managed Services)

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Design and build AI Agent systems using ReAct, Plan-and-Execute, Reflection, and multi-agent collaboration patterns.

  • Implement efficient fine-tuning pipelines using LoRA, QLoRA, DoRA, and full-parameter fine-tuning on proprietary domain-specific datasets.

  • Build and maintain LLM evaluation frameworks: LLM-as-a-Judge, RAGAS, DeepEval, ARES, and custom task-specific metrics for continuous quality monitoring.

From the employer’s posting
AI Agent & Multi-Agent Systems Design and build AI Agent systems using ReAct, Plan-and-Execute, Reflection, and multi-agent collaboration patterns. Implement Function Calling and tool-use capabilities, enabling agents to interact with external APIs, databases, and enterprise systems.
Model Fine-Tuning & Customization Implement efficient fine-tuning pipelines using LoRA, QLoRA, DoRA, and full-parameter fine-tuning on proprietary domain-specific datasets. Prepare and curate instruction-following datasets, RLHF/RLAIF datasets, and evaluation benchmarks for domain adaptation.
Evaluation & Production Operations Build and maintain LLM evaluation frameworks: LLM-as-a-Judge, RAGAS, DeepEval, ARES, and custom task-specific metrics for continuous quality monitoring. Implement production monitoring for LLM systems: output quality tracking, latency/throughput metrics, cost monitoring, drift detection, and guardrail compliance.

What you’ll bring

All qualifications

Core experience

  • Bachelor's degree or above in Computer Science, Artificial Intelligence, Machine Learning, or related technical field.
  • 2+ years of professional experience in AI/ML engineering with demonstrated production deployment of LLM-based systems at scale.
  • Deep understanding of Transformer architecture, attention mechanisms (MHA, GQA, MQA), and LLM pre-training / fine-tuning / inference paradigms.
  • Hands-on experience with RAG system development: vector databases (Milvus, ChromaDB, Qdrant, Weaviate, Pinecone, pgvector), embedding models (BGE, M3E, GTE, OpenAI, Cohere), reranking (bge-reranker, Cohere Rerank, cross-encoders), and advanced retrieval techniques (hybrid search, query expansion, HyDE).
  • Practical experience deploying and tuning open-source Chinese LLMs: DeepSeek, Qwen, Kimi , or international models (Llama 3.x, Mistral, Mixtral, Gemma, Phi).
  • Strong experience with model deployment and serving infrastructure: vLLM, TensorRT-LLM, TGI, Ollama, Xinference, SGLang; GPU resource scheduling (Kubernetes + GPU operators).

Preferred experience

  • Master's or PhD in AI/ML preferred.
  • Experience with agent frameworks: LangGraph, AutoGen, CrewAI, OpenAI Assistants API, and multi-agent orchestration patterns.
  • Familiarity with MCP (Model Context Protocol), OpenAI API specification, and multi-modal LLM capabilities (vision, audio).
  • Experience with prompt optimization tools: DSPy, PromptLayer, LangSmith for systematic prompt engineering.
Qualification wording
Bachelor's degree or above in Computer Science, Artificial Intelligence, Machine Learning, or related technical field. Master's or PhD in AI/ML preferred.
2+ years of professional experience in AI/ML engineering with demonstrated production deployment of LLM-based systems at scale.
Deep understanding of Transformer architecture, attention mechanisms (MHA, GQA, MQA), and LLM pre-training / fine-tuning / inference paradigms.
Hands-on experience with RAG system development: vector databases (Milvus, ChromaDB, Qdrant, Weaviate, Pinecone, pgvector), embedding models (BGE, M3E, GTE, OpenAI, Cohere), reranking (bge-reranker, Cohere Rerank, cross-encoders), and advanced retrieval techniques (hybrid search, query expansion, HyDE).
Practical experience deploying and tuning open-source Chinese LLMs: DeepSeek, Qwen, Kimi , or international models (Llama 3.x, Mistral, Mixtral, Gemma, Phi).
Strong experience with model deployment and serving infrastructure: vLLM, TensorRT-LLM, TGI, Ollama, Xinference, SGLang; GPU resource scheduling (Kubernetes + GPU operators).
Experience with agent frameworks: LangGraph, AutoGen, CrewAI, OpenAI Assistants API, and multi-agent orchestration patterns.
Familiarity with MCP (Model Context Protocol), OpenAI API specification, and multi-modal LLM capabilities (vision, audio).
Experience with prompt optimization tools: DSPy, PromptLayer, LangSmith for systematic prompt engineering.
Education & alternatives
REQUIRED QUALIFICATIONS - Bachelor's degree or above in Computer Science, Artificial Intelligence, Machine Learning, or related technical field. Master's or PhD in AI/ML preferred. - 2+ years of professional experience in AI/ML engineering with demonstrated production deployment of LLM-based systems at scale.
Apply at Avepoint

Posting record

Report an error

Open 4 monthsWe first saw this posting 142 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jul 2, 2026142 days ago
Recorded sightings
167
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 142

Up longer than most. Similar jobs usually come down between day 1 and day 15.

At Avepoint, jobs usually come down by about day 143.

From 1,368 similar postings that came down, and 7 of Avepoint’s. Coming down is not always a hire.

Avepoint is hiring

12 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Kubernetes
  • FastAPI
  • Flask
  • PyTorch
  • TensorFlow
Where the posting names them
- Proficiency in model quantization and inference optimization: GGUF (llama.cpp), GPTQ, AWQ, AutoAWQ, FP8/INT8; knowledge of KV Cache optimization and memory-efficient attention (FlashAttention, FlashInfer, PageAttention). - Solid programming skills in Python; experience with PyTorch, TensorFlow, or JAX; familiarity with FastAPI/Flask for building LLM API services. - Experience with LLM evaluation methodologies, A/B testing frameworks, and production monitoring of AI systems.
- Implement model inference optimization: quantization (GGUF/llama.cpp, GPTQ, AWQ, AutoAWQ, FP8/INT8), KV Cache optimization, continuous batching (vLLM, TensorRT-LLM, TGI, SGLang), speculative decoding, and tensor parallelism for high-throughput serving. - Build and maintain model serving infrastructure using vLLM, TensorRT-LLM, Text Generation Inference (TGI), Ollama, Xinference, and SGLang; configure GPU resource scheduling with Kubernetes + GPU operators. AI gateway tools for routing, model tracking and load balancing such as TrueFoundry, Kubeflow, LiteLLM or Ray for heavy deep learning. Model Fine-Tuning & Customization
- Practical experience deploying and tuning open-source Chinese LLMs: DeepSeek, Qwen, Kimi , or international models (Llama 3.x, Mistral, Mixtral, Gemma, Phi). - Strong experience with model deployment and serving infrastructure: vLLM, TensorRT-LLM, TGI, Ollama, Xinference, SGLang; GPU resource scheduling (Kubernetes + GPU operators). - Proficiency in model quantization and inference optimization: GGUF (llama.cpp), GPTQ, AWQ, AutoAWQ, FP8/INT8; knowledge of KV Cache optimization and memory-efficient attention (FlashAttention, FlashInfer, PageAttention).

Your next step

Complete your application on www.avepoint.com. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

We are looking for a highly skilled AI Engineer specializing in Large Language Models (LLMs) and Agentic AI. You will architect, build, and deploy production-grade LLM applications — from intelligent knowledge bases and RAG systems to autonomous multi-agent workflows. You will work hands-on with open-source Chinese and international LLMs (DeepSeek, Qwen, Kimi, etc), implementing everything from model deployment and inference optimization to prompt engineering and agent orchestration. This is a builder role for someone who thrives at the intersection of research and engineering.

KEY RESPONSIBILITIES

LLM Application Development

  • Design and develop enterprise LLM-powered applications: intelligent Q&A systems, enterprise knowledge base assistants, AI copilots, document analysis tools, and automated customer service agents.
  • Architect and implement end-to-end RAG (Retrieval-Augmented Generation) systems: document parsing and chunking (recursive, semantic, agentic), embedding generation (BGE, M3E, GTE), vector retrieval (dense + sparse hybrid search), reranking (bge-reranker, Cohere Rerank), and response synthesis with source attribution.
  • Develop and optimize Prompt Engineering strategies: chain-of-thought, tree-of-thought, few-shot prompting, structured output parsing (JSON mode / Pydantic), prompt templates (LangChain/LangSmith), and prompt version management.
  • Knowledge in harness engineering, context management in ensuring LLM interactions and or AI agents reliable and deterministic.

 

 

AI Agent & Multi-Agent Systems

  • Design and build AI Agent systems using ReAct, Plan-and-Execute, Reflection, and multi-agent collaboration patterns.
  • Implement Function Calling and tool-use capabilities, enabling agents to interact with external APIs, databases, and enterprise systems.
  • Develop multi-agent orchestration using LangGraph, AutoGen, CrewAI, and other agent frameworks to solve complex enterprise tasks through agent collaboration.
  • Design MCP (Model Context Protocol) integrations for standardized LLM tool interoperability.

Open-Source LLM Deployment & Optimization

  • Deploy and optimize latest version of open-source Chinese LLMs: DeepSeek, Qwen, and Kimi for on-premise and private cloud environments.
  • Implement model inference optimization: quantization (GGUF/llama.cpp, GPTQ, AWQ, AutoAWQ, FP8/INT8), KV Cache optimization, continuous batching (vLLM, TensorRT-LLM, TGI, SGLang), speculative decoding, and tensor parallelism for high-throughput serving.
  • Build and maintain model serving infrastructure using vLLM, TensorRT-LLM, Text Generation Inference (TGI), Ollama, Xinference, and SGLang; configure GPU resource scheduling with Kubernetes + GPU operators. AI gateway tools for routing, model tracking and load balancing such as TrueFoundry, Kubeflow, LiteLLM or Ray for heavy deep learning.

Model Fine-Tuning & Customization

  • Implement efficient fine-tuning pipelines using LoRA, QLoRA, DoRA, and full-parameter fine-tuning on proprietary domain-specific datasets.
  • Prepare and curate instruction-following datasets, RLHF/RLAIF datasets, and evaluation benchmarks for domain adaptation.
  • Evaluate fine-tuned models using automated benchmarks and LLM-as-a-Judge methodologies.

Evaluation & Production Operations

  • Build and maintain LLM evaluation frameworks: LLM-as-a-Judge, RAGAS, DeepEval, ARES, and custom task-specific metrics for continuous quality monitoring.
  • Implement production monitoring for LLM systems: output quality tracking, latency/throughput metrics, cost monitoring, drift detection, and guardrail compliance.
  • Design A/B testing frameworks for model comparison and prompt iteration.
  • Implement LLM security guardrails: input/output filtering, PII detection, prompt injection defense, content moderation, and safety alignment.

Research & Technical Leadership

  • Track frontier AI research and evaluate emerging technologies (new model architectures, training techniques, inference methods) for enterprise adoption.
  • Contribute to internal knowledge sharing: tech talks, documentation, and best-practice guides on LLM development.

REQUIRED QUALIFICATIONS

  • Bachelor's degree or above in Computer Science, Artificial Intelligence, Machine Learning, or related technical field. Master's or PhD in AI/ML preferred.
  • 2+ years of professional experience in AI/ML engineering with demonstrated production deployment of LLM-based systems at scale.
  • Deep understanding of Transformer architecture, attention mechanisms (MHA, GQA, MQA), and LLM pre-training / fine-tuning / inference paradigms.
  • Expert proficiency in LLM application frameworks: LangChain, LlamaIndex, Haystack, or equivalent production-grade tools.
  • Hands-on experience with RAG system development: vector databases (Milvus, ChromaDB, Qdrant, Weaviate, Pinecone, pgvector), embedding models (BGE, M3E, GTE, OpenAI, Cohere), reranking (bge-reranker, Cohere Rerank, cross-encoders), and advanced retrieval techniques (hybrid search, query expansion, HyDE).
  • Practical experience deploying and tuning open-source Chinese LLMs: DeepSeek, Qwen, Kimi , or international models (Llama 3.x, Mistral, Mixtral, Gemma, Phi).
  • Strong experience with model deployment and serving infrastructure: vLLM, TensorRT-LLM, TGI, Ollama, Xinference, SGLang; GPU resource scheduling (Kubernetes + GPU operators).
  • Proficiency in model quantization and inference optimization: GGUF (llama.cpp), GPTQ, AWQ, AutoAWQ, FP8/INT8; knowledge of KV Cache optimization and memory-efficient attention (FlashAttention, FlashInfer, PageAttention).
  • Solid programming skills in Python; experience with PyTorch, TensorFlow, or JAX; familiarity with FastAPI/Flask for building LLM API services.
  • Experience with LLM evaluation methodologies, A/B testing frameworks, and production monitoring of AI systems.

PREFERRED QUALIFICATIONS

  • Experience with agent frameworks: LangGraph, AutoGen, CrewAI, OpenAI Assistants API, and multi-agent orchestration patterns.
  • Familiarity with MCP (Model Context Protocol), OpenAI API specification, and multi-modal LLM capabilities (vision, audio).
  • Experience with prompt optimization tools: DSPy, PromptLayer, LangSmith for systematic prompt engineering.
  • Knowledge of model distillation and efficient transfer learning from large teacher models to smaller student models.
  • Contributions to open-source AI projects or publications in NLP/LLM research venues.
  • Experience with cloud GPU providers and cost optimization for LLM inference at scale.
  • Access to high-performance GPU computing resources for model development and experimentation.

Any personal data you share with us during the application process will be processed strictly in compliance with applicable data protection laws and our Privacy Notice.

About Avepoint

People
About 3,443 in 2025, up 17% from the year before.Annual report (SEC Form 10-K)
Company
Listed as AVPT.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Singapore

- Design and develop enterprise LLM-powered applications: intelligent Q&A systems, enterprise knowledge base assistants, AI copilots, document analysis tools, and automated customer service agents. - Architect and implement end-to-end RAG (Retrieval-Augmented Generation) systems: document parsing and chunking (recursive, semantic, agentic), embedding generation (BGE, M3E, GTE), vector retrieval (dense + sparse hybrid search), reranking (bge-reranker, Cohere Rerank), and response synthesis with source attribution. - Develop and optimize Prompt Engineering strategies: chain-of-thought, tree-of-thought, few-shot prompting, structured output parsing (JSON mode / Pydantic), prompt templates (LangChain/LangSmith), and prompt version management.
More source context
- Expert proficiency in LLM application frameworks: LangChain, LlamaIndex, Haystack, or equivalent production-grade tools. - Hands-on experience with RAG system development: vector databases (Milvus, ChromaDB, Qdrant, Weaviate, Pinecone, pgvector), embedding models (BGE, M3E, GTE, OpenAI, Cohere), reranking (bge-reranker, Cohere Rerank, cross-encoders), and advanced retrieval techniques (hybrid search, query expansion, HyDE). - Practical experience deploying and tuning open-source Chinese LLMs: DeepSeek, Qwen, Kimi , or international models (Llama 3.x, Mistral, Mixtral, Gemma, Phi).
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.