We are looking for a Forward Deployed AI Engineer to deploy, integrate, optimize, and operationalize enterprise Generative AI platforms within secure, on-premise and air-gapped banking environments.
You will work closely with client IT, infrastructure, security, engineering, and AI teams to turn AI platform architectures into reliable, production-ready deployments.
You will work closely with client IT, infrastructure, security, engineering, and AI teams to turn AI platform architectures into reliable, production-ready deployments.
Optimize LLM inference performance, including TTFT, throughput, latency and GPU utilization.
Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.
From the employer’s posting
We are looking for a Forward Deployed AI Engineer to deploy, integrate, optimize, and operationalize enterprise Generative AI platforms within secure, on-premise and air-gapped banking environments.
You will work closely with client IT, infrastructure, security, engineering, and AI teams to turn AI platform architectures into reliable, production-ready deployments.
We are looking for a Forward Deployed AI Engineer to deploy, integrate, optimize, and operationalize enterprise Generative AI platforms within secure, on-premise and air-gapped banking environments.
You will work closely with client IT, infrastructure, security, engineering, and AI teams to turn AI platform architectures into reliable, production-ready deployments.
What You'll Do
Configure and optimize NVIDIA GPU Operator, GPU time-slicing and MIG for AI workloads.
Optimize LLM inference performance, including TTFT, throughput, latency and GPU utilization.
Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.
Optimize LLM inference performance, including TTFT, throughput, latency and GPU utilization.
Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.
Develop and maintain Helm charts, Kustomize manifests and Kubernetes configurations.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Docker
Kubernetes
Neo4j
Where the posting names them
- Experience deploying LLMs, NVIDIA NIM, Triton or enterprise AI platforms.
- Strong understanding of containerization, Docker/OCI images and Kubernetes workloads.
- Experience with Helm, Kustomize, Kubernetes Operators and GitOps.
- Deploy and configure NVIDIA NIMs, LLMs, DataRobot, Graph Databases, and related AI platforms.
- Install and manage AI workloads on Red Hat OpenShift and Kubernetes environments.
- Package and deploy container images, dependencies, and LLM model weights in air-gapped environments.
- Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.
- Develop and maintain Helm charts, Kustomize manifests and Kubernetes configurations.
- Troubleshoot deployment, infrastructure, networking and performance issues in secure client environments.
- 2+ years of hands-on experience in MLOps / LLMOps.
- Strong experience with Red Hat OpenShift and Kubernetes.
- Hands-on experience with NVIDIA GPUs and NVIDIA GPU Operator.
- Strong understanding of containerization, Docker/OCI images and Kubernetes workloads.
- Experience with Helm, Kustomize, Kubernetes Operators and GitOps.
- Experience with ArgoCD, OpenShift Pipelines or similar CI/CD tools.
- Experience with NVIDIA NIM, Triton Inference Server or DataRobot.
- Experience with Graph Databases such as Neo4j or ArangoDB.
- Experience with GPU performance tuning, MIG and GPU time-slicing.
Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a presence in India and the UAE. Founded in 2012, our mission has always been to simplify the world’s choices.
Today, we’ve evolved into Tangram.ai — a modular, GenAI-powered platform built for the enterprise. Tangram lets organizations assemble intelligent agents, solutions, and models like building blocks to create, scale, and adapt AI-powered capabilities with speed, security, and precision. It’s not just a platform,it’s the operating layer for GenAI in the enterprise.
Role Overview
We are looking for a Forward Deployed AI Engineer to deploy, integrate, optimize, and operationalize enterprise Generative AI platforms within secure, on-premise and air-gapped banking environments.
You will work closely with client IT, infrastructure, security, engineering, and AI teams to turn AI platform architectures into reliable, production-ready deployments.
What You'll Do
Deploy and configure NVIDIA NIMs, LLMs, DataRobot, Graph Databases, and related AI platforms.
Install and manage AI workloads on Red Hat OpenShift and Kubernetes environments.
Package and deploy container images, dependencies, and LLM model weights in air-gapped environments.
Configure and optimize NVIDIA GPU Operator, GPU time-slicing and MIG for AI workloads.
Optimize LLM inference performance, including TTFT, throughput, latency and GPU utilization.
Build and manage CI/CD and GitOps pipelines using tools such as ArgoCD and OpenShift Pipelines.
Develop and maintain Helm charts, Kustomize manifests and Kubernetes configurations.
Troubleshoot deployment, infrastructure, networking and performance issues in secure client environments.
Work directly with client IT, Security and Infrastructure teams to resolve technical blockers and ensure successful deployments.
What We're Looking For
4+ years of experience in Software Engineering, DevOps, Platform Engineering or a related field.
2+ years of hands-on experience in MLOps / LLMOps.
Strong experience with Red Hat OpenShift and Kubernetes.
Hands-on experience with NVIDIA GPUs and NVIDIA GPU Operator.
Experience deploying LLMs, NVIDIA NIM, Triton or enterprise AI platforms.
Strong understanding of containerization, Docker/OCI images and Kubernetes workloads.
Experience with Helm, Kustomize, Kubernetes Operators and GitOps.
Experience with ArgoCD, OpenShift Pipelines or similar CI/CD tools.
Understanding of air-gapped / disconnected environments and offline software deployment.
Good understanding of enterprise authentication and security frameworks such as Active Directory, LDAP, Kerberos and OAuth.
Experience with secure secrets management using HashiCorp Vault, OpenShift Secrets or similar technologies.
Strong troubleshooting, communication and client-facing skills.
Brownie Points
Experience deploying AI platforms in Banking / BFSI or highly regulated environments.
Experience working in air-gapped or disconnected data centers.
CKA / CKAD certification.
Experience with NVIDIA NIM, Triton Inference Server or DataRobot.
Experience with Graph Databases such as Neo4j or ArangoDB.
Experience with GPU performance tuning, MIG and GPU time-slicing.
Experience with large-scale LLM inference and RAG deployments.
Demand for Forward Deployed Engineer roles
New Forward Deployed Engineer postings at the employers we follow are up 225% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Forward Deployed Engineer, by the work the posting describes.
Forward deployed engineers are placed with their employer's customers: they learn a customer's problem and write the code that makes the employer's product solve it inside the customer's own systems.
Postings ask for strong software engineering, most often in Python, ease with customers and their executives, often travel, and in about three of four cases work with large language models or AI agents.
An AI engineer or data engineer builds for their own employer's product team; a forward deployed engineer does similar work inside a customer. We give this role to every posting whose title says forward deployed.