Back to jobs

AI/ML & LLM Engineer

Reads like an ML Engineer role: training models and running them in production.

Pay
$130,000–140,000/year · BaseLocation-specific pay — pay source
Compensation & Benefits The anticipated annual base salary range for this position in Sterling, VA is $130,000 – $140,000. Actual compensation will be determined based on several factors, including relevant experience, qualifications, skills, geographic location, internal equity, and business needs. In addition to competitive compensation, REI Systems offers a comprehensive benefits package, including medical, dental, and vision coverage; retirement savings benefits; ESOP; paid time off; professional development opportunities; and other programs designed to support our employees' overall well-being.
Read the full posting
Work setting
Working pattern needs review — work setting source
Education: Bachelor’s degree in Computer Science, Data Science, or a related field; Master’s degree preferred. Location: Hybrid - Sterling, VA HQ (with flexibility for remote work as per company policy). Clearance: Candidate must be able to obtain and maintain a Clearance.
Work setup in the employer’s posting: TELECOMMUTE
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting
  • Design and build machine learning and AI solutions for business needs

  • Build RAG solutions over enterprise documents and approved knowledge sources

  • Deploy and maintain model inference APIs and AI microservices

  • Design and run LLM evaluations for accuracy, groundedness, and hallucinations

  • Build ingestion and retrieval pipelines for enterprise data used by AI apps

From the employer’s posting
Design, develop, test, and implement machine learning and AI solutions to address business and operational requirements.
Build and support Retrieval-Augmented Generation (RAG) solutions using enterprise documents, structured data, and approved knowledge sources.
Develop and maintain model inference APIs, AI services, and microservices using production software engineering practices.
Design and execute LLM evaluation approaches for accuracy, relevance, groundedness, consistency, safety, latency, and potential hallucinations.
Design ingestion and retrieval pipelines for enterprise documents and data sources used by AI/LLM applications.

Before you apply

Employer’s visa record
118 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • Strong Python skills
  • Machine learning and LLM engineering experience
  • Practical experience building production-oriented RAG, NLP, and AI services
  • Ability to independently own complex AI development tasks

Preferred experience

  • Experience supporting FDA, HHS, or other federal government programs.
  • Ability to translate business requirements into practical AI/ML and LLM-enabled solutions.
  • Experience developing and deploying AI/ML solutions in AWS or Azure.
  • Ability to independently own complex AI development tasks while collaborating effectively within a larger technical team.
Qualification wording
strong Python, machine learning, and LLM engineering skills
practical experience building production-oriented RAG, NLP, and AI services
can independently own complex AI development tasks
Experience supporting FDA, HHS, or other federal government programs.
Ability to translate business requirements into practical AI/ML and LLM-enabled solutions.
Experience developing and deploying AI/ML solutions in AWS or Azure.
Ability to independently own complex AI development tasks while collaborating effectively within a larger technical team.
Education & alternatives
This individual should have sufficient AI/ML experience to independently own complex development and evaluation tasks, make sound implementation recommendations, contribute to architecture and technical reviews, and mentor less-experienced engineers while working under the broader direction of senior architects and program leadership. Education: Bachelor’s degree in Computer Science, Data Science, or a related field; Master’s degree preferred. Location: Hybrid - Sterling, VA HQ (with flexibility for remote work as per company policy).

Benefits in the posting

Full benefits wording
  • The anticipated annual base salary range for this position in Sterling, VA is $130,000 – $140,000. Actual compensation will be determined based on several factors, including relevant experience, qualifications, skills, geographic location, internal equity, and business needs.
  • In addition to competitive compensation, REI Systems offers a comprehensive benefits package, including medical, dental, and vision coverage; retirement savings benefits; ESOP; paid time off; professional development opportunities; and other programs designed to support our employees' overall well-being.

From the employer’s posting.

Apply at REI Systems

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 3, 202649 days ago
Recorded sightings
46
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Lower than most similar jobs

$130K–$140K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 49

Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

REI Systems is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • SQL
  • AWS
  • Azure
  • Docker
  • Kubernetes
  • S3
  • SageMaker
  • Hugging Face
  • PyTorch
  • scikit-learn
  • TensorFlow
Where the posting names them
- Work within Agile/Scrum development teams and participate in sprint planning, backlog refinement, demonstrations, and retrospectives. - Collaborate with application developers to integrate AI functionality into Java, .NET, web, and cloud-based enterprise applications without assuming ownership of the full application stack. Qualifications
The AI/ML & LLM Engineer will design, develop, evaluate, deploy, and support machine learning and Generative AI solutions that improve data analysis, automate business processes, enhance search and knowledge discovery, and support intelligent decision-making. The ideal candidate combines strong Python, machine learning, and LLM engineering skills with practical experience building production-oriented RAG, NLP, and AI services. This role is intended for a hands-on engineer who can independently own complex AI development tasks while collaborating with data engineers, software developers, product owners, architects, cloud engineers, and business stakeholders. Responsibilities
- Develop machine learning models using structured, semi-structured, and unstructured datasets. - Build and maintain reusable Python components, APIs, services, notebooks, and AI/ML pipelines. - Perform data preparation, feature engineering, model training, validation, testing, performance evaluation, and optimization.
Software Engineering & Agile Delivery - Develop clean, maintainable, testable, and reusable Python code following established software engineering standards. - Develop RESTful APIs and backend services that expose AI/ML functionality to enterprise applications.
- Approximately 5-8 years of professional software development, data engineering, data science, AI/ML, or related technical experience, including substantial hands-on AI/ML development experience. - Strong programming skills in Python and experience building production-quality Python applications or services. - Hands-on experience with machine learning libraries/frameworks such as Scikit-learn, PyTorch, TensorFlow, Hugging Face, or similar technologies.
Key Technologies Languages: Python, SQLAI/ML: Scikit-learn, PyTorch, TensorFlow, Hugging FaceGenerative AI: LLMs, RAG, Prompt Engineering, Embeddings, Vector Search, LLM EvaluationAI Orchestration: LangChain, LlamaIndex, Semantic Kernel or comparable frameworksCloud: AWS and/or AzureDevelopment: REST APIs, Git, CI/CD, DockerData: SQL databases, APIs, document repositories, structured and unstructured dataMethodology: Agile/Scrum, MLOps/LLMOps, DevSecOps Ideal Candidate Profile
Ideal Candidate Profile The successful candidate will be a hands-on AI/ML and LLM engineer rather than solely a researcher, data analyst, or AI strategist. They should be comfortable writing production-quality Python, working with data, building and evaluating ML/LLM solutions, implementing RAG pipelines, developing AI APIs, and collaborating with application and cloud engineering teams to move AI capabilities from prototype into secure production environments. This individual should have sufficient AI/ML experience to independently own complex development and evaluation tasks, make sound implementation recommendations, contribute to architecture and technical reviews, and mentor less-experienced engineers while working under the broader direction of senior architects and program leadership.
- Work with relational databases, APIs, document repositories, object storage, search platforms, and cloud-based data services. - Write and optimize SQL queries and retrieval logic to support model training, evaluation, and inference. - Collaborate with data engineers to establish reliable, governed data pipelines for AI/ML use cases.
- Experience developing REST APIs and backend services for AI/ML functionality. - Working knowledge of SQL and relational databases. - Familiarity with Git, CI/CD, automated testing, containerization, and modern software development practices.
- Experience supporting FDA, HHS, or other federal government programs. - Experience developing and deploying AI/ML solutions in AWS or Azure. - Experience with AWS AI/ML services such as Amazon Bedrock, SageMaker, Lambda, S3, OpenSearch, or related services.
- Experience developing and deploying AI/ML solutions in AWS or Azure. - Experience with AWS AI/ML services such as Amazon Bedrock, SageMaker, Lambda, S3, OpenSearch, or related services. - Experience with Azure AI services or Azure OpenAI.
- Experience with AWS AI/ML services such as Amazon Bedrock, SageMaker, Lambda, S3, OpenSearch, or related services. - Experience with Azure AI services or Azure OpenAI. - Experience with vector databases or vector search technologies such as Pinecone, FAISS, OpenSearch, pgvector, Chroma, or similar technologies.
- Monitor model quality, retrieval quality, latency, cost, drift, failures, and other operational metrics and recommend improvements. - Participate in CI/CD processes for AI/ML applications and containerize services using technologies such as Docker. - Collaborate with DevOps and cloud engineering teams to deploy scalable, observable, and resilient AI solutions.
- Experience designing automated LLM evaluation, prompt/version management, guardrails, or LLMOps capabilities. - Experience with Docker and containerized AI application deployment; familiarity with Kubernetes or cloud-native environments. - Experience with MLOps, model monitoring, model versioning, experiment tracking, or ML lifecycle management.
- Strong programming skills in Python and experience building production-quality Python applications or services. - Hands-on experience with machine learning libraries/frameworks such as Scikit-learn, PyTorch, TensorFlow, Hugging Face, or similar technologies. - Experience developing, evaluating, and integrating AI/ML models into applications or production environments.

Your next step

Complete your application on careers-reisystems.icims.com. The employer’s form will show what is required.

Applying through iCIMS

  • You start with your email. New applicants then create a login, and returning ones sign in.
  • Upload your resume before you fill anything in: iCIMS fills some profile fields from it.
  • Check your status on the employer’s iCIMS Dashboard, under Past Job Submittals.

Already applied? Track this application

Job description

View original posting ↗

Overview

REI Systems’ mission is to deliver reliable, innovative technology solutions that advance Federal clients' missions and exceed their expectations. Our technologists and consultants are passionate about solving complex challenges that impact millions of lives. We take a Mindful Modernization® approach in delivering our services, including application modernization, grants management, case management systems, government data analytics, and advisory services. This approach, the REI Way, ensures mission impact by aligning our clients' strategic objectives with measurable outcomes through people, processes, and technology.  We offer the same commitment to our employees by providing professional development, meaningful projects, and flexibility to spend time with family and friends. We believe employees are at their best when fulfilled in both their professional careers and their personal lives. Learn more at www.REIsystems.com.  Employees voted REI Systems a Washington Post Top Workplace in 2015, 2016, 2018, 2020, 2021, 2022, 2023, 2024, and 2025! 

Responsibilities

Position Overview

REI Systems is seeking a mid-senior AI/ML & LLM Engineer to support technology modernization and digital transformation initiatives for the FDA.

The AI/ML & LLM Engineer will design, develop, evaluate, deploy, and support machine learning and Generative AI solutions that improve data analysis, automate business processes, enhance search and knowledge discovery, and support intelligent decision-making.

The ideal candidate combines strong Python, machine learning, and LLM engineering skills with practical experience building production-oriented RAG, NLP, and AI services. This role is intended for a hands-on engineer who can independently own complex AI development tasks while collaborating with data engineers, software developers, product owners, architects, cloud engineers, and business stakeholders.

Responsibilities

AI/ML Development

  • Design, develop, test, and implement machine learning and AI solutions to address business and operational requirements.
  • Develop machine learning models using structured, semi-structured, and unstructured datasets.
  • Build and maintain reusable Python components, APIs, services, notebooks, and AI/ML pipelines.
  • Perform data preparation, feature engineering, model training, validation, testing, performance evaluation, and optimization.
  • Evaluate algorithms, models, and approaches based on accuracy, robustness, performance, scalability, explainability, and business requirements.
  • Integrate AI/ML capabilities into existing enterprise applications and workflows through well-defined services and APIs.
  • Develop proof-of-concepts and prototypes and transition successful solutions into secure, production-ready capabilities.
  • Troubleshoot model, data, integration, latency, and application issues throughout the development lifecycle.

Generative AI & LLM Solutions

  • Develop applications leveraging Large Language Models (LLMs) and Generative AI technologies.
  • Build and support Retrieval-Augmented Generation (RAG) solutions using enterprise documents, structured data, and approved knowledge sources.
  • Implement prompt engineering, prompt templates, grounding, context management, tool/function calling, and structured LLM outputs.
  • Integrate commercial and/or open-source LLMs through APIs and enterprise AI platforms.
  • Work with embeddings, semantic search, vector databases, reranking, chunking strategies, and document-processing pipelines.
  • Develop AI-enabled capabilities such as intelligent search, summarization, classification, information extraction, question-answering, and workflow automation.
  • Design and execute LLM evaluation approaches for accuracy, relevance, groundedness, consistency, safety, latency, and potential hallucinations.
  • Implement appropriate guardrails, monitoring, fallback strategies, and human-in-the-loop processes for Generative AI applications.

RAG, Knowledge & Data Engineering

  • Design ingestion and retrieval pipelines for enterprise documents and data sources used by AI/LLM applications.
  • Develop data preprocessing, cleansing, transformation, chunking, metadata enrichment, and validation routines.
  • Work with relational databases, APIs, document repositories, object storage, search platforms, and cloud-based data services.
  • Write and optimize SQL queries and retrieval logic to support model training, evaluation, and inference.
  • Collaborate with data engineers to establish reliable, governed data pipelines for AI/ML use cases.
  • Ensure appropriate handling of data quality, lineage, security, access controls, and source traceability.

MLOps, LLMOps & Deployment

  • Deploy AI/ML models and LLM-enabled services into development, test, and production environments.
  • Develop and maintain model inference APIs, AI services, and microservices using production software engineering practices.
  • Build or support automated model testing, evaluation, deployment, monitoring, and retraining pipelines.
  • Track model and prompt versions, evaluation results, configurations, dependencies, and production behavior.
  • Monitor model quality, retrieval quality, latency, cost, drift, failures, and other operational metrics and recommend improvements.
  • Participate in CI/CD processes for AI/ML applications and containerize services using technologies such as Docker.
  • Collaborate with DevOps and cloud engineering teams to deploy scalable, observable, and resilient AI solutions.

Responsible AI, Security & Governance

  • Apply responsible AI practices including transparency, traceability, evaluation, testing, documentation, and appropriate human oversight.
  • Evaluate AI solutions for bias, accuracy, reliability, privacy, security, data leakage, prompt injection, and other relevant risks.
  • Implement safeguards appropriate to the use case, including input/output controls, content filtering, grounding checks, access controls, and auditability.
  • Follow applicable federal and FDA security, privacy, data-governance, records-management, and software development requirements.
  • Maintain technical documentation covering models, prompts, data sources, evaluation methods, configurations, limitations, testing, and deployment.
  • Participate in technical and governance reviews and provide documentation required for production deployment and operational support.

Software Engineering & Agile Delivery

  • Develop clean, maintainable, testable, and reusable Python code following established software engineering standards.
  • Develop RESTful APIs and backend services that expose AI/ML functionality to enterprise applications.
  • Participate in code reviews, unit testing, integration testing, technical design discussions, and documentation.
  • Work within Agile/Scrum development teams and participate in sprint planning, backlog refinement, demonstrations, and retrospectives.
  • Collaborate with application developers to integrate AI functionality into Java, .NET, web, and cloud-based enterprise applications without assuming ownership of the full application stack.

Qualifications

  • Approximately 5-8 years of professional software development, data engineering, data science, AI/ML, or related technical experience, including substantial hands-on AI/ML development experience.
  • Strong programming skills in Python and experience building production-quality Python applications or services.
  • Hands-on experience with machine learning libraries/frameworks such as Scikit-learn, PyTorch, TensorFlow, Hugging Face, or similar technologies.
  • Experience developing, evaluating, and integrating AI/ML models into applications or production environments.
  • Hands-on experience with Generative AI, LLMs, NLP, and LLM APIs.
  • Strong understanding of RAG, embeddings, vector search, prompt engineering, grounding, context management, and LLM evaluation.
  • Experience working with structured and unstructured data, including preprocessing, transformation, validation, and analysis.
  • Experience developing REST APIs and backend services for AI/ML functionality.
  • Working knowledge of SQL and relational databases.
  • Familiarity with Git, CI/CD, automated testing, containerization, and modern software development practices.
  • Experience working in Agile, multidisciplinary development environments.
  • Strong analytical, experimentation, troubleshooting, and problem-solving skills.
  • Ability to communicate AI/ML concepts, limitations, risks, and recommendations clearly to technical and non-technical stakeholders.

Preferred Qualifications

  • Experience supporting FDA, HHS, or other federal government programs.
  • Experience developing and deploying AI/ML solutions in AWS or Azure.
  • Experience with AWS AI/ML services such as Amazon Bedrock, SageMaker, Lambda, S3, OpenSearch, or related services.
  • Experience with Azure AI services or Azure OpenAI.
  • Experience with vector databases or vector search technologies such as Pinecone, FAISS, OpenSearch, pgvector, Chroma, or similar technologies.
  • Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI orchestration frameworks.
  • Experience developing document intelligence, NLP, semantic search, knowledge-management, or enterprise search solutions.
  • Experience designing automated LLM evaluation, prompt/version management, guardrails, or LLMOps capabilities.
  • Experience with Docker and containerized AI application deployment; familiarity with Kubernetes or cloud-native environments.
  • Experience with MLOps, model monitoring, model versioning, experiment tracking, or ML lifecycle management.
  • Understanding of microservices, event-driven integration, and enterprise application architecture.
  • Familiarity with DevSecOps practices and secure software development for AI-enabled systems.
  • Experience working with sensitive, regulated, scientific, healthcare, or federal datasets is a plus.

Professional Skills

  • Strong analytical and critical-thinking abilities.
  • Excellent written and verbal communication skills.
  • Ability to translate business requirements into practical AI/ML and LLM-enabled solutions.
  • Ability to independently own complex AI development tasks while collaborating effectively within a larger technical team.
  • Strong attention to detail and commitment to model, software, evaluation, and data quality.
  • Ability to balance experimentation with production engineering, security, governance, performance, and operational constraints.
  • Ability to communicate technical risks, assumptions, model limitations, dependencies, and recommendations clearly.
  • Strong documentation, mentoring, and knowledge-sharing skills.

Key Technologies

Languages: Python, SQLAI/ML: Scikit-learn, PyTorch, TensorFlow, Hugging FaceGenerative AI: LLMs, RAG, Prompt Engineering, Embeddings, Vector Search, LLM EvaluationAI Orchestration: LangChain, LlamaIndex, Semantic Kernel or comparable frameworksCloud: AWS and/or AzureDevelopment: REST APIs, Git, CI/CD, DockerData: SQL databases, APIs, document repositories, structured and unstructured dataMethodology: Agile/Scrum, MLOps/LLMOps, DevSecOps

 

Ideal Candidate Profile

The successful candidate will be a hands-on AI/ML and LLM engineer rather than solely a researcher, data analyst, or AI strategist. They should be comfortable writing production-quality Python, working with data, building and evaluating ML/LLM solutions, implementing RAG pipelines, developing AI APIs, and collaborating with application and cloud engineering teams to move AI capabilities from prototype into secure production environments.

This individual should have sufficient AI/ML experience to independently own complex development and evaluation tasks, make sound implementation recommendations, contribute to architecture and technical reviews, and mentor less-experienced engineers while working under the broader direction of senior architects and program leadership.

 

Education: Bachelor’s degree in Computer Science, Data Science, or a related field; Master’s degree preferred.

Location: Hybrid - Sterling, VA HQ (with flexibility for remote work as per company policy).

Clearance: Candidate must be able to obtain and maintain a Clearance.

 

Compensation & Benefits

 

The anticipated annual base salary range for this position in Sterling, VA is $130,000 – $140,000. Actual compensation will be determined based on several factors, including relevant experience, qualifications, skills, geographic location, internal equity, and business needs.

 

In addition to competitive compensation, REI Systems offers a comprehensive benefits package, including medical, dental, and vision coverage; retirement savings benefits; ESOP; paid time off; professional development opportunities; and other programs designed to support our employees' overall well-being.

 

EEO Statement: REI Systems is an Equal Opportunity Employer. In our workplace, we seek, we welcome, and respect diversity in all of its forms.

 

#LI-HYBRID

#LI-TK1

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Compensation & Benefits The anticipated annual base salary range for this position in Sterling, VA is $130,000 – $140,000. Actual compensation will be determined based on several factors, including relevant experience, qualifications, skills, geographic location, internal equity, and business needs. In addition to competitive compensation, REI Systems offers a comprehensive benefits package, including medical, dental, and vision coverage; retirement savings benefits; ESOP; paid time off; professional development opportunities; and other programs designed to support our employees' overall well-being.
Location & working pattern

Sterling, VA

Education: Bachelor’s degree in Computer Science, Data Science, or a related field; Master’s degree preferred. Location: Hybrid - Sterling, VA HQ (with flexibility for remote work as per company policy). Clearance: Candidate must be able to obtain and maintain a Clearance.
More source context
EEO Statement: REI Systems is an Equal Opportunity Employer. In our workplace, we seek, we welcome, and respect diversity in all of its forms. #LI-HYBRID #LI-TK1
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.