Machine Learning Data Engineer (LLM & Generative AI)
Reads like a ML Engineer role: putting models into production.
New York
- Pay
- Pay not listedSimilar roles state $165K–$240K
- Work setting
- Not stated
- Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting
What you’ll work on
Full postingWe are seeking an innovative and highly technical Machine Learning Data Engineer to build the foundational data infrastructure that powers our Large Language Models (LLMs) and autonomous AI agents.
Build automated pipelines to extract, clean, and format data for LLM fine-tuning (SFT, RLHF, DPO)
Build telemetry systems to measure latency and accuracy of live LLMs and AI agents
Architect synthetic data generation workflows using foundation models
Implement data quality checks, deduplication, and toxicity filtering
Manage and optimize data flows into vector databases for RAG
From the employer’s posting
We are seeking an innovative and highly technical Machine Learning Data Engineer to build the foundational data infrastructure that powers our Large Language Models (LLMs) and autonomous AI agents. In this role, you will sit at the bleeding edge of generative AI, focusing on the end-to-end data lifecycle—from orchestrating real-time telemetry to architecting the pipelines that train and refine our models. You will be responsible for ensuring our models are fed with high-quality, diverse, and well-structured data to drive continuous performance improvements.
Design, build, and maintain highly scalable, automated data pipelines to extract, clean, and format massive datasets specifically for LLM fine-tuning (Supervised Fine-Tuning, RLHF, and DPO)
Develop robust telemetry and sampling systems to ingest real-time production data
Architect and scale synthetic data generation workflows
Implement automated data quality checks, deduplication strategies, and toxicity filtering
Manage and optimize data flows into vector databases to support Retrieval-Augmented Generation (RAG) capabilities for our agentic workflows
What you’ll bring
All qualificationsCore experience
- Experience: 5+ years of professional experience in Data Engineering, Machine Learning Engineering, or MLOps.
- Familiarity with vector search and vector databases (e.g., Pinecone, Milvus, Weaviate, Qdrant).
- Experience with LLM evaluation frameworks (e.g., RAGAS, TruLens, DeepEval) and building automated LLM benchmarking suites.
- Understanding of privacy-preserving techniques (PII redaction pipelines) for handling sensitive data in ML training.
- Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) for real-time analytics.
- Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) not just for analytics, but to feed real-time contextual data into our agentic workflows and streaming RAG systems.
Qualification wording
Experience: 5+ years of professional experience in Data Engineering, Machine Learning Engineering, or MLOps.
Familiarity with vector search and vector databases (e.g., Pinecone, Milvus, Weaviate, Qdrant).
Experience with LLM evaluation frameworks (e.g., RAGAS, TruLens, DeepEval) and building automated LLM benchmarking suites.
Understanding of privacy-preserving techniques (PII redaction pipelines) for handling sensitive data in ML training.
Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) for real-time analytics.
Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) not just for analytics, but to feed real-time contextual data into our agentic workflows and streaming RAG systems.
Education & alternatives
Requirements - Education: Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related technical field. - Experience: 5+ years of professional experience in Data Engineering, Machine Learning Engineering, or MLOps.
Tools in this posting
- Python
- SQL
- GCP
- Kafka
- Hugging Face
Source — Tool mentions in context
- Experience: 5+ years of professional experience in Data Engineering, Machine Learning Engineering, or MLOps. - Programming Languages: Expert-level proficiency in Python and advanced SQL. - Generative AI & LLMs: Demonstrated hands-on experience working with LLM APIs (OpenAI, Anthropic, etc.), open-source models (Hugging Face, Llama), and orchestration frameworks (LangChain, LlamaIndex, or AutoGen).
- Data Orchestration: Strong experience with workflow orchestration tools. - Cloud & Big Data: Experience with scalable cloud infrastructure (GCP) and distributed data processing frameworks. - These are the applicable requirements, although equivalent competencies in any of the above will also be considered.
- Understanding of privacy-preserving techniques (PII redaction pipelines) for handling sensitive data in ML training. - Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) for real-time analytics. - Bilingual (English/Spanish)
- Bilingual (English/Spanish) - Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) not just for analytics, but to feed real-time contextual data into our agentic workflows and streaming RAG systems. What We Offer
- Programming Languages: Expert-level proficiency in Python and advanced SQL. - Generative AI & LLMs: Demonstrated hands-on experience working with LLM APIs (OpenAI, Anthropic, etc.), open-source models (Hugging Face, Llama), and orchestration frameworks (LangChain, LlamaIndex, or AutoGen). - Synthetic Data: Proven experience employing prompt engineering and programmatic techniques for high-quality synthetic data generation and validation.
Benefits in the posting
Full benefits wording- Competitive salary
- Initial stock options grant
- Annual performance bonus
- Unlimited PTO
- Paid parental leave
- Health, dental, and vision plans
- 401(k) with employer matching, for US-based employees
- Continuous learning opportunities
- Empowering opportunities for growth in a dynamic entrepreneurial environment
From the employer’s posting.
About Felix
At Félix, we are building the indispensable financial companion for Latinos in the US.
In the employer’s words · Read in context
Posting record
Report an errorActively hiringFirst seen by us 6 days ago, still listed, and not a repost of an earlier posting.
- Status in our records
- Live
- First seen by us
- Oct 23, 2026 · 6 days ago
- Recorded sightings
- 16
- Last seen by us
- Oct 30, 2026
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Your next step
- Have your resume and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
- Ask the employer about the pay range before committing time to the process.
Complete your application on jobs.gem.com. The employer’s form will show what is required.
Already applied? Track this application
Job description
About Us
About the Role
Responsibilities
- Automated Fine-Tuning Pipelines: Design, build, and maintain highly scalable, automated data pipelines to extract, clean, and format massive datasets specifically for LLM fine-tuning (Supervised Fine-Tuning, RLHF, and DPO).
- Real-Time Agent & LLM Evaluation: Develop robust telemetry and sampling systems to ingest real-time production data. Use this data to continuously measure, evaluate, and benchmark the real-time performance, latency, and accuracy of live LLMs and AI agents.
- Synthetic Data Generation: Architect and scale synthetic data generation workflows. Leverage foundational models to create high-variance synthetic datasets to augment training data, cover edge cases, and mitigate bias where real-world data is scarce or privacy-restricted.
- Data Quality & Curation: Implement automated data quality checks, deduplication strategies, and toxicity filtering to ensure the highest standard of data integrity entering the model training pipelines.
- Infrastructure & MLOps Integration: Partner closely with ML Researchers and DevOps to integrate data pipelines with model training infrastructure, ensuring seamless continuous integration and continuous deployment (CI/CD) for model updates.
- Vector Database Management: Manage and optimize data flows into vector databases to support Retrieval-Augmented Generation (RAG) capabilities for our agentic workflows.
Requirements
- Education: Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related technical field.
- Experience: 5+ years of professional experience in Data Engineering, Machine Learning Engineering, or MLOps.
- Programming Languages: Expert-level proficiency in Python and advanced SQL.
- Generative AI & LLMs: Demonstrated hands-on experience working with LLM APIs (OpenAI, Anthropic, etc.), open-source models (Hugging Face, Llama), and orchestration frameworks (LangChain, LlamaIndex, or AutoGen).
- Synthetic Data: Proven experience employing prompt engineering and programmatic techniques for high-quality synthetic data generation and validation.
- Data Orchestration: Strong experience with workflow orchestration tools.
- Cloud & Big Data: Experience with scalable cloud infrastructure (GCP) and distributed data processing frameworks.
- These are the applicable requirements, although equivalent competencies in any of the above will also be considered.
- Familiarity with vector search and vector databases (e.g., Pinecone, Milvus, Weaviate, Qdrant).
- Experience with LLM evaluation frameworks (e.g., RAGAS, TruLens, DeepEval) and building automated LLM benchmarking suites.
- Understanding of privacy-preserving techniques (PII redaction pipelines) for handling sensitive data in ML training.
- Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) for real-time analytics.
- Bilingual (English/Spanish)
- Experience deploying streaming data pipelines (Kafka, Flink, or Kinesis) not just for analytics, but to feed real-time contextual data into our agentic workflows and streaming RAG systems.
What We Offer
- Competitive salary
- Initial stock options grant
- Annual performance bonus
- Unlimited PTO
- Paid parental leave
- Work model: currently fully remote, with a future transition to a hybrid setup
- Health, dental, and vision plans
- 401(k) with employer matching, for US-based employees
- Continuous learning opportunities
- Empowering opportunities for growth in a dynamic entrepreneurial environment
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
New York
- Paid parental leave - Work model: currently fully remote, with a future transition to a hybrid setup - Health, dental, and vision plans
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
See how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.