Back to jobs

Principal AI/ML Architect

Pay
Pay not listed
Work setting
Hybrid — work setting source
Work setup in the employer’s posting: hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type Full Time
Employment type in the employer’s posting: Full Time
From the employer’s posting

What you’ll work on

Full posting
  • Own end-to-end architecture for complex GenAI, agentic AI, and ML platforms

  • Design and operate multi-agent workflows with orchestration, memory, and guardrails

  • Design production retrieval systems spanning ingestion, embeddings, and search

  • Partner with client leaders to turn business strategy into AI roadmaps

  • Raise engineering standards through architecture reviews, code reviews, and mentoring

From the employer’s posting
Own the end-to-end architecture for complex GenAI, agentic AI, and ML platforms
Design and operate multi-step reasoning and multi-agent workflows using ADK, LangChain, MCP
Design production-scale retrieval and knowledge systems spanning data ingestion, chunking, metadata, embeddings
Partner with client executives and engineering leaders to translate business strategy into AI roadmaps
Raise the technical bar through architecture reviews, design documents, code reviews, mentoring

What you’ll bring

All qualifications

Core experience

  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related technical field; equivalent practical experience will also be considered.
  • 15+ years of progressive experience across software engineering, machine learning, data, or AI, including substantial ownership of production systems at scale.
  • Experience establishing evaluation, observability, security, privacy, governance, and responsible AI controls for enterprise AI solutions.

Preferred experience

  • Experience training, tuning, or adapting neural networks, embedding models, or foundation models.
  • Experience building reusable AI accelerators, reference implementations, or platform capabilities across multiple clients or product teams.
  • Familiarity or good to have understanding with Kubernetes, infrastructure as code, event-driven architectures, and modern data platforms.
Qualification wording
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related technical field; equivalent practical experience will also be considered.
15+ years of progressive experience across software engineering, machine learning, data, or AI, including substantial ownership of production systems at scale.
Experience establishing evaluation, observability, security, privacy, governance, and responsible AI controls for enterprise AI solutions.
Experience training, tuning, or adapting neural networks, embedding models, or foundation models.
Experience building reusable AI accelerators, reference implementations, or platform capabilities across multiple clients or product teams.
Familiarity or good to have understanding with Kubernetes, infrastructure as code, event-driven architectures, and modern data platforms.
Education & alternatives
Basic qualifications: - Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related technical field; equivalent practical experience will also be considered. - 15+ years of progressive experience across software engineering, machine learning, data, or AI, including substantial ownership of production systems at scale.

About Egen

Egen is a fast-growing, entrepreneurial technology company with a data-first mindset.

In the employer’s words · Read in context

Apply at Egen

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 23, 202629 days ago
Recorded sightings
28
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 29

Similar jobs usually come down between day 7 and day 76.

At Egen, jobs usually come down by about day 31.

From 6,389 similar postings that came down, and 9 of Egen’s. Coming down is not always a hire.

Egen is hiring

9 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Azure
  • Kubernetes
  • GCP
Where the posting names them
- Set enterprise AI architecture and technical direction: Own the end-to-end architecture for complex GenAI, agentic AI, and ML platforms. Define reference architectures, reusable patterns, engineering guardrails, and technology choices across engagements. - Build at the frontier - hands-on: Stay close to the code on the highest-leverage technical work, including foundation-model and embedding fine-tuning, advanced RAG, semantic search, evaluation harnesses, and novel agentic workflows using Python and Google Cloud Vertex AI. - Engineer AI for production: Design for latency, reliability, security, cost, scalability, and maintainability from day one. Apply disciplined MLOps and LLMOps practices so systems are versioned, evaluated, monitored, deployed, and continuously improved.
Your technical toolkit: - Languages and software engineering Expert-level Python; strong shell scripting; API and service design; clean, tested, maintainable code; distributed-system fundamentals; and full SDLC ownership. - Models and AI ecosystem Deep, current expertise with Google Gemini, GPT-class models, LLaMA and other open models; advanced prompt engineering; structured outputs; model selection; fine-tuning; and rigorous evaluation.
- A proven record of deploying generative AI, agentic AI, and/or applied-ML products into production - beyond proofs of concept. - Deep hands-on expertise with Python, modern LLM and ML architectures, agent frameworks, Google Cloud / Vertex AI, production APIs, and scalable software systems. - Experience establishing evaluation, observability, security, privacy, governance, and responsible AI controls for enterprise AI solutions.
- MLOps and LLMOps CI/CD, model and prompt versioning, experiment tracking, automated evaluation, observability, model monitoring, drift detection, rollback, and production incident response. - Data and ML foundations Strong SQL and data engineering; classical machine learning; neural networks; training, tuning, and inference; and the ability to connect data quality to model and product outcomes. Basic qualifications:
- Experience establishing evaluation, observability, security, privacy, governance, and responsible AI controls for enterprise AI solutions. - Strong data engineering and SQL knowledge, with the ability to design reliable data and retrieval foundations for AI products. - Senior client-facing experience, with the communication skills to explain technical choices, risks, and business value to executive stakeholders and engineering teams.
- Retrieval and search Advanced RAG, hybrid and semantic search, embeddings, re-ranking, and vector platforms such as Vertex AI Vector Search, pgvector, Pinecone, or equivalent technologies. - Cloud infrastructure and AI systems End-to-end experience architecting highly available, scalable AI and software environments across Google Cloud / Vertex AI, AWS, and Azure, including model serving, data integration, IAM, networking, security, observability, and cost management. - Frameworks Strong command of LangChain, LlamaIndex, or equivalent orchestration layers - together with the judgment to use simpler, more maintainable patterns when appropriate.
- Pre-sales experience including discovery workshops, solution shaping, estimation, proposal development, and technical presentations. - Familiarity or good to have understanding with Kubernetes, infrastructure as code, event-driven architectures, and modern data platforms. Employment type
About Egen: Egen is a fast-growing, entrepreneurial technology company with a data-first mindset. We bring together exceptional engineering talent and advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where talented people choose to do their best work - applying deep engineering and technology expertise to envision how data, AI, and platforms can change the world for the better. We are dedicated to learning, thrive on solving difficult problems, and continually innovate to achieve fast, effective results. If that describes you, we want you on our team.
- Architecture experience in regulated or high-stakes domains such as healthcare, financial services, or the public sector. - Google Cloud Professional Machine Learning Engineer, Professional Cloud Architect, or comparable certification. - Experience building reusable AI accelerators, reference implementations, or platform capabilities across multiple clients or product teams.

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

About Egen:

 

Egen is a fast-growing, entrepreneurial technology company with a data-first mindset. We bring together exceptional engineering talent and advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. 

We are committed to being a place where talented people choose to do their best work - applying deep engineering and technology expertise to envision how data, AI, and platforms can change the world for the better. We are dedicated to learning, thrive on solving difficult problems, and continually innovate to achieve fast, effective results. If that describes you, we want you on our team.  

About the opportunity:

    As a Principal AI/ML Architect, you will set the technical direction for Egen's most complex generative AI, agentic AI, and applied machine learning engagements while remaining personally hands-on in the work that matters most. We treat AI as a software engineering discipline. You will raise that bar by architecting systems that succeed in production and helping the engineers around you do the same.

     

    You will own the hardest architectural problems in our portfolio: agentic platforms operating at scale, applied-ML solutions, advanced retrieval systems, and AI in regulated or high-stakes environments where being wrong is expensive. Document intelligence and RAG pipelines are part of your toolkit, not the ceiling. You will take systems from an ambiguous business problem to a robust, scalable service, solving for latency, reliability, cost, security, and governance.

     

    You will also be the senior technical face of our engagements. You will partner directly with client leadership to translate business strategy into AI architecture, shape solutions during pre-sales, guide engineering teams, and earn the trust that turns a project into a long-term program.            

What you will do:

  • Set enterprise AI architecture and technical direction: Own the end-to-end architecture for complex GenAI, agentic AI, and ML platforms. Define reference architectures, reusable patterns, engineering guardrails, and technology choices across engagements. 

  • Build at the frontier - hands-on: Stay close to the code on the highest-leverage technical work, including foundation-model and embedding fine-tuning, advanced RAG, semantic search, evaluation harnesses, and novel agentic workflows using Python and Google Cloud Vertex AI. 

  • Engineer AI for production: Design for latency, reliability, security, cost, scalability, and maintainability from day one. Apply disciplined MLOps and LLMOps practices so systems are versioned, evaluated, monitored, deployed, and continuously improved. 

  • Architect agentic systems at scale: Design and operate multi-step reasoning and multi-agent workflows using ADK, LangChain, MCP, and custom agent frameworks, with robust orchestration, state management, tool use, memory, human oversight, failure isolation, and verification controls. 

  • Establish evaluation, observability, and responsible AI standards: Define measurable quality criteria and production telemetry for accuracy, groundedness, safety, drift, latency, and cost. Embed privacy, security, governance, and responsible AI throughout the lifecycle. 

  • Shape data and retrieval architectures: Design production-scale retrieval and knowledge systems spanning data ingestion, chunking, metadata, embeddings, vector and hybrid search, re-ranking, provenance, permissions, and continuous content refresh. 

  • Advise clients and shape opportunities: Partner with client executives and engineering leaders to translate business strategy into AI roadmaps and solution architectures. Lead discovery, technical workshops, estimates, trade-off discussions, and pre-sales solutioning. 

  • Multiply engineering capability: Raise the technical bar through architecture reviews, design documents, code reviews, mentoring, reusable accelerators, and clear standards that help senior and mid-level engineers deliver with greater confidence. 

  • Own outcomes across the full lifecycle: Guide initiatives from problem framing and experimentation through production rollout, operational readiness, adoption, and measurable business value. Surface risks early and drive decisions to resolution.

Your technical toolkit:

  • Languages and software engineering Expert-level Python; strong shell scripting; API and service design; clean, tested, maintainable code; distributed-system fundamentals; and full SDLC ownership. 
  • Models and AI ecosystem Deep, current expertise with Google Gemini, GPT-class models, LLaMA and other open models; advanced prompt engineering; structured outputs; model selection; fine-tuning; and rigorous evaluation. 
  • Agentic AI engineering Hands-on production experience with Google Agent Development Kit (ADK), LangChain, custom agent frameworks, tool use, Model Context Protocol (MCP), workflow orchestration, planning, memory, state, guardrails, human-in-the-loop controls, and multi-agent design.
  • Retrieval and search Advanced RAG, hybrid and semantic search, embeddings, re-ranking, and vector platforms such as Vertex AI Vector Search, pgvector, Pinecone, or equivalent technologies.
  • Cloud infrastructure and AI systems End-to-end experience architecting highly available, scalable AI and software environments across Google Cloud / Vertex AI, AWS, and Azure, including model serving, data integration, IAM, networking, security, observability, and cost management.
  • Frameworks Strong command of LangChain, LlamaIndex, or equivalent orchestration layers - together with the judgment to use simpler, more maintainable patterns when appropriate. 
  • MLOps and LLMOps CI/CD, model and prompt versioning, experiment tracking, automated evaluation, observability, model monitoring, drift detection, rollback, and production incident response.
  • Data and ML foundations Strong SQL and data engineering; classical machine learning; neural networks; training, tuning, and inference; and the ability to connect data quality to model and product outcomes.

Basic qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related technical field; equivalent practical experience will also be considered. 

  • 15+ years of progressive experience across software engineering, machine learning, data, or AI, including substantial ownership of production systems at scale. 

  • Demonstrated principal-level technical leadership, including architecture ownership, cross-team technical direction, and decision-making across complex engagements or product portfolios. 

  • A proven record of deploying generative AI, agentic AI, and/or applied-ML products into production - beyond proofs of concept. 

  • Deep hands-on expertise with Python, modern LLM and ML architectures, agent frameworks, Google Cloud / Vertex AI, production APIs, and scalable software systems. 

  • Experience establishing evaluation, observability, security, privacy, governance, and responsible AI controls for enterprise AI solutions. 

  • Strong data engineering and SQL knowledge, with the ability to design reliable data and retrieval foundations for AI products. 

  • Senior client-facing experience, with the communication skills to explain technical choices, risks, and business value to executive stakeholders and engineering teams.

Preferred qualifications:

  • Experience training, tuning, or adapting neural networks, embedding models, or foundation models. 

  • Architecture experience in regulated or high-stakes domains such as healthcare, financial services, or the public sector. 

  • Google Cloud Professional Machine Learning Engineer, Professional Cloud Architect, or comparable certification. 

  • Experience building reusable AI accelerators, reference implementations, or platform capabilities across multiple clients or product teams. 

  • Pre-sales experience including discovery workshops, solution shaping, estimation, proposal development, and technical presentations. 

  • Familiarity or good to have understanding with Kubernetes, infrastructure as code, event-driven architectures, and modern data platforms. 

Employment type

Full Time

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Hyderabad

- Establish evaluation, observability, and responsible AI standards: Define measurable quality criteria and production telemetry for accuracy, groundedness, safety, drift, latency, and cost. Embed privacy, security, governance, and responsible AI throughout the lifecycle. - Shape data and retrieval architectures: Design production-scale retrieval and knowledge systems spanning data ingestion, chunking, metadata, embeddings, vector and hybrid search, re-ranking, provenance, permissions, and continuous content refresh. - Advise clients and shape opportunities: Partner with client executives and engineering leaders to translate business strategy into AI roadmaps and solution architectures. Lead discovery, technical workshops, estimates, trade-off discussions, and pre-sales solutioning.
More source context
- Agentic AI engineering Hands-on production experience with Google Agent Development Kit (ADK), LangChain, custom agent frameworks, tool use, Model Context Protocol (MCP), workflow orchestration, planning, memory, state, guardrails, human-in-the-loop controls, and multi-agent design. - Retrieval and search Advanced RAG, hybrid and semantic search, embeddings, re-ranking, and vector platforms such as Vertex AI Vector Search, pgvector, Pinecone, or equivalent technologies. - Cloud infrastructure and AI systems End-to-end experience architecting highly available, scalable AI and software environments across Google Cloud / Vertex AI, AWS, and Azure, including model serving, data integration, IAM, networking, security, observability, and cost management.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.