Time since we first saw it
Day 25
Similar jobs usually come down between day 5 and day 43.
At Citi, jobs usually come down by about day 14.
From 16,018 similar postings that came down, and 1,636 of Citi’s. Coming down is not always a hire.
Pune Maharashtra India
Live, first seen by us 25 days agoTime Type: Full time------------------------------------------------------ Most Relevant Skills
Employment type in the employer’s posting: Full timeFrom the employer’s posting
The role will be AVP (C12) in the TTS Analytics team.
As a key contributor to ideation on analytical projects to tackle strategic business priorities.
Own end-to-end delivery of AI-powered products, from requirements to support
Build automated, scalable LLM evaluation pipelines and frameworks
Author ODD, model validation packages and model risk assessments
Develop structured prompt architectures and optimize token budgets and model routing
The role will be AVP (C12) in the TTS Analytics team.
As a key contributor to ideation on analytical projects to tackle strategic business priorities.
Own end‑to‑end delivery of AI‑powered products: requirements, design, implementation, testing, deployment, and support.
Design, build, and maintain automated, scalable evaluation pipelines and frameworks
Author comprehensive Object Development Documentation (ODD), Model Validation packages, model risk assessments
Develop structured, reproducible prompt architectures using advanced techniques
Overall 8+ years of experience. 5+ years of Data Science/ML engineering experience, with at least 1–2 years dedicated to Generative AI, LLMs, NLP, and evaluation frameworks.
Bachelor / Masters (preferred) in Computer Science Engineering, Data Science, AI/ML, or related technical disciplines (or equivalent practical experience).
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 25
Similar jobs usually come down between day 5 and day 43.
At Citi, jobs usually come down by about day 14.
From 16,018 similar postings that came down, and 1,636 of Citi’s. Coming down is not always a hire.
448 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Must have substantial experience in: · Strong proficiency in Python (async/concurrency, FastAPI/Pydantic, pytest) and standard data analysis stacks (Pandas, NumPy). · Hands-on experience with modern LLM tooling such as LangChain, LlamaIndex, Hugging Face, etc..
· Deep understanding of quantitative evaluation metrics (Semantic similarity, Faithfulness, Answer Relevancy, Precision/Recall, Hallucination scoring, Toxicity). · Experience building structured dataset curation pipelines, data cleansing, versioning (like S3), and synthetic data generation techniques. · Observability: application monitoring, centralized logging, tracing; strong debugging and problem‑resolution skills.
· Strong proficiency in Python (async/concurrency, FastAPI/Pydantic, pytest) and standard data analysis stacks (Pandas, NumPy). · Hands-on experience with modern LLM tooling such as LangChain, LlamaIndex, Hugging Face, etc.. · Deep understanding of quantitative evaluation metrics (Semantic similarity, Faithfulness, Answer Relevancy, Precision/Recall, Hallucination scoring, Toxicity).
Complete your application on citi.wd5.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
Yes. We’ve followed 2 other Specialized Analytics Senior Analyst jobs there since November 2026. All 2 are still up.
Job Description
Overview
The C12 is a developing professional role. Deals with most problems independently and has some latitude to solve complex problems. Integrates in-depth specialty area knowledge with a solid understanding of industry standards and practices. Good understanding of how the team and area integrate with others in accomplishing the objectives of the sub function/ job family. Applies analytical thinking and knowledge of data analysis tools and methodologies. Requires attention to detail when making judgments and recommendations based on the analysis of information. Typically deals with variable issues with potentially broader business impact. Applies professional judgment when interpreting data and results. Breaks down information in a systematic and communicable manner. Developed communication and diplomacy skills are required to exchange potentially complex/sensitive information. Moderate but direct impact through close contact with the businesses' core activities. Quality and timeliness of service provided will affect the effectiveness of own team and other closely related teams.
TTS Analytics C12
What do we do?
ROLE DESCRIPTION
The role will be AVP (C12) in the TTS Analytics team.
The role will involve working on
QUALIFICATIONS
Experience:
Must have substantial experience in:
· Strong proficiency in Python (async/concurrency, FastAPI/Pydantic, pytest) and standard data analysis stacks (Pandas, NumPy).
· Hands-on experience with modern LLM tooling such as LangChain, LlamaIndex, Hugging Face, etc..
· Deep understanding of quantitative evaluation metrics (Semantic similarity, Faithfulness, Answer Relevancy, Precision/Recall, Hallucination scoring, Toxicity).
· Experience building structured dataset curation pipelines, data cleansing, versioning (like S3), and synthetic data generation techniques.
· Observability: application monitoring, centralized logging, tracing; strong debugging and problem‑resolution skills.
· AI Governance
Good to Have
· Prior experience in financial services, healthcare, or heavily regulated enterprise environments, particularly with Model Risk Governance
· Experience evaluating complex multi-step reasoning, tool-calling agents, memory systems, and Multi-Agent Orchestration frameworks.
· Knowledge of data privacy and responsible AI practices; experience implementing audit and guardrail tooling.
Education:
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
New Analyst postings at the employers we follow are up 26% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Analyst, by the work the posting describes.
Analysts answer business questions with data. They pull numbers with SQL, build reports and dashboards, and explain what changed and why to the people making decisions.
Most postings ask for SQL, spreadsheets, a dashboard tool such as Tableau or Power BI, and clear writing.
Unlike a data scientist, an analyst mostly explains what happened rather than building models that predict what will.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Pune Maharashtra India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.