AI Analyst (Bangalore, Karnataka, IN)

<div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Job Summary</H2> </div><div><p><span style="font-family:arial, helvetica, sans-serif">The ERDM Sr. AI Operations Analyst is responsible for ensuring that Sales &amp; Finance AI solutions operate with the highest levels of trust, accuracy, control, and compliance.</span></p> <p><span style="font-family:arial, helvetica, sans-serif">We are seeking a detail-obsessed, data driven expert to serve as the guardian of accuracy for our Sales &amp; Finance AI chat assistants. You will design validation frameworks, partner with data engineering teams, and ensure every metric the AI surfaces - especially Bookings and Revenue - is accurate, consistent, and trustworthy. You will lead incident response on any data accuracy or hallucination even</span></p> <p><span style="font-family:arial, helvetica, sans-serif">The role also serves as the bridge between Finance users and technical development teams. This role is responsible for translating business requirements into AI-enabled solutions and ensuring that Finance AI capabilities align with business goals and leadership needs.</span></p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Core Responsibilities:</H2> </div><div><p><span style="font-family:arial, helvetica, sans-serif"><strong>Requirements &amp; Solution Definition</strong></span></p> <ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Gather and document business requirements from Finance users and stakeholders through interviews, workshops, observation, and feedback analysis</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Write clear, detailed user stories with well-defined acceptance criteria that IT can act on without ambiguity</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Ensure requirements reflect metric integrity standards and executive-readiness expectations</span></li> </ul> <p> </p> <p><span style="font-family:arial, helvetica, sans-serif"><strong>AI Quality Assurance</strong></span></p> <ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Develop and maintain AI-specific testing frameworks - define test scenarios, expected outputs, edge cases, and pass/fail criteria tailored to conversational AI behavior</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Establish and document quality standards for AI-generated responses - accuracy, completeness, formatting, tone, and contextual relevance</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Validate AI-generated responses against Snowflake source data using SQL queries to confirm metric accuracy and consistency</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Conduct thorough UAT, regression testing, and release testing for every new feature, enhancement, prompt update, data refresh, or model change before go-live</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Confirm metric integrity - verify that Bookings and Revenue figures surfaced by the AI match official Finance reporting</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Coordinate business sign-off activities - manage the approval workflow with Finance stakeholders before releases are promoted to production</span></li> </ul> <p> </p> <p><span style="font-family:arial, helvetica, sans-serif"><strong>Hallucination Prevention</strong></span></p> <ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Design and execute validation test strategies specifically targeting hallucination risks - test for fabricated data, incorrect metric associations, misleading trends, and unsupported narratives</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Identify and catalog high-risk Finance use cases where hallucination potential is elevated (e.g., multi-step calculations, year-over-year comparisons, segment-level breakdowns, forecast vs. actuals)</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Monitor response quality on an ongoing basis - conduct periodic spot-checks and audits of AI outputs across different query types and user scenarios</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Escalate and resolve quality concerns immediately - flag suspected hallucinations to the Data Accuracy Specialist (IC4) and team lead; coordinate with IT/Engineering to implement fixes and guardrails</span></li> </ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Core Responsibilities</H2> </div><div><p><span style="font-family:arial, helvetica, sans-serif"><strong>Executive Use Cases</strong></span></p> <ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Support in designing and testing executive-focused use cases - ensure AI responses meet the precision, tone, and contextual depth expected by C-suite and SVP users</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Test and validate executive prompt frameworks - verify that curated queries, guided flows, and personalized dashboards produce accurate, polished outputs</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Contribute to improving usability and decision-support capabilities - identify opportunities to make the executive experience more intuitive, actionable, and insightful</span></li> </ul> <p> </p> <p><span style="font-family:arial, helvetica, sans-serif"><strong>Adoption &amp; Change Management</strong></span></p> <ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Develop and execute adoption strategies - create structured plans to drive Finance user engagement, from initial awareness through active daily use</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Lead user onboarding - design and deliver onboarding experiences for new users, including guided walkthroughs, sandbox environments, and office hours</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Deliver training programs - conduct live demos, workshops, and drop-in sessions tailored to different user groups (analysts, managers, directors)</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Manage communications - draft and distribute release notes, feature announcements, tips &amp; tricks, known issue updates, and adoption progress reports to Finance stakeholders</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Collect and synthesize user feedback through surveys, interviews, and usage analytics to continuously improve the experience</span></li> </ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Required Qualifications:</H2> </div><div><ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Bachelor's degree Required</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">7+ years in Business Analysis / Finance Analytics / FP&amp;A Operations</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Experience with AI-powered tools, chatbots, or conversational AI interfaces</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Understanding of Finance metrics and reporting (Bookings, Revenue, or related areas)</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Working knowledge of SQL and Snowflake</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Understanding of AI/LLM fundamentals - how large language models retrieve, process, and present information; awareness of common failure modes (hallucination, data staleness, context window limitations)</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Prompt Engineering Certificate or related experience</span></li> </ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:16.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px">Preferred Qualifications:</H2> </div><div><ul> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Familiarity with Abacus or similar platforms</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Hands-on experience with prompt engineering — designing, testing, and refining prompts to improve AI response quality and accuracy</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Experience creating training materials, user guides, or knowledge base content</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Experience with AI testing frameworks or quality assurance for data-driven applications</span></li> <li style="font-family:arial, helvetica, sans-serif"><span style="font-family:arial, helvetica, sans-serif">Familiarity with AI governance or responsible AI principles</span></li> </ul></div></div></div>