Back to jobs

Senior Manager, AI Engineer/ Solutions & Engineering

Pay
$153,770–186,327/year · Full-time equivalentAnnual period assumed — pay source
Compensation Overview: Princeton - NJ - US: $153,770 - $186,327 
 The starting pay range(s) listed above is for full-time employees (FTE). You may also be eligible for additional discretionary incentive cash and stock opportunities. We determine starting pay thoughtfully – carefully considering the nature of the role, required skills, work location, schedule and the knowledge and experience you bring. Final compensation is guided by pay equity principles and applicable employment laws. Compensation programs are reviewed on an ongoing basis and may be adjusted over time to reflect evolving market factors, and individual, team or Company performance. Benefits:
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Build and ship LLM-powered solutions (assistant extensions, connectors, agentic workflows, and custom applications) from prototype to production

  • Design around the harness: understand how AI assistant platforms run the agent loop (tool calls, context assembly, permissions, sandboxing) and shape solutions to fit

  • Implement guardrails and human-in-the-loop controls suited to regulated pharma content (MLR review, compliance, auditability, data boundaries)

From the employer’s posting
Key Responsibilities Build and ship LLM-powered solutions (assistant extensions, connectors, agentic workflows, and custom applications) from prototype to production Build evaluations first: define what “good” means for each use case, create golden datasets, graders, and regression suites, and use them to drive every prompt, tool, and model change
Build with coding agents: use agents such as Claude Code as a daily development tool, writing specs, directing agents, and reviewing and testing their output, while owning correctness and quality Design around the harness: understand how AI assistant platforms run the agent loop (tool calls, context assembly, permissions, sandboxing) and shape solutions to fit Engineer context deliberately: system prompts, reusable instructions, memory, retrieval, structured outputs, and long-context strategy
Select the right model for each task by weighing capability, cost, latency, and risk, using your own evals as evidence Implement guardrails and human-in-the-loop controls suited to regulated pharma content (MLR review, compliance, auditability, data boundaries) Monitor and improve quality, cost, latency, and adoption of deployed solutions using production traces and feedback

Before you apply

Employer’s visa record
469 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience)
  • 5+ years of software or ML engineering experience, with at least 1 year building LLM or agent-based solutions
  • Strong communication skills, including explaining trade-offs to business partners
Qualification wording
Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience)
5+ years of software or ML engineering experience, with at least 1 year building LLM or agent-based solutions
Strong communication skills, including explaining trade-offs to business partners
Education & alternatives
Qualifications - Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience) - 5+ years of software or ML engineering experience, with at least 1 year building LLM or agent-based solutions

Benefits in the posting

Full benefits wording
  • Subject to the terms and conditions of the applicable plans then in effect, you may be eligible to participate in our comprehensive benefit plans – including wellbeing support, retirement and financial protection benefits, and insurance offerings (medical, dental, vision, life and disability).
  • U.S.-based exempt employees are eligible for Flexible Time Off (FTO), which provides paid time off without a set accrual limit, subject to manager approval, along with 11 paid company holidays each year.
  • Non-exempt employees, RayzeBio employees, and employees located in Puerto Rico receive 160 hours of paid vacation annually for new hires (subject to manager approval), 11 paid company holidays, and 3 optional holidays.
  • Depending on eligibility, employees may also have access to additional time-off benefits, including paid sick leave, up to two paid volunteer days per year, summer hours flexibility, and leaves of absence for medical, personal, parental, caregiver, bereavement, or military needs. Eligible employees also enjoy an annual Global Shutdown between Christmas Day and New Year's Day.
  • How We Work
  • Supporting People with Disabilities

From the employer’s posting.

Apply at Bristol Myers Squibb

Posting record

Report an error

Actively hiringFirst seen by us 4 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 13, 20264 days ago
Recorded sightings
4
Last seen by us
Nov 16, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 4

Similar jobs usually come down between day 2 and day 14.

At Bristol Myers Squibb, jobs usually come down by about day 22.

From 959 similar postings that came down, and 139 of Bristol Myers Squibb’s. Coming down is not always a hire.

Bristol Myers Squibb is hiring

38 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down at a usual pace
  • 5% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • TypeScript
  • AWS
  • Azure
  • GCP
  • Hugging Face
Where the posting names them
- Proven LLM solutions in production, not just prototypes - Strong Python (ideally TypeScript too), API-driven development, Git, CI/CD, and a cloud platform (AWS, Azure, or GCP) - Advanced prompt and context engineering: system prompt design, few-shot patterns, structured outputs, reasoning and long-context strategies
- Multimodal and document-understanding workloads - Fine-tuning or distillation (LoRA, PEFT) and open-weight models (Hugging Face, Llama, Mistral) Qualifications

Your next step

Complete your application on bristolmyerssquibb.wd5.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

At Bristol Myers Squibb, our employees often ask, “Who are you working for?”—a question that fuels collaboration, accountability, and urgency in our work. Our purpose-driven culture inspires us to discover, develop, and deliver innovative medicines to prevail over serious diseases. We offer uniquely interesting and meaningful work, opportunities for growth, and a supportive environment that values inclusion, wellbeing, flexibility, and comprehensive benefits. This is work that transforms the lives of patients, and the careers of those who do it.



At BMS, digital innovation and technology are central to our vision of transforming patients’ lives through science. We are applying AI to accelerate content creation, speed up decision making, and enable more personalized customer engagement, increasingly through enterprise AI assistants and agents that commercial teams use in their daily work.

We are looking for a hands-on AI Engineer who solves real business problems with LLMs. You will design how models are prompted, grounded, equipped with tools, evaluated, and governed, and you will build the solutions that run on top of them, using coding agents to move fast. You will understand how models and agent harnesses work well enough to know when a solution will succeed, when it will fail, and how to design around both.


Key Responsibilities

  • Build and ship LLM-powered solutions (assistant extensions, connectors, agentic workflows, and custom applications) from prototype to production
  • Build evaluations first: define what “good” means for each use case, create golden datasets, graders, and regression suites, and use them to drive every prompt, tool, and model change
  • Build with coding agents: use agents such as Claude Code as a daily development tool, writing specs, directing agents, and reviewing and testing their output, while owning correctness and quality
  • Design around the harness: understand how AI assistant platforms run the agent loop (tool calls, context assembly, permissions, sandboxing) and shape solutions to fit
  • Engineer context deliberately: system prompts, reusable instructions, memory, retrieval, structured outputs, and long-context strategy
  • Choose the right build pattern: platform extension vs. connector vs. custom app vs. API-based agent, and when not to use an agent
  • Select the right model for each task by weighing capability, cost, latency, and risk, using your own evals as evidence
  • Implement guardrails and human-in-the-loop controls suited to regulated pharma content (MLR review, compliance, auditability, data boundaries)
  • Monitor and improve quality, cost, latency, and adoption of deployed solutions using production traces and feedback
  • Translate business needs into technical solutions with marketing, commercial, and IT partners
  • Enable the business: explain what AI can do, where it breaks, and what it is worth
  • Raise the team’s practice: share reusable patterns, review peers’ work, and track new models and platform capabilities

Required Knowledge and Skills

Evaluation and quality engineering

  • Designing evals for non-deterministic systems: golden datasets, rubric and LLM-as-judge graders, human review, and regression testing
  • Evaluating each layer separately: retrieval, tool use, multi-step agent trajectories, and final output
  • Validating the judges themselves: calibrating LLM graders against human labels and spotting grader bias
  • Running evals in CI so that changes to prompts, tools, skills, or model versions are measured before release
  • Turning evaluation results into improvements (error analysis, failure categorization, targeted fixes)

Working with coding agents

  • Current, hands-on daily use of coding agents such as Claude Code (or Codex, Cursor, or similar) to design, build, test, and refactor real software
  • Spec-driven workflows: writing clear specs and acceptance tests, breaking work into agent-sized tasks, and running agents in parallel or over long tasks
  • Configuring agents: project instructions, skills, MCP servers, hooks, and permissions
  • Reviewing agent output critically. You can explain and defend every line you ship, and you know when an agent is going off track.

Applied LLM engineering

  • Proven LLM solutions in production, not just prototypes
  • Strong Python (ideally TypeScript too), API-driven development, Git, CI/CD, and a cloud platform (AWS, Azure, or GCP)
  • Advanced prompt and context engineering: system prompt design, few-shot patterns, structured outputs, reasoning and long-context strategies
  • Retrieval and grounding: chunking, hybrid search, reranking, metadata filtering, and knowing when connectors or direct file access replace a vector DB
  • Agentic patterns: tool and function calling, multi-step workflows, MCP, and judgment on when not to use an agent
  • Working with unstructured and semi-structured data (documents, PDFs, content assets)

Understanding how models and harnesses work

  • Transformer fundamentals: tokenization, attention, context windows, and sampling
  • The training stack (pretraining, instruction tuning, RLHF/RLAIF) and how reasoning models differ
  • How an agent harness works: the loop, tool exposure, context management, and permissions
  • Failure modes (hallucination, sycophancy, position bias, prompt injection, tool misuse) and the mitigation for each
  • Reasoning about cost, latency, and quality from first principles

Engineering practices

  • LLMOps: tracing, observability, versioning of prompts and models, and cost and usage management
  • Security basics: prompt injection via tools and documents, data leakage, PII, least-privilege access

Desirable Experience

  • Enterprise AI assistant platforms: hands-on experience building on Claude Desktop (Chat, Cowork, Code; skills, projects, plugins, connectors), ChatGPT Enterprise (custom GPTs, connectors, projects), Gemini Enterprise / Gemini for Workspace, or similar harnesses
  • Building or configuring MCP servers and integrating enterprise systems as connectors
  • Agent SDK or API-based agent development for cases that outgrow the assistant platform
  • Pharma, life sciences, or other regulated industries (MLR, GxP, 21 CFR Part 11 awareness)
  • Commercial pharma data and systems (Veeva, PromoMats, IQVIA), digital marketing, content supply chain, or HCP/DTC engagement
  • Enterprise AI rollout: adoption programs, workshops, champion networks, usage governance
  • Multi-agent or sub-agent orchestration (LangGraph or similar)
  • Multimodal and document-understanding workloads
  • Fine-tuning or distillation (LoRA, PEFT) and open-weight models (Hugging Face, Llama, Mistral)

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent experience)
  • 5+ years of software or ML engineering experience, with at least 1 year building LLM or agent-based solutions
  • A portfolio of shipped work, such as assistant extensions, connectors, agent workflows, or an eval suite you built
  • Strong communication skills, including explaining trade-offs to business partners


#LI-Onsite


We hire for skills and capabilities, not just credentials – if this role excites you, but doesn’t perfectly match your resume, we encourage you to apply anyway.

Compensation Overview:

Princeton - NJ - US: $153,770 - $186,327 


The starting pay range(s) listed above is for full-time employees (FTE). You may also be eligible for additional discretionary incentive cash and stock opportunities. We determine starting pay thoughtfully – carefully considering the nature of the role, required skills, work location, schedule and the knowledge and experience you bring. Final compensation is guided by pay equity principles and applicable employment laws. Compensation programs are reviewed on an ongoing basis and may be adjusted over time to reflect evolving market factors, and individual, team or Company performance.


Benefits:


Subject to the terms and conditions of the applicable plans then in effect, you may be eligible to participate in our comprehensive benefit plans – including wellbeing support, retirement and financial protection benefits, and insurance offerings (medical, dental, vision, life and disability).


U.S.-based exempt employees are eligible for Flexible Time Off (FTO), which provides paid time off without a set accrual limit, subject to manager approval, along with 11 paid company holidays each year.


Non-exempt employees, RayzeBio employees, and employees located in Puerto Rico receive 160 hours of paid vacation annually for new hires (subject to manager approval), 11 paid company holidays, and 3 optional holidays.


Depending on eligibility, employees may also have access to additional time-off benefits, including paid sick leave, up to two paid volunteer days per year, summer hours flexibility, and leaves of absence for medical, personal, parental, caregiver, bereavement, or military needs. Eligible employees also enjoy an annual Global Shutdown between Christmas Day and New Year's Day.


U.S.-based job seekers can explore full benefit offerings at https://careers.bms.com/benefits


How We Work

Where you work matters – because collaboration, innovation and patient impact happen in many settings. Our roles are structured across four work models: site-essential, site-by-design, field-based and remote-by-design. The model assigned to this role is based on its core responsibilities. Learn more at https://careers.bms.com/ways-of-working.


Supporting People with Disabilities

BMS is dedicated to ensuring that people with disabilities can excel through a transparent recruitment process, reasonable workplace accommodations/adjustments and ongoing support in their roles. Applicants can request a reasonable workplace accommodation/adjustment prior to accepting a job offer. If you require reasonable accommodations/adjustments in completing this application, or in any part of the recruitment process, direct your inquiries to adastaffingsupport@bms.com. Visit careers.bms.com/eeo-accessibility to access our complete Equal Employment Opportunity statement.


Candidate Rights

BMS will consider qualified applicants with arrest and conviction records, pursuant to applicable laws in your area.


For roles based in Los Angeles County only:  If you live in or expect to work from Los Angeles County if hired for this position, please visit this page for important additional information: https://careers.bms.com/california-residents/


For roles based in Washington State only: If you live in or expect to work from Washington State if hired for this position, please visit this page for important information about the Washington Fair Chance Act.


Data Protection

We will never request payments, financial information, or social security numbers during our application or recruitment process. Learn more about protecting yourself at https://careers.bms.com/fraud-protection.


Any data processed in connection with role applications will be treated in accordance with applicable data privacy policies and regulations.


If this posting is missing required information required by local law or incorrect, contact BMS at TAEnablement@bms.comwith the Job Title and Requisition number. Do not send application-related inquiries to this email. To check your application status, please login to your Candidate Home Account.



R1608179 : Senior Manager, AI Engineer/ Solutions & Engineering

About Bristol Myers Squibb

People
About 32,500 in 2025, down 5% from the year before.Annual report (SEC Form 10-K)
Company
Listed as BMY.
H-1B visas
80 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Compensation Overview: Princeton - NJ - US: $153,770 - $186,327 
 The starting pay range(s) listed above is for full-time employees (FTE). You may also be eligible for additional discretionary incentive cash and stock opportunities. We determine starting pay thoughtfully – carefully considering the nature of the role, required skills, work location, schedule and the knowledge and experience you bring. Final compensation is guided by pay equity principles and applicable employment laws. Compensation programs are reviewed on an ongoing basis and may be adjusted over time to reflect evolving market factors, and individual, team or Company performance. Benefits:
Location & working pattern

Princeton - NJ - US

- Advanced prompt and context engineering: system prompt design, few-shot patterns, structured outputs, reasoning and long-context strategies - Retrieval and grounding: chunking, hybrid search, reranking, metadata filtering, and knowing when connectors or direct file access replace a vector DB - Agentic patterns: tool and function calling, multi-step workflows, MCP, and judgment on when not to use an agent
More source context
How We Work Where you work matters – because collaboration, innovation and patient impact happen in many settings. Our roles are structured across four work models: site-essential, site-by-design, field-based and remote-by-design. The model assigned to this role is based on its core responsibilities. Learn more at https://careers.bms.com/ways-of-working. Supporting People with Disabilities
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.