Time since we first saw it
Day 20
Up longer than most. Similar jobs usually come down between day 2 and day 14.
From 1,020 similar postings that came down. Coming down is not always a hire.
Indianapolis, IN
Live, first seen by us 20 days agoMust be authorized to work in the U.S. without current or future visa sponsorship. This role will be hybrid based out of our Indianapolis office,Read the full posting
The AI Prompt Engineer will lead the design, development, and optimization of large language model (LLM) prompts used for scalable conversation scoring at Authenticx.
Design and implement sophisticated LLM prompts aligned to internal scoring rubrics and customer-specific needs.
Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring workflows.
Maintain a centralized prompt library to ensure reuse and standardization across use cases.
The AI Prompt Engineer will lead the design, development, and optimization of large language model (LLM) prompts used for scalable conversation scoring at Authenticx. This role is critical in translating objective scoring rubrics into reusable, testable prompt logic that supports our enterprise healthcare clients. The engineer will collaborate across teams including engineering, implementation, product, and data labeling to deliver reliable and high-quality prompt workflows. This is a hands-on role suited for someone who thrives in an experimental, iterative environment and has an interest in scaling natural language solutions.
Key Responsibilities Design and implement sophisticated LLM prompts aligned to internal scoring rubrics and customer-specific needs. Conduct prompt testing and evaluation using labeled datasets to ensure performance accuracy.
Conduct prompt testing and evaluation using labeled datasets to ensure performance accuracy. Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring workflows. Maintain a centralized prompt library to ensure reuse and standardization across use cases.
Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring workflows. Maintain a centralized prompt library to ensure reuse and standardization across use cases. Document prompt strategies, testing approaches, and outcomes for internal learning.
Must be authorized to work in the US without current or future visa sponsorship
Strong understanding of LLMs, NLP systems, and prompt engineering concepts.
Ability to structure and document complex logic in a scalable and repeatable manner.
Demonstrated ability to collaborate effectively with both technical and non-technical teams.
Experience in structured data labeling or QA workflows.
Familiarity with tools like LangChain, OpenAI/GPT APIs, or vector databases.
Proficiency in Python or scripting tools for evaluation or automation.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 20
Up longer than most. Similar jobs usually come down between day 2 and day 14.
From 1,020 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Background in linguistics, cognitive science, or HCI. - Proficiency in Python or scripting tools for evaluation or automation. Additional Information
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Already applied? Track this application
Who is Authenticx?
Authenticx is on a mission to help humans understand humans. Our software platform is the new standard for humanizing customer interaction data at scale. We do this by channeling our passion and talent into helping health care leaders listen to their conversational data in a way that delivers value to the enterprise.
What do we offer our team members?
Position Summary
The AI Prompt Engineer will lead the design, development, and optimization of large language model (LLM) prompts used for scalable conversation scoring at Authenticx. This role is critical in translating objective scoring rubrics into reusable, testable prompt logic that supports our enterprise healthcare clients. The engineer will collaborate across teams including engineering, implementation, product, and data labeling to deliver reliable and high-quality prompt workflows. This is a hands-on role suited for someone who thrives in an experimental, iterative environment and has an interest in scaling natural language solutions.
Key Responsibilities
Required Qualifications
Preferred Qualifications
Additional Information
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Indianapolis, IN
- A collaborative environment that supports your personal and professional development - Hybrid working flexibility - Free health insurance options
- Must be authorized to work in the U.S. without current or future visa sponsorship. - This role will be hybrid based out of our Indianapolis office,
- May include occasional travel for team meetings or planning sessions - Must be authorized to work in the U.S. without current or future visa sponsorship. - This role will be hybrid based out of our Indianapolis office,