Time since we first saw it
Day 1
Similar jobs usually come down between day 1 and day 15.
From 1,368 similar postings that came down. Coming down is not always a hire.
Warsaw · Warsaw, Poland
Actively hiring, first seen by us 1 day agoBecause it feels good to tell your family and your friends how you made the world a little bit better. You go to bed knowing that what you do matters, and that your talents align with your beliefs. We want to make the healthcare experience more human, and that starts with you being you. We believe that taking the diversity of human experience into account makes a better healthcare experience for all . We’re not just different: we embrace diversity. We will encourage you to come to work your whole self, and that includes not coming to the office at all if you prefer not to, as we're 100% remote friendly. Job Description
Location type: RemoteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: DocplannerFrom the employer’s posting
Take technical leadership of NLP initiatives with scientists and product stakeholders
Implement and evaluate LLM-based solutions at scale
Validate, monitor and support models in production
Research and deploy LLM-powered information retrieval for multilingual products
Monitor changes in production data and tune inference parameters
Taking technical leadership of NLP initiatives
Implementing and evaluating LLM-based solutions at scale.
Validating, monitoring, and supporting models and the environment in a production setup.
Researching, architecting, and deploying LLM-powered information retrieval solutions
Monitoring changes in data characteristics in production to ensure ongoing reliability.
at least 2 years of experience in LLM engineering in a fast-paced, product-driven environment
Solid Software Engineering background
Proven ability to integrate, deploy, and optimize large language models in production
Hands-on experience designing and creating agent-based workflows.
Experience with LLM evaluation frameworks
Actively hiringFirst seen by us 1 day ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 1
Similar jobs usually come down between day 1 and day 15.
From 1,368 similar postings that came down. Coming down is not always a hire.
6 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
In this role, you’ll work alongside exceptional engineers, product stakeholders, and other cross-functional leaders on one of Docplanner’s most strategic initiatives, leveraging a cutting-edge tech stack to push the boundaries of AI in healthcare. Our tech stack for LLM evals is built in Langfuse, custom Python or “live evals” in application. Or new applications are built in TypeScript in monorepo. We also have systems in .Net, PHP and Python. For LLMs we are using mainly models from OpenAi, but also Antropic and Google. You will be responsible for:
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Welcome to the good side of tech 👋
You might have heard about us, but with a different name: ZnanyLekarz. It all started 14 years ago when we asked ourselves: is anyone in healthcare thinking about patients? We jumped in and we empowered patients by giving them access to leave and read reviews about their visit. We then provided doctors with the technology to manage bookings easily and save time, so they could devote themselves to what they always wanted: treating patients. And today is the day in which we ask you: wanna join us in the next step of making the healthcare experience more human?
Docplanner at scale
We are leaders in 13 countries so far, and more than 90 million patients trust us every month. 300k+ specialists believe in us and our product, and so do leading venture capital funds such as Point Nine Capital, Goldman Sachs Asset Management and One Peak Partners. And yet, employing over 3.000 people all over the globe, we managed to keep the startup-mindset we started with over 14 years ago.
At Docplanner we are a diverse group of over 300 people working in Engineering, Data, and Product teams. We are responsible for building the product for all locations. Many of us have been here for over 5 years, yet we still welcome each new person with great joy and excitement.
We could tell you about us, but we will let our reviews on Glassdoor speak for themselves. In case you’d like to see how it feels to be 100% yourself at work, here’s a video of us.
And why should you join us?
Because it feels good to tell your family and your friends how you made the world a little bit better. You go to bed knowing that what you do matters, and that your talents align with your beliefs.
We want to make the healthcare experience more human, and that starts with you being you. We believe that taking the diversity of human experience into account makes a better healthcare experience for all . We’re not just different: we embrace diversity. We will encourage you to come to work your whole self, and that includes not coming to the office at all if you prefer not to, as we're 100% remote friendly.
Job Description
As a LLM Engineer on the Platform AI team, you will take ownership of end-to-end LLM capabilities initiatives supporting our product teams with LLM engineering. You will be expected to drive technical excellence, champion best practices across the team, and actively shape our evolving tech stack and workflows. The new challenge is to help teams fulfill regulatory requirements (e.g., the AI Act) through processes that include proper prompt management, automated prompt and model evaluations, mitigation of unsafe model behavior, robust audit logging, and ensuring appropriate human oversight.
In this role, you’ll work alongside exceptional engineers, product stakeholders, and other cross-functional leaders on one of Docplanner’s most strategic initiatives, leveraging a cutting-edge tech stack to push the boundaries of AI in healthcare.
Our tech stack for LLM evals is built in Langfuse, custom Python or “live evals” in application. Or new applications are built in TypeScript in monorepo. We also have systems in .Net, PHP and Python. For LLMs we are using mainly models from OpenAi, but also Antropic and Google.
You will be responsible for:
Taking technical leadership of NLP initiatives, working closely with scientists, engineers, and product stakeholders to deliver AI-driven solutions that directly support strategic business objectives.
Implementing and evaluating LLM-based solutions at scale.
Validating, monitoring, and supporting models and the environment in a production setup.
Researching, architecting, and deploying LLM-powered information retrieval solutions to deliver accurate and scalable results in complex, multilingual product environments; championing industry-leading frameworks and evangelizing their adoption across the organization.
Monitoring changes in data characteristics in production to ensure ongoing reliability.
Selecting the best parameters for inference and continuously optimizing model performance.
What will set you up for success in this role?
Experience & Foundation: Solid Software Engineering background with at least 2 years of experience in LLM engineering in a fast-paced, product-driven environment.
Production LLMs: Proven ability to integrate, deploy, and optimize large language models in production, ensuring high scalability and robust performance.
Advanced AI Workflows: Hands-on experience designing and creating agent-based workflows.
Rigorous Evaluation: Experience with LLM evaluation frameworks to ensure AI outputs are accurate, safe, and reliable for end users.
Product & Business Mindset: A problem-solving approach focused on solving real user problems and delivering measurable business value, rather than just experimenting with new technology.
Cross-Functional Collaboration: Strong communication skills with a track record of influencing stakeholders across Product, Marketing, and Engineering, translating technical limits and opportunities into business goals.
Execution & Delivery: Adaptable in dynamic environments with a proven ability to manage timelines, prioritize high-impact tasks, and deliver under tight deadlines.
Technical Leadership: Experience mentoring other engineers, fostering continuous growth, and driving a high-performance culture within the team.
Let’s talk money
A salary adequate to your experience and skills.
True flexibility and work-life balance
Remote or hybrid work model with or hub in Warsaw;
Flexible working hours (fully flexible, as in most cases you only have to be on a couple of meetings weekly);
20/26 days of paid time off (depending on your contract);
Additional paid day off on your birthday or work anniversary (you choose what you want to celebrate).
Health comes first
Private healthcare plan with Signal Iduna for you and subsidized for your family.
Multisport card co-financing for you to have access to sports facilities across Poland.
Access to iFeel, a technological platform for mental wellness offering online psychological support and counseling.
Keep growing with us
Free English and Spanish classes.
We promote and embrace equal opportunities in our hiring process, and also every day at work. When you apply for our roles you receive equal treatment regardless of age, disabilities, gender reassignment, marital or civil partner status, pregnancy or parental status, race, colour, nationality, ethnic or national origin, religion or belief, sex, sexual orientation or any other dimension of human difference. If you require additional support in your recruitment process, we kindly encourage you to let us know. Behind those words you’re reading, there’s a person (hi!) who already helped a candidate by adapting the interviews, and now we’re lucky to have this person with us. So, even if you’ve never asked for it before, may this serve as a sign that, now, you can do so. We can only truly be equal if we adapt to each other.
“We believe all humans, in all their beautiful diversity, should have equal rights, dignity and respect. Period.” Mariusz Gralewski, CEO
New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Warsaw, Poland
Because it feels good to tell your family and your friends how you made the world a little bit better. You go to bed knowing that what you do matters, and that your talents align with your beliefs. We want to make the healthcare experience more human, and that starts with you being you. We believe that taking the diversity of human experience into account makes a better healthcare experience for all . We’re not just different: we embrace diversity. We will encourage you to come to work your whole self, and that includes not coming to the office at all if you prefer not to, as we're 100% remote friendly. Job Description
True flexibility and work-life balance - Remote or hybrid work model with or hub in Warsaw; - Flexible working hours (fully flexible, as in most cases you only have to be on a couple of meetings weekly);
No clear work-authorization passage found. Eligibility is unconfirmed.