Time since we first saw it
Day 16
Up longer than most. Similar jobs usually come down between day 1 and day 12.
From 155 similar postings that came down. Coming down is not always a hire.
Porto, Portugal
Live, first seen by us 16 days agoWork setup in the employer’s posting: remoteFrom the employer’s posting
Employment type in the employer’s posting: FreelanceFrom the employer’s posting
Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts. Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked. Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
- Location: Must be based in Portugal. - Education: Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field. - Prompt Engineering & AI Expertise: At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 16
Up longer than most. Similar jobs usually come down between day 1 and day 12.
From 155 similar postings that came down. Coming down is not always a hire.
22 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Prompt Engineering & AI Expertise: At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning. - Data Analysis: Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools. - Technical Agility: Ability to quickly learn and master proprietary tools with minimal supervision.
Complete your application on jobs.lever.co. The employer’s form will show what is required.
Already applied? Track this application
We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance.
Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.
Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
Draft technical launch readiness justifications (Launch Certification Documentation) for final.
Language Skills: Native fluency in Portuguese and fluent in English.
Location: Must be based in Portugal.
Education: Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
Prompt Engineering & AI Expertise: At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.
Data Analysis: Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
Technical Agility: Ability to quickly learn and master proprietary tools with minimal supervision.
Communication: Excellent verbal and written communication skills.
Familiarity with enterprise-grade LLM interfaces like the Goose API.
Experience in AI model evaluation, data science, computational linguistics, or software engineering.
Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
Linguistic expertise, including an understanding of semantics and logic.
Freelance
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Porto, Portugal
- Language Skills: Native fluency in Portuguese and fluent in English. - Location: Must be based in Portugal. - Education: Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
No clear work-authorization passage found. Eligibility is unconfirmed.