Time since we first saw it
Day 57
Up longer than most. Similar jobs usually come down between day 1 and day 15.
From 1,371 similar postings that came down. Coming down is not always a hire.
Miami · Miami, Florida, United States
Live, first seen by us 57 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: AI Product & EngineeringFrom the employer’s posting
Brightstar.AI is seeking a full-time or recently graduated Masters or PhD-level Applied AI Engineer Intern – Advancing Agent Quality with a strong research mindset, affiliated with a leading (South Florida) university, to contribute to its AI Think Tank and to the hands-on build-out of Brightstar’s proprietary AI systems.
The first concrete assignment is the AI Twin Board, Brightstar’s proprietary board-simulation product, where the intern will help build the evaluation harness end to end: realistic task suites, calibrated LLM judge, failure-mode diagnostics, and the data flywheel that feeds improvements back into the agents themselves.
is seeking a full-time or recently graduated
Will you now or in the future require visa sponsorship to work in the United States?From the employer’s application form
Role Type: External Research Affiliate / Think Tank Contributor Location: South Florida preferred Affiliation: Local university-based Masters or PhD researcher or postdoctoral AI researcher working under faculty direction Organization: Brightstar.AI Role Summary
Role Summary Brightstar.AI is seeking a full-time or recently graduated Masters or PhD-level Applied AI Engineer Intern – Advancing Agent Quality with a strong research mindset, affiliated with a leading (South Florida) university, to contribute to its AI Think Tank and to the hands-on build-out of Brightstar’s proprietary AI systems. The intern will pair academic rigor with applied engineering: building the evaluation environments, automated raters, and diagnostic tooling that establish — with evidence rather than impression — whether an agent is reliable enough to put in front of operators, executives, and investors. The first concrete assignment is the AI Twin Board, Brightstar’s proprietary board-simulation product, where the intern will help build the evaluation harness end to end: realistic task suites, calibrated LLM judge, failure-mode diagnostics, and the data flywheel that feeds improvements back into the agents themselves. The AI Twin Board is the starting point, not the full scope — as Brightstar’s AI portfolio expands, the same quality discipline will be applied to other agentic systems, internal platforms, and portfolio-company deployments.
Minimum Qualifications · Currently enrolled in a Masters or PhD program — or serving as a postdoctoral or early-career academic researcher — in Artificial Intelligence, Machine Learning, Computer Science, Computational Linguistics, or a related field. · 1 years of research, project, or professional experience with LLMs or Agents.
Why This Role Matters Brightstar.AI’s Think Tank is intended to provide systematic forward-looking intelligence on where AI may create value, where it may disrupt industries, and how firms can better anticipate what may work tomorrow rather than only what worked yesterday. Masters and PhD-level Applied AI Engineers are a critical part of that model, bringing academic depth, frontier perspective, and analytical rigor into the Think Tank’s quarterly insights and longer-term point of view. Moreover, this role extends beyond research to focus on the practical application of AI in terms of AI Twin Board technology, which we see as a key differentiator in our research approach and value creation methodology.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 57
Up longer than most. Similar jobs usually come down between day 1 and day 15.
From 1,371 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordCheck the employer’s posting for the current role and application details.
Already applied? Track this application
Role Type: External Research Affiliate / Think Tank Contributor
Location: South Florida preferred
Affiliation: Local university-based Masters or PhD researcher or postdoctoral AI researcher working under faculty direction
Organization: Brightstar.AI
Role Summary
Brightstar.AI is seeking a full-time or recently graduated Masters or PhD-level Applied AI Engineer Intern – Advancing Agent Quality with a strong research mindset, affiliated with a leading (South Florida) university, to contribute to its AI Think Tank and to the hands-on build-out of Brightstar’s proprietary AI systems. The intern will pair academic rigor with applied engineering: building the evaluation environments, automated raters, and diagnostic tooling that establish — with evidence rather than impression — whether an agent is reliable enough to put in front of operators, executives, and investors.
The first concrete assignment is the AI Twin Board, Brightstar’s proprietary board-simulation product, where the intern will help build the evaluation harness end to end: realistic task suites, calibrated LLM judge, failure-mode diagnostics, and the data flywheel that feeds improvements back into the agents themselves. The AI Twin Board is the starting point, not the full scope — as Brightstar’s AI portfolio expands, the same quality discipline will be applied to other agentic systems, internal platforms, and portfolio-company deployments.
Working in coordination with university professors and research leaders, the intern will also bring up-to-date knowledge of the fast-evolving AI landscape — especially large language models, reasoning systems, emerging model capabilities, and the societal implications of advanced AI — and help translate what current and next-generation systems may enable over the next six months to three years into Brightstar’s evaluation standards and Think Tank point of view.
Key Responsibilities
· Design, build, and scale realistic agent environments and task suites that reflect how Brightstar’s agents are actually used — board-level deliberation, research synthesis, diligence workflows, and multi-step tool use.
· Develop agentic LLM judge, calibrate them against human expert evaluation, and benchmark Brightstar agents against leading frontier models.
· Build trajectory-analysis frameworks and diagnostic tooling that root-cause agent failure modes — passivity, hallucination, persona drift, brittle tool execution — and feed fixes back into agent prompts, harnesses, and architecture.
· Enable agents to generate and iterate on their own verifiers (automated test cases, checklists, ground-truth sets) to support effective exploration and iterative problem-solving.
· Harvest multi-turn interaction trajectories into high-quality datasets and reward signals that support fine-tuning and post-training of the models Brightstar relies on.
· Contribute to the AI Twin Board build-out as the initial focus, and extend the same evaluation approach to other Brightstar AI initiatives as the roadmap grows.
· Contribute frontier AI research perspectives to the Brightstar.AI Think Tank as part of weekly review sessions and select strategic discussions.
· Review relevant research papers, conference findings, and publications from leading AI institutions and labs as inputs to the Think Tank knowledge base and to Brightstar’s evaluation methodology.
· Help interpret academic and technical developments for a business and investment audience, including implications for industry transformation and applied AI opportunities.
Minimum Qualifications
· Currently enrolled in a Masters or PhD program — or serving as a postdoctoral or early-career academic researcher — in Artificial Intelligence, Machine Learning, Computer Science, Computational Linguistics, or a related field.
· 1 years of research, project, or professional experience with LLMs or Agents.
· 2 year of experience with machine learning and deep learning.
· Experience in software engineering and cloud-based development.
· Experience with agent builders, e.g. OpenSDK, OpenAI Agent Builder, etc.
· Able to communicate complex technical concepts clearly to non-technical executive audiences.
Preferred Qualifications
· In-depth knowledge of machine learning algorithms, including supervised learning and reinforcement learning.
· Hands-on experience building LLM or agent evaluation systems — autoraters, human-evaluation pipelines, benchmark design, or evaluation infrastructure.
· Experience with multi-agent orchestration, retrieval-augmented generation, and tool-use / function-calling reliability.
· Active research or publications in LLMs, reasoning systems, model behavior, AI safety, or the societal impact of advanced AI systems.
· Strong research discipline, intellectual curiosity, and the ability to separate meaningful signal from AI hype.
· Affiliated with a (South Florida) university and working under the supervision of a faculty member or professor, or recent graduate.
Why This Role Matters
Brightstar.AI’s Think Tank is intended to provide systematic forward-looking intelligence on where AI may create value, where it may disrupt industries, and how firms can better anticipate what may work tomorrow rather than only what worked yesterday. Masters and PhD-level Applied AI Engineers are a critical part of that model, bringing academic depth, frontier perspective, and analytical rigor into the Think Tank’s quarterly insights and longer-term point of view. Moreover, this role extends beyond research to focus on the practical application of AI in terms of AI Twin Board technology, which we see as a key differentiator in our research approach and value creation methodology.
New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Miami, Florida, United States
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting