Back to jobs

Staff AI Engineer

Pay
$275,000–300,000/yearAnnual period assumed. Location-specific pay — pay source
Pay Range Disclosure Cobalt is committed to fair and equitable compensation practices. The salary range for this role is ($275,000 - $300,000) + equity + benefits. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications. The salary range may differ in other states and may be impacted by proximity to major metropolitan cities. Cobalt (the "Company") is an equal opportunity employer, and we want the best available persons for every job. The Company makes employment decisions only based on merit. It is the Company's policy to prohibit discrimination in any employment opportunity (including but not limited to recruitment, employment, promotion, salary increases, benefits, termination and all other terms and conditions of employment) based on race, color, sex, sexual orientation, gender, gender identity, gender expression, genetic information, pregnancy, religious creed, national origin, ancestry, age, physical/mental disability, medical condition, marital/domestic partner status, military and veteran status, height, weight or any other such characteristic protected by federal, state or local law. The Company is committed to complying with all applicable laws and providing equal employment opportunities. This commitment applies to all persons involved in the operations of the Company regardless of where the employee is located and prohibits unlawful discrimination by any employee of the Company.
Read the full posting
Work setting
Remote — work setting source
Listed location: Remote
Read the full posting
Employment
Not stated

What you’ll work on

Full posting
  • Design, build and operate shared foundations: evaluation frameworks, agent observability and tracing, execution controls, and model access with routing and failover where needed.

  • Work Flexibly, Live Fully: Benefit from generous flexible paid time off and 6 weeks of paid parental leave, supporting your wellbeing and life beyond work..

  • Work with domain experts to build representative test cases and turn production failures into regression tests.

From the employer’s posting
Set technical direction for agent systems across teams, including orchestration, tool use, context and memory management, human oversight and failure recovery. Design, build and operate shared foundations: evaluation frameworks, agent observability and tracing, execution controls, and model access with routing and failover where needed. Establish evaluation practices that measure task completion, accuracy, false positives, security and cost per successful task. Work with domain experts to build representative test cases and turn production failures into regression tests.
Comprehensive Benefits: Access retirement savings 401(k) in the US or pension in the EU, healthcare coverage and dedicated stipends for wellness, home office equipment, Wi-Fi and learning and development.. Work Flexibly, Live Fully: Benefit from generous flexible paid time off and 6 weeks of paid parental leave, supporting your wellbeing and life beyond work.. Pay Range Disclosure
Design, build and operate shared foundations: evaluation frameworks, agent observability and tracing, execution controls, and model access with routing and failover where needed. Establish evaluation practices that measure task completion, accuracy, false positives, security and cost per successful task. Work with domain experts to build representative test cases and turn production failures into regression tests. Make agent workflows resilient to tool failures, timeouts, rate limits and partial execution, with clear limits on retries, runtime and spend.

About Cobalt

At Cobalt, we believe everyone deserves to live and work in a safer, more secure world.

In the employer’s words · Read in context

Apply at Cobalt

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 27, 202625 days ago
Recorded sightings
12
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 25

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,376 similar postings that came down. Coming down is not always a hire.

Cobalt is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • GCP
  • Kubernetes
Where the posting names them
Nice To Have - Experience with GCP, Go or Kubernetes. - Experience building sandboxed environments for agents that execute untrusted code or interact with external systems.

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

About Cobalt

At Cobalt, we believe everyone deserves to live and work in a safer, more secure world. Founded in 2013 on the belief that penetration testing could – and should – be better, we set out to challenge the status quo and transform how organizations approach offensive security.
 
Today, we’re leading the way in transforming the offensive security market, bringing together world-class security expertise, innovative technology and a global community of security professionals to make security testing more seamless, effective and collaborative. Our diverse, fully-remote team partners with organizations of all sizes to help them OPERATE FEARLESSLY and INNOVATE SECURELY.
 
And we’re just getting started!
 
AI is fundamentally reshaping the cybersecurity landscape, creating new opportunities, new challenges and entirely new ways of thinking about security. At Cobalt, we’re not waiting to see what happens next; we’re helping define it. We’re challenging conventions, pushing boundaries and reimagining what’s possible in offensive security.
 
Customers can launch a pentest in as little as 24 hours through our SaaS platform and exclusive Cobalt Core community. With 500+ highly vetted security testers, representing just 5% of applicants, the Cobalt Core conducts thousands of tests annually, helping organizations identify and remediate risk across their evolving attack surfaces.
 
This is an exciting time to join Cobalt. We’re looking for ambitious, creative and agile leaders who thrive on change, think beyond traditional playbooks and have the vision to create new categories, shape markets and build what comes next. If you’re excited by the opportunity to make a real impact in a market undergoing significant transformation, we’d love you to be part of our journey.

Description

Cobalt runs AI agents in production that test real customer applications. We’re looking for a Staff AI Engineer who has built and operated production agent systems and can help us make them more reliable, secure and cost-efficient.

You’ll set the technical direction for how we design, evaluate, ship and operate agents, and stay hands-on building the foundations our teams use. You’ll work across engineering, product, research and security, mentoring engineers and helping teams turn promising prototypes into dependable production systems.

Your primary focus will be our agent platform and production practices. You’ll also help engineering teams improve how they build software with AI coding agents.

What You’ll Do

  • Set technical direction for agent systems across teams, including orchestration, tool use, context and memory management, human oversight and failure recovery.
  • Design, build and operate shared foundations: evaluation frameworks, agent observability and tracing, execution controls, and model access with routing and failover where needed.
  • Establish evaluation practices that measure task completion, accuracy, false positives, security and cost per successful task. Work with domain experts to build representative test cases and turn production failures into regression tests.
  • Make agent workflows resilient to tool failures, timeouts, rate limits and partial execution, with clear limits on retries, runtime and spend.
  • Work with security and platform teams to build in scoped permissions, customer data isolation, audit trails and safe execution of tools and code.
  • Establish practical engineering standards: evals in CI, prompt and model versioning, regression testing for non-deterministic systems, cost and latency budgets, and staged rollouts with rollback paths.
  • Lead model selection and cost optimization. Benchmark models against real workloads and make informed trade-offs between quality, latency and cost.
  • Partner with teams on production readiness, incident investigation and improvements to agent reliability.
  • Help teams use AI coding agents effectively across planning, implementation, review and testing. Measure the impact on delivery speed and software quality.
  • Mentor engineers and technical leads through design reviews, pairing, internal talks and written guidance. Help teams adopt shared capabilities and improve them based on feedback.
  • Work with product, research and security leaders to turn business priorities into a technical roadmap with clear outcomes.

You Must Have

  • Significant software engineering experience, typically 8–10+ years, with a track record of technical leadership across teams.
  • Hands-on experience building and operating LLM-based agents in production, with a clear understanding of their scale, constraints and business outcomes.
  • A track record of improving agent reliability: building evaluations, investigating non-deterministic failures and improving success rates against measurable goals.
  • Strong knowledge of agent architectures, including tool use, orchestration, planning, context and memory management, and the judgment to know when simpler workflows are sufficient.
  • Experience running LLM workloads through managed cloud model platforms or direct provider APIs, including rate limits, failure handling and cost tracking.
  • Strong backend and distributed systems fundamentals, including APIs, asynchronous workflows, concurrency and fault tolerance.
  • Experience with production observability, incident investigation and safe rollout of system changes.
  • An understanding of security risks in agent systems, including prompt injection, unsafe tool execution and exposure of sensitive data.
  • Evidence of impact beyond your own code: shared platforms other teams adopted, standards that improved outcomes or engineers you helped grow.

Tools and Practices You’ve Likely Used

We care more about your depth of experience and engineering judgment than experience with any specific tool.

  • Agent orchestration: Framework-based or custom orchestration, tool calling and structured outputs.
  • Tool integration: Model Context Protocol (MCP), APIs and permission-controlled tool execution.
  • Evaluations: Automated evaluation harnesses, domain-specific test datasets and regression testing in CI.
  • Observability: Distributed tracing, structured logs and metrics for multi-step agent workflows.
  • Model access: Managed cloud model platforms, direct provider APIs and multi-provider gateways.

Nice To Have

  • Experience with GCP, Go or Kubernetes.
  • Experience building sandboxed environments for agents that execute untrusted code or interact with external systems.
  • Offensive security, application security or security tooling experience.
  • Experience introducing AI coding tools across engineering teams and measuring their impact.
  • Public writing, talks or open-source contributions related to agent engineering.

Why You Should Join Us

• Shape the Future of Cybersecurity: Help define the Continuous Offensive Security Market, build Cobalt’s global brand and establish category leadership in a rapidly growing industry..
• Make a Strategic Impact: Work alongside an experienced executive team, influence company strategy and lead a global marketing organization through Cobalt’s next phase of growth..
• Share in Our Success: Enjoy competitive compensation and an attractive equity plan, with the opportunity to share in the long-term value you help create..
• Comprehensive Benefits: Access retirement savings 401(k) in the US or pension in the EU, healthcare coverage and dedicated stipends for wellness, home office equipment, Wi-Fi and learning and development..
• Work Flexibly, Live Fully: Benefit from generous flexible paid time off and 6 weeks of paid parental leave, supporting your wellbeing and life beyond work..

Pay Range Disclosure 

Cobalt is committed to fair and equitable compensation practices. The salary range for this role is ($275,000 - $300,000) + equity + benefits. A candidate’s salary is determined by various factors including, but not limited to, relevant work experience, skills, and certifications.  The salary range may differ in other states and may be impacted by proximity to major metropolitan cities. 

Cobalt (the "Company") is an equal opportunity employer, and we want the best available persons for every job. The Company makes employment decisions only based on merit. It is the Company's policy to prohibit discrimination in any employment opportunity (including but not limited to recruitment, employment, promotion, salary increases, benefits, termination and all other terms and conditions of employment) based on race, color, sex, sexual orientation, gender, gender identity, gender expression, genetic information, pregnancy, religious creed, national origin, ancestry, age, physical/mental disability, medical condition, marital/domestic partner status, military and veteran status, height, weight or any other such characteristic protected by federal, state or local law. The Company is committed to complying with all applicable laws and providing equal employment opportunities. This commitment applies to all persons involved in the operations of the Company regardless of where the employee is located and prohibits unlawful discrimination by any employee of the Company.

Cobalt is an E-Verify employer. E-Verify is an Internet-based system operated by the Department of Homeland Security (DHS) in partnership with the Social Security Administration (SSA). It allows participating employers to electronically verify the employment eligibility of their newly hired employees in the United States.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

This passage needs a closer read in the full description.

Location & working pattern

Remote

At Cobalt, we believe everyone deserves to live and work in a safer, more secure world. Founded in 2013 on the belief that penetration testing could – and should – be better, we set out to challenge the status quo and transform how organizations approach offensive security. Today, we’re leading the way in transforming the offensive security market, bringing together world-class security expertise, innovative technology and a global community of security professionals to make security testing more seamless, effective and collaborative. Our diverse, fully-remote team partners with organizations of all sizes to help them OPERATE FEARLESSLY and INNOVATE SECURELY. And we’re just getting started!
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.