Back to jobs

AI Platform Engineer

Pay
USD 170,000–190,000/year · Base — pay source
Required Education:Bachelor's Degree Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field, or an equivalent combination of education and experience. Required Experience:3+ years of progressive experience in platform engineering, cloud engineering, DevOps/SRE, software engineering, or related infrastructure engineering roles, with direct experience operating production cloud services at scale. Preferred Experience:3+ years Experience configuring and managing Portkey or comparable enterprise AI gateways and LLM proxy systems. Familiarity with specialized AI observability and evaluation frameworks (e.g., LangSmith, Phoenix, Arize, Traceloop). Experience with FinOps practices applied specifically to token-based consumption and AI workloads. Experience delivering and supporting infrastructure services in a large, federated, higher-education, research institution, or similarly decentralized enterprise environment. Required Skills, Knowledge and Abilities:Cloud Infrastructure: Deep experience with AWS cloud services and cloud-native architecture (experience with AWS Bedrock is highly desirable). Infrastructure-as-Code: Demonstrated proficiency with Terraform, AWS CloudFormation, or equivalent IaC tools. Containers & Orchestration: Hands-on experience with Docker and Kubernetes (EKS) or AWS ECS. Automation & CI/CD: Hands-on experience building and supporting CI/CD pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and modern source control strategies. APIs & Security: Strong foundation in API design, gateway management, authentication mechanisms (OAuth2, OIDC), service-to-service communication, IAM, secrets management (e.g., AWS Secrets Manager, HashiCorp Vault), and cloud network security. Observability: Practical experience setting up metrics, logging, distributed tracing, and alerting tools (e.g., Prometheus, Grafana, Datadog, AWS CloudWatch, OpenTelemetry). Programming Languages: Proficiency in Python and/or modern programming languages used for automation and platform tooling. GenAI / LLM Domain Expertise: Practical working knowledge of LLM APIs, foundation models, token-based usage models, model routing/gateways, streaming responses, rate limiting, and the operational constraints/latency characteristics of Generative AI services. Additional Information In compliance with NYC's Pay Transparency Act, the annual base salary range for this position is USD $170,000.00 to USD $190,000.00. New York University considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/training, key skills, internal peer equity, as well as, market and organizational considerations when extending an offer. This pay range represents base pay only and excludes any additional items such as incentives, bonuses, clinical compensation, or other items. NYU aims to be among the greenest urban campuses in the country and carbon neutral by 2040. Learn more at nyu.edu/nyugreen.NYU is an Equal Opportunity Employer and is committed to a policy of equal treatment and opportunity in every aspect of its recruitment and hiring process without regard to age, alienage, caregiver status, childbirth, citizenship status, color, creed, disability, domestic violence victim status, ethnicity, familial status, gender and/or gender identity or expression, marital status, military status, national origin, parental status, partnership status, predisposing genetic characteristics, pregnancy, race, religion, reproductive health decision making, sex, sexual orientation, unemployment status, veteran status, or any other legally protected basis. All interested persons are encouraged to apply at all levels.
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting

The AI Platform Engineer is a senior technical individual contributor responsible for building, operating, and continuously improving the shared infrastructure and platform services that enable secure, reliable, and scalable use of artificial intelligence across New York University (NYU).

Required Education:Bachelor's Degree Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field, or an equivalent combination of education and experience.

Before you apply

Employer’s visa record
244 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Apply at New York University

Posting record

Report an error

Actively hiringFirst seen by us 5 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 12, 20265 days ago
Recorded sightings
6
Last seen by us
Nov 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 5

Similar jobs usually come down between day 3 and day 50.

At New York University, jobs usually come down by about day 56.

From 90 similar postings that came down, and 6 of New York University’s. Coming down is not always a hire.

New York University is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • AI Engineer hiring is picking up
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Datadog
  • Docker
  • Grafana
  • Kubernetes
  • Terraform
Where the posting names them
Required Education:Bachelor's Degree Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field, or an equivalent combination of education and experience. Required Experience:3+ years of progressive experience in platform engineering, cloud engineering, DevOps/SRE, software engineering, or related infrastructure engineering roles, with direct experience operating production cloud services at scale. Preferred Experience:3+ years Experience configuring and managing Portkey or comparable enterprise AI gateways and LLM proxy systems. Familiarity with specialized AI observability and evaluation frameworks (e.g., LangSmith, Phoenix, Arize, Traceloop). Experience with FinOps practices applied specifically to token-based consumption and AI workloads. Experience delivering and supporting infrastructure services in a large, federated, higher-education, research institution, or similarly decentralized enterprise environment. Required Skills, Knowledge and Abilities:Cloud Infrastructure: Deep experience with AWS cloud services and cloud-native architecture (experience with AWS Bedrock is highly desirable). Infrastructure-as-Code: Demonstrated proficiency with Terraform, AWS CloudFormation, or equivalent IaC tools. Containers & Orchestration: Hands-on experience with Docker and Kubernetes (EKS) or AWS ECS. Automation & CI/CD: Hands-on experience building and supporting CI/CD pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and modern source control strategies. APIs & Security: Strong foundation in API design, gateway management, authentication mechanisms (OAuth2, OIDC), service-to-service communication, IAM, secrets management (e.g., AWS Secrets Manager, HashiCorp Vault), and cloud network security. Observability: Practical experience setting up metrics, logging, distributed tracing, and alerting tools (e.g., Prometheus, Grafana, Datadog, AWS CloudWatch, OpenTelemetry). Programming Languages: Proficiency in Python and/or modern programming languages used for automation and platform tooling. GenAI / LLM Domain Expertise: Practical working knowledge of LLM APIs, foundation models, token-based usage models, model routing/gateways, streaming responses, rate limiting, and the operational constraints/latency characteristics of Generative AI services. Additional Information

Your next step

Complete your application on uscareers-nyu.icims.com. The employer’s form will show what is required.

Applying through iCIMS

  • You start with your email. New applicants then create a login, and returning ones sign in.
  • Upload your resume before you fill anything in: iCIMS fills some profile fields from it.
  • Check your status on the employer’s iCIMS Dashboard, under Past Job Submittals.

Already applied? Track this application

Has New York University posted this job before?

Yes. We’ve followed one other AI Platform Engineer job there since November 2026. It is still up.

  1. New YorkStill up after 6 days, first seen Nov 12
  2. This jobUp 6 days so far, first seen Nov 12

Job description

View original posting ↗

Position Summary

The AI Platform Engineer is a senior technical individual contributor responsible for building, operating, and continuously improving the shared infrastructure and platform services that enable secure, reliable, and scalable use of artificial intelligence across New York University (NYU). This position develops and maintains the core technical foundation supporting NYU’s enterprise AI capabilities—including cloud infrastructure, model gateways and routing, APIs, identity and access management (IAM), automated deployment pipelines, observability, usage/cost telemetry, and overall platform reliability. Working within architectural patterns established by the AI Solutions Architect and adhering to institutional security and technology standards, the AI Platform Engineer translates AI architecture into production-ready infrastructure and reusable platform capabilities. This role is highly hands-on and is expected to build, automate, and operate infrastructure directly.

Qualifications

Required Education:Bachelor's Degree Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field, or an equivalent combination of education and experience. Required Experience:3+ years of progressive experience in platform engineering, cloud engineering, DevOps/SRE, software engineering, or related infrastructure engineering roles, with direct experience operating production cloud services at scale. Preferred Experience:3+ years Experience configuring and managing Portkey or comparable enterprise AI gateways and LLM proxy systems. Familiarity with specialized AI observability and evaluation frameworks (e.g., LangSmith, Phoenix, Arize, Traceloop). Experience with FinOps practices applied specifically to token-based consumption and AI workloads. Experience delivering and supporting infrastructure services in a large, federated, higher-education, research institution, or similarly decentralized enterprise environment. Required Skills, Knowledge and Abilities:Cloud Infrastructure: Deep experience with AWS cloud services and cloud-native architecture (experience with AWS Bedrock is highly desirable). Infrastructure-as-Code: Demonstrated proficiency with Terraform, AWS CloudFormation, or equivalent IaC tools. Containers & Orchestration: Hands-on experience with Docker and Kubernetes (EKS) or AWS ECS. Automation & CI/CD: Hands-on experience building and supporting CI/CD pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and modern source control strategies. APIs & Security: Strong foundation in API design, gateway management, authentication mechanisms (OAuth2, OIDC), service-to-service communication, IAM, secrets management (e.g., AWS Secrets Manager, HashiCorp Vault), and cloud network security. Observability: Practical experience setting up metrics, logging, distributed tracing, and alerting tools (e.g., Prometheus, Grafana, Datadog, AWS CloudWatch, OpenTelemetry). Programming Languages: Proficiency in Python and/or modern programming languages used for automation and platform tooling. GenAI / LLM Domain Expertise: Practical working knowledge of LLM APIs, foundation models, token-based usage models, model routing/gateways, streaming responses, rate limiting, and the operational constraints/latency characteristics of Generative AI services.

Additional Information

In compliance with NYC's Pay Transparency Act, the annual base salary range for this position is USD $170,000.00 to USD $190,000.00. New York University considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/training, key skills, internal peer equity, as well as, market and organizational considerations when extending an offer. This pay range represents base pay only and excludes any additional items such as incentives, bonuses, clinical compensation, or other items. NYU aims to be among the greenest urban campuses in the country and carbon neutral by 2040. Learn more at nyu.edu/nyugreen.NYU is an Equal Opportunity Employer and is committed to a policy of equal treatment and opportunity in every aspect of its recruitment and hiring process without regard to age, alienage, caregiver status, childbirth, citizenship status, color, creed, disability, domestic violence victim status, ethnicity, familial status, gender and/or gender identity or expression, marital status, military status, national origin, parental status, partnership status, predisposing genetic characteristics, pregnancy, race, religion, reproductive health decision making, sex, sexual orientation, unemployment status, veteran status, or any other legally protected basis. All interested persons are encouraged to apply at all levels.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

This passage needs a closer read in the full description.

Location & working pattern

New York, NY

Working pattern and location restrictions need checking in the full posting.

Work authorization

This passage needs a closer read in the full description.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.