Design and implement LLM-driven features in production systems
Build and maintain data pipelines for structured and unstructured data
Create evaluation suites, define success metrics, and analyze failures
Diagnose and mitigate hallucination, latency, and cost issues
Implement monitoring, logging, and alerting for AI services
From the employer’s posting
Design and implement LLM‑driven features in production systems.
Build and maintain data pipelines for both structured and unstructured data.
Create evaluation suites, define success metrics, and analyze failures.
Diagnose and mitigate hallucination, latency, and cost issues.
Implement monitoring, logging, and alerting for AI services.
Before you apply
Employer’s visa record
2 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Strong Python programming with tested, maintainable code
Hands-on experience building with LLM tools or frameworks
Experience evaluating LLM-powered applications with test sets and metrics
Bachelor's degree in a quantitative field or equivalent practical experience
Experience contributing to production or production-like software
Qualification wording
Strong programming ability in Python with clear, tested, and maintainable code.
Hands‑on experience building with LLM tools or frameworks (prompting, structured outputs, tool‑calling, retrieval, multi‑step workflows)
Experience evaluating LLM‑powered applications: building test sets, reviewing failures, defining metrics, and iterating on prompts or retrieval.
Bachelor’s degree in computer science, machine learning, mathematics, physics, statistics, econometrics, or equivalent practical experience.
Experience contributing to production or production‑like software through work, internships, research, open source, or substantial personal projects.
Education & alternatives
- Document designs, experiments, and findings for internal knowledge sharing.
- Bachelor’s degree in computer science, machine learning, mathematics, physics, statistics, econometrics, or equivalent practical experience.
- Experience contributing to production or production‑like software through work, internships, research, open source, or substantial personal projects.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
Where the posting names them
- Build and maintain data pipelines for both structured and unstructured data.
- Write clean, testable Python code and maintain reusable libraries.
- Develop prompts, tool‑calling workflows, and retrieval pipelines.
- Experience contributing to production or production‑like software through work, internships, research, open source, or substantial personal projects.
- Strong programming ability in Python with clear, tested, and maintainable code.
- Experience with web services, data integrations, testing, logging, and basic monitoring across diverse data types.
Join Cantor Fitzgerald Technology Markets LLC as a Machine Learning Engineer focused on building AI‑driven solutions for a high‑volume financial services business. You will work closely with product, engineering, and business teams to create, test, and operationalize large language model (LLM) applications, ensuring they meet performance, reliability, and responsible‑AI standards.
Design and implement LLM‑driven features in production systems.
Build and maintain data pipelines for both structured and unstructured data.
Write clean, testable Python code and maintain reusable libraries.
Develop prompts, tool‑calling workflows, and retrieval pipelines.
Create evaluation suites, define success metrics, and analyze failures.
Diagnose and mitigate hallucination, latency, and cost issues.
Collaborate with product, engineering, and business stakeholders.
Implement monitoring, logging, and alerting for AI services.
Contribute to responsible‑AI guardrails and human‑in‑the‑loop processes.
Document designs, experiments, and findings for internal knowledge sharing.
Bachelor’s degree in computer science, machine learning, mathematics, physics, statistics, econometrics, or equivalent practical experience.
Experience contributing to production or production‑like software through work, internships, research, open source, or substantial personal projects.
Strong programming ability in Python with clear, tested, and maintainable code.
Experience with web services, data integrations, testing, logging, and basic monitoring across diverse data types.
Hands‑on experience building with LLM tools or frameworks (prompting, structured outputs, tool‑calling, retrieval, multi‑step workflows) and awareness of common failure modes.
Experience evaluating LLM‑powered applications: building test sets, reviewing failures, defining metrics, and iterating on prompts or retrieval.
Solid grounding in machine learning, statistics, and experimental design with ability to interpret technical papers and documentation.
Strong communication skills and comfort working with product, engineering, and business partners.
Interest in applying AI responsibly in financial services, including privacy, security, human review, and appropriate automation.
Familiarity with cloud deployment, containers, and modern release pipelines.
$140,000 - $160,000
About Newmark Group
People
About 8,800 in 2025, up 17% from the year before.Annual report (SEC Form 10-K)
Company
Listed as NMRK.
About the role
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.