PlayStation Global

Copy of Senior Software Development Engineer in Test, ML

Canada, Waterloo, ON

Actively hiring, first seen by us 1 day ago

Pay: CAD 114,000–143,000/yearAnnual period assumed — pay source
The estimated Ontario base pay range for this role is listed below. $114,000—$143,000 CAD Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks.
Read the full posting
Work setting: Not stated
Employment: Not stated

What you’ll work on

Full posting

Design and maintain automated test frameworks and scripts for ML inference services
Validate score distributions, ranking behavior and output quality of ML models before release
Build realistic test accounts and datasets to evaluate model behavior
Run functional, API, regression, performance and load testing on services
Debug test failures and model anomalies and report defects

From the employer’s posting

Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java

Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release

Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios

Perform different types of testing, including functional, integration, regression and API testing working with RESTful APIs, microservices and databases, and non-functional performance and load testing

Debug and analyze test failures, model anomalies and report defects

What you’ll bring

All qualifications

Core experience

Proficiency in Python/Java/Scala/go for test automation.
Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems
Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc
Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)Experience in working with databases for backend validation.
Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.)
Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health

Preferred experience

Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems.
Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors.
Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation, rather than deterministic assertions.
Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.) is a plus.

Qualification wording

Proficiency in Python/Java/Scala/go for test automation.

Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems

Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc

Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)Experience in working with databases for backend validation.

Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.)

Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health

Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems.

Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors.

Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation, rather than deterministic assertions.

Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.) is a plus.

Education & alternatives

Required Qualifications: - A Bachelor's degree in Computer Science or related field - Minimum 5 years of experience as an SDET, with strong experience testing backend systems.

Apply at PlayStation Global

Posting record

Report an error

Actively hiringFirst seen by us 1 day ago, still listed, and not a repost of an earlier posting.

Status in our records: Live
First seen by us: Nov 3, 20261 day ago
Recorded sightings: 2
Last seen by us: Nov 4, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 1

Early. Similar jobs usually come down between day 7 and day 55.

From 9,988 similar postings that came down. Coming down is not always a hire.

PlayStation Global is hiring

29 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Data Scientist hiring has slowed
Takes jobs down at a usual pace

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

Java
Python
Scala
AWS
Databricks
Datadog
Docker
GCP
Grafana
Kubernetes
Go

Where the posting names them

- Drive architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas. - Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java - Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios

- Minimum 5 years of experience as an SDET, with strong experience testing backend systems. - Proficiency in Python/Java/Scala/go for test automation. - Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems

- Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)Experience in working with databases for backend validation. - Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.) - Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health

- Experience with performance and load testing tools - Experience with Databricks or similar ML platform tooling - Experience architecting and optimizing CI/CD pipelines, quality gates, and release validation systems using Jenkins or similar platforms.

- Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.) - Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health - Strong understanding of software development lifecycle (SDLC) and agile methodologies.

Upload resume Add LinkedIn

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

About the role

We file this job under Data Scientist, by the work the posting describes.

Data scientists use statistics and models to answer harder questions, such as whether a change worked, what demand will look like next quarter, or which customers are likely to leave.

Postings usually ask for Python or R, SQL, statistics, experiment design and common machine learning methods.

Unlike an ML engineer, a data scientist's main output is often an analysis or a first model, not software running inside a product.

US government figures for data scientists

Median yearly pay, May 2025: $120,230
Expected change, 2025 to 2035: 34.6% more jobsagainst 3.5% for all jobs

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-2051.

Job description

View original posting ↗

Why Sony Interactive Entertainment?

Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.

At PlayStation, we're passionate about both partnership and technology. We care about building performant products and powerful tools, solving practical problems in delightful ways. We love building the systems that millions of people use, and we're always our own first customers and critics. We strive to be at the forefront of development technologies and celebrate our diversity with engineering teams located on four continents from all walks of life. We build our teams to be places where every voice is heard, all input is valued, and our members have the creative freedom to make their ideas real.

Sr Software Development Engineer in Test, ML

Locations: Madison, WI and Waterloo, Ontario Canada

PlayStation is seeking a Sr Software Development Engineer in Test, ML to join our Madison team and lead quality efforts for machine learning-powered products and services. You will partner closely with ML engineers, software engineers, product managers, and data partners to build scalable test automation and validation approaches for systems serving PlayStation at global scale. This role is focused on building confidence in model reliability, production readiness, and behavioral consistency. Unlike traditional software backend testing, success here requires validating probabilistic systems through score distributions, cohort-level behavior, thresholds, and statistical signals, not just deterministic pass/fail assertions.

Responsibilities:

Drive architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.

Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java
Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios
Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release
Perform different types of testing, including functional, integration, regression and API testing working with RESTful APIs, microservices and databases, and non-functional performance and load testing to verify inference service scalability, latency requirements and reliability under production like conditions
Work closely with ML engineers and ops teams to ensure that all features and bug fixes come with automated test coverage, ensuring continuous integration and deployment
Debug and analyze test failures, model anomalies and report defects
Drive high standards of quality for both engineering decisions and customer-facing features with optimal test and automation strategy
Develop and implement best practices for test automation that is highly scalable and maintainable
Monitor test execution and optimize performance in test environments
Come up with innovative solutions to organizational problems

Required Qualifications:

A Bachelor's degree in Computer Science or related field
Minimum 5 years of experience as an SDET, with strong experience testing backend systems.
Proficiency in Python/Java/Scala/go for test automation.
Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems
Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc
Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)Experience in working with databases for backend validation.
Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.)
Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health
Strong understanding of software development lifecycle (SDLC) and agile methodologies.
Excellent problem-solving skills and excellent communication skills.

Preferred Qualifications:

Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems.
Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors.
Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation, rather than deterministic assertions.
Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.) is a plus.
Experience with performance and load testing tools
Experience with Databricks or similar ML platform tooling
Experience architecting and optimizing CI/CD pipelines, quality gates, and release validation systems using Jenkins or similar platforms.

At SIE, we consider several factors when setting each role’s base pay range, including the competitive benchmarking data for the market and geographic location.

Please note that the base pay range may vary in line with our hybrid working policy and individual base pay will be determined based on job-related factors which may include knowledge, skills, experience, and location.

The estimated Ontario base pay range for this role is listed below.

$114,000—$143,000 CAD

Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks.

Please refer to our Candidate Privacy Notice for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights.

Equal Opportunity Statement:

Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category.

We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond.

Sony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.

Source details