Back to jobs

Manager, Testing Optimization & Analytics

Pay
Pay not listedSimilar roles state $95K–$145K
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Maintain the testing backlog and coordinate key tests across the organization

  • Monitor live tests to check design, sampling, metrics and statistical methods

  • Build interactive dashboards and analyses to interpret test results

  • Communicate summarized test results and recommendations to stakeholders

  • Train product managers, analysts and business staff on testing best practices

From the employer’s posting
Maintain a testing backlog, coordinate execution of key tests across the organization while correcting for cross-impact.
Proactively monitor live tests and ensure they are appropriately implemented with proper test design, sampling, metrics, statistical and analytical frameworks.
Build interactive dashboards and perform analyses needed to support the outcome and interpretation of test results.
Proactively communicate summarized test results and recommendations to stakeholders.
Train product managers, analysts and business stakeholders on testing best practices, interpreting results and recommendations to drive an active test-and-learn culture.

About Rue Gilt Groupe

We combine world-class merchandising, technology and marketing to create the most engaging and satisfying online shopping experience available.

In the employer’s words · Read in context

Apply at Rue Gilt Groupe

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
5
Last seen by us
Nov 22, 2026
Employer says posted
May 3, 2021

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$95K–$145K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,327 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 5 and day 43.

From 16,008 similar postings that came down. Coming down is not always a hire.

Rue Gilt Groupe is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • Looker
  • Tableau
Where the posting names them
- 4+ years of experience running Site/App features, Pricing, Shipping and Marketing experiments. - 4+ years of hands-on SQL experience. Experience working on scripting languages like Python, Viz tools (Tableau, Looker). - Solid understanding of statistics and analytical frameworks required to implement and interpret test results.

Your next step

Complete your application on robertsrecruiting.catsone.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Introduction

We are looking for a Testing Manager to join our Business Analytics team and lead efforts to solve some of the most complex testing and optimization scenarios in a fast-growing ecommerce company leveraging the trove of online data from our 35M members. 

This position requires a combination of strong testing, analytics and statistical skills. Solid understanding of ecommerce businesses that operate in multiple channels and cater to an engaged customer base.

As a Testing Manager you will help accelerate learnings from a variety of UX/UI, site features, services/offer tests and foster a data driven test-and-learn culture. 

What you’ll accomplish…

  • Manage our testing & optimization program to empower technology, product and business teams with data driven insights. 
  • Act as primary testing & optimization subject matter expert. Maintain a testing backlog, coordinate execution of key tests across the organization while correcting for cross-impact.
  • Proactively monitor live tests and ensure they are appropriately implemented with proper test design, sampling, metrics, statistical and analytical frameworks.  
  • Build interactive dashboards and perform analyses needed to support the outcome and interpretation of test results.
  • Proactively communicate summarized test results and recommendations to stakeholders.
  • Work crossfunctionaly with data science, business intelligence, product and business teams to ensure business requirements and testing standards are met for all tests.
  • Drive continuous improvements and advancements in the testing program, including implementing industry best practices in methodologies, technologies and automation.
  • Create a testing knowledge base by recording successes, failures and trends accumulated across tests, and effectively communicate these learnings and insights across teams.
  • Train product managers, analysts and business stakeholders on testing best practices, interpreting results and recommendations to drive an active test-and-learn culture.
  • Identify gaps and emerging trends in testing platforms, methodologies. Provide recommendations on new solutions to continually improve testing capabilities and efficiencies. When needed, work directly with vendors to drive technological advances and to resolve issues. 
  • Expected to perform these duties with little daily oversight.

THE RIGHT FIT:

You have…

  • Degree in a quantitative field such as statistics, mathematics, computer science or economics.
  • 5+ years working within an eCommerce and multi-channel (iOS, mobile web and desktop experiences)
  • 4+ years working in a testing & optimization focused role, A / B and multivariate testing.
  • 4+ years of experience running Site/App features, Pricing, Shipping and Marketing experiments.
  • 4+ years of hands-on SQL experience. Experience working on scripting languages like Python, Viz tools (Tableau, Looker). 
  • Solid understanding of statistics and analytical frameworks required to implement and interpret test results.
  • Excellent communication skills, working cross-functionally to achieve results and a high level of comfort delivering analyses and insights. 
  • Strong problem-solving skills and demonstrated ability to take initiative.
  • Experience with testing platforms built-in house and / or 3rd parties (Optimizely, Target, Optimize, SiteSpect, AB Tasty).
  • Experience in conversion optimization, digital marketing, UX design and / or consumer psychology and research.

ABOUT US:

We combine world-class merchandising, technology and marketing to create the most engaging and satisfying online shopping experience available. Each day, 35+ million loyal Members turn to us for everything from women, men and children’s apparel and accessories to home décor and exclusive experiences. Our approach to retail brings excitement to online shopping in a way that not only strategically supports our brand partners, but also inspires our Members daily. 

Demand for Analyst roles

New Analyst postings at the employers we follow are up 26% over the last 6 weeks compared with the 6 before.

Weekly new Analyst postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 993, the most 1,510, and the latest week had 1,367.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Analyst, by the work the posting describes.

Analysts answer business questions with data. They pull numbers with SQL, build reports and dashboards, and explain what changed and why to the people making decisions.

Most postings ask for SQL, spreadsheets, a dashboard tool such as Tableau or Power BI, and clear writing.

Unlike a data scientist, an analyst mostly explains what happened rather than building models that predict what will.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Boston, MA

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.