Digital Experimentation Manager

By living our values - we play to win, customer obsessed, we are one and it starts with me - we deliver That New Look Feeling for our customers and each other. 

The Role:

The Experimentation Manager plays a key role in advancing our Customer & Digital Product strategy. This role enables product squads and digital teams to achieve their OKRs by embedding a robust experimentation culture and following a test-and-learn approach. The manager ensures a strong testing program and infrastructure to maximize learning, optimise customer experiences, and support the broader product strategy.

Key responsibilities include:

• Acting as the primary experimentation and optimization point of contact, consulting and supporting Product and Ecommerce teams in developing their experimentation roadmaps.
• Partnering with Product Managers to understand quarterly OKRs and designing experiments that drive impactful outcomes.
• Advising Digital teams on impactful experiment designs, to ensure learnings are actionable.
• Providing detailed post-test analysis and actionable insights to squads.
• Proactively monitoring live experiments and ensuring metrics and segmentation are correctly implemented and reported.
• Scaling experimentation by enhancing frameworks and tools to support multiple teams and experiments simultaneously.
• Collaborating with technical teams to continuously improve test execution processes.

WHATS IN IT FOR YOU:

• 40% staff discount plus friends & family discounts throughout the year
• Access to our reward platform for external discount and offers
• Private pension scheme
• Virtual GP access for you and your children – it allows you to speak to a doctor at a time and date that suits you
• All employees are covered by our life assurance policy from day one
• Unlock extra leave with our buy more holiday scheme.
• Celebrate YOU! Enjoy an extra paid day off on your birthday each year
• Enhanced maternity, paternity and adoption leave, and shared parental leave.
• Spread the cost of your commute with interest-free season ticket loans
• Do your bit for the environment and save money with our Cycle2Work scheme
• We're proud to partner with the Retail Trust and Fashion & Textile Children's Trust

What you’ll be doing:

• Collaborate with Digital teams, senior leadership, and peers to develop the strategy for experimentation.
• Build strong relationships with Product Management to align experimentation efforts with development roadmaps.
• Create and maintain leadership-facing dashboards and reports, increasing visibility of results and findings across the business.
• Ensure tests are designed to provide clear answers aligned with business goals and metrics.
• Present results to stakeholders and maintain a centralized knowledge library of test outcomes.
• Stay updated with industry trends, emerging technologies, and best practices to continuously innovate the testing program.
• Foster collaboration with UX, Marketing, Ecommerce, and Customer Care teams, ensuring their involvement in the experimentation process.
• Evangelize experimentation best practices across the organization by hosting hypothesis generation sessions and ideation workshops.
• Support teams in ensuring smooth execution of the Test & Build cycle, maintaining close collaboration with UX.
• Identify and resolve testing issues, keeping stakeholders informed of delays or updates.
• Enhance testing velocity by streamlining processes and implementing automation where possible.
• Work with third-party providers to manage technical integrations for web and app testing environments.

Who you are:

• A positive, can-do attitude.
• Passion for deriving insights and intellectual curiosity.
• Strong communication skills, including written updates, presentations, and effective workshop facilitation.
• The ability to build strong relationships across teams and influence decisions.
• A focus on enhancing customer experiences through digital channels.
• Experience managing A/B and MVT testing programs, including the use of holdout groups.
• Proven ability to lead and scale company-wide experimentation programs.
• Deep knowledge of tools supporting automation, experimentation, personalization, attribution, and analytics.
• Strong collaboration skills with Product Managers, Data, Engineering, and Analytics teams.
• Expertise in experimentation best practices and scaling strategies for multiple simultaneous tests.
• Proficiency in quantitative analysis for data-driven decision-making.
• Familiarity with qualitative analysis and its role in experimentation strategies
• Advanced skills in web analytics tools such as Adobe Analytics, Google Analytics, or Content Square.
• Proficiency in SQL, with additional programming skills (e.g., Python, R) as a plus.
• Technical aptitude to navigate APIs, databases, and system architecture.