Experimentation & Analysis Lead, Experimentation (Remote, Americas)

Job post summary
Location Canada
Team Marketing and Growth

About the role

Shopify has redefined commerce. We’ve raised the standard for how businesses of all sizes operate, market, and sell their products and services. With over 1,000,000 merchants in more than 175 different countries, we continue to grow while looking for innovative ways to impact the market.

As an Experimentation & Analysis Lead, you'll use your combination of marketing expertise and analytical skills to run growth experiments, analyze the results, identify impactful growth opportunities, and educate growth teams on rigorous experimentation. You'll work with the Growth Strategy & Operations and Growth Data Science and Engineering teams to conceptualize and build the foundation for experimentation at Shopify.

We care about growing creative, collaborative people, and strong, capable teams. Your peers in Shopify's Growth Org have diverse backgrounds, skill sets, and experiences but share an established track record of driving significant business growth.

The Experimentation & Analysis Lead will be responsible for embedding within Growth teams to lead all parts of the experimentation process, from hypothesis generation and experimental design to statistical analysis and internal education on rigorous experimentation practices. Your success will hinge on your ability to strategically design web and email experiments, rigorously analyze and present the results, and enable your colleagues through best practices and streamlined workflows.


You'll be doing things like:

  • Strategizing and leading the experimentation roadmaps for high-growth teams.

  • Collaborating with conversion rate optimizers in Growth to help them run smarter experiments, faster.

  • Deep dive on experimentation workflows, educating and enabling your colleagues to run more rigorous experiments.

  • Work, as part of a multidisciplinary team, on answering questions and unlocking growth through experimentation.

  • Use your analytical skills to find new opportunities the company should be exploring and experimenting with.

  • Influence the roadmaps of other teams and help craft the future direction of the company.


  • Expertise in experimental design and analysis, including: A/B, and full and partial factorial designs that control for threats to validity.    

  • Strong experience working with high velocity experimentation programs. You’re familiar with the entire experimentation process, from ideation through to iteration. You need to have deep domain expertise and understand the nuances of conversion rate optimization.

  • Strong experience with analytics tools, such as Excel, Mode, Tableau, Amplitude, and/or Google Analytics.

  • Strong communication and leadership skills, including: setting an experimentation strategy and designing experimentation workflows, managing stakeholders’ requests and 

  • Experience with Bayesian statistics and mathematical concepts, such as: sample size, credible intervals, etc.

  • Experience working with different stakeholders across multiple disciplines, including data scientists, engineers, and marketers


Bonus Points:

  • Experience working in SaaS or other technology companies. It’s useful to understand our industry and business model.

  • Experience with SQL and/or Python. You may not be able to write complex queries from scratch, but you have a high-level understanding of databases and how to query them.

  • Strong project management and prioritization skills with an approach that defaults to action. You can drive good decisions quickly and help other teams do the same.

At Shopify, we are committed to building and fostering an environment where our employees feel included, valued, and heard. Our belief is that a strong commitment to diversity and inclusion enables us to truly make commerce better for everyone. We strongly encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities and/or people with intersectional identities. Please take a look at our 2020 Sustainability Report to learn more about Shopify's commitments.

How we hire

At Shopify, we put a lot of care and time into who we hire. We believe that in order to build the best products, we need to build high impact teams. Our recruitment process centres around what we call the Life Story interview, a conversational-style interview where we get to learn more about you.
Learn more about our hiring process 

Not what you’re looking for?Check out these similar roles.

Let's make commerce better for everyone

Search jobs
Shopify Merchant's Pottery Shop