TrustRadius: an HG Insights company

What is Statsig?

Statsig is a feature management with feature flags, pulse, holdouts, from the company of the same name in Bellevue.

Best in class experimentation platform

Use Cases and Deployment Scope

We use Statsig as our new, centralised experimentation platform and it has effectively replaced two other products in the process - Mixpanel and Launch Darkly. Statsig has allowed us to quickly scale our experimentation practices, giving clear insights and indications on performance, health and roll out of experiments. As a product manager, it's been invaluable to be able to directly understand and slice the data coming back.

Pros

  • Clear experimentation insights and details
  • Experimentation health and performance ratings
  • Statistical analysis of in flight work

Cons

  • Complex data science focussed UI

Usability

Alternatives Considered

Mixpanel and LaunchDarkly

Other Software Used

Mixpanel, Miro, Atlassian Jira

Heyyy Statsig

Use Cases and Deployment Scope

I am a Product Manager and we use Statsig to test the effectiveness of new feature releases. We are mainly concerned with user success in properly evaluating the product while onboarding

Pros

  • Makes setting up experiments easy
  • Really responsive support
  • Advanced experimental config for detailed statistical analysis
  • Post experiment analysis tools

Cons

  • There is no way to test two different user segments in the same experiment
  • Adding metadata to events is non-intuitive, the available metadata isn't shown in the UI while you are in the configuration flow
  • I'm not sure the recent sidebar reorganization is better than the previous version
  • Since we primarily use experiments as gates, with just a boolean parameter, it wasn't obvious that there is a default parameter output when calling the API to register an exposure. Maybe the default parameter object should be a mandatory function argument

Return on Investment

  • We uncovered several feature releases that were causing a negative impact on our product activation rate by running exclusion experiments

Usability

Alternatives Considered

Flagsmith and VWO