Qualtrics XM for Strategy and Research vs. Sawtooth Lighthouse Studio

I think Qualtrics CoreXM can be used in nearly every scenario. It is best suited for internal or external gathering of the voice of the customer through product/service satisfaction surveys, disenrollment surveys, net promoter scores, post-meeting satisfaction surveys, comparison surveys (conjoint studies), etc. It also works well as a knowledge-transfer assessment tool (for tests or quizzes). Also, as a way to capture registrations or RSVPs. It is not as well suited for managing an online community forum that relies on participants to see and react to comments/responses from other members of the online community (like social media). There are other products better suited for that use case.

Incentivized

Anyone wanting to design and analyze advanced studies, particularly those that incorporate discrete choice modeling (such as MaxDiff and / or Conjoint) should be using Sawtooth Lighthouse Studio. The capabilities and flexibility offered by this platform for these choices is far beyond any other platform I am aware of. It is less appropriate where you need the survey tool to 'play well with others.' Two examples: 1) pulling in live data streams so they can be cleaned and visualized. 2) Integrating into any service where an API call is appropriate such as adding / removing people from a mailing list, incentive management tool, or qualitative community tool.

Incentivized

• Qualtrics offers a wide range of question formats. This feature allows for uniquely styled questions that keep a students interest.
• Qualtrics is very useful for sending out surveys on a particular schedule at a good time to not overload our campus IT system. The reminder feature is great in that I can set up all four reminders for the entire survey when I set up the survey.
• I most value the immediate support when I run into a problem. A problem stops my work in its tracks. It is very important that I get the issue resolved quickly so I can get on with my work.

• Powerful programming capabilities
• Advanced analysis
• Fantastic customer and technical support
• Good documentation

Incentivized

• The collaborate feature can be clunky and sometimes we have to remove access and add a person back in for them to see the survey in their lists
• We have a contract through our university and more than one person has created their account in the wrong place, causing some administrative headaches as that is fixed so that we can collaborate on surveys with them.
• I wish it was easier to organize my surveys into folders, there should be a more efficient way to do that.

Incentivized

• They could focus on integrating API type functionality
• I would love if the data came out labeled
• I am not a fan of the 'limited' time a study can stay up. This causes issues with longitudinal studies.

Incentivized

I was impressed a couple years ago when two heads of market research at Fortune 500 companies told me about them, and I've been even more impressed with the advancements I've seen in the last year. I like where the company is headed, and I look forward to using them again in a future role.

All the menus are very user friendly and intuitive. I can always find exactly what I'm looking for and can change anything I need to with ease. All the elements of the survey are adjustable with very little effort and without confusion.

It is incredibly powerful, very rhobust and has fantastic support. The only reasons I'm not giving it a higher rating are 1) There is a very steep learning curve when it comes to designing more complex studies. 2) It is difficult to get Sawtooth Lighthouse Studio to 'talk' to other systems as the Perl upon which it is built is not really designed to work with API calls, etc.

Incentivized

Whenever we have had an issue with trying to figure out how to do something (even though the documentation is incredibly well put together) we have asked Qualtrics support and have always received our answer nearly immediately (I think in maybe 10 times, only once did a support person need to call us back). Qualtrics support is dedicated to solving customer issues right, and in the first contact, if at all possible

I cannot explain how great the support team is. They are prompt and very thorough in their responses.

Incentivized

I still use it. It does everything you need an online survey to do. From heat mapping to complex skip logic and display logic. I use it weekly and it never disappoints

I like being able to easily integrate new colleagues by simply giving them a log in user name and password

My institution at the time was using the free version of Qualtrics. We use UserTesting at work currently since we have licenses paid for. Qualtrics isn't bad at with the institution level of license but it could be better. Overall, the interface is not as exciting or eye catching but it does the job.

While QuestioPro has the capability to build surveys and even do some advanced analysis, it is less powerful (and less intuitive) than Sawtooth Lighthouse Studio. It cannot handle studies with the complexity we are used to designing. The CMNTY Platform was initially sold to us as a combined Quant / Qual platform, but we found very quickly that the quant side of it is extremely limited.

Incentivized

• Increased productivity due to the highly intuitive user-interface and template saving capabilities.
• Reporting and analytics are extremely valuable. Our team can track responses and share feedback/results extremely quickly.
• If a user has created a great template, they can share to external teams quite easily. It helps other departments!

Incentivized

• Our business is survey data so we rely heavily on sawtooth
• The advanced design and analytics are incredibly useful
• Negative - I wish it would work natively with API calls

Incentivized