Optimal Workshop, a company in New Zealand, offers their suite of user research tools on a subscription basis, including the Treejack information architecture tool, OptimalSort card sorting test, Chalkmark first-click testing, and other tools.
$2,388
per year
Webtrends Analytics
Score 4.4 out of 10
N/A
WebTrends provides an enterprise web analytics platform and, according to Forrester, has a strong focus on support for mobile and social channels and a very open platform. Webtrends competes directly with Adobe Site Catalyst, IBM Coremetrics. and comScore DigitalAnalytix.
The tools are great for user researchers who have a solid foundation with IA research methods, or are willing to learn them while using the tools. However they don't magically create valid IA studies; someone with no IA research experience may struggle to use the tools and/or run studies resulting in poor quality data.
Scenarios 1. If you want to use web server log files as input to your web analytics, then Webtrends will provides a good product, with great ease of implementation. Don't even think about being cheap on hardware, and make sure Webtrends runs on real servers, not in a VM environment. 2. If you want to use Data Tagging, similar to Google Analytics or Site Catalyst, Webtrends has a powerful product, just be prepared to pay. 3. If you are new to Web Analytics, but it is the strategic direction, start with Webtrends on Premises. Questions to Ask 1. What are you trying to accomplish? 2. Can you place a dollar value on the benefit that you expect/need from Webtrends? 3.Can you live with Webtrends running SaaS?
Webtrends Analytics makes complex situations understandable to a non-technical audience. The vast capabilities and ways to slice data is both a great tool, but can also cause a user/users many hours of frustration.
Visual data display is clean, to the point, and not overly convoluted with unneeded variables and standard (defualt) settings. Everything the end user sees is customizeable.
Exports of raw data collections was easy and accurate. Once the parameters of data collection are finally set up and working, its easy to get what you want from the UI and is delievered in a variety of options.
The recruitment panelists are not professional, nor do they take the tasks seriously. You are going to get a lot of bad data.
They are HQ'd outside the US and must have a small team because the customer service is the absolute WORST I've experienced in their industry.
They pride themselves on documentation, but when they fail to document something they blame the customer for the mistake.
There are way too many limitations with the tool after you launch, limited integrations, and poor survey questionnaire options. The tool itself is far too basic for most sites, especially B2B.
Webtrends is not great at providing statistical data for analysis. You need to enable Log File Delivery or create an analysis export to perform this. This could theoretically be done with Streams.
Webtrends has difficulty identifying multi-visit users due to the inherent fragility of cookie-based tracking.
Webtrends Analytics does not provide Pathing capabilities for segments, only for the aggregate. However, this can be worked around with Scenario functionality selectively fired by a tag management system.
Segmentation by high-cardinality parameters tends to cause issues with table limits. Even after scrubbing and scrutinizing data, we commonly see up of 10K rows per dimension. Due to this, we use Webtrends Analytics to roll up data into larger segments and export all of our log data into our database for heavy duty number crunching.
The obstacles to renewing are 1) finding people to manage it who know it well and 2) frustration because of the lack of on-the-fly analysis. Usually, renewal prices are reasonable and the cost of switching to something else when you have a somewhat complicated setup far outweigh the renewal costs, especially if your implementation is sound and your reports are humming along. A lot of renewal decisions are going to hinge on the new product that will start to roll out this month.
I would rate Optimal Workshop's overall usability 9 out of 10 due to several key factors. Firstly, the platform has a user-friendly interface makes navigation straightforward, even for first-time users. The tools and features are well-organized, ensuring users can quickly find what they need without unnecessary complexity. Secondly, the platform is highly intuitive, meaning users can easily understand how to perform tasks without extensive guidance. This is supported by clear and concise instructions throughout the application, reducing the learning curve significantly.
Additionally, the learnability of Optimal Workshop is exceptional. New users can become proficient in a short amount of time, thanks to its well-thought-out design and helpful onboarding materials. Even more advanced features are presented in a way that feels approachable and manageable. Finally, the platform supports a seamless workflow, allowing users to focus on their research or tasks rather than struggling with the software. These qualities collectively make Optimal Workshop a reliable and efficient tool for many projects, justifying its high usability rating.
If I could give it a 0, I would. Not having an intuitive user interface made it impossible to convince non-analytic business users to use the tool on their own. Even as a seasoned analyst, frequent calls were needed to get what should be simple tasks done. Account managers don't understand the tool either, and have to refer you to technical support
The v9 admin interface and v10 reporting interface work as well as expected, but have a tendency to be pokey, especially for bulky reports and whenever you're connected to wifi. I much prefer using the REST API for all reporting for this reason, which simply dumps out the data and doesn't bother with the user interface.
We’ve never had to use much of their support services since the platform is very easy to use, we have however needed to transfer ownership between team members due to people leaving or other circumstances. Under those situations, the support offered to us has been been very quick and efficient and we never had to nudge them much to get the job done.
The Webtrends Support Engineers are expert at what they do, and we get to speak to someone on the support team quickly. They provide great solutions when available, and when there is no solution, which can happen, they describe work-arounds.
The in-person training was comprehensive enough to get you started, but I strongly recommend having a more experienced person when beginning with the tool.
Webtrends provides several free webinars over the course of the year, many of which I would expect to pay for. The people providing the webinars seem to have a good feel for real-world application of the product.
Careful planning and patience. Use a non-public test site to fine tune tags and reporting. Despite best laid plans, there will be surprises when you collect the data, run the analysis and begin generating reports using the tool. Perform a tag audit to ensure tags fire as desired.
Optimal Workshop was the best tool that provided just what we needed and not anything more. The price point was also perfect for us as it provided room to try it out and then jump into a bigger package
Webtrends has its work cut out for itself considering you have the behemoth Google Analytics and Google Analytics Premium having a strong offering and brand recognition for the price of free. After reviewing the paid service I'd suggest you start off with GA as a cheaper alternative that is just as robust, if not much more flexible in regards to the reporting and goal tracking needs for our company.
Optimal Workshop has provided a very low-risk, quick testing ground for navigation menus. So while the full impact cannot be determined, we are happy we are using Optimal Workshop, and are gaining benefits from it.
Webtrends has had a positive impact on site visitation because it allowed us to understand the sources by domain for site traffic and find out ways to increase visits from those domains.
Webtrends has also allowed us to understand areas of optimization on the site, which has had a positive impact on the overall user journey on the site, likely leading to longer site duration and engagement.
