Elasticsearch is an enterprise search tool from Elastic in Mountain View, California.
$16
per month
IBM Watson Explorer
Score 8.4 out of 10
N/A
IBM Watson Explorer supports enterprise search with unstructured data analysis, machine learning, and content analysis to improve decision-making, support customer service or serve other business needs.
Elasticsearch is really well suited for searching text (Natural Language Processing) and you can fine tune the searches and scoring very well. I like the ability to find Significant Terms in the Index, where you can find aggregations that are really relevant to a specific search. It also allows for queries to lead to new queries via aggregations which is great for navigating your data. It is less suited to doing more complex aggregations where slices of data are required to be processing using guassian normalizations. And doing searches which join different documents is very very hard, and requires serious thought on how to denormalize data.
The Watson Explorer is great because it potentially replaces a meriad of other low-level analytics products that we would need to use for data analytics and data mining. WEX isn't really suitable much beyond doing text and data analytics and performing machine learning, so if your team doesn't really have a use-case that fits all of these categories, it is worth looking at an alternative.
Free to try - It's possible to use most of the useful features of Watson Explore on their trial/demo accounts.
Super well-designed data analytics tool - Most of the tools and features of the explorer are really useful, and truly help you fully understand the depth of any format of textual data.
Extensive sources compatibility - WEX can retrieve data from a large range of sources, and the compatibility there is quite good as well.
Setting Java memory thresholds can be a pain for those not accustomed to things like Eden Space & Old Generation which can lead to over allocation, or more likely, under allocation. Apache Solr had a similar issue. It would be nice if the program would take an extra step and dogfood it's own advice by analyzing the system & processes to return a solid recommendation for that configuration. The proper configuration information is outlined in the documentation, it would be nice if that was automated.
The only health check that ElasticSearch reports back is a "red" status without any real solid information about what is going on, though its usually memory thresholds or disk I/O. I am currently on ElasticSearch 1.5 so that may have changed for newer versions. When the status goes "red", I as the administrator of the software, feel like I lose control of whats going on which should rarely happen. Something more verbose would eliminate that.
This is more of a critique of the ElasticStack in general. The whole top to bottom stack is starting to get feature creep with things that are better suited in other software and increasing the barrier for entry for people to get started with setting up a robust logging infrastructure. ElasticSearch as a storage search engine, is pretty streamlined, but I can see that the tools that comprise the ELK Stack are going to require a certification with constant study at some point. During major release for Logstash a while back, it literally took a month to learn a new language because Elastic completely changed the syntax. For a medium sized organization of only a couple of admins, that is a pretty high bar where time is money. They really should work on refining/automating the tools & search engine they have, instead of shoehorning/changing things on to an already rock solid foundation.
Support is just OK, like most of the other IBM Watson products. The setup/integration is really hands-on, but it's also problematic because support later may take a considerable amount of time.
UI could still use a little more improvement - part of the administration and sources dashboards are hard to navigate.
The Application Builder is a great part of the product, but hard to learn/understand - this is where we needed the most support from IBM and tutorials/documentation.
To get started with Elasticsearch, you don't have to get very involved in configuring what really is an incredibly complex system under the hood. You simply install the package, run the service, and you're immediately able to begin using it. You don't need to learn any sort of query language to add data to Elasticsearch or perform some basic searching. If you're used to any sort of RESTful API, getting started with Elasticsearch is a breeze. If you've never interacted with a RESTful API directly, the journey may be a little more bumpy. Overall, though, it's incredibly simple to use for what it's doing under the covers.
We've only used it as an opensource tooling. We did not purchase any additional support to roll out the elasticsearch software. When rolling out the application on our platform we've used the documentation which was available online. During our test phases we did not experience any bugs or issues so we did not rely on support at all.
Elasticsearch is the most well-known and supported free data platform that we identified. We are taking advantage of community knowledge and practices. In terms of flexibility and breadth of use cases no other competitor came close to Elasticsearch. We've tried Solr in the past be we encountered issues which were deal-breaking for us. MongoDB - it just did not pass our evaluation parameters as a main data platform. We still use it for smaller purposes, though.
Google Cloud offers a Natural Language product, but it is just an API. This API doesn't offer the useful visualizations of relations, analytics, and graphs that IBM Watson Explorer offers on their interface. For this reason, we chose to go with IBM WEX. For later stages of our production, we decided to use Google's NLP API because we found that it was quick to integrate into production after studying data and developing models using IBM WEX.
I am not in finance and I suspect even if I was this would be hard to measure. But for sure, Elasticsearch has enabled us to have the most flexible data model in the industry for our customer's data, and in doing so we have attracted many many technical customers and got much of their $$$.
One problem with Elasticsearch is that because it runs on the JVM, there can be some stop-the-world JVM garbage collections happening that can take down nodes and reduce indexing speed. The solution for that tends to be "let's just upgrade the CPU on that machine". And before you know it you are paying $$$ because this'll happen with 40+ machines.
On the other hand, I do think that ES is more efficient than other systems and so it requires fewer nodes to keep it highly tolerant and available, so we probably saved some money that way.
Positive - Trial/demo period. This was really useful for us to figure out what features of WEX we liked most and how difficult it would be to integrate WEX into our workflow.
Negative - On-boarding was long and almost always requires support from IBM support, unlike most other products this advanced.
Positive - WEX replaced a large selection of alternative products we would have to use for the same functionality, and having all of that function in one place was definitely helpful.
