Hive vs. OpenText Vertica

Hive is great for managing projects with your team. Assigning tasks is simple enough using Hive. It helps manage team goals for the projects. We are able to create reports (via the dashboard) for the progress and updates to provide to the team based on completed stages. Works great for bigger projects.

Incentivized

As someone just starting out with data analytics and warehousing vertica is a great tool for a small scale business. It has amazing performance and can scale upto TBs of data. It works well for any organization which has about 100 - 500 DAUs of the system. The system doesn't require a lot of ops overhead. Scaling for PB data and 1000s of DAU is vertica's weak point. The system is just not designed for large scale usage and still has a long way to go to improve scalability. There are experiments to run Vertica query engine on top of HDFS which seem promising, however - if you have the the Hadoop ecosystem you are better off going the HDFS + Presto/Impala/SparkSQL route. But if you are in the Hadoop ecosystem, you probably are already investing a lot in ops.

Incentivized

• Data warehousing: Hive is often used as a data warehousing platform, allowing users to store and analyze large amounts of structured and semi-structured data. It is especially good at handling data that is too large to be stored and analyzed on a single machine, and supports a wide variety of data formats.
• Batch processing: Hive is designed for batch processing of large datasets, making it well-suited for tasks such as data ETL (extract, transform, load), data cleansing, and data aggregation.
• Data transformation: Hive allows users to perform data transformations and manipulations using custom scripts written in Java, Python, or other programming languages. This can be useful for tasks such as data cleansing, data aggregation, and data transformation.
• Integration with other tools: Hive integrates with a wide variety of other tools and services in the Hadoop ecosystem, such as Pig, Spark, and HBase, allowing users to perform a wide range of data analysis and management tasks.

Incentivized

• Column-oriented storage organization, which increases performance of queries.
• Compression, which reduces storage costs and I/O bandwidth. High compression is possible because columns of homogeneous datatypes are stored together and because updates to the main store are batched.
• Shared nothing architecture, which reduces system contention for shared resources and allows gradual degradation of performance in the face of hardware failure.
• Easy to use and maintain through automated data replication, server recovery, query optimization, and storage optimization.
• Support for standard programming interfaces ODBC, JDBC, ADO.NET, and OLEDB.
• Integration to Hadoop with the capability to perform analytics on ORC and Parquet files directly.

Incentivized

• Organizing tasks by assignees could be better. It's a little cumbersome to check off each person you want. Can you group these?
• I don't really use any view besides task view. Is there something better I could be using?
• It would be nice if attachments showed up in a nicer format, maybe with a preview?

Incentivized

• One time, one of the nodes wasn't coming up because of some ambiguity with the local data. Vertica wasn't able to fix it by itself and we were trying to remove the node out of the database and we couldn't do it. It would be great if that could be addressed. Luckily when we rebooted the whole server, some of the dead transaction got flushed because of which vertica was able to recover and the node came up.

Incentivized

Its a easy tool, the best way to organize the workflow but has room for more improvements.

Our CSR is easily accessible and they have support built into the app itself. They also have a pretty robust support site. We also took advantage of the free trial and learned so much by putting Hive through the paces and figuring out the best way to mold it to our needs.

Incentivized

HP/Micro Focus Vertica support is in par with other bigger vendors. In addition to this, there is enough best practices documentation available for some of the most common ways you will use Vertica that makes it easy to get Vertica up and running.

Incentivized

One key difference between Hive and Spark is the way they process data. Hive is a batch-oriented system, which means that it is designed to process large amounts of data in a batch mode rather than in real-time. In contrast, Spark is a real-time processing platform that is designed to handle streaming data and support interactive queries. Another difference is the way they execute queries. Hive uses a SQL-like query language called HiveQL, while Spark supports a wide range of languages and APIs, including SQL, Python, Scala, and R. But we chose Hive due to its simple queries on large datasets and for data warehousing tasks.

Incentivized

MySQL and MS SQL Server are both fantastic RDBMS products. MS SQL Server goes a bit further since it has the builtin analytical functions. But it only scales so far. Once the data goes beyond capacity, getting results out just does not happen anymore. IBM Netezza and Teradata were both appliances that required different expertise than we had in house. Vertica was able to do the same, and in some cases better, on commodity hardware (frankly in our case old servers that were slated for recycling!) and at a small scale. In other words, Vertica we could grow slowly over time. Infobright is a great log processing database but for the functions we were looking to serve it just didn't have some of the features Vertica had that we felt were show stoppers.

Incentivized

• I've gotten to know my colleagues better, knowing their roles makes it faster to contact them to complete tasks and that speed makes us optimize and earn better results
• The jobs speed made us focus on optimization and customization for the client, and that in a better treatment by the client and better revenue
• We can understand which tasks takes more time and to stimate better what we can ask for

Incentivized

• Vertica increased our productivity in analyzing the data and validating simple proof of concepts with our data.
• Results of analytical queries produced from Vertica are used by all departments as well as part of some of our products.

Incentivized