TrustRadius: an HG Insights company

Apache Sqoop Professional, Scientific, and Technical Services Reviews & Insights

Score8.8 out of 10

4 Reviews and Ratings

Community insights

TrustRadius Insights for Apache Sqoop are summaries of user sentiment data from TrustRadius reviews and, when necessary, third party data sources.

Recommendations

Users have made several recommendations for Apache Sqoop based on their experiences with the tool. Firstly, they suggest contacting customer support before purchasing Apache Sqoop to address any concerns and ensure it meets specific requirements. Secondly, users highly recommend Apache Sqoop for data transfer between relational databases and Hadoop. They find it easy to use and efficient, especially for importing SQL databases into Hadoop data lakes. Additionally, users appreciate its ability to handle bulk and delta data transfers from RDBMS to Hadoop environments. Lastly, users recommend Apache Sqoop for its integration capabilities with other tools in the Hadoop ecosystem. They find it useful for transforming data batches and consider it one of the best ETL (Extract, Transform, Load) tools they have used. Some users also suggest adding file import functionality to enhance its capabilities further. Overall, users suggest giving Apache Sqoop a try as it is considered a highly recommended tool for data transfer between relational databases and Hadoop.

Apache Sqoop Reviews

1 Review
Professional, Scientific, and Technical ServicesInformation Technology & Services1

Simplistic CLI tool for RDBMS and Hadoop transfers

Rating: 9 out of 10
Incentivized

Use Cases and Deployment Scope

Sqoop is being used to offload relational databases into Hadoop HDFS, Hive, or HBase. From there, big data analysis processes can be run, then Sqoop is used to reload different tables in the source database for relational queries by external systems such as web applications.

Sqoop helps bridge the gap between traditional RDBMS systems and the Hadoop ecosystem.

Pros

  • Provides generalized JDBC extensions to migrate data between most database systems
  • Generates Java classes upon reading database records for use in other code utilizing Hadoop's client libraries
  • Allows for both import and export features

Cons

  • Sqoop2 development seems to have stalled. I have set it up outside of a Cloudera CDH installation, and I actually prefer it's "Sqoop Server" model better than just the CLI client version that is Sqoop1. This works especially well in a microservices environment, where there would be only one place to maintain the JDBC drivers to use for Sqoop.

Likelihood to Recommend

Sqoop is great for sending data between a JDBC compliant database and a Hadoop environment. Sqoop is built for those who need a few simple CLI options to import a selection of database tables into Hadoop, do large dataset analysis that could not commonly be done with that database system due to resource constraints, then export the results back into that database (or another). Sqoop falls short when there needs to be some extra, customized processing between database extract, and Hadoop loading, in which case Apache Spark's JDBC utilities might be preferred.