IBM® StreamSets enables users to create and manage smart streaming data pipelines through a graphical interface, facilitating data integration across hybrid and multicloud environments. IBM StreamSets can support millions of data pipelines for analytics, applications and hybrid integration.
N/A
Informatica Intelligent Data Management Cloud
Score 7.0 out of 10
N/A
The Informatica® Intelligent Data Management Cloud™ (IDMC) is designed to help businesses efficiently handle the complex challenges of dispersed and fragmented data to innovate with their data on virtually any platform, any cloud, multi-cloud and multi-hybrid.
Because real-world sources often change (new fields get added, formats get tweaked, etc.), StreamSets helps detect and adapt to those "schema drifts" or changes automatically, or with minimal manual intervention. That makes pipelines more resilient and significantly reduces the maintenance burden. Therefore, data sets with constantly changing sources/formats are great for StreamSets.
Informatica Cloud is an excellent tool for freeing up trapped data in your internal systems and exporting it into a cloud data warehouse or SQL container. Especially if you have any internal SQL query generators that allow you to copy and paste into the Source setup. For example, we use Business Objects internally, and you can build out the query you need inside the firewall with that, then paste it into the query within Informatica Cloud while establishing the Source connection. This way you are not writing all your source parameters by hand, cutting new jobs setup time by 50%. Where Cloud will not suit you well is if you need significant visibility to the health of the system from a tracking, monitoring or error handling standpoint. Cloud will tell you it failed, maybe give you an example error, but has no further troubleshooting or diagnostic assistance to offer.
Informatica Cloud is a great tool for automating data imports. Raw data files can be scheduled to run at designated times, and using pre-built mappings ensures that the data goes into the system accurately each time.
It is also a great tool for converting raw data into specific formatting. For example, configuring the mapping so that the first letter of a first, middle or last name is always capitalized.
Additionally, Informatica Cloud has a built-in field-matching tool so that records that already exist are updated rather than having duplicates created.
IBM Stream sets has been a wonderful addition to our technology stack. It has helped in some of our initiatives such as data engineering, data integration for not only external customers but also for internal purposes. The tool has also helped on our use cases related to streaming data. Moving to another tool would require significant amount of work and time.
because i think that overall the solution is having a positive impact on the business, it allows multiple benefits in simplification of the tasks and is capable of doing multiple process that are usually done by a combination of man and systems, reducing the time and effort required to have the data.
Streamsets support has improved a lot in the last couple of years. We had some challenges in the beginning with support, but now the quality of the support and the responsiveness to tickets are better. We have contacted support multiple times when it came to scenarios where the system was slow or the output as not as we expected
I've never had trouble getting into contact with Informatica's support for technical help. I give it a nine because it does pretty well for mid to enterprise-scale workflows.
Before, we were using Informatica since most of our applications were running on on-prem servers. Later, when we started moving to the cloud, we tried Informatica Cloud, but it's more useful for batch-oriented than streaming. That's why one of our tech architects suggested IBM StreamSets for our real-time data streaming. During the POC stage, we were happy that the data streaming was way better with IBM StreamSets compared to the Informatica Cloud way of doing.
Having used SQL Server Integration Services (SSIS) in the past, Informatica Cloud was a huge-step up in functionality, usability and performance. Hands-down, Informatica Cloud is a much more robust product overall. While SSIS is well-suited for specific instances (i.e. SQL Server-specific implementations), Informatica Cloud is a much better product as an overall integration/transformation tool.
Getting data out of various systems such as Salesforce.com or FTP and consolidating it into tables in one central database.
Having the ability to run data transformation tasks (the equivalent of batch jobs in SF or stored procedures in SQL) on a schedule without consuming those resources on the target or source systems.
