AWS Data Pipeline vs. Informatica Intelligent Data Management Cloud

AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals. With AWS Data Pipeline, you can regularly access your data where it’s stored, transform and process it at scale, and efficiently transfer the results to AWS services such as Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR.

Incentivized

Informatica Cloud is an excellent tool for freeing up trapped data in your internal systems and exporting it into a cloud data warehouse or SQL container. Especially if you have any internal SQL query generators that allow you to copy and paste into the Source setup. For example, we use Business Objects internally, and you can build out the query you need inside the firewall with that, then paste it into the query within Informatica Cloud while establishing the Source connection. This way you are not writing all your source parameters by hand, cutting new jobs setup time by 50%. Where Cloud will not suit you well is if you need significant visibility to the health of the system from a tracking, monitoring or error handling standpoint. Cloud will tell you it failed, maybe give you an example error, but has no further troubleshooting or diagnostic assistance to offer.

Incentivized

• Helps you easily create complex data processing workloads
• Fault tolerant
• Highly available

Incentivized

• Informatica Cloud is a great tool for automating data imports. Raw data files can be scheduled to run at designated times, and using pre-built mappings ensures that the data goes into the system accurately each time.
• It is also a great tool for converting raw data into specific formatting. For example, configuring the mapping so that the first letter of a first, middle or last name is always capitalized.
• Additionally, Informatica Cloud has a built-in field-matching tool so that records that already exist are updated rather than having duplicates created.

Incentivized

• Pipeline Stuck in Pending Status
• Pipeline Component Stuck in Waiting for Runner Status
• EMR Cluster Fails With Error

Incentivized

• The User Interface can be a bit difficult to get in initial stages.
• Error messages are hard to understand which sometimes takes a lot of time for the resolution
• Cannot Implement complex SQL queries which should be fixed in future release.

Incentivized

I've never had trouble getting into contact with Informatica's support for technical help. I give it a nine because it does pretty well for mid to enterprise-scale workflows.

Incentivized

AWS data pipelines are easy to use over data factory for data engineers

Incentivized

Having used SQL Server Integration Services (SSIS) in the past, Informatica Cloud was a huge-step up in functionality, usability and performance. Hands-down, Informatica Cloud is a much more robust product overall. While SSIS is well-suited for specific instances (i.e. SQL Server-specific implementations), Informatica Cloud is a much better product as an overall integration/transformation tool.

Incentivized

• Easy to use
• Data engineers are able to create the data pipelines quickly and effectively
• Scalable and Fault tolerant

Incentivized

• A positive impact is bringing more projects.
• Getting data out of various systems such as Salesforce.com or FTP and consolidating it into tables in one central database.
• Having the ability to run data transformation tasks (the equivalent of batch jobs in SF or stored procedures in SQL) on a schedule without consuming those resources on the target or source systems.

Incentivized