Azure Data Factory vs. KNIME Analytics Platform

In a data pipeline, you will be able to add different kinds of activities for example connect from your on-premise SFTP and move CSV files to storage accounts. As well data factory has its own data flow if you are an ETL developer who experimented with maybe you have worked with SSIS, thus, you will start quickly with this new feature of the data factory.

Incentivized

KNIME Analytics Platform has vastly improved our effectiveness when working with large data sets. The self documenting GUI allows analysts to focus on what they are trying to accomplish, not complex code syntax. If we were to use traditional tools, like SQL, work would take much longer and it would be more difficult to collaborate both internally and with clients. Since KNIME Analytics Platform is database oriented, some spreadsheet functions are not supported, which is as it should be. For small data sets we often use Excel vlookup and pivot tables in place of KNIME Analytics Platform. If VBA code is requried, we go to KNIME Analytics Platform as we find VBA to be unstable in Excel.

• Creating ETL and ELT workflows as well as orchestrating and monitoring pipelines without writing any code.
• Hybrid data integration is easily and agilely possible through this software.
• It has lot of various useful components

Incentivized

• Visual programming as oppose to scripting encourages data analysts to reap deeper insights from their data
• Large community contribution in extending the KNIME Analytics Platform into other areas of analytics, e.g. Text Analytics, Predictive Analytics, ML, etc.
• Open source with periodic updates ensures it is equipped to deal with the most sophisticated data analytics use case

• Learning curve for pipeline creation interface.
• Alerting isn't necessarily built in. Had to work around this to meet team needs.
• With GIT enabled, some features can only be done via git, while some need to be done via the portal.

Incentivized

• Automation - e.g. RapidMiner Studio provides a Turbo Prep function, where one can get to working on models more quickly (RapidMiner is not open source though)
• KNIME does not replace a regular reporting tool - it is not meant to. However, if I have already spent some time developing a data acquisition and analytical model, it would be nice to be able to deploy, for example, a monitoring or reporting module that would process data autonomously and react accordingly.

Incentivized

We are happy with Knime product and their support. Knime AP is versatile product and even can execute Python scripts if needed. It also supports R execution as well; however, it is not being used at our end

So far product has performed as expected. We were noticing some performance issues, but they were largely Synapse related. This has led to a shift from Synapse to Databricks. Overall this has delayed our analytic platform. Once databricks becomes fully operational, Azure Data Factory will be critical to our environment and future success.

Incentivized

The training KNIME Analytics Platform provide helps you get to grips with a product that is already very intuitive. There is a KNIME Analytics Platform way of thinking about addressing problems, but once you understand a couple of patterns which you see again and again in your workflow it all makes sense.

Incentivized

We have not had need to engage with Microsoft much on Azure Data Factory, but they have been responsive and helpful when needed. This being said, we have not had a major emergency or outage requiring their intervention. The score of seven is a representation that they have done well for now, but have not proved out their support for a significant issue

Incentivized

KNIME's HQ is in Europe, which makes it hard for US companies to get customer service in time and on time. Their customer service also takes on average 1 to 2 weeks to follow up with your request. KNIME's documentation is also helpful but it does not provide you all the answers you need some of the time.

Incentivized

KNIME Analytics Platform is easy to install on any Windows, Mac or Linux machine. The KNIME Server product that is currently being replaced by the KNIME Business Hub comes as multiple layers of software and it took us some time to set up the system right for stability. This was made harder by KNIME staff's deeper expertise in setting up the Server in Linux rather than Windows environment. The KNIME Business Hub promises to have a simpler architecture, although currently there is no visibility of a Windows version of the product.

Incentivized

Azure Data Factory fits well into our overall systems architecture where we already utilize largely Azure services and also Microsoft based products in the on-premises environment. I think cost structure is also very competitive with Azure Data Factory. Most services provide a visual interface for designing ETL workflows, but our team found Azure Data Factory's interface more intuitive.

Incentivized

There are two aspects which put KNIME Analytics Platform ahead of other products. Firstly the fact that KNIME Analytics Platform comes at no cost and no restrictions on its use is an instant winner for any organisation wanting to democratise their data. It means that a client is free to install it on as many machines as they wish without worrying about costs, the number of seats required or payment models or procurement negotiation. It also means that we are not building costs into our clients business. Secondly, KNIME Analytics Platform has a very comprehensive set of tools for importing/exporting data, data manipulation and data science. Some products offer analytics packages on top of their base offering at additional cost and they are still not as comprehensive as what you get with KNIME Analytics Platform for free. For some types of analysis you may require to download additional packages with KNIME Analytics Platform, but its invariably at no cost, those packages are kept out of the main download to keep the size down. Due to the easy integration with R and Python, I view KNIME Analytics Platform as also having the capabilities of those languages too. This has helped me in the past with seamlessly importing a rare filetype and using very specific models not directly available in KNIME Analytics Platform.

Incentivized

• Limiting the amount of data moving up and down from the cloud for cloud-native applications.
• Overall simple to use interface which is actually easier for a first time ETL developer than SSIS.

Incentivized

• It is suited for data mining or machine learning work but If we're looking for advanced stat methods such as mixed effects linear/logistics models, that needs to be run through an R node.
• Thinking of our peers with an advanced visualization techniques requirement, it is a lagging product.

Incentivized