dbt vs. SolarWinds Task Factory

dbt (Data Build Tool) is best suited for doing the data transformation. dbt is just a transformation tool and it is not suitable for building a data pipeline which requires extraction of data and loading. dbt is well suited for SQL based transformation logic and it is less appropriate when transformation logic requires python.

Incentivized

Since I started working with this great tool all data analysis programs have been running effectively. Implementation of projects and tasks have been effective and reliable. Data collected from each department gives us working plan on better management of various programs. The Dimension Merge SCD Transform helps us to load large volumes of data within a short period of time.

Incentivized

• user experience makes it easy to work with SQL and version control
• customer success team and the dbt (data build tool) community help establish best practices
• thorough and clear documentation

• The Slowly Changing Dimension Component saves us a huge amount if time compared to the native SSIS component.
• JSON Transform is really useful to convert record and send it to rest API.
• The advanced derived columns allow us to use really cool functions that are not available in the regular transforms.

Incentivized

• Slow load times of the dbt cloud environment (they're working on it via a new UI though)
• More out-of-the-box solutions for managing procedures, functions, etc would be nice to have, but honestly, it's pretty easy to figure out how to adapt dbt macros

Incentivized

• It was built by Pragmatic Works who sold it to SentryOne and now Solar Winds, concerned about future support. SolarWinds is discontinuing support for related products such as BiXpress.
• Had issues with connecting to certain versions of SQL Server - would fail when deploying one package - had to deploy the entire solutions.
• Occasional random failures observed with the Filter tranform.

Incentivized

Task Factory has become a key product for our use of doing ETL work in SSIS. Their custom SSIS components allow us to work simply on the data engineering side of things. We can ignore the lower level work needed to connect to disparate data sources. This allows us to work faster and provide more value to the business

Incentivized

dbt is very easy to use. Basically if you can write SQL, you will be able to use dbt to get what you need done. Of course more advanced users with more technical skills can do more things.

Incentivized

Compared to some of the other transformations I have worked with, it really is pretty simple for the type of functionality you get

Incentivized

Overall, the best vendor we currently have on the data side of the house. No issues, issues are resolved very quickly and upgrades go without any issues.

Incentivized

Overall it went smoothly. Had a couple of gotchas with licensing and upgrading but nothing that really stopped us.

Incentivized

Matillion is graphical versus dbt, which is SQL code-based (that, of course, is a matter of personal preference and not an objective advantage). The integrated testing, documentation generation, lineage, etc., were additional criteria that led us to choose dbt.

Incentivized

I've not found too many tools to bolt onto SSIS that encompass what you get with Task Factory. I have used some Enterprise ETL tools like Dell's Boomi, but did not find it to be very intuitive. Task Factory does not leave you guessing how to use its components. Additionally, their support is very responsive and helpful.

Incentivized

• In 3 months we re-wrote the data warehouse (15-20 sources) in dbt with 3 developers.
• We are using it continually for the past year with no issues.
• Sorry, I don't have ROI numbers but the impact was huge.

Incentivized

• We were able to support our developers with Task Factory features and reduce the development time by 40%.
• Recently Task Factory has changed their pricing module and it seems to be pretty costly for our process. Our business team has started to evaluate whether this is worth it going forward.

Incentivized