About the Services
Apache Airflow
Apache Airflow is a free, open-source platform for developing batch-oriented workflows. It launched in 2014 and has big-name companies like Airbnb, Lyft, and Etsy in its portfolio. It has a growing community of over 2,000 contributors and many users worldwide.
Apache Airflow uses a workflow management system. This system handles automating and monitoring data integration processes. It can handle simple data transfers and complex machine-learning workflows. The user interface is easy to use, so you can focus on your work instead of minding a confusing interface.
But having that simple interface has a caveat. Open-source platforms need technical expertise, and Airflow is no different. You can start with several options to install. If you don’t want to hire experts to do this for you, you need to know about Python and some required libraries and even about Docker Containers for a seamless cloud deployment.
Apache Airflow also doesn’t have a record of privacy and security certifications, but it has security features like role-based access control and encryption. So, your data is safe from prying eyes. It also provides logging and auditing capabilities. So, this will help identify and investigate any security or privacy incidents. Companies with stringent security and privacy requirements trust Apache Airflow. But again, either you need some more technical expertise, or pay for someone who knows how to secure Airflow in your environment.
Dataloader.io
Dataloader.io is a cloud solution to import, export, and delete Salesforce data powered by Mulesoft Anypoint Platform, the counterpart of the desktop version of the same name. It focuses on Salesforce data enabling imports and exports to and from CSV files. These CSV files may come from FTP, SFTP, or cloud storage like Box and DropBox.
Dataloader.io doesn't require registration as it supports Salesforce authentication. Much like the desktop version, it uses fill-in-the-blank forms and not drag-and-drop. You can't use any other source or target aside from the mentioned ones. You can choose a task between Import, Export, and Delete and follow the wizard to complete it. The difference between the cloud and the desktop version is in scheduling and notification features.
With Dataloader.io, your data is safe with security and privacy certifications. It is PCI Level 2, SSAE16, ISO 27001, SOC 1 and 2, and GDPR compliant. This cloud service lives in Amazon Web Services (AWS) and uses AWS privacy and security certifications.
Skyvia
Skyvia is a no-code cloud data integration platform for many data integration scenarios. It’s an all-rounder tool for ETL, ELT, Reverse ETL, data migration, one-way and bi-directional data sync, workflow automation, and more. Devart launched this fantastic product in 2014 for cloud data integration and backup.
Skyvia offers more than 180 ready-made data connectors. These are available for thousands of free users, including 2000+ paid customers. Big names like Hyundai and General Electric trust Skyvia to process their data. Its easy-to-use, drag-and-drop interface suits both IT professionals and business users. And don’t take our word for it. Listen to G2 reviewers about how easy it is to start and work with it. Data integration experts who used other tools can adapt with little to no help from support.
Skyvia has flexible pricing plans perfect for small startups and large enterprises. So, it makes it applicable to businesses of all sizes. Also, Skyvia’s freemium model allows users to start using it now and then decide if they need to upgrade later.
The safety of your data is also our prime concern. So, we hosted it in Microsoft Azure cloud, providing the best data security and privacy. It complies with a wide set of security standards, including SOC 2, ISO 27001, and many others.
Focus | ETL, ELT, and reverse ETL | ETL | Data ingestion, ELT, ETL, reverse ETL, data sync, workflow automation. |
Skill level | Python coding skills. | No-code solution. | No-code wizard. Top-rated as one of the easiest ETL tools by G2. |
Sources | 80+ | CSV, Salesforce. | 180+ |
Destinations | Supported data sources. | CSV, Salesforce. | Supported data sources, including databases, data warehouses, cloud apps and flat files. |
Database replication | Full or incremental load. | Full or partial based on date filters. | Full table and incremental via change data capture. |
Ability for customers to add new data sources | Yes, by coding. | None | Ye s, by request or using REST API connector. |
G2 customer satisfaction | 4.3 out of 5 71 reviews | None | 4.8 out of 5 217 Reviews |
Peer Insights satisfaction | - | 4.2 out of 5 8 reviews | 4.8 103 Ratings |
Developer tools | Python packages/CLI. Web UI. | Web-based interface. | REST connector for data sources that have REST API. |
Advanced ETL capabilities | Integration with other integration tools like Kafka, dbt, Airbyte, and more. | None | Visual ETL data pipeline designer with data orchestration capabilities. |
Compliance and security certifications | No official list of certifications. | PCI Level 1, SSAE16, AES-256 data encryption, ISO 27001, SOC 1 and 2, GDPR. | HIPAA, GDPR, PCI DSS. ISO 27001 and SOC 2 (by Azure). |
Purchase process | Download and install. | Use the Free Tier or start the 30-day free trial then contact Sales. | Self-service or sales. |
Vendor lock-in | None | Monthly | Monthly or annual contracts. |
Pricing | Cloud-hosted with volume-based pricing. Self-managed with a customized package. With a free tier and 14-day trial. | 3 Pricing Plans (Free, Professional, Enterprise). Row-based pricing. With a 30-day free trial for Enterprise. | Volume-based and feature-based pricing. Freemium model allows to start with a free plan. |
Connectors
Apache Airflow
Apache Airflow provides 80+ built-in data connectors and provider packages. These connectors will work with various types of data sources. And this includes databases, cloud platforms, and messaging systems. It can also deal with popular APIs, data warehouses, and lakes. Some of the most popular connectors include MySQL and PostgreSQL.
But, if you need one that is not available, you can create your own using Airflow’s API. Additionally, the Airflow community never stops developing and sharing new connectors. So, if your data source is so unique and recent, look for a connector in the community first. But if nobody made one for it yet, prepare to roll up your sleeves and code.
Dataloader.io
There's little to say about Dataloader.io connectors because you can only use Salesforce data and CSV. Your CSVs should be in your local drive, FTP, or cloud storage like Box and DropBox. For Enterprise users, SFTP is also available.
Dataloader.io allows importing attachments to Salesforce from Zip files and exporting attachments from Salesforce to a Zip file. Each attachment relates to a Salesforce object, like Contacts or Events. When importing attachments, you should have a CSV file containing information about the attachments and the Zip file.
Trying an Import task shows a Database option as the data source, but it's not yet available.
If you need more data sources and destinations, it is better to choose another tool that has more connectors.
Skyvia
Skyvia offers more than 180 connectors, and more to come very soon. It supports connectors for CRMs, accounting, email marketing, e-commerce, human resources, marketing automation, payment processing, product management, all major databases and DWH, flat files, and more. It’s also not a problem whether your data is on-premise or in the cloud.
You can access your on-premise data with peace of mind using the Skyvia Agent. It allows you to connect to databases like SQL Server, MySQL, and more using an encrypted connection. You need to download the Skyvia Agent and install it. Then, download a secured key file and place it in the same folder as the Agent. The Agent is like an unbreakable metal door, and you use the key file to open that door to your on-premise data. You can also set it up so that Skyvia can access only the resources you specify and nothing else.
Customers can also leave a request for a new data connector. And Skyvia will prioritize building it without additional payment.
Transformation
Apache Airflow
Apache Airflow provides a flexible way to handle data transformations. Airflow supports a variety of data transformation tasks. This includes data cleansing, aggregation, filtering, and enrichment. You can perform transformations using code-based approaches. So, if you prefer to click than code to perform transformations, this is not for you.
Airflow has a web, graphical interface for data transformations, but coding is always required. So, it supports programming languages like Python and SQL.
Dataloader.io
In Dataloader.io, you only specify a source Salesforce object or the CSV file. Then, you map the columns. There’s no option to transform data further.
If you need further transformation, you can use an external tool and work on the CSV files.
Skyvia
Skyvia is a full-featured ETL service that allows powerful data transformations. It is a no-code solution allowing data splitting, conversion, lookups, and many more.
You can use the Skyvia Data Flow and Control Flow for advanced data pipelines. Transformations for these advanced pipelines are flexible. It supports extending your data with new columns, conditional flows, and summarized values. And all these you can do with parameters, variables, and more for flexibility without code.
Moreover, Skyvia has an Expression Builder to build formulas with many functions. With this, you can convert or extract parts of the data or form new values to suit your needs. And if you love coding in SQL, Skyvia can further extend your transformation needs. It supports multiple joins, groupings, CASE expressions, and more in SELECT queries. And you can also use DML commands like INSERT, UPDATE, and DELETE.
Support
Apache Airflow
Airflow has an active and helpful community, and users can access various support channels depending on their needs. Their website provides documentation and guides for all levels of users. They also have a mailing list where users can ask for help and get support from the community.
For those who need more help, premium support is available through third-party vendors. These vendors provide support levels, including response time guarantees and service-level agreements (SLAs). They also offer training and consulting services.
Users can reach out to these vendors through their websites or by contacting them directly to benefit from their premium support services. With these options, users can choose the level of support that fits their needs and budget.
Dataloader.io
You have two support options in Dataloader.io: email and community. You only have the community to support you if you have the Free plan. The paid plans allow you also to have email support.
But for all paid plans, there’s a help center with videos and instructions for Dataloader.io tasks. Note that there’s no SLA or priority support available.
Skyvia
Skyvia offers free email, chat (on the website or in-app), and forum support for all customers. It also provides extensive documentation with lots of tutorials and user guides.
For paid customers, Skyvia offers a prioritized support including additional support options for Enterprise customers.
Pricing
Apache Airflow
Apache Airflow is an open-source platform, which means it’s free to use. There are no hidden charges or fees to access and use Airflow’s core features.
Moreover, Apache Airflow doesn’t need any upfront payment, subscription, or contract. Users can download, install, and run the software. They can do that on their own hardware or cloud infrastructure. They have full control over their deployment, scaling, and maintenance. This makes it an attractive option for those who want to avoid vendor lock-in.
There are also no user, workflow, or data source limitations in using Airflow. You can experiment, innovate, and collaborate on your pipelines without worries.
But this flexibility needs a lot of skilled work hours. So, if you need a data integration tool that is ready to use from day 1, this may not be an attractive option.
Dataloader.io
There are three pricing plans for Dataloader.io: Free, Professional, and Enterprise. Each plan has its limits on what you can do within Dataloader.io.
You can try the Free plan immediately if you have a Salesforce account. The Free plan allows you to process 10,000 rows per month and a CSV file limit of 10MB. CSV locations available to you are your local drive, FTP, Box, and Dropbox. You can only have one scheduled task, which expires after 30 days. If you need help, only the community can provide it.
With the Professional plan, the number of rows increases to 100,000/month, and a CSV file limit extends to 50MB. You can also have 50 scheduled tasks that never expire. If you need help, you can send an email or ask the community. There’s no free trial for the Professional plan. Try the Free plan first. Then, extend the limits by paying per month per user.
The Enterprise plan offers a 30-day free trial. You can process unlimited rows monthly, and your file limit increases to 100MB. You also have flexible security and unlimited scheduled tasks.
Check out the pricing page for Dataloader.io for more details.
Skyvia
Skyvia Data Integration is a freemium tool with an option to request a 14-day trial. So, price is not a barrier to entry.
And when you’re ready, paid plans start from $19 per month. Pricing tiers depend on a few factors. It includes the number of loaded records, scheduling frequency, and advanced ETL features. There are no sale commitments. And customers can upgrade or downgrade at any time. Check out a detailed comparison here.
If you doubt the price is worth it, check out review sites like G2. Aside from ease of use, reasonable pricing is one of the things Skyvia customers like. So, you can be sure the features you get are worth every penny.