About the Services
AWS Glue is a serverless data integration tool from Amazon. It helps you extract data from other cloud services offered by Amazon Web Services (AWS). Then, incorporate it into data lakes and data warehouses. It offers a cost-efficient way to process data for good use in analytics and machine learning. AWS Glue provides a performance-optimized infrastructure for running Apache Spark for data integration. It supports batch and stream processing. And it speeds up data ingestion, processing, and integration.
AWS Glue covers various data integration scenarios. This includes ETL, ELT, reverse ETL, data ingestion, and replication.
AWS Glue encrypts all customer data at rest using industry-standard encryption algorithms. AWS Glue also provides customers with fine-grained access control over their metadata. It is compliant with various security standards such as SOC 1/2/3, PCI DSS Level 1, and HIPAA Eligible Service.
Apache Nifi is an open-source, easy-to-use system to process and distribute data. Brand new UI version 1 was released in 2016. More than 2400 companies are using Apache Nifi, according to Enlyft.
Apache Nifi works on-premise or with any cloud provider. You can download, install, and configure Apache Nifi on Linux, Mac, and Windows machines. Keep in mind that Nifi may require technical skills. You can’t install it and build ETL pipelines in minutes. But once you complete your configuration, you can prepare data pipelines in a browser.
There are no limits on the number of data sources and destinations in a pipeline. You are only limited by the processing capacity of your machine.
Data security and privacy are your responsibility. But if you deploy the system in AWS or Azure, you can leverage their security and privacy certifications.
Skyvia is a no-code cloud data integration platform for many data integration scenarios. It’s an all-rounder tool for ETL, ELT, Reverse ETL, data migration, one-way and bi-directional data sync, workflow automation, and more. Devart launched this fantastic product in 2014 for cloud data integration and backup.
Skyvia offers more than 160 ready-made data connectors. These are available for thousands of free users, including 2000+ paid customers. Big names like Hyundai and General Electric trust Skyvia to process their data. Its easy-to-use, drag-and-drop interface suits both IT professionals and business users. And don’t take our word for it. Listen to G2 reviewers about how easy it is to start and work with it. Data integration experts who used other tools can adapt with little to no help from support.
Skyvia has flexible pricing plans perfect for small startups and large enterprises. So, it makes it applicable to businesses of all sizes. Also, Skyvia’s freemium model allows users to start using it now and then decide if they need to upgrade later.
The safety of your data is also our prime concern. So, we hosted it in Microsoft Azure cloud, providing the best data security and privacy. It complies with a wide set of security standards, including SOC 2, ISO 27001, and many others.
|Focus||ETL, ELT, Reverse ETL, streaming.||ETL, ELT||Data ingestion, ELT, ETL, reverse ETL, data sync, workflow automation.|
|Skill level||Low-code, no-code solutions|
Or, coding in Python or Scala on complex scenarios.
|No-code solution.||No-code and easy to use wizard.|
|Sources||JDBC-compatible connectors and Amazon ecosystem connectors.||Unspecified||160+|
|Destinations||Supported data sources.||Unspecified||Supported data sources, including databases, data warehouses, cloud apps and flat files.|
|Database replication||Full and incremental load.||Full and incremental load.||Full table and incremental via change data capture.|
|Ability for customers to add new data sources||API for creating custom connectors.||Contributing to community/coding.||Yes, by request or using REST API connector.|
|G2 customer satisfaction||4.2 out of 5|
|4.2 out of 5|
|4.7 out of 5 |
|Peer Insights satisfaction||4.2|
|Developer tools||AWS Glue Studio, Console, CLI, and API.||Web interface, REST API.|
CLI, integration to Kafka, and more.
|REST connector for data sources that have REST API.|
|Advanced ETL capabilities||Job bookmarking, parallel execution.||REST API and open architecture.||Visual ETL data pipeline designer with data orchestration capabilities.|
|Compliance and security certifications||SOC 1/2/3, HIPAA, GDPR, ISO 27001, 27017, and 27018, PCI DSS.||No provided security and privacy certifications.||HIPAA, GDPR, PCI DSS.|
ISO 27001 and SOC 2 (by Azure).
|Purchase process||Use the free trial or talk to sales.||Download, install, and configure.||Self-service or sales.|
No minimum contract term.
|None||Monthly or annual contracts.|
No minimum contract term.
|Free||Volume-based and feature-based pricing. Freemium model allows to start with a free plan.|
AWS Glue supports the following connection types:
• JDBC-compatible data sources,
• Amazon Relational Database Service (Amazon RDS),
• Amazon Redshift,
• Amazon DocumentDB,
• MongoDB Atlas.
But there’s no mention of the latest number of data connectors available for AWS Glue.
AWS Glue provides an API for creating custom connectors. With this, you can connect to data sources unknown to AWS Glue.
Apache Nifi can connect to various data sources, including SQL and NoSQL databases, flat files, and others. It has a number of components for data extraction and loading called processors which you can drag in the Nifi canvas and configure.
Every Nifi processor for data access is available to you. You can check the Apache Nifi documentation for more details.
You can contribute new data sources and destinations to the сommunity. So, you need to know Java and follow the rules of the community in contributing code.
Skyvia offers more than 160 connectors, and more to come very soon. It supports connectors for CRMs, accounting, email marketing, e-commerce, human resources, marketing automation, payment processing, product management, all major databases and DWH, flat files, and more. It’s also not a problem whether your data is on-premise or in the cloud.
You can access your on-premise data with peace of mind using the Skyvia Agent. It allows you to connect to databases like SQL Server, MySQL, and more using an encrypted connection. You need to download the Skyvia Agent and install it. Then, download a secured key file and place it in the same folder as the Agent. The Agent is like an unbreakable metal door, and you use the key file to open that door to your on-premise data. You can also set it up so that Skyvia can access only the resources you specify and nothing else.
Customers can also leave a request for a new data connector. And Skyvia will prioritize building it without additional payment.
AWS Glue can generate ETL code to transform source data into target schemas. Its graphical user interface (GUI) supports various types of transformations. These include handling missing values, filtering, mapping, aggregating, pivoting, and more.
If you prefer to code your transformations, AWS Glue supports Python and Scala.
Apache Nifi transformation capabilities include aggregating, splitting, data encryption, and decryption to hide sensitive information. You can also do XSLT transforms for XML data and JOLT transforms for JSON data. Besides that, you can also do regular expressions and even run SQL commands in relational databases.
All transformations in Apache Nifi are part of its Processors list. So, check specific transformation processors in the Apache Nifi documentation.
Skyvia is a full-featured ETL service that allows powerful data transformations. It is a no-code solution allowing data splitting, conversion, lookups, and many more.
You can use the Skyvia Data Flow and Control Flow for advanced data pipelines. Transformations for these advanced pipelines are flexible. It supports extending your data with new columns, conditional flows, and summarized values. And all these you can do with parameters, variables, and more for flexibility without code.
Moreover, Skyvia has an Expression Builder to build formulas with many functions. With this, you can convert or extract parts of the data or form new values to suit your needs. And if you love coding in SQL, Skyvia can further extend your transformation needs. It supports multiple joins, groupings, CASE expressions, and more in SELECT queries. And you can also use DML commands like INSERT, UPDATE, and DELETE.
AWS Glue provides different levels of support for its customers. These include Basic, Developer, Business, and Enterprise.
Basic support is free. And this includes access to AWS Trusted Advisor and AWS Personal Health Dashboard.
Developer support includes all Basic support features, then add a 12-hour response time resolution of cases.
Business support includes all Developer support features, plus 1-hour response time for cases and Infrastructure Event Management.
Enterprise support includes all Business support features, plus a dedicated Technical Account Manager (TAM) and Infrastructure Event Management with customizations.
You can reach AWS Glue customer support by creating a case in the AWS Support Center. AWS Glue provides an SLA of 99.9% availability for its service. If you need premium support, you can avail yourself of AWS Premium Support.
Open-source projects like Apache Nifi have communities where you can ask for help. You can be a part of their mailing list or you can chat to them through Slack. There is no resolution time for your problems, neither is priority support.
However, there are how-to videos and documentation. And you can ask questions on developer-focused sites like StackOverflow.
Skyvia offers free email, chat (on the website or in-app), and forum support for all customers. It also provides extensive documentation with lots of tutorials and user guides.
For paid customers, there's also a phone support option and additional support options for Enterprise customers.
AWS Glue pricing depends on the number of Data Processing Units (DPUs) used per hour. DPUs are a measure of processing power and memory capacity. AWS Glue charges $0.44 per DPU hour. This means you pay only for what you use with no upfront costs or commitments.
AWS Glue also has Always Free AWS Glue 1 Million. It includes 1 million objects stored in the AWS Glue Data Catalog and 1 million requests/month.
The tool is free to use, from downloading to configuring. However, keep in mind that you'll have to pay for the planned infrastructure later on. There is no difference whether you'll build your own data centers or use cloud services.
There are also companies offering consulting services and even freelancers who have successful implementations experience, but they also require payment.
So, if you need to get the fast result it will be better to use alternatives that provide quick solutions. Apache Nifi, however, can offer you a flexibility for complex scenarios.
Skyvia Data Integration is a freemium tool with an option to request a 14-day trial. So, price is not a barrier to entry.
And when you’re ready, paid plans start from $19 per month. Pricing tiers depend on a few factors. It includes the number of loaded records, scheduling frequency, and advanced ETL features. There are no sale commitments. And customers can upgrade or downgrade at any time. Check out a detailed comparison here.
If you doubt the price is worth it, check out review sites like G2. Aside from ease of use, reasonable pricing is one of the things Skyvia customers like. So, you can be sure the features you get are worth every penny.