How It Works

In Skyvia, you configure your integration operations visually via web browser. Then you can run them manually or scheduled for automatic execution.

Skyvia stores and executes the configured integration operations in the cloud, so you don't need to care about their execution or install anything on your computer. It logs all the execution results, so you may check them whenever you need.

ExpandedToggleIcon        Packages and Tasks

Your data integration operations are defined as packages. Package is the basic concept in our Skyvia. A package is a unit of work that performs a set of data ETL operations.

Packages consist of tasks - units of data extracting, transforming and loading process. A package can contain one or more tasks.

Each package has source and target. Unless a source or a target is a manually uploaded or downloaded CSV file, a package must have source and target connections specified.

For example, you may create an import package to load data Salesforce data to Dynamics CRM. It has a connection to Salesforce as a source connection, and a connection to Dynamics CRM - as a target. One of its tasks loads accounts, another one loads contacts, the third one loads products, etc.

import-salesforce-dynamics

Package is scheduled and executed as a whole, you cannot execute its tasks separately. However, whenever necessary, you may just clone a package and delete unnecessary tasks from it.

 

ExpandedToggleIcon        Package Kinds

Skyvia supports several data integration package kinds for different use cases.

Import Package - a package that loads data from source to target in one direction. A source can be CSV files, a database/data warehouse, or a cloud application. A target can be either a database/data warehouse or a cloud application.
 
Import packages in Skyvia have a lot of features that make them useful in different cases. They can import data from CSV files, load existing data from one data source to another directly, filter source data and load only part of it. Import packages allow you not only to create new records - they support all kinds of data manipulation operations - insert, update, delete, upsert.
 
You can configure import package to import only new or updated records from the source to keep target up-to-date automatically (see Importing Only Recently Added or Changed Data from Cloud Sources) and use such a package for synchronization in one direction.
 
For import, Skyvia provides powerful mapping settings, which allow you to load data even when source and target have different data structure and preserve source data relations in target.
Export Package - a package that exports data from a database or cloud application to CSV files. Export package supports filtering and ordering data to export. It allows you to select columns both from the main source object and its related (parent) objects.
Replication Package - a package for replicating cloud application data to a database or cloud data warehouse and keeping the copy up-to-date automatically. Replication package creates tables with the same structure as the replicated cloud objects automatically and copies cloud application data to them. For subsequent replication execution it can use Incremental updates.
Synchronization Package - a package for bi-directional data synchronization (changes are applied both from source to target and from target to source). Source and target can be cloud applications or databases.
 
Synchronization shares most mapping features with import, so you can synchronize data with different structure. There are, however, certain specificities and requirements, which you need to know before using a synchronization package. Please read Synchronization Overview for more information.

 

ExpandedToggleIcon        Mapping

Import and synchronization packages allow you to configure mapping. Mapping determines what will be loaded to a target fields. Skyvia supports different kinds of mapping. It allows mapping target fields to source fields, to constants, use expressions to transform the source data, use lookups to look for the value in another source or target objects, etc. For target foreign keys you may use relation mapping that builds relations in target based on the relations in source automatically. For more information about how to configure mapping and details about supported mapping kinds see the Mapping section.

column-mapping

 

ExpandedToggleIcon        Managing Packages

You can manage packages on the Integration Packages page - run, create, edit, clone, or delete them. The Integration Package Details page displays detailed information about a package and package run history - the log of package runs with their results.

packages-page