Greatly Improved Data Import in Skyvia 4.1
Devart has released the new version of Skyvia, an online service for cloud data integration, backup, and management. The update delivers a lot of new features for Import - a member of Data Integration toolkit for cloud and relational data. The new Import features include UPSERT support for all data sources, greatly improved Lookup functionality, data filtering support, importing data from several related source objects to one target object, etc.
Devart, a recognized provider of database connectivity solutions and tools for developers, has announced the release of Skyvia 4.1, an online service for cloud data integration, cloud backup and data management.
UPSERT Operation Support
Skyvia Import performs the UPSERT operation not just for Salesforce, but for all supported data sources now.
Skyvia implements UPSERT in the following way: if a Null value is specified for the ID or primary key, the record is inserted, and if a non-null value is specified, Skyvia tries to update the record with the specified ID or primary key.
The primary key value can be specified in various ways: as a source column value or via lookup or external ID, etc., so that an ability to perform UPSERT even without knowing the ID values provided.
Since Lookup on the target table can be used to get IDs for existing records by some other fields, the UPSERT operation allows avoiding duplicate records import.
Powerful Lookup Mapping
Lookup mapping now offers powerful functionality to get values for target fields both from target and source objects. Its new features are available for both Import and Synchronization packages.
Skyvia Import supports lookup not only on the objects from target connection, but also on objects from the source connection too.
Composite Lookup Key Support
Ability to use a lookup key that consists of multiple columns, when one lookup key column is not enough to uniquely identify the necessary record from the lookup object.
Lookup Error Processing
If no such record was found by Lookup, there is a capability to specify to throw an error or to assign the Null value to the mapped target column. Additionally there is an ability to control what to do when multiple records are found - to throw an error or to take the first found record.
New lookup can perform both case-sensitive and case-insensitive comparisons.
Lookup can optionally select necessary fields all the rows from the lookup object to cache once, and then search for the necessary records in the cache. During the import a large number of rows with lookup, it can be more efficient to select all the data from a lookup object once than select necessary records from it for each imported rows. For cloud data sources with API call limits, it can decrease the number of API calls used.
For advanced mapping cases there is an ability to use the second-level lookup to specify values for the lookup key of the first-level lookup.
Skyvia 4.1 provides data filtering for the source data. It can filter data in two ways. First, it provides advanced filter settings for configuring custom filters as complex as a user may ever need. Additionally there is an option to import only the recently changed or inserted data.
In a single click Skyvia allows configuring an import task to load only the records that was inserted or updated since the last successful package run (or since package creation if it was never run). This provides scheduling import package for automatic execution, and this package will load only the data changes each time instead of loading all the source data.
Additionally, this feature can be used for creating a trigger-action like integration. Ability to configure an import operation that will perform some data change in a target when a record is created or updated in a source and schedule it to execute every few minutes.
Import Joined Tables
Another new Import feature is the ability to import data not just from a single object or table, but to join several related tables and use their columns in mapping directly.
File Mask Support
For importing CSV files from FTP/SFTP and Dropbox, the new Skyvia Import allows specifying not only file names but also file masks that include a date variable. When such Import package is scheduled for automatic execution, it will search the file to import by substituting the current date to the mask.
Support for Self-referencing Relations
When using the Relation mapping, Skyvia now supports relations when object references itself. An example of such relation can be a relation of Salesforce Account object that references itself via the ParentId field. Now Skyvia can correctly build a self-referencing relation in target, based on such a relation in source.
For more information about the new features of Skyvia, please visit https://skyvia.com/
Devart is one of the leading developers of database tools and administration software, ALM solutions, data providers for various database servers, data integration and backup solutions. The company also implements Web and Mobile development projects.
Learn more about Devart at https://www.devart.com