Data Integration

Commonly referred to as ETL, data integration encompasses the following three primary operations:

Extract

Exporting data from specified data sources.

Transform

Modifying the source data (as needed), using rules, merges, lookup tables or other conversion methods, to match the target.

Load

Importing the resulting transformed data into a target database.

The more recent usage of the term is ELT, emphasizing that the transformation operation does not necessarily need to be performed before loading, particularly in systems such as Snowflake that support transformation during or after loading.

In addition, the scope of data integration has expanded to include a wider range of operations, including:

  • Data preparation.

  • Data migration, movement, and management.

  • Data warehouse automation.

The following data integration tools and technologies are known to provide native connectivity to Snowflake:

Solution

Version / Installation Requirements

Ab Initio

Azure Data Factory

  • Azure Data Factory: No requirements

  • Snowflake: No requirements

Boomi

  • Boomi: DCP 4.2 (or higher) or Integration July 2020 (or higher)

  • Snowflake: No requirements

Datameer

  • Datameer: v7

  • Snowflake: No requirements

DataVirtuality

  • DataVirtuality: No requirements

  • Snowflake: No requirements

dbt

  • dbt: v0.13 (or higher)

  • Snowflake: No requirements

Denodo

  • Denodo: Denodo Platform 6.0 (or higher)

  • Snowflake: No requirements

Diyotta

  • Diyotta: No requirements

  • Snowflake: No requirements

Etleap

  • Etleap: No requirements

  • Snowflake: No requirements

Etlworks

  • Etlworks: No requirements

  • Snowflake: No requirements

Fivetran

Available in Partner Connect

  • Fivetran: No requirements

  • Snowflake: No requirements

Google Cloud Data Fusion

  • Google Cloud Data Fusion: Snowflake plugin

  • Snowflake: No requirements

Google Cloud Dataflow

  • Google Cloud Dataflow: Apache Beam

  • Snowflake: No requirements

Heap

  • Heap: Connect

  • Snowflake: No requirements

HVR

IBM InfoSphere DataStage

  • DataStage: InfoSphere Information Server 11.7.0

  • Snowflake: JDBC Driver — download from Maven

Informatica

Available in Partner Connect

  • Informatica Cloud:

    • Cloud Connector for Snowflake — available directly in the Informatica Cloud interface

    • Secure Agent — download and install from the Informatica Cloud interface

  • Snowflake:

Informatica

  • Informatica PowerCenter:

    • PowerCenter 10.2 (or higher)

    • PowerExchange for Snowflake

  • Snowflake:

Apache Kafka

Keboola

  • Keboola: No requirements

  • Snowflake: No requirements

Matillion ETL

Available in Partner Connect

  • Matillion Data Loader: No requirements

  • Snowflake: No requirements

Matillion ETL

Available in Partner Connect

  • Matillion ETL: No requirements

  • Snowflake: No requirements

Pentaho

  • Pentaho Data Integration (PDI):

    • Pentaho 8.3 (or higher): Snowflake plugin — download from the Pentaho Customer Portal (requires login)

    • Pentaho 8.2 (or lower): No Pentaho requirements, but some Snowflake requirements

  • Snowflake:

    • Pentaho 8.3 (or higher): No requirements

    • Pentaho 8.2 (or lower): . JDBC Driver — download from Maven . or . PentahoSnowflakePlugin (3rd-party connector) — download from GitHub

Qlik

Available in Partner Connect

Rivery

Available in Partner Connect

  • Rivery: No requirements

  • Snowflake: No requirements

SAP Data Services

Segment

  • Segment: No requirements

  • Snowflake: No requirements

SnapLogic

Available in Partner Connect

  • Snaplogic: 4.7.0 (or higher) with Snowflake Snap Pack

  • Snowflake: JDBC Driver — download from Maven

Snowplow

  • Snowplow: Snowflake Loader — download from GitHub

  • Snowflake: No requirements

Stitch

Available in Partner Connect

  • Stitch: No requirements

  • Snowflake: No requirements

StreamSets

  • StreamSets: No requirements

  • Snowflake: No requirements

Striim

Available in Partner Connect

  • Striim: No requirements

  • Snowflake: No requirements

Tableau

Talend

  • Talend:

    • Talend 6.4 (or higher): No requirements

    • Talend 6.3 (or lower): Snowflake component — contact Talend for details

  • Snowflake: No requirements

TMMData

  • TMMData: No requirements

  • Snowflake: No requirements

Trifacta

  • Trifacta: No requirements

  • Snowflake: No requirements

Workato

  • Workato: No requirements

  • Snowflake: No requirements

Wherescape

  • Wherescape: No requirements

  • Snowflake: No requirements