Data Integration¶
Commonly referred to as ETL, data integration encompasses the following three primary operations:
- Extract:
Exporting data from specified data sources.
- Transform:
Modifying the source data (as needed), using rules, merges, lookup tables or other conversion methods, to match the target.
- Load:
Importing the resulting transformed data into a target database.
The more recent usage of the term is ELT, emphasizing that the transformation operation does not necessarily need to be performed before loading, particularly in systems such as Snowflake that support transformation during or after loading.
In addition, the scope of data integration has expanded to include a wider range of operations, including:
Data preparation.
Data migration, movement, and management.
Data warehouse automation.
The following data integration tools and technologies are known to provide native connectivity to Snowflake:
Solution |
Version / Installation Requirements |
Notes |
|
---|---|---|---|
Ab Initio: No requirements — contact Ab Initio for more details Snowflake: ODBC Driver — download from the ODBC Download page |
|||
Agile Data Engine: No requirements Snowflake: No requirements |
|||
Airbyte: No requirements Snowflake: No requirements |
|
||
Alteryx Designer Cloud: No requirements Snowflake: No requirements |
|
||
Amazon Data Firehose: No requirements Snowflake: No requirements |
Additional resources: |
||
AWS Glue: No requirements Snowflake: No requirements |
Additional resources: |
||
Artie: No requirements Snowflake: No requirements |
|
||
Ascend.io: No requirements Snowflake: No requirements |
|
||
Azure Data Factory: No requirements Snowflake: No requirements |
|
||
Boomi: DCP 4.2 (or higher) or Integration July 2020 (or higher) Snowflake: No requirements |
|
||
CData Software: The latest version of the driver/connector/application is always recommended, but legacy versions will continue to work if they are licensed. Note that any changes to Snowflake since the release of a driver may not be available in the driver depending on how the changes are implemented. Snowflake: No requirements |
|
||
Celigo: No requirements Snowflake: No requirements |
|
||
Census: No requirements Snowflake: No requirements |
|
||
Coalesce: No requirements Snowflake: No requirements |
|
||
Datameer: v7 Snowflake: No requirements |
|
||
DataVirtuality: No requirements Snowflake: No requirements |
|
||
dbt: v0.13 (or higher) Snowflake: No requirements |
|
||
Denodo: Denodo Platform 6.0 (or higher) Snowflake: No requirements |
|
||
Devart ODBC Driver for Snowflake: No requirements Snowflake: No requirements |
|
||
Devart Python Connector for Snowflake: No requirements Snowflake: No requirements |
|
||
Devart SSIS Data Flow Components for Snowflake: No requirements Snowflake: No requirements |
|
||
Diyotta: No requirements Snowflake: No requirements |
|
||
dlt: No requirements Snowflake: No requirements |
|
||
Etleap: No requirements Snowflake: No requirements |
|
||
Etlworks: No requirements Snowflake: No requirements |
|
||
Fivetran: No requirements Snowflake: No requirements |
|
||
Google Cloud Data Fusion: Snowflake plugin Snowflake: No requirements |
|
||
Google Cloud Dataflow: Apache Beam Snowflake: No requirements |
|
||
Heap: Connect Snowflake: No requirements |
|
||
Hevo Data CDC for ETL: No requirements Snowflake: No requirements |
|
||
Hightouch: No requirements Snowflake: No requirements |
|
||
HVR: No requirements Snowflake: ODBC Driver — download from the ODBC Download page |
|
||
DataStage: InfoSphere Information Server 11.7 Snowflake: JDBC Driver — download from the JDBC Driver page in the Maven Central Repository |
|
||
Informatica Cloud:
Snowflake:
|
|
||
Informatica Data Loader: No requirements Snowflake: No requirements |
|
||
Informatica PowerCenter:
Snowflake:
|
|
||
Apache Kafka: No requirements Kafka Connect: API 2.0.0 to 2.2.0 (all other versions are not supported) Snowflake: Snowflake Connector for Kafka — download from Maven |
|
||
Keboola: No requirements Snowflake: No requirements |
|
||
Knoema: No requirements Snowflake: No requirements |
|
||
Matillion Data Productivity Cloud: No requirements Snowflake: No requirements |
|
||
Matillion ETL: No requirements Snowflake: No requirements |
|
||
Nexla: No requirements Snowflake: No requirements (ODBC, JDBC, and API options) |
|
||
Pentaho Data Integration (PDI):
Snowflake:
|
|
||
Precog: No requirements Snowflake: No requirements |
|
||
Qlik Replicate: No requirements Snowflake: ODBC Driver — download from the ODBC Download page |
|
||
Redpoint:
Snowflake:
|
|
||
Rivery: No requirements Snowflake: No requirements |
|
||
SAP Data Services: 4.2 SP12 (or higher) Snowflake: ODBC Driver — download from the ODBC Download page |
|
||
Segment: No requirements Snowflake: No requirements |
|
||
Skyvia: No requirements Snowflake: No requirements |
|
||
Solace: No requirements Snowflake: No requirements |
|
||
Snaplogic: 4.7.0 (or higher) with Snowflake Snap Pack Snowflake: JDBC Driver — download from the JDBC Driver page in the Maven Central Repository |
|
||
Snowplow: Snowflake Loader — download from GitHub Snowflake: No requirements |
|
||
Stitch: No requirements Snowflake: No requirements |
|
||
StreamSets: No requirements Snowflake: No requirements |
|
||
Striim: No requirements Snowflake: No requirements |
|
||
Supermetrics: No requirements Snowflake: No requirements |
|
||
Tableau: Prep 2018.3 (or higher) Snowflake: ODBC Driver — download from the ODBC Download page |
|
||
Talend:
Snowflake: No requirements |
|
||
TIBCO ActiveMatrix BusinessWorks:
Snowflake: JDBC Driver — download from the JDBC Driver page in the Maven Central Repository |
|
||
TMMData: No requirements Snowflake: No requirements |
|||
Trifacta: No requirements Snowflake: No requirements |
|
||
Wherescape: No requirements Snowflake: No requirements |
|
||
Workato: No requirements Snowflake: No requirements |
|