Set up tasks for the Snowflake Connector for Kafka

This topic describes the overall tasks required to set up, configure, and run the Snowflake Connector for Kafka.

Prerequisites

Ensure the following prerequisites are met:

  1. Ensure that you have reviewed Snowflake Connector for Kafka.
  2. Ensure that you have reviewed how the connector works.
  3. You have configured Kafka with the desired data retention time and/or storage limit. See how the connector works for all supported properties.
  4. You have installed and configured the Kafka Connect cluster.
    Snowflake recommends using the same versions on Kafka Broker and Kafka Connect Runtime.
  5. You have configured the Kafka Connect cluster to run in the same cloud provider region as your Snowflake account.
    While not strictly required, running in the same region improves throughput and reduces cross-region data transfer costs.

Tasks

Perform the following tasks to set up, configure, and run the Snowflake Connector for Kafka.

OrderTaskDescription
0Review PrerequisitesReview and confirm all required prerequisites.
1Configure SnowflakeConfigure Snowflake for the Snowflake Connector for Kafka.
2Configure KafkaConfigure Kafka for the Snowflake Connector for Kafka.
3Test the connectorTest the connector with a small amount of data.