Automated directory table metadata refreshes

You can automatically refresh the metadata for a directory table by using the following event notification services:

The refresh operation synchronizes the metadata with the latest set of associated files in storage, and occurs in response to the following types of changes:

  • New files in the path are added to the table metadata.

  • Files in the path are updated in the table metadata.

  • Files no longer in the path are removed from the table metadata.

To set up automated refreshes, see the topic for the cloud storage service where your files are located:

Cross-cloud support

The following table indicates which cloud storage services Snowflake supports for automated directory table refreshes, based on the cloud platform that hosts your Snowflake account. Cross-cloud support is currently available to accounts hosted on Amazon Web Services only.

Snowflake Account Host

Amazon S3

Google Cloud Storage

Microsoft Azure Blob storage

Microsoft Data Lake Storage Gen2

Microsoft Azure General-purpose v2

Amazon Web Services

✔

✔

✔

✔

✔

Google Cloud Platform

❌

✔

❌

❌

❌

Microsoft Azure

❌

❌

✔

✔

✔

Considerations

  • Automated refreshes are event-based and provide better performance that manual refreshes for large or fast-growing stages.

  • Snowflake doesn’t support refreshing the directory table metadata on an internal stage. You must manually refresh the directory table metadata for an internal stage. For instructions, see Manual refresh.

Next Topics:

Language: English