Replication: Stages, pipes, storage integrations, and load history (Pending)

Attention

This behavior change is in the 2024_02 bundle.

For the current status of the bundle, refer to Bundle History.

Note

This behavior change was part of the 2024_01 bundle, however it has been moved to the 2024_02 bundle.

Snowflake accounts can be replicated across regions and cloud platforms. Supported database objects are replicated to target accounts when a database is replicated.

The replication of internal and external stage objects, pipe objects, storage integrations, and table load history is available in preview. This change makes replication of stages, pipes, storage integrations, and load history generally available when this BCR bundle becomes enabled by default.

Before the change:

Primary stage objects, pipe objects, storage integrations, and table load history are not replicated to target accounts (unless you have enabled the preview feature). Any existing stages, pipes, and storage integrations in a target account are not modified during a refresh operation.

After the change:

Primary stage objects, pipe objects, and table load history are replicated to target accounts when the database that contains them is replicated in a replication or failover group. Primary storage integrations are replicated to target accounts if they are included in the replication or failover group. To replicate storage integrations, the object_types parameter must include INTEGRATIONS and the allowed_integrations parameter must include STORAGE INTEGRATIONS for the group.

If a target account has secondary databases with manually created internal or external stages, or pipes, these objects are dropped when the replication or failover group is refreshed after this feature is enabled. If the primary replication or failover group includes storage integrations, these objects are dropped in the target account.

If the primary database has an internal stage with directory table enabled, the files on the stage are also replicated. If there are files on the stage that are larger than 5GB, the refresh operation for the replication or failover group fails. To work around this limitation, move any files larger than 5GB to another stage. For more information, see Considerations.

Stage, pipe, and load history replication is supported for databases that are replicated in replication or failover groups. This feature is not supported for database replication.

For more information, see Stage, pipe, and load history replication.

As part of pipe object replication, two new execution states, FAILING_OVER and READ_ONLY are added to SYSTEM$PIPE_STATUS and is generally enabled, not configurable by this BCR bundle.

Ref: 1461