Apache Iceberg™ tables: Updates to metadata retention period¶
Attention
This behavior change is in the 2024_02 bundle.
For the current status of the bundle, refer to Bundle History.
Snowflake determines the metadata retention period for Apache Iceberg™ tables that use a catalog integration as follows:
- Before the change:
Snowflake retrieves the value of
history.expire.max-snapshot-age-ms
from the current metadata file, converts the value to days (rounding down), and stores it in the DATA_RETENTION_TIME_IN_DAYS parameter.If Snowflake doesn’t find
history.expire.max-snapshot-age-ms
in the metadata file, or can’t parse the value, it sets DATA_RETENTION_TIME_IN_DAYS at the table level to a default value of 5 days (the default Apache Iceberg value).You can also change the value of DATA_RETENTION_TIME_IN_DAYS manually.
- After the change:
Snowflake sets DATA_RETENTION_TIME_IN_DAYS at the table level to whichever of the following values is smaller:
history.expire.max-snapshot-age-ms
The following value, depending on your Snowflake account edition:
Standard Edition: 1 day.
Enterprise Edition or higher: 5 days.
You can’t change the value of DATA_RETENTION_TIME_IN_DAYS manually. Instead, you must update
history.expire.max-snapshot-age-ms
and refresh the table.
Ref: 1519