October 07-09, 2024 — 8.38 Release Notes (with behavior changes)¶

Attention

The release has completed.

For differences between the in-advance and final versions of these release notes, see Release notes change log.

Behavior change bundles¶

This release contains the following behavior change bundles:

Bundle Name	Status in this Release	Previous Status
2024_08	Disabled by default; admins can enable for testing	N/A (introduced in this release)
2024_07	Enabled by default; admins can disable for opt-out	Disabled by default
2024_06	Generally enabled; admins can no longer enable/disable	Enabled by default

The status for each bundle will change in the next behavior change release, planned for January 2025; however, this schedule is subject to change.

For more information about bundle statuses and how they may impact your accounts, see About Behavior Changes.

SQL updates¶

New SQL functions¶

The following function(s) are now available with this release:

Function category	New function	Description
Semi-structured	ARRAY_REVERSE	Returns an array with the elements of the input array in reverse order.

Query objects larger than 16 MB in files on a stage¶

With this release, you can now query objects up to 128 MB in files on a stage. Although you still can’t store objects larger than 16 MB in a column, you can reduce their size before storing them in columns. For example, you can split large objects across multiple columns or rows, transform nested JSON into a tabular format, or simplify complex geometries.

For more information, see Reducing the size of objects larger than 16 MB before loading.

Data governance updates¶

Data quality: New SYSTEM$DATA_METRIC_SCAN function¶

With this release, we are pleased to announce a new system function, SYSTEM$DATA_METRIC_SCAN, that returns records that failed a data quality check. Previously, you could use data metric functions to identify data quality issues but did not have the ability to pinpoint the records responsible for the problems.

With this new capability, you can use a single command to extract records that failed data quality checks. This simplifies the identification of problematic records in your data and makes it easier to remediate data quality issues.

For more information, see SYSTEM$DATA_METRIC_SCAN.

Release notes change log¶

Announcement	Update	Date
Release notes	Initial publication (preview)	04-Oct-24
Apache Iceberg™ tables: New SYSTEM$VERIFY_EXTERNAL_VOLUME function	Postponed to a later release.	08-Oct-2024
Data quality: New SYSTEM$DATA_METRIC_SCAN function	Added to Data governance updates section.	09-Oct-2024