October 07-09, 2024 — 8.38 Release Notes (with behavior changes)¶

New SQL functions¶

The following function(s) are now available with this release:

Query objects larger than 16 MB in files on a stage¶

With this release, you can now query objects up to 128 MB in files on a stage. Although you still can’t store objects larger than 16 MB in a column, you can reduce their size before storing them in columns. For example, you can split large objects across multiple columns or rows, transform nested JSON into a tabular format, or simplify complex geometries.

For more information, see Reducing the size of objects larger than 16 MB before loading.

Data quality: New SYSTEM$DATA_METRIC_SCAN function¶

With this release, we are pleased to announce a new system function, SYSTEM$DATA_METRIC_SCAN, that returns records that failed a data quality check. Previously, you could use data metric functions to identify data quality issues but did not have the ability to pinpoint the records responsible for the problems.

With this new capability, you can use a single command to extract records that failed data quality checks. This simplifies the identification of problematic records in your data and makes it easier to remediate data quality issues.

For more information, see SYSTEM$DATA_METRIC_SCAN.