Snowpark Library for Python release notes for 2025¶

New features¶

• Added support for the restricted caller permission of execute_as argument in StoredProcedure.register():code:.

• Added support for non-select statements in DataFrame.to_pandas().

• Added support for the artifact_repository parameter to Session.add_packages, Session.add_requirements, Session.get_packages, Session.remove_package, and Session.clear_packages.

• Added support for reading an XML file using a row tag by session.read.option('rowTag', <tag_name>).xml(<stage_file_path>) (experimental).

  • Each XML record is extracted as a separate row.

  • Each field within that record becomes a separate column of type VARIANT, which can be further queried using the dot notation, such as col(a.b.c).

• Added updates to DataFrameReader.dbapi (PrPr):

  • Added the fetch_merge_count parameter for optimizing performance by merging multiple fetched data into a single Parquet file.

  • Added support for Databricks.

  • Added support for ingestion with Snowflake UDTF.

• Added support for the following AI-powered functions in functions.py (Private Preview):

  • prompt

  • ai_filter (added support for prompt() function and image files, and changed the second argument name from expr to file)

  • ai_classify

Snowpark local testing updates¶

Snowpark pandas API updates¶

New features¶

• Added Support for relaxed consistency and ordering guarantees in Dataframe.to_snowpark_pandas by introducing the relaxed_ordering parameter.

• DataFrameReader.dbapi (preview) now accepts a list of strings for the session_init_statement parameter, allowing multiple SQL statements to be executed during session initialization.

Improvements¶

• Improved query generation for Dataframe.stat.sample_by to generate a single flat query that scales well with large fractions dictionary compared to older method of creating a UNION ALL subquery for each key in fractions. To enable this feature, set session.conf.set("use_simplified_query_generation", True).

• Improved the performance of DataFrameReader.dbapi by enabling the vectorized option when copying a parquet file into a table.

• Improved query generation for DataFrame.random_split in the following ways. They can be enabled by setting session.conf.set("use_simplified_query_generation", True):

  • Removed the need to cache_result in the internal implementation of the input dataframe resulting in a pure lazy dataframe operation.

  • The seed argument now behaves as expected with repeatable results across multiple calls and sessions.

• DataFrame.fillna and DataFrame.replace now both support fitting int and float into Decimal columns if include_decimal is set to True.

• Added documentation for the following UDF and stored procedure functions in files.py as a result of their General Availability.

  • SnowflakeFile.write

  • SnowflakeFile.writelines

  • SnowflakeFile.writeable

• Minor documentation changes for SnowflakeFile and SnowflakeFile.open().

Bug fixes¶

• Fixed a bug for the following functions that raised errors. .cast() is applied to their output:

  • from_json

  • size

Snowpark local testing updates¶

Snowpark pandas API updates¶

Snowpark local testing updates¶

Bug fixes¶

• Fixed a bug in DataFrameReader.dbapi (private preview) that prevents usage in stored procedures and Snowbooks.

New features¶

• Added support for the following AI-powered functions in functions.py (Private Preview):

  • ai_filter

  • ai_agg

  • summarize_agg

• Added support for the new FILE SQL type, with the following related functions in functions.py (Private Preview):

  • fl_get_content_type

  • fl_get_etag

  • fl_get_file_type

  • fl_get_last_modified

  • fl_get_relative_path

  • fl_get_scoped_file_url

  • fl_get_size

  • fl_get_stage

  • fl_get_stage_file_url

  • fl_is_audio

  • fl_is_compressed

  • fl_is_document

  • fl_is_image

  • fl_is_video

• Added support for importing third-party packages from PyPi using Artifact Repository (Private Preview):

  • Use keyword arguments artifact_repository and artifact_repository_packages to specify your artifact repository and packages respectively when registering stored procedures or user defined functions.

  • Supported APIs are:

    • Session.sproc.register

    • Session.udf.register

    • Session.udaf.register

    • Session.udtf.register

    • functions.sproc

    • functions.udf

    • functions.udaf

    • functions.udtf

    • functions.pandas_udf

    • functions.pandas_udtf

Improvements¶

• Improved version validation warnings for snowflake-snowpark-python package compatibility when registering stored procedures. Now, warnings are only triggered if the major or minor version does not match, while bugfix version differences no longer generate warnings.

• Bumped cloudpickle dependency to also support cloudpickle==3.0.0 in addition to previous versions.

Bug fixes¶

• Fixed a bug where creating a Dataframe with large number of values raised Unsupported feature 'SCOPED_TEMPORARY'. error if thread-safe session was disabled.

• Fixed a bug where df.describe raised internal SQL execution error when the DataFrame is created from reading a stage file and CTE optimization is enabled.

• Fixed a bug where df.order_by(A).select(B).distinct() would generate invalid SQL when simplified query generation was enabled using session.conf.set("use_simplified_query_generation", True).

  • Disabled simplified query generation by default.

Snowpark pandas API updates¶

Snowpark local testing updates¶

New features¶

• Added support for the following functions in functions.py

  • normal

  • randn

• Added support for allow_missing_columns parameter to Dataframe.union_by_name and Dataframe.union_all_by_name.

Improvements¶

• Improved random object name generation to avoid collisions.

• Improved query generation for Dataframe.distinct to generate SELECT DISTINCT instead of SELECT with GROUP BY all columns. To disable this feature, set session.conf.set("use_simplified_query_generation", False).

Deprecations¶

• Deprecated Snowpark Python function snowflake_cortex_summarize. Users can install snowflake-ml-python and use the snowflake.cortex.summarize function instead.

• Deprecated Snowpark Python function snowflake_cortex_sentiment. Users can install snowflake-ml-python and use the snowflake.cortex.sentiment function instead.

Bug fixes¶

• Fixed a bug where session-level query tag was overwritten by a stack trace for DataFrames that generate multiple queries. Now, the query tag will only be set to the stacktrace if session.conf.set("collect_stacktrace_in_query_tag", True).

• Fixed a bug in Session._write_pandas where it was erroneously passing use_logical_type parameter to Session._write_modin_pandas_helper when writing a Snowpark pandas object.

• Fixed a bug in options SQL generation that could cause multiple values to be formatted incorrectly.

• Fixed a bug in Session.catalog where empty strings for database or schema were not handled correctly and were generating erroneous SQL statements.

Experimental Features¶

• Added support for writing pyarrow Tables to Snowflake tables.

Snowpark pandas API updates¶

Bug fixes¶

• Fixed a bug in apply where kwargs were not being correctly passed into the applied function.

Snowpark local testing updates¶

Bug fixes¶

• Fixed a bug in DataFrame.join that caused columns to have incorrect typing.

• Fixed a bug in when statements that caused incorrect results in the otherwise clause.

New features¶

Added support for the following functions in functions.py:

• array_reverse

• divnull

• map_cat

• map_contains_key

• map_keys

• nullifzero

• snowflake_cortex_sentiment

• acosh

• asinh

• atanh

• bit_length

• bitmap_bit_position

• bitmap_bucket_number

• bitmap_construct_agg

• cbrt

• equal_null

• from_json

• ifnull

• localtimestamp

• max_by

• min_by

• nth_value

• nvl

• octet_length

• position

• regr_avgx

• regr_avgy

• regr_count

• regr_intercept

• regr_r2

• regr_slope

• regr_sxx

• regr_sxy

• regr_syy

• try_to_binary

• base64

• base64_decode_string

• base64_encode

• editdistance

• hex

• hex_encode

• instr

• log1p

• log2

• log10

• percentile_approx

• unbase64

• Added support for specifying a schema string (including implicit struct syntax) when calling DataFrame.create_dataframe.

• Added support for DataFrameWriter.insert_into/insertInto. This method also supports local testing mode.

• Added support for DataFrame.create_temp_view to create a temporary view. It will fail if the view already exists.

• Added support for multiple columns in the functions map_cat and map_concat.

• Added an option keep_column_order for keeping original column order in DataFrame.with_column and DataFrame.with_columns.

• Added options to column casts that allow renaming or adding fields in StructType columns.

• Added support for contains_null parameter to ArrayType.

• Added support for creating a temporary view via DataFrame.create_or_replace_temp_view from a DataFrame created by reading a file from a stage.

• Added support for value_contains_null parameter to MapType.

• Added interactive to telemetry that indicates whether the current environment is an interactive one.

• Allow session.file.get in a Native App to read file paths starting with / from the current version

• Added support for multiple aggregation functions after DataFrame.pivot.

Experimental features¶

• Added Session.catalog class to manage Snowflake objects. It can be accessed via Session.catalog.

  • snowflake.core is a dependency required for this feature.

• Allow user input schema or user input schemas when reading JSON file on stage.

• Added support for specifying a schema string (including implicit struct syntax) when calling DataFrame.create_dataframe.

Improvements¶

• Updated README.md to include instructions on how to verify package signatures using cosign.

Bug fixes¶

• Fixed a bug in local testing mode that caused a column to contain None when it should contain 0.

• Fixed a bug in StructField.from_json that prevented TimestampTypes with tzinfo from being parsed correctly.

• Fixed a bug in function date_format that caused an error when the input column was date type or timestamp type.

• Fixed a bug in DataFrame that allowed null values to be inserted in a non-nullable column.

• Fixed a bug in functions replace and lit which raised type hint assertion error when passing Column expression objects.

• Fixed a bug in pandas_udf and pandas_udtf where session parameters were erroneously ignored.

• Fixed a bug that raised an incorrect type conversion error for system function called through session.call.

Snowpark pandas API updates¶