Snowpark Connect for Spark reference

This section provides reference documentation for Snowpark Connect for Spark, covering configuration, API compatibility, and client library details.

  • Parameters lists Spark and custom configuration properties that control session behavior, file I/O, and UDF execution.

  • DataFrame support details which Spark DataFrame API methods are supported, partially supported, or unsupported.

  • Dataset support covers the typed Dataset API for Java and Scala applications.

  • Snowpark Connect (Python) documents the Python snowpark-connect package.

  • Java/Scala client documents the com.snowflake:snowpark-connect-java-client library.

  • Snowpark Submit covers the CLI flags, configuration options, and output formats.