Install Snowpark Submit¶
You can install Snowpark Submit to run batch-oriented Spark workloads directly on Snowflake’s infrastructure.
To install Snowpark Submit, complete the following steps:
Install Snowpark Submit by using
pip.In a connections.toml file for Snowflake authentication, add a Snowflake connection. If you already have a Snowflake connection, you can use that connection.
If you don’t have a connections.toml file already, create one as described in Connecting using the connections.toml file.
Once you have a connections.toml file, you can add a Snowflake connection to it. For example, to add a Snowflake connection called
snowpark-submit, add the following lines to the configuration file:Verify that you can connect to Snowflake from your client computer.
To verify that the connection works from your client computer, create a
.pyfile with code that connects to Snowflake.Create a
connection_test.pyfile, and then add the following code:From your active Python virtual environment, run the following command, specifying the name of the connection that you added to your
connections.tomlfile.
Once you have verified that you can connect to Snowflake from your client computer, you can use Snowpark Submit to run batch-oriented Spark workloads directly on Snowflake’s infrastructure. See Snowpark Submit reference for the Snowpark Submit command-line reference or Snowpark Submit examples for examples of how to use Snowpark Submit.