Snowpark-optimized Warehouses

This topic explains how to create and use Snowpark-optimized warehouses which provide 16x memory per node compared to a standard Snowflake virtual warehouse.

In this Topic:

Introduction

When to Use a Snowpark-optimized Warehouse

Snowpark workloads can be run on both Standard and Snowpark-optimized warehouses. Snowpark-optimized warehouses are recommended for workloads that have large memory requirements such as ML training use cases using a stored procedure on a single virtual warehouse node. Additionally, Snowpark workloads, utilizing UDF or UDTF, may also benefit from Snowpark-optimized warehouses.

Creating a Snowpark-optimized Warehouse

This preview introduces a new warehouse_type property to the CREATE WAREHOUSE command.

Create a new Snowpark-optimized warehouse snowpark_opt_wh:

CREATE OR REPLACE WAREHOUSE snowpark_opt_wh WITH
  WAREHOUSE_SIZE = 'MEDIUM'
  WAREHOUSE_TYPE = 'SNOWPARK-OPTIMIZED';

Tip

To maximize CPU and memory resources when running Snowpark UDFs or stored procedures, set the MAX_CONCURRENCY_LEVEL parameter for your warehouse when using the CREATE WAREHOUSE or ALTER WAREHOUSE command. For example:

alter warehouse snowpark_opt_wh set max_concurrency_level = 1;

To verify the compute resources for your warehouse have been fully provisioned, use SHOW WAREHOUSES to check its state.

Modifying Snowpark-optimized Warehouse Properties

The ALTER WAREHOUSE command can be used to modify warehouse properties, including the warehouse type.

Note

Changing the warehouse type using the ALTER WAREHOUSE command is only supported for a warehouse in the SUSPENDED state. To suspend a warehouse before changing the warehouse_type property, execute the following statement:

ALTER WAREHOUSE snowpark_opt_wh SUSPEND;

Using Snowpark Python Stored Procedures to Run ML Training Workloads

For information on Machine Learning Models and Snowpark Python, see Training Machine Learning Models with Snowpark Python.

Billing for Snowpark-optimized Warehouses

The following table shows the Snowflake credits charged per hour for a Snowpark-optimized virtual warehouse by warehouse size. For more details on virtual warehouse credit usage, see Virtual Warehouse Credit Usage.

X-Small

Small

Medium

Large

X-Large

2X-Large

3X-Large

4X-Large

5X-Large

6X-Large

Credits/hour

n/a

n/a

6

12

24

48

96

192

384

768

Region availability

Snowpark-optimized warehouses are available in the following regions:

AWS

  • us-east-1

  • us-west-2

  • eu-west-1

  • eu-central-1

  • ap-south-1

  • ap-northeast-1

  • ap-southeast-1

  • ap-southeast-2

  • us-east-2

Azure

  • eastus2

  • westus

  • westeurope

  • australiaeast

  • japaneast

Google Cloud:

  • us-central-1

Known Limitations

  • Initial creation and resumption of a Snowpark-optimized virtual warehouse may take longer than standard warehouses.

  • Certain Scikit-learn algorithms may not use all of the resources available in a Snowpark-optimized warehouses.

  • Snowpark-optimized warehouses do not support Query Acceleration.

  • Snowpark-optimized warehouses are not supported on XSMall or SMALL warehouse sizes.

Back to top