Set up Openflow - Snowflake Deployment: Create runtime

A runtime is a containerized Apache NiFi instance that executes your data integration flows – connectors and custom flow definitions. Each runtime is isolated for security and resource control, and can scale from one node up to fifty to handle varying data volumes.

To create a runtime in your Snowflake deployment:

  1. Sign in to Snowsight.

  2. In the navigation menu, select Ingestion » Openflow.

  3. Select Launch Openflow. A new tab opens for the Openflow canvas.

  4. In Openflow Control Plane, select Create a runtime. The Create Runtime dialog box appears.

  5. In the Create Runtime populate the following fields:

    Field

    Description

    Runtime Name

    Enter a name for your runtime.

    Deployment drop down

    Choose the deployment previously created in Set up Openflow - Snowflake Deployment: Create deployment

    Node Type

    Choose a node type from the Node type drop-down list. This specifies the size of your nodes.

    Min/Max node

    In the Min/Max node range selector, select a range. The minimum value specifies the number of nodes that the runtime starts with when idle and the maximum value specifies the number of nodes that the runtime can scale up to, in the event of high data volume or CPU load.

    Snowflake Role

    Choose the Snowflake role previously created in Set up Openflow - Snowflake Deployment: Create Snowflake role.

    Usage Roles

    Optionally, select the roles created to grant usage to the runtime for required databases, schema, and table access.

    External Access Integrations

    Optionally, select the previously created external access integrations to grant access to external resources.

  6. Select Create. The runtime takes a couple of minutes to be created.

Once created, view your runtime by navigating to the Runtimes tab of the Openflow control plane. Select the runtime to open the Openflow canvas.

[Optional] Grant MONITOR privileges on the runtime

If you created a monitoring role when setting up your deployment, you can add the runtime to that role. This allows data engineers or operations teams to monitor the runtime without having the OPENFLOW_ADMIN role.

  • To add the runtime to the monitoring role, run the following code, replacing <OPENFLOW_RUNTIME_NAME> with the name of the Openflow runtime integration:

    USE ROLE OPENFLOW_ADMIN;

GRANT MONITOR ON OPENFLOW RUNTIME INTEGRATION <OPENFLOW_RUNTIME_NAME> TO ROLE <OPENFLOW_MONITOR_ROLE>;
    Copy

Next step

Configure allowed domains for Openflow connectors. See Set up Openflow - Snowflake Deployment: Configure allowed domains for Openflow connectors.