Second generation Openflow objects and interfaces

Second-generation (gen 2) Openflow deployments, runtimes, and connectors are first-class Snowflake objects. You can use the Openflow UI or SQL commands to work with the same underlying objects.

Gen 1 and gen 2 resources can coexist in the same account:

  • New deployments are gen 2 only. You can no longer create new gen 1 deployments (BYOC or Snowflake). All new deployments must use CREATE OPENFLOW DEPLOYMENT.
  • Runtimes inherit the generation of their parent deployment. New runtimes on a gen 1 deployment are gen 1; new runtimes on a gen 2 deployment are gen 2.
  • Gen 2 runtimes support both gen 1 and gen 2 connectors. Both types can coexist on the same gen 2 runtime.
  • Gen 1 runtimes support gen 1 connectors only. Don’t install gen 2 connectors on a gen 1 runtime.
  • Existing gen 1 resources stay gen 1 and continue to work unchanged. Migration from gen 1 to gen 2 is available in Private Preview; contact your Snowflake account representative to be included.

Gen 2 introduces SQL-first lifecycle management, a revised security model, and connectors managed as File Based Entities (FBEs) with versioned configuration.

Start here

If you are new to gen 2 Openflow, read these topics in order:

  1. Openflow gen 1 and gen 2 — Understand gen 1 vs gen 2 for deployments, runtimes, and connectors, and which documentation set applies to each.
  2. About Openflow — Review Openflow concepts shared by gen 1 and gen 2 (deployment types, architecture, use cases).
  3. Quickstart: gen 2 Openflow — Set up privileges and create your first gen 2 deployment, runtime, and connector.
  4. Migrating from gen 1? Migration from gen 1 to gen 2 is available in Private Preview; contact your Snowflake account representative to be included.
  5. Configure a connector with the setup wizard — Install and configure a gen 2 connector with the setup wizard.
  6. Configure a gen 2 connector with SQL — Create and configure a gen 2 connector with SQL and stage commands.

Known limitations

For how gen 2 differs from gen 1 in supported operations and lifecycle, see Openflow gen 1 and gen 2.

Preview quotas

  • BYOC deployments: At most 20 per account (enforced by Openflow and Snowflake).
  • Snowflake deployments: At most three per account.
  • Runtimes: At most 100 per deployment. You can hit other limits before that maximum—for example, 50 EC2 nodes per node type on a BYOC deployment, or block storage quota on a Snowflake deployment when other applications consume storage.
  • A runtime can have at most 50 nodes. This applies to both generations (BYOC node groups and Snowflake deployment compute pools).

Diagnostics

  • Gen 2 runtime diagnostic bundles can be created from SQL or the Openflow UI. Snowflake deployment diagnostic bundles (not scoped to a single runtime) are also supported from SQL. For BYOC troubleshooting, you can also run ./diagnostics.sh on the deployment agent instance; see Troubleshoot Openflow.

Operations shared with gen 1

  • GRANT OWNERSHIP on gen 2 deployments, runtimes, or connectors can break underlying functionality today. Avoid ownership transfer until an upcoming update; see Transferring OWNERSHIP in Openflow gen 1 and gen 2.
  • For BYOC deployments, installation and upgrade documentation can only be downloaded from the UI; upgrades are not automatic. See Manage Openflow.

Setup wizard

Gen 2 documentation

TopicDescription
Openflow gen 1 and gen 2Compare gen 1 and gen 2 deployments, runtimes, and connectors; authorization and lifecycle differences; how to identify resources and which documentation to follow.
Quickstart: gen 2 OpenflowPrerequisites, privilege grants, and example commands to create gen 2 resources.
gen 2 connector configuration and versioningVersioned configuration for SQL, Git, and automation (optional background if you use the UI only). Stage access and Git workflow for reusing validated configs.
Configure a connector with the setup wizardStep-by-step setup wizard for gen 2 connectors.
Configure a gen 2 connector with SQLCreate and configure gen 2 connectors with SQL and stage commands (programmatic setup).
Manage the gen 2 Openflow connector lifecycleStart, stop, and remove gen 2 connectors after installation.
Monitor connectors using the Openflow Connectors DashboardMonitor gen 2 connector health, throughput, and ingestion status.
Migrate deployment and runtimes (Private Preview)Migrate an existing gen 1 deployment and all its runtimes to gen 2 objects. Covers prerequisites, the migration wizard, post-migration access grants, rollback constraints, and troubleshooting. Contact your Snowflake account representative for access.
Migrate connectors (Private Preview)Migrate individual gen 1 connectors to gen 2 connector instances. Covers prerequisites, Snowflake Secrets rewiring, the disabled source connector, and failure recovery. Contact your Snowflake account representative for access.

Gen 1 documentation

Gen 1 Openflow resources continue to use the public Openflow documentation. When you work with gen 1 deployments, runtimes, or catalog-installed connectors, follow these topics:

For source-specific setup (for example, preparing PostgreSQL for CDC), use the connector setup topic in the public docs for gen 1 and gen 2 connectors alike. Gen 2 connector topics link to those instructions where the source configuration is the same.