PutSnowpipeStreaming2 2025.10.2.19¶
Bundle¶
com.snowflake.openflow.runtime | runtime-snowpipe-streaming-2-processors-nar
Description¶
Send Records formatted as Newline Delimited JSON to Snowflake Database Pipes using Snowpipe Streaming Version 2.
Input Requirement¶
REQUIRED
Supports Sensitive Dynamic Properties¶
false
Properties¶
Property |
Description |
|---|---|
Account |
Snowflake Account Identifier with Organization Name and Account Name formatted as [organization-name]-[account-name] |
Authentication Strategy |
Strategy for authenticating Snowflake connections |
Channel Group |
Group for managing distinct Snowpipe Streaming Channels with partitioning |
Channel Insert Timeout |
Maximum duration to retry inserting records before failing with an upper bound of 5 minutes |
Database |
Snowflake Database destination for processed records |
File Fragment Count |
Maximum number of File Fragments sent to object storage for Snowpipe Streaming ingestion from input FlowFiles.Must be between 1 and 100. |
File Fragment Size |
Maximum size in bytes for each File Fragment sent to object storage for Snowpipe Streaming ingestion.Must be between 1 KB and 256 MB |
Offset Token End Expression |
Expression Language definition to produce the highest offset token for a FlowFile as a monotonically increasing number |
Offset Token Record Pointer |
JSON Pointer to offset token in each record required when the last committed offset token is between start and end boundaries |
Offset Token Start Expression |
Expression Language definition to produce the lowest offset token for a FlowFile as a monotonically increasing number |
Offset Tracking Timeout |
Maximum duration to poll channel status for committed offset tokens |
Pipe |
Snowflake Pipe destination for processed records |
Private Key Service |
RSA Private Key Service for authenticating connections |
Schema |
Snowflake Schema destination for processed records |
Transfer Strategy |
Strategy for transferring records to Snowpipe Streaming |
User |
Snowflake User for authenticating connections |
Web Client Service Provider |
Web Client Service Provider supporting HTTP request and response handling |
Relationships¶
Name |
Description |
|---|---|
failure |
FlowFiles that failed to upload to Snowflake |
invalid |
FlowFiles that Snowflake identified as containing one or more invalid rows resulting in partial transmission |
success |
FlowFiles successfully uploaded to Snowflake |