MergeSnowflakeJournalTable 2025.10.9.21

Bundle

com.snowflake.openflow.runtime | runtime-database-cdc-processors-nar

Description

Triggers a merge operation on changes from journal table to a destination table in Snowflake. The merge operation is performed asynchronously and the processor polls the result of the operation. If the query is still in progress the FlowFile will be penalized.

Tags

Input Requirement

REQUIRED

Supports Sensitive Dynamic Properties

false

Properties

PropertyDescription
Destination Database NameThe name of the Snowflake database where the data is being ingested to.
Merge Query Retry CountIndicates how many times the merge query should be retried if it fails.
Object Identifier ResolutionControls how source object identifiers (schemas, tables, columns) are stored and queried in Snowflake. This setting determines whether you will need to use double quotes in your SQL queries. The ‘Case-Sensitive’ option is the default, production behavior — ‘Case-Insensitive’ is considered preview for the time being.
Placeholder ValueThe value of the payload placeholder to look for in a MERGE. This will be converted to the destination column’s data type.
Snowflake Connection PoolThe Controller Service that is used to obtain a connection to the Snowflake database to perform merge operation.
Unchanged Value StrategyDetermines how the MERGE query should handle unchanged values in journal columns. By default it expects full values.

Relationships

NameDescription
ddlDDL to execute.
deleted during compactionFlowFile deleted during compaction based on table name and generation.
failureFailure query execution.
failure retryRetry failure query execution.
poll query resultScheduled async query execution.
successSuccess query execution.
unknown file typeUnknown file type.

Writes attributes

NameDescription
merge.query.idThe ID of the query that is used to merge the journal table into the target table.