FetchSourceTableSchema 2025.10.9.21

Bundle

com.snowflake.openflow.runtime | runtime-database-cdc-processors-nar

Description

Fetches the table schema (i.e., column names, data types, etc.) for a given table in a database, converting the data types to Snowflake-compatible types. The schema is written to the FlowFile content as a JSON object, in a form such as: { “columns”: [ { “name”: “<columnName>”, “type”: “<snowflakeType>”, “nullable”: <true|false>, “scale”: <scale>, “precision”: <precision> }, … ], “primaryKeys”: [“<primaryKey1>”, “<primaryKey2>”, …] }

Tags

Input Requirement

REQUIRED

Supports Sensitive Dynamic Properties

false

Properties

PropertyDescription
Column Filter ServiceSpecifies the Column Filter Service to be used for filtering out unwanted columns
Connection PoolThe connection pool to use to fetch the source table schema
Schema NameThe name of the schema that the source table is stored in
Table NameThe name of the source table

Relationships

NameDescription
failureFlowFiles are routed to this relationship in the event that the source table’s schema cannot be fetched
successFlowFiles are routed to this relationship when the source table’s schema is successfully fetched
table not foundFlowFiles are routed to this relationship when the source table does not exist

Writes attributes

NameDescription
mime.typeapplication/json
dbms.typeThe type of database management system (DBMS) that the source table is stored in. E.g. POSTGRESQL
primary.key.countThe number of primary keys in the source table
column.countThe number of columns in the source table