FetchDatabaseMetadata 2025.10.2.19¶

Bundle¶

com.snowflake.openflow.runtime | runtime-horizon-catalog-processors-nar

Description¶

Fetches complete database metadata for all tables and outputs them to a FlowFile. The output is a JSON array containing database information and schema details for all tables, including column names, data types, and metadata. The schema fetching supports PostgreSQL, MySQL, and SQL Server. For SQL Server, this processor can retrieve metadata from ALL accessible databases when connected with appropriate permissions. For PostgreSQL and MySQL, it retrieves metadata from the connected database. Output format (array of database objects): [ { “source”: “<database_type>”, “database_name”: “<database_name>”, “schemas”: [ { “name”: “<schema_name>”, “entities”: [ { “name”: “<table_name>”, “type”: “table”, “comment”: “<table_comment>”, “total_rows”: <number_of_rows>, “columns”: [ { “name”: “<column_name>”, “comment”: “<column_comment>”, “data_type”: “<data_type>” } ], “created_on”: <epoch_millis>, “updated_on”: <epoch_millis> } ] } ] } ] Note: For SQL Server connections, if the connection has access to multiple databases, the array will contain multiple database objects. For PostgreSQL and MySQL, the array will contain a single database object. Table and column comments, created_on, updated_on timestamps, and total_rows are included when available from the database metadata, but may be omitted if not supported by the database system. Timestamps are represented as epoch milliseconds, or -1 if not available. Total rows represents an approximate/estimated value from database statistics (not an exact count) and is set to -1 if it cannot be determined due to permissions or other database-specific limitations.

Tags¶

database, metadata, schema, table

Input Requirement¶

REQUIRED

Supports Sensitive Dynamic Properties¶

false

Properties¶

Relationships¶

Writes attributes¶