Horizon Catalog connectors¶
Horizon Catalog provides connectors for collecting metadata, lineage, and popularity data from external data sources and BI tools.
We recommend that you manage metadata access separately from your data access roles. See Metadata access control for more information.
For information about encryption, network security, credentials management, and the shared-responsibility model, see Security and data protection.
Cost and refresh schedule¶
There’s no charge for adding connectors, for ingesting metadata from connected sources, or for storing the metadata, lineage, and popularity data that connectors collect.
Refresh schedule¶
Horizon Catalog refreshes the metadata from each connected source every 24 hours.
Costs that still apply¶
- Your warehouse: Snowsight uses your active warehouse for some steps, such as checking your privileges when you create a connection. These queries consume credits at standard warehouse rates.
- The external source: Connectors run metadata and lineage queries against the source system, for example on a Databricks SQL warehouse. The provider of that system bills for any compute that these queries use.
BI connectors¶
Source data connectors¶
Data pipeline tools¶
Query collected metadata with Account Usage views¶
The objects that connectors collect from external systems are available as rows in views in the ACCOUNT_USAGE schema of the shared SNOWFLAKE database. Use these views to inventory your external objects, track changes, and find objects that were removed from the source system.
- The EXTERNAL_DWH_OBJECTS view contains objects collected from databases, data warehouses, and data pipeline tools, including databases, schemas, tables, views, and dbt models, seeds, and sources.
- The EXTERNAL_BI_OBJECTS view contains objects collected from BI tools, including folders, projects, datasets, dashboards, and charts.
Each row is one collected object. Both leaf objects and the containers that hold them are rows, and the OBJECT_TYPE column tells
them apart. The PARENT_REFERENCE_ID column points to the REFERENCE_ID of an object’s parent in the same view, so you can walk the
hierarchy without relying on names. The CONNECTOR and CONNECTOR_TYPE columns identify which connector collected each object.
For example, to list the current tables and views that a connector collected, largest first:
To list the dashboards that changed in the last 7 days, together with their parent folders:
For the full list of columns, see the reference pages for each view.