Viewing Snowpipe in Snowsight¶

In Snowsight, you can view the detailed status and copy history for Snowpipe. You don’t need to write and run any specific queries to check if any of your pipes are failing, stalled, or stopped loading new data from files anymore.

With this feature, you can visualize the stages, pipes, and tables in a graph and understand the relationships and data lineage between these objects. You can also view the complete information for any of your pipes about what was loaded (or partially loaded) and also about what failed.

Note

To view details about the pipe, you must use a role with the MONITOR or OWNERSHIP privilege on the pipe and the USAGE privilege on both the database and schema that contain the pipe. For more information, see Pipe privileges.

Viewing pipe details in Snowsight¶

To view pipe details in Snowsight, take the following steps:

  1. Sign in to Snowsight.

  2. In the navigation menu, select Data » Databases.

  3. Locate the database and schema that contain the pipe.

  4. Select the pipe to open the details.

As the following image demonstrates, on the Pipe Details page, you can see the execution status and the configured notification integration for the pipe you are viewing. You can also visualize the relationships between the stages, pipes, and tables in a graph.

Viewing copy history for your pipes in Snowsight¶

To view the copy history for any of your pipes, select the Copy History tab on the top of the Pipe Details page.

As the following image demonstrates, on the COPY HISTORY page, you can see the detailed copy history of the pipe, including STATUS, DURATION, ROWS, SIZE, and FILE NAME.

The histogram displays up to 14 days of loading history and allows you to select from the following dimensions:

  • Copies (default): the number of files loaded. Displays file counts grouped by status on a daily or hourly basis, helping to identify failed loads and monitor ingestion trends over time.

  • Rows: the number of rows inserted. Aggregates row counts by day or hour, providing insights into data throughput trends.

  • Duration: pipe ingestion duration. Shows the time taken for pipe ingestion (aggregated by day or hour), which represents the serverless compute time of your pipe and serves as a proxy for compute cost.

The pipe metrics section helps analyze health and throughput of your pipe with the following key metrics:

  • Success rate: Percentage of files successfully loaded within the selected time range.

  • Max ingestion gap: Highlights large gaps between ingestion cycles, making it easier to identify interruptions in continuous ingestion.

  • Time since last ingestion: indicates the time elapsed since the most recent file was loaded.

  • Min row count: identifies files with fewer rows than expected or empty files.

  • Pending files: shows the number of detected files yet to be loaded into the table.

You can also choose to manually load files that haven’t been loaded by selecting the Manual Refresh option on the ellipsis dropdown menu on the top right corner of the page.

Language: English