Snowflake Connector for ServiceNow® V2 release notes¶

Behavior changes¶

Not applicable

New features¶

• The DELETE_TABLE procedure now accepts an optional drop_related_objects boolean parameter. When this parameter is set to true, the procedure drops all the objects related to the table, such as the flattened views, the event log table, and the sink table.

• The filtered reload feature now supports detection of deletes and can filter out these records when using the sys_ids parameter in the RELOAD_TABLE procedure. Prior to this release, the filtered reload feature only detected data updates and insertion.

Bug fixes¶

• Corrected error in CONNECTOR_STATS view ingested row statistics when running filtered reload.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

• Reverted a performance optimization that could cause increased warehouse consumption.

Behavior changes¶

• To see the configuration details for tables you reload, use the new RELOADED_TABLES view instead of the CONFIGURED_TABLES view. This new view includes the configuration values for the table from the CONFIGURED_TABLES view plus new columns that provide information about the reload configuration that was used for the table and the reload status for the table. For more information, see About Monitoring the Connector.

New features¶

• Added support for OAuth client credentials grant flow. When setting up OAuth, we recommend that you use this flow instead of OAuth authentication code grant flow. For more information, see Setting up OAuth. If the connector is already configured with another OAuth flow and then you configure it to use the client credentials grant flow, we recommend that you perform the following tasks, if possible:

  • Recreate the secret and security integration objects to use client credentials. For instructions, see Creating a security integration and Creating a secret object.

  • Update the connection to ServiceNow instance to use new credentials. For more information, see Updating the connection to ServiceNow® instance.

• Added a new config parameter to the RELOAD_TABLE procedure. This parameter allows you to reload specific records in a table instead of the whole table. For details, see Filtered reload.

• In views containing reference fields, columns with the __DISPLAY_VALUE suffix that contain data for reference fields now display the most recent data. Previously, these columns always returned the display value for the ingested raw value from the same table. To enable this feature, including in existing views, call the CREATE_VIEW_WITH_DISPLAY_VALUES stored procedure. For more information, see Creating a View Containing Reference Fields.

Bug fixes¶

• Improved the performance of the initial test request when a new table is enabled for ingestion.

• Improved error handling when the returned error code is in a different format than expected.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

Fixed an issue where the reference columns in flattened views displayed incomplete data when the view contained data from a table with fetch_display_values enabled.

Behavior changes¶

The flattened views now always display columns in alphabetical order. Previously, these views sometimes displayed columns in random order.

New features¶

Not applicable

Bug fixes¶

• Fixed an issue where data included in a view would shift between columns when the view contained reference fields.

• Fixed an issue where flattened views weren’t recreated correctly.

• For tables with fetch_display_values enabled, fixed an issue where the connector only retrieved a single page of up to 10,000 records for a table before the ingestion process stopped. However, you must reload these tables to apply the fix to them, including tables with fetch_display_values enabled through the global connector settings. For instructions on how to reload a table, see Reloading Data in a Table.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

Fixed an issue where calling the CONFIGURE_DISPLAY_VALUE_FETCHING stored procedure would fail to configure the default display values for tables and cause the Snowflake Connector for ServiceNow® V2 to stop responding.

Behavior changes¶

Not applicable

New features¶

• A new CONFIGURE_DISPLAY_VALUE_FETCHING procedure was added. It is used to set global, default configuration for handling display values. Display value synchronization can also be configured on the table level, using the ENABLE_TABLE procedure.

• Data with resolved display values can now be fetched, instead of only raw data.

Bug fixes¶

• Fixes for the connector state export process.

• Improved handling of DNS errors.

• CREATE_VIEW_WITH_DISPLAY_VALUES and ENABLE_REFERENCED_TABLES procedures now handle included columns configuration.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

• The connector now handles an exception when a table that is getting exported has incomplete configuration.

• The upgrade process no longer fails if the GET_TROUBLESHOOTING_DATA procedure doesn’t get created.

• The connector no longer fails when an internal state snapshot doesn’t created because of its size.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

• Added migration to support old sync states in data export.

Behavior changes¶

• The export process to store the connector internal state changed.

  In addition to storing metadata in the __CONNECTOR_STATE_EXPORT table, the data is also split into multiple tables with a _SFSDKEXPORT_V1 suffix.

New features¶

• Snowflake Connector for ServiceNow® V2 now supports disaster recovery in another region.

• Added support for configuring deletion synchronization at the table level using the ENABLE_TABLE procedure.

  For more information on using the ENABLE_TABLE procedure, see Enabling a single table using custom configuration.

Bug fixes¶

• Unexpected responses from the ServiceNow API are now correctly handled in the procedures such as CHECK_ROW_COUNT.

Behavior changes¶

• Event sharing is now mandatory for new installations.

New features¶

• You can now set a specified table page size with the RESET_PAGE_SIZE procedure instead of using the default connector’s value.

• If the connector’s default page size was set to an invalid value, the connector will use the recommended value of 10,000.

Bug fixes¶

• Ingestion fails when a worker task reaches API timeout when discovering the initial table page size.

Behavior changes¶

Not applicable

New features¶

• Add timeout on establishing the http connection.

Bug fixes¶

Not applicable

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

• Incremental updates no longer fail if Snowflake doesn’t receive the timestamp of the newest record on the ingested table.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

• Incremental updates no longer fail when the event log table is empty.

• Incremental ingestion no longer fails when a fetched batch is empty due to having out-of-date rows during record updates from the source.

Behavior changes¶

Modified the ServiceNow API request sorting rules applied during incremental updates to eliminate data loss while reading data from multiple read replicas.

New features¶

Not applicable

Bug fixes¶

Page size is no longer reduced when the ServiceNow instance is not reachable.

Behavior changes¶

Not applicable

New features¶

Not applicable

Bug fixes¶

• Fixed configuration validation in the UPDATE_CONNECTION_CONFIGURATION procedure.

Behavior changes¶

• A request for the most recent timestamp is added at the beginning of updates and deletes.

New features¶

• The UPDATE_CONNECTION_CONFIGURATION procedure is added. This procedure allows to change External Access Integration and Secret objects used by the connector.

• User Agent header in connector HTTP requests is now set to snowflake-connector-for-service-now.

Bug fixes¶

• Handle HTTP Client timeout errors gracefully.

  Reduce page size on such an error.

• ServiceNow® and Snowflake time differences no longer cause data to be lost.

Behavior changes¶

Not applicable.

New features¶

Not applicable.

Bug fixes¶

• Migration script fix for certain users.

Behavior changes¶

Not applicable.

New features¶

Not applicable.

Bug fixes¶

• Fix RELOAD_TABLE procedure when both row_filter and data_range_start_time are set. Previously row filtering sync states were not cleaned up correctly.

• Improve error handling in the data ingestion process when the connector is not able to overcome errors related to authentication. In such cases, the connector should now be able to detect the error earlier and stop the ingestion process.

Behavior changes¶

Not applicable.

New features¶

• The row_filter field in ENABLE_TABLE procedure now accepts arbitrary number of whitespace characters in filtering expression rather than allowing only single space between expression elements.

  For more information see Enabling a single table using custom configuration.

Bug fixes¶

• During table reload row filter and column filtering now taken into account.

• Row filter now works as expected for tables without a sys_updated_on column

Behavior changes¶

Not applicable.

New features¶

Procedures CHECK_ROW_COUNT, ENABLE_TABLE (without custom configuration parameters) and SHOW_REFERENCES_OF_TABLE can now be called in a user-owned task.

Bug fixes¶

Not applicable.

Behavior changes¶

Not applicable.

New features¶

Row filtering is now available. Row filtering supports the filtering of ingested table rows based on conditions evaluated against table columns. The row filtering condition is set using the ENABLE_TABLE procedure.

For more information see Enabling a single table using custom configuration in Setting Up data ingestion for your ServiceNow® data.

Bug fixes¶

Improve performance of the migration script from prior version.

Behavior changes¶

Not applicable.

New features¶

Not applicable

Bug fixes¶

Improve performance of the migration script from prior version.

Behavior changes¶

Not applicable.

New features¶

Add a default way to obtain the schema of a table when starting its ingestion. This should help in a scenario where the connector couldn’t start to ingest a table because of ACLs met on the first ingested row.

Bug fixes¶

• Fix RUN_HEALTHCHECK as it sometimes could fail to send the connector’s status in a specific scenario.

Behavior changes¶

Not applicable.

New features¶

Change endpoint for fetching schema of the table. From version 5.4.0 and later, the ADMIN role in ServiceNow® is no longer required to use CREATE_VIEW_WITH_DISPLAY_VALUES, SHOW_REFERENCES_OF_TABLE and ENABLE_TABLE (when using column filtering) procedures.

Bug fixes¶

From version 5.4.0 and later, new event log table DELETE events include the RAW column, which is set to a value from the newest update event instead of the first insert event. Previously existing event log table events remain unchanged.

Behavior changes¶

Not applicable.

New features¶

Not applicable.

Bug fixes¶

Fix handling the null value of the journal_table property in the object passed to the FINALIZE_CONNECTOR_CONFIGURATION procedure. The journal_table parameter can now also be skipped.

Behavior changes¶

Not applicable.

New features¶

Add optional table_name and sys_id arguments to FINALIZE_CONNECTOR_CONFIGURATION to help in journal table validation.

Bug fixes¶

• Improve URL validation in SET_CONNECTION_CONFIGURATION to support custom ServiceNow® domains.

Behavior changes¶

Not applicable.

New features¶

max_sys_created_on argument in CHECK_ROW_COUNT procedure now defaults to NULL.

Bug fixes¶

• Don’t start healthcheck reporting if the configuration hasn’t successfully completed.

• Fix SHOW_REFERENCES_OF_TABLE to include self-references of a given table in returned value.

• Fix CREATE_VIEW_WITH_DISPLAY_VALUES to handle situation when table references itself.

Behavior changes¶

• External function making API calls to ServiceNow® are replaced with external access.

• Signatures and behavior of many procedures changed. Division of responsibility can be checked in the below table:

Prior procedure	New procedure
CONFIGURE_CONNECTOR	Several specialized procedures CONFIGURE_*.
CONFIGURE_WAREHOUSE	UPDATE_WAREHOUSE
STOP_CONNECTOR	PAUSE_CONNECTOR
START_CONNECTOR	Several procedures to install the app when using worksheets.
PREFILL_CONFIG_TABLE	GET_AVAILABLE_TABLES
ENABLE_TABLE_WITH_COLUMNS	ENABLE_TABLE
ENABLE_TABLES(VARCHAR, BOOLEAN)	ENABLE_TABLES(ARRAY), DISABLE_TABLES(ARRAY)
TEST_SN_CONNECTION	TEST_CONNECTION
CHECK_SN_ROW_COUNT	CHECK_ROW_COUNT
GET_STATUS
GET_CONNECTION_STATUS
GET_VERSION
RUN_UPGRADE

• Procedures return an object with response_code property. The procedure result with an optional error reason is displayed directly in the response.

• Signatures and behavior of several views changed. Division of responsibility can be checked in the below table:

  Prior view	New view
  ENABLED_TABLES	CONFIGURED_TABLES, TABLES_STATE
  CONNECTOR_RUNS_STATE	Included in GET_TROUBLESHOOTING_DATA procedure.
  CONNECTOR_STATS	AGGREGATED_CONNECTOR_STATS
  	SYNC_STATUS

New features¶

Not applicable.

Bug fixes¶

Not applicable.