Snowflake Connector for ServiceNow release notes¶
This topic provides release notes for the Snowflake Connector for ServiceNow. For additional information, see Snowflake Connector for ServiceNow.
Version 4.20.0 (November 30th, 2023)¶
Behavior changes¶
For incremental updates, in the case of a successful run, there is only a single
DONE
ingestion state.Added
SKIPPED
ingestion state when an ingestion was skipped.The
EVENT_LOG
tableSYS_UPDATED_ON
column is now populated with the raw date from ServiceNow instead of being formatted according to theTIMESTAMP_NTZ_OUTPUT_FORMAT
account parameter.
New features¶
A new
CONFIGURE_TABLES_RANGE_START
procedure that allows the setting of a data range start time timestamp. This limits data ingestion during initial ingestion or reloads.The
ENABLED_TABLES
view displays data range start times of tables as a UTC timestamp.
Bug fixes¶
Fixed various bugs when setting the
TIMESTAMP_OUTPUT_FORMAT
,TIMESTAMP_NTZ_OUTPUT_FORMAT
, andTIMESTAMP_TZ_OUTPUT_FORMAT
account parameters so that they cannot be parsed inAUTO
format.Fixed various bugs when setting the
TIMESTAMP_INPUT_FORMAT
account parameter for other than the defaultAUTO
value.Fixed the
CREATE_VIEW_WITH_DISPLAY_VALUES
procedure to correctly handle references invisible to the connector by not including them in the created view.
Version 4.19.0 (November 6th, 2023)¶
Behavior changes¶
The
DONE
ingestion state appears inCONNECTOR_RUNS_STATES
,ENABLED_TABLES
andTABLES_STATE
only if fetched data has been merged into the sync table.Use
sys_created_on
instead ofsys_updated_on
in the journal table. Ensure that you have access to thesys_created_on
column in thesys_audit_delete
table before upgrading to the newest version of the connector. If you encounter any problems, contact support.
New features¶
Not applicable.
Bug fixes¶
Show
NULL
instead ofSYSDATE()
in theRUN_END_TIME
column of theCONNECTOR_STATS
view if the ingestion run is running.The initial load is not started unnecessarily when restoring ingestion.
Version 4.18.0 (October 19, 2023)¶
Behavior changes
Removed the TOTAL_ROWS column in the
CONNECTOR_STATS
view.Removed the ROW_COUNT column in the
WORKER_STATE
view.Improved data ingestion speed by moving and merging updates and deletes from the event log into the sync table for an asynchronous task. Before the change the ingestion loop fetched the data, inserted it into the event log, and merged the updates into the sync table. The merging operation is typically long, so it can significantly reduce the throughput of the data ingestion. Asynchronous merging moves long operations into the background, which improves throughput. Performance gains can be limited by the performance of the ServiceNow instance.
Asynchronous merges now delay the appearance of the ingested data in the sync table. The data is immediately available in the event log, but the sync table is synced after the asynchronous merging completes. If the connector stops during data ingestion, the data in the sync table might be incomplete. Starting the connector resumes ingestion and syncs the data.
The ingestion state DONE in the
CONNECTOR_RUNS_STATES
andENABLED_TABLES
views now means that data is available in the event log table; but not necessarily in the sync table. Due to asynchronous merges, the sync table may take some time to sync. This behavior is subject to change in a future release.
New features¶
Not applicable.
Bug fixes¶
Fixed the
CREATE_VIEW_WITH_DISPLAY_VALUES
procedure to correctly handle columns having SQL keywords as the name; for example, columns named GROUP or LIMIT.Fixed the
CREATE_VIEW_WITH_DISPLAY_VALUES
procedure to correctly handle references invisible for the connector by not including them in the created view.
Version 4.17.1 (October 9, 2023)¶
Behavior changes¶
Not applicable.
New features¶
Not applicable.
Bug fixes¶
Added validation of the supported cron values when configuring a table’s ingestion schedules.
Reduced the complexity of the query that searches for tables to be ingested.
Fixed an issue so that access validation on metadata tables does not fail if some of the rows are hidden.
Fixed an issue with timestamp formatting so that timestamps work correctly, even if the default timestamp format is changed on the account.
Version 4.17.0 (September 27, 2023)¶
Behavior changes¶
Not applicable.
New features¶
Initial load of data is now implemented using the INSERT command, instead of using the MERGE command.
Bug fixes¶
Fixed issue of the incorrect handling of the ServiceNow timestamp in a non-UTC time zone.
Reduced the number of lock timeouts when assigning workers to tables.
Version 4.16.0 (September 5, 2023)¶
Behavior changes¶
Tables with custom schedules are not ingested immediately after enabling. Instead, the initial load is performed at the scheduled ingestion time.
New features¶
Added garbage collecting mechanism for internal connector data to optimize the usage of the connector internal storage space.
Bug fixes¶
Fixed an issue of the
CREATE_VIEW_WITH_DISPLAY_VALUES
procedure so that it does not reference non-VARIANT column when creating the view.Fixed an issue so that the
CONFIGURE_WAREHOUSE
procedure does not resume reloading tasks when in theRELOADING_DISABLED
state.
Version 4.15.0 (August 25, 2023)¶
Behavior changes¶
The SCHEDULE_INTERVAL column in the
TABLES_STATE
view and the value of thedata_ingestion_schedule
keys are now cron expressions.Deleted the CURRENT_EPOCH column from the
TABLES_STATE
view.
New features¶
Added the
CONFIGURE_TABLES_SCHEDULE
procedure that enables setting both interval and custom schedules.
Bug fixes¶
Fixed issue of the
CREATE_VIEW_WITH_DISPLAY_VALUES
procedure to enable the creation of a display value view when several references point to the same table.Reduced the number of deadlocks and eliminated the duplicated assignments when assigning workers to the tables.
Fixed issue of the
CONNECTOR_STATS
to show the correct count in the UPDATEDROWS column.
Version 4.14.0 (August 9, 2023)¶
Behavior changes¶
The SCHEDULE_INTERVAL column type in the
TABLES_STATE
view is changed to VARCHAR.
New features¶
Not applicable.
Bug fixes¶
Fixed issue of the logs in case of no access to the
sys_table_rotation
or journal tables to provide a more meaningful message.Fixed issue of the
PREFILL_CONFIG_TABLE
procedure to filter out rows with empty or null table name.Fixed destination schema validation to enable tables for more than 10000 columns in the schema.
Fixed issue of the references with the empty
display_field
or thereference_table
attributes not skipped in theSHOW_REFERENCES_OF_TABLE
procedure.
Version 4.13.0 (July 17, 2023)¶
Behavior changes¶
Not applicable.
New features¶
Added the
CREATE_VIEW_WITH_DISPLAY_VALUES
procedure which creates a view with display values. The newly created view is similar to the flattened table view, but the referenced columns are replaced with the values.Added the
DELETE_TABLE
procedure which enables removing tables from config along with the ingestion history.
Bug fixes¶
Not applicable.
Version 4.12.0 (July 5, 2023)¶
Behavior changes¶
Tables in the
RELOADING_CANCELLED
state are now treated as enabled in theENABLED_TABLES
view.
New features¶
Not applicable.
Bug fixes¶
Fixed issue of the reloading tasks. Only the reloading tasks of the tables provided in the arguments of the
ENABLED_TABLES
andDISABLE_TABLES
procedures are now resumed or suspended. Reloading tasks of the metadata tables are suspended when the last table is disabled, and resumed when the first table is enabled.Fixed issue of the
ENABLE_REFERENCED_TABLES
to not throw theTypeError: Cannot read properties of null
exception.Fixed issue of a broken upgrade migration for version 4.11.0.
Fixed issue of the
PREFILL_CONFIG_TABLE
procedure to handle incorrect responses from ServiceNow.Fixed issue of the
START_CONNECTOR
procedure to not resume tasks if all tables are disabled.
Version 4.11.0 (June 16, 2023)¶
Behavior changes¶
Empty views for tables that do not have metadata ingested are no longer created.
Truncate-and-load strategy populates the
sys_id
,last_update_date
, andis_deleted
columns in destination tables, and thesys_id
event log tables.
New features¶
Added the FLATTENED_VIEWS_STATUS and FLATTENED_VIEWS_LAST_UPDATED columns to the
ENABLED_TABLES
view.
Bug fixes¶
Fixed issue of the
CHECK_RECORD_HISTORY
procedure to not use undocumented query parameter to filter rows bysys_id
.
Version 4.10.0 (June 7, 2023)¶
Behavior changes¶
Not applicable.
New features¶
When the connector is started, the access to the required fields in the mandatory metadata tables is validated.
When the columns selected for ingestion of a specific table are changed, the flattened views are recreated.
Bug fixes¶
Fixed issue of the
CHECK_RECORD_HISTORY
to not accept an empty string forsys_id
.
Version 4.9.0 (May 31, 2023)¶
Behavior changes¶
Not applicable.
New features¶
Added
tableName
property to the error response fromGET_CONNECTION_STATUS
in case of the FORBIDDEN status.Added the
ENABLE_TABLES_WITH_COLUMNS
procedure which enables selecting table columns for ingestion. Flattened views display only the configured columns.Added the
ENABLE_TABLES
and theDISABLE_TABLES
procedures which accept the ARRAY type as an argument. The previousENABLE_TABLES
procedure, which accepted BOOLEAN as a second parameter, is deprecated.The
ENABLED_TABLES
view displays the list of included columns.
Bug fixes¶
Fixed issue of the
CHECK_RECORD_HISTORY
to use proper query when searching for a specificsys_id
in an audit table.
Version 4.8.0 (May 9, 2023)¶
Behavior changes¶
Not applicable.
New Features¶
It’s no longer possible to change the configuration of the metadata table using the
CONFIGURE_CONNECTOR_TABLES
procedure.Added the
SHOW_REFERENCES_OF_TABLE
procedure which returns all of the references for a given table.Improved view creation logging.
Bug fixes¶
Fixed issue to return the correct message instead of null upon calling the
TOP_CONNECTOR
procedure.Fixed issue to not reduce page size and not retry requests on receiving a firewall error.
Fixed issue to improve handling invalid ServiceNow instance names.
Version 4.7.0 (April 7, 2023)¶
Behavior changes¶
Not applicable.
New features¶
Modified the schedule of metadata tables to use the lowest enabled table schedule.
Bug fixes¶
Not applicable.
Version 4.6.0 (March 31, 2023)¶
Behavior changes¶
The connector no longer grants itself access to tables created in destination schema. Instead, the connector uses table and view ownership to access tables in the destination schema.
New features¶
Added the PAGE_SIZE column to the
ENABLED_TABLES
view.Modified the
START_CONNECTOR
stored procedure to return more detailed errors if the request to ServiceNow fails.Modified the
GET_STATUS
stored procedure to return a message that email notification failed.Added a monthly reminder to refresh the OAuth token used for email notification.
Bug fixes¶
Fixed issue to allow workers to pick more than one table per minute if started at the same time.
Fixed issue to prohibit table reload until destination and event log tables are created during the initial ingestion of the table.
Fixed issue to allow the connector to work with managed destination schema.
Fixed issue where old rows are marked as deleted in rotated tables even if journal table is not configured.
Version 4.5.0 (March 16, 2023)¶
Behavior changes¶
Not applicable.
New features¶
This release is the first publicly available release of the connector. For more information, see About the Snowflake Connector for ServiceNow.
Bug fixes¶
Not applicable.