Openflow Connector for Oracle: Configure connector¶
Note
The connector is subject to the Connector Terms.
This topic describes the steps to set up the Openflow Connector for Oracle connector itself.
As a data engineer, perform the following tasks to install and configure the connector:
Install the connector¶
Navigate to the Openflow Overview page. In the Featured connectors section, select View more connectors.
On the Openflow connectors page, find the connector and select Add to runtime.
In the Select runtime dialog, select your runtime from the Available runtimes drop-down list.
Select Add.
Note
Before you install the connector, ensure that you have created a database and schema in Snowflake for the connector to store ingested data.
Authenticate to the deployment with your Snowflake account credentials and select Allow when prompted to allow the runtime application to access your Snowflake account. The connector installation process takes a few minutes to complete.
Authenticate to the runtime with your Snowflake account credentials.
The Openflow canvas appears with the connector process group added to it.
Configure the connector¶
To configure the connector, perform the following steps:
Right-click on the added runtime and select Parameters.
Populate the required parameter values as described in Specify flow parameters.
Specify flow parameters¶
This section describes the flow parameters that you can configure based on the following parameter contexts:
Snowflake Destination Parameters: Used to establish connection with Snowflake.
Oracle Ingestion Parameters: Used specify the tables to replicate.
Oracle Source Parameters: Used to define the configuration of data downloaded Oracle.
Snowflake Destination Parameters¶
Parameter |
Description |
Required |
|---|---|---|
Destination Database |
The database where data will be persisted. It must already exist in Snowflake. The name is case-sensitive. For unquoted identifiers, provide the name in uppercase. |
Yes |
Snowflake Account Identifier |
When using:
|
Yes |
Snowflake Authentication Strategy |
When using:
|
Yes |
Snowflake Private Key |
When using:
|
No |
Snowflake Private Key File |
When using:
|
No |
Snowflake Private Key Password |
When using
|
No |
Snowflake Role |
When using
|
Yes |
Snowflake Username |
When using
|
Yes |
Snowflake Warehouse |
Snowflake warehouse used to run queries. |
Yes |
Oracle Ingestion Parameters¶
Parameter |
Description |
|---|---|
Included Table Names |
Comma-separated list of fully-qualified table paths (e.g., SCHEMA_NAME.TABLE_NAME). |
Included Table Regex |
A regular expression to match table paths for automatic inclusion of existing and new tables. |
Filter JSON |
A JSON array to include specific columns based on a regex pattern for given tables. Currently unsupported |
Merge Task Schedule CRON |
A CRON expression to define when merge operations from the Journal to the Destination Table will be triggered For example, * * * * * ? for continuous merge. |
Object Identifier Resolution |
Specifies how source object identifiers such as schemas, tables, and columns names are stored and queried in Snowflake. This setting dictates whether you will need to use double quotes in SQL queries. Option 1: Default, case-sensitive. For backwards compatibility.
Note Snowflake recommends using this option if you must preserve source casing for legacy or compatibility reasons.
For example, if the source database includes table names that differ in case only such as Option 2: Recommended, case-insensitive
Note Snowflake recommends using this option if database objects are not expected to have mixed case names. Important Do not change this setting after connector ingestion has begun. Changing this setting after ingestion has begun will break the existing ingestion. If you must change this setting, create a new connector instance. |
Oracle Source Parameters¶
Parameter |
Description |
Required |
|---|---|---|
Oracle Connection URL |
JDBC URL of the database connection to the DB.
For example |
Yes |
Oracle Username |
Username of the connect user that has access to the XStream Server. |
Yes |
Oracle Password |
Password of the connect user that has access to the XStream Server. |
Yes |
Oracle Database Processor Multiplier |
Core Processor Licensing Factor as described in Oracle Processor Core Factor Table |
Required for Embedded License only |
Oracle Database Processor Cores |
The number processor cores in your Oracle database. |
Required for Embedded License only |
XStream Billing Acknowledgement |
A confirmation of the licensing agreement |
Required for Embedded License only |
XStream Out Server Name |
The name of the XStream Server that must already exist in Oracle. |
Yes |
XStream Out Server URL |
JDBC URL of the database connection for XStream, must use OCI driver.
For example |
Yes |
Run the flow¶
Right-click on the plane and select Enable all Controller Services.
Right-click on the imported process group and select Start. The connector starts the data ingestion.