Package com.snowflake.connectors.taskreactor.worker.ingestion

Class SimpleIngestionWorker<I,M,D,C>

java.lang.Object

com.snowflake.connectors.taskreactor.worker.Worker<ConnectorResponse>

com.snowflake.connectors.taskreactor.worker.ingestion.SimpleIngestionWorker<I,M,D,C>

Type Parameters:

I - resource id class, containing properties which identify the resource in the source system

M - resource metadata class, containing additional properties which identify the resource in the source system. The properties can be fetched automatically or calculated by the connector

C - custom ingestion configuration class, containing custom ingestion properties

D - destination configuration class, containing properties describing where the ingested data should be stored

public class SimpleIngestionWorker<I,M,D,C>
extends Worker<ConnectorResponse>

A worker executing an SimpleIngestion. * It executes common logic for most of the simple ingestion scenarios.

Method Summary

Modifier and Type	Method	Description
static <I,M,D,C> SimpleIngestionWorker<I,M,D,C>	from(Session session, SimpleIngestion<I,M,D,C> ingestion, WorkerId workerId, Identifier instanceSchema, com.fasterxml.jackson.databind.JavaType simpleIngestionWorkItemType)	Creates a new SimpleIngestionWorker.
protected ConnectorResponse	performWork(WorkItem workItem)

Methods inherited from class com.snowflake.connectors.taskreactor.worker.Worker

run, shouldCancel

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

from

public static <I,M,D,C> SimpleIngestionWorker<I,M,D,C> from(Session session,
                                                                                                SimpleIngestion<I,M,D,C> ingestion,
                                                                                                WorkerId workerId,
                                                                                                Identifier instanceSchema,
                                                                                                com.fasterxml.jackson.databind.JavaType simpleIngestionWorkItemType)

Creates a new SimpleIngestionWorker.

Type Parameters:

I - resource id class, containing properties which identify the resource in the source system

M - resource metadata class, containing additional properties which identify the resource in the source system. The properties can be fetched automatically or calculated by the connector

C - custom ingestion configuration class, containing custom ingestion properties

D - destination configuration class, containing properties describing where the ingested data should be stored

Parameters:

session - Snowpark session object

ingestion - simple ingestion

workerId - worker id

instanceSchema - Task Reactor instance name

simpleIngestionWorkItemType - JavaType type of SimpleIngestionWorkItem

Returns:

a new simple ingestion worker

performWork

protected ConnectorResponse performWork(WorkItem workItem)

Specified by:

performWork in class Worker<ConnectorResponse>

Parameters:

workItem - work item provided by the dispatcher

Returns:

custom object defined by the user.