Package com.snowflake.connectors.application.ingestion.process

Class DefaultIngestionProcessRepository

java.lang.Object

com.snowflake.connectors.application.ingestion.process.DefaultIngestionProcessRepository

All Implemented Interfaces:

CrudIngestionProcessRepository, IngestionProcessRepository

public class DefaultIngestionProcessRepository
extends Object
implements IngestionProcessRepository, CrudIngestionProcessRepository

Default implementation of IngestionProcessRepository and CrudIngestionProcessRepository.

Field Summary

Fields

Modifier and Type	Field	Description
static int	EXPRESSION_LIMIT	Maximum limit of inserted/updated records.

Constructor Summary

Constructors

Constructor	Description
DefaultIngestionProcessRepository(Session session)	Creates a new DefaultIngestionProcessRepository.

Method Summary

Modifier and Type	Method	Description
String	createProcess(String resourceIngestionDefinitionId, String ingestionConfigurationId, String type, String status, Variant metadata)	Creates a new ingestion process.
void	deleteAllByResourceId(String resourceIngestionDefinitionId)	Deletes ingestion processes with the specified resource ingestion definition id.
void	endProcess(String processId)	Ends an ingestion process with the specified id.
void	endProcess(String resourceIngestionDefinitionId, String ingestionConfigurationId, String type)	Ends an ingestion process with the specified resource ingestion definition id, ingestion configuration, and process type.
Optional<IngestionProcess>	fetch(String processId)	Fetches an ingestion process by the specified id.
List<IngestionProcess>	fetchAll(String status)	Fetches all ingestion processes with the specified status.
List<IngestionProcess>	fetchAll(String resourceIngestionDefinitionId, String ingestionConfigurationId, String type)	Fetches all ingestion processes with the specified resource ingestion definition id, ingestion configuration, and process type.
List<IngestionProcess>	fetchAll(List<String> resourceIngestionDefinitionIds)	Fetches all ingestion processes with resource ingestion definition id contained within the specified list of ids.
List<IngestionProcess>	fetchAllActive(String resourceIngestionDefinitionId)	Fetches all ingestion processes with the specified resource ingestion definition id and statuses: IngestionProcessStatuses.SCHEDULED, IngestionProcessStatuses.IN_PROGRESS.
List<IngestionProcess>	fetchAllById(List<String> processIds)	Fetches all ingestion processes by the specified ids.
List<IngestionProcess>	fetchLastFinished(String resourceIngestionDefinitionId, String ingestionConfigurationId)	Fetches ingestion processes with the latest finishedAt date, status = FINISHED and distinct process type.
Optional<IngestionProcess>	fetchLastFinished(String resourceIngestionDefinitionId, String ingestionConfigurationId, String type)	Fetches an ingestion process with the latest finishedAt date and status = FINISHED
void	save(IngestionProcess process)	Saves the specified ingestion process.
void	save(Collection<IngestionProcess> ingestionProcesses)	Saves the specified ingestion processes.
void	updateStatus(String processId, String status)	Updates the status of an ingestion process with the specified id.
void	updateStatus(String resourceIngestionDefinitionId, String ingestionConfigurationId, String type, String status)	Updates the status of an ingestion process with the specified resource ingestion definition id, ingestion configuration, and process type.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

EXPRESSION_LIMIT

public static final int EXPRESSION_LIMIT

Maximum limit of inserted/updated records.

See Also:

Constant Field Values

Constructor Detail

DefaultIngestionProcessRepository

public DefaultIngestionProcessRepository(Session session)

Creates a new DefaultIngestionProcessRepository.

Parameters:

session - Snowpark session object

Method Detail

createProcess

public String createProcess(String resourceIngestionDefinitionId,
                            String ingestionConfigurationId,
                            String type,
                            String status,
                            Variant metadata)

Description copied from interface: IngestionProcessRepository

Creates a new ingestion process.

Specified by:

createProcess in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

ingestionConfigurationId - ingestion configuration id

type - process type

status - initial process status

metadata - process metadata

Returns:

id of the created process

updateStatus

public void updateStatus(String processId,
                         String status)

Updates the status of an ingestion process with the specified id. This implementation assumes that process cannot be in FINISHED status and finished_at timestamp must be null to perform the update.

Specified by:

updateStatus in interface IngestionProcessRepository

Parameters:

processId - process id

status - new process status

Throws:

IngestionProcessUpdateException - if no rows were updated or more than 1 row was updated

updateStatus

public void updateStatus(String resourceIngestionDefinitionId,
                         String ingestionConfigurationId,
                         String type,
                         String status)

Updates the status of an ingestion process with the specified resource ingestion definition id, ingestion configuration, and process type.

This update method is not recommended, as technically multiple processes can fit the specified criteria. It should only be used when the status update is a part of a resource update. This implementation assumes that process cannot be in FINISHED status and finished_at timestamp must be null to perform the update.

Specified by:

updateStatus in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

ingestionConfigurationId - ingestion configuration id

type - process type

status - new process status

Throws:

IngestionProcessUpdateException - if no rows were updated

endProcess

public void endProcess(String processId)

Ends an ingestion process with the specified id.

The ending of the process will set the status to a terminal value and update the process' finishedAt timestamp. This implementation assumes that process cannot be in FINISHED status and finished_at timestamp must be null to perform the update.

Specified by:

endProcess in interface IngestionProcessRepository

Parameters:

processId - process id

Throws:

IngestionProcessUpdateException - if no rows were updated or more than 1 row was updated

endProcess

public void endProcess(String resourceIngestionDefinitionId,
                       String ingestionConfigurationId,
                       String type)

Ends an ingestion process with the specified resource ingestion definition id, ingestion configuration, and process type.

This update method is not recommended, as technically multiple processes can fit the specified criteria. It should only be used when the status update is a part of a resource update.

The ending of the process will set the status to a terminal value and update the process' finishedAt timestamp. This implementation assumes that process cannot be in FINISHED status and finished_at timestamp must be null to perform the update.

Specified by:

endProcess in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

ingestionConfigurationId - ingestion configuration id

type - process type

Throws:

IngestionProcessUpdateException - if no rows were updated

fetch

public Optional<IngestionProcess> fetch(String processId)

Description copied from interface: IngestionProcessRepository

Fetches an ingestion process by the specified id.

Specified by:

fetch in interface CrudIngestionProcessRepository

Specified by:

fetch in interface IngestionProcessRepository

Parameters:

processId - process id

Returns:

ingestion process with the specified id

fetchAllById

public List<IngestionProcess> fetchAllById(List<String> processIds)

Description copied from interface: IngestionProcessRepository

Fetches all ingestion processes by the specified ids.

Specified by:

fetchAllById in interface IngestionProcessRepository

Parameters:

processIds - List of process ids

Returns:

ingestion processes with the specified ids

fetchLastFinished

public Optional<IngestionProcess> fetchLastFinished(String resourceIngestionDefinitionId,
                                                    String ingestionConfigurationId,
                                                    String type)

Description copied from interface: IngestionProcessRepository

Fetches an ingestion process with the latest finishedAt date and status = FINISHED

Specified by:

fetchLastFinished in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

ingestionConfigurationId - ingestion configuration id

type - process type

Returns:

ingestion process with the specified id

fetchLastFinished

public List<IngestionProcess> fetchLastFinished(String resourceIngestionDefinitionId,
                                                String ingestionConfigurationId)

Description copied from interface: IngestionProcessRepository

Fetches ingestion processes with the latest finishedAt date, status = FINISHED and distinct process type.

Specified by:

fetchLastFinished in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

ingestionConfigurationId - ingestion configuration id

Returns:

ingestion process with the specified id

fetchAll

public List<IngestionProcess> fetchAll(String resourceIngestionDefinitionId,
                                       String ingestionConfigurationId,
                                       String type)

Description copied from interface: IngestionProcessRepository

Fetches all ingestion processes with the specified resource ingestion definition id, ingestion configuration, and process type.

Specified by:

fetchAll in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

ingestionConfigurationId - ingestion configuration id

type - process type

Returns:

a list containing processes matching the specified criteria

fetchAllActive

public List<IngestionProcess> fetchAllActive(String resourceIngestionDefinitionId)

Description copied from interface: IngestionProcessRepository

Fetches all ingestion processes with the specified resource ingestion definition id and statuses: IngestionProcessStatuses.SCHEDULED, IngestionProcessStatuses.IN_PROGRESS.

Specified by:

fetchAllActive in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id

Returns:

a list containing processes matching the specified criteria

save

public void save(IngestionProcess process)

Description copied from interface: CrudIngestionProcessRepository

Saves the specified ingestion process.

Specified by:

save in interface CrudIngestionProcessRepository

Parameters:

process - ingestion process

save

public void save(Collection<IngestionProcess> ingestionProcesses)

Description copied from interface: CrudIngestionProcessRepository

Saves the specified ingestion processes.

Specified by:

save in interface CrudIngestionProcessRepository

Parameters:

ingestionProcesses - ingestion processes

fetchAll

public List<IngestionProcess> fetchAll(List<String> resourceIngestionDefinitionIds)

Description copied from interface: CrudIngestionProcessRepository

Fetches all ingestion processes with resource ingestion definition id contained within the specified list of ids.

Specified by:

fetchAll in interface CrudIngestionProcessRepository

Parameters:

resourceIngestionDefinitionIds - resource ingestion definition ids

Returns:

a list containing processes matching the specified criteria

fetchAll

public List<IngestionProcess> fetchAll(String status)

Description copied from interface: CrudIngestionProcessRepository

Fetches all ingestion processes with the specified status.

Specified by:

fetchAll in interface CrudIngestionProcessRepository

Parameters:

status - process status

Returns:

a list containing all the processes matching the specified criteria

deleteAllByResourceId

public void deleteAllByResourceId(String resourceIngestionDefinitionId)

Description copied from interface: IngestionProcessRepository

Deletes ingestion processes with the specified resource ingestion definition id.

Specified by:

deleteAllByResourceId in interface IngestionProcessRepository

Parameters:

resourceIngestionDefinitionId - resource ingestion definition id