CreateVertexAIEmbeddings 2025.10.9.21

Bundle

com.snowflake.openflow.runtime | runtime-vertexai-nar

Description

Uses VertexAI to create embeddings for text. The input text can be provided as a single FlowFile or as a record-oriented FlowFile.

Tags

chatbot, cloud, embeddings, gcp, gen ai, generative ai, google, llm, nlp, openflow, text, vertex

Input Requirement

Supports Sensitive Dynamic Properties

false

Properties

PropertyDescription
Auto TruncateIf set to false, text that exceeds the token limit causes the request to fail.
Embeddings ModelThe model to use for embeddings, available models are listed at https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models#models
Embeddings Record PathThe path to the field in the record where the embeddings are to be written.
GCP Credentials ServiceThe Controller Service used to obtain Google Cloud Platform credentials.
GCP LocationThe location to configure the Vertex client with
GCP Project IDThe project ID to configure the Vertex client with
Max Batch SizeThe maximum number of records to include in each batch sent to VertexAI
Model PublisherThe publisher of the model
Output DimensionalityUsed to specify output embedding size. If set, output embeddings will be truncated to the size specified.
Record ReaderThe record reader to use for reading record-oriented data. If the incoming data is to be treated as plaintext, this property should be left unset.
Record WriterThe Record Writer to use for writing the output
Task TypeUsed to convey intended downstream application of embeddings to help the model tune embeddings for a specific purpose.
Text Record PathThe path to the field in the record that contains the text to be embedded. If the incoming data is to be treated as plaintext, this property should be left unset.
UserAn identifier for the remote user on whose behalf the request is being made.

Relationships

NameDescription
failureThe original FlowFile will be routed to this relationship if the embeddings could not be created
successThe embeddings will be routed to this relationship

Writes attributes

NameDescription
record.countThe number of records written to the output
mime.typeThe MIME type of the output data, based on the chosen Record Writer

Use cases

Create embeddings for text using VertexAI’s Embedding model