PutDynamoDBRecord 2025.10.9.21

Bundle

org.apache.nifi | nifi-aws-nar

Description

Inserts items into DynamoDB based on record-oriented data. The record fields are mapped into DynamoDB item fields, including partition and sort keys if set. Depending on the number of records the processor might execute the insert in multiple chunks in order to overcome DynamoDB’s limitation on batch writing. This might result partially processed FlowFiles in which case the FlowFile will be transferred to the “unprocessed” relationship with the necessary attribute to retry later without duplicating the already executed inserts.

Tags

AWS, Amazon, DynamoDB, Insert, Put, Record

Input Requirement

REQUIRED

Supports Sensitive Dynamic Properties

false

Properties

PropertyDescription
AWS Credentials Provider serviceThe Controller Service that is used to obtain AWS credentials provider
Communications Timeout
Endpoint Override URLEndpoint URL to use instead of the AWS default including scheme, host, port, and path. The AWS libraries select an endpoint URL based on the AWS region, but this property overrides the selected endpoint URL, allowing use with other S3-compatible endpoints.
Partition Key AttributeSpecifies the FlowFile attribute that will be used as the value of the partition key when using “Partition by attribute” partition key strategy.
Partition Key FieldDefines the name of the partition key field in the DynamoDB table. Partition key is also known as hash key. Depending on the “Partition Key Strategy” the field value might come from the incoming Record or a generated one.
Partition Key StrategyDefines the strategy the processor uses to assign partition key value to the inserted Items.
Record ReaderSpecifies the Controller Service to use for parsing incoming data and determining the data’s schema.
Region
SSL Context ServiceSpecifies an optional SSL Context Service that, if provided, will be used to create connections
Sort Key FieldDefines the name of the sort key field in the DynamoDB table. Sort key is also known as range key.
Sort Key StrategyDefines the strategy the processor uses to assign sort key to the inserted Items.
Table NameThe DynamoDB table name
proxy-configuration-serviceSpecifies the Proxy Configuration Controller Service to proxy network requests.

Relationships

NameDescription
failureFlowFiles are routed to failure relationship
successFlowFiles are routed to success relationship
unprocessedFlowFiles are routed to unprocessed relationship when DynamoDB is not able to process all the items in the request. Typical reasons are insufficient table throughput capacity and exceeding the maximum bytes per request. Unprocessed FlowFiles can be retried with a new request.

Writes attributes

NameDescription
dynamodb.chunks.processedNumber of chunks successfully inserted into DynamoDB. If not set, it is considered as 0
dynamodb.key.error.unprocessedDynamoDB unprocessed keys
dynmodb.range.key.value.errorDynamoDB range key error
dynamodb.key.error.not.foundDynamoDB key not found
dynamodb.error.exception.messageDynamoDB exception message
dynamodb.error.codeDynamoDB error code
dynamodb.error.messageDynamoDB error message
dynamodb.error.serviceDynamoDB error service
dynamodb.error.retryableDynamoDB error is retryable
dynamodb.error.request.idDynamoDB error request id
dynamodb.error.status.codeDynamoDB error status code
dynamodb.item.io.errorIO exception message on creating item

See also