GenerateAnswersFromGroundTruth 2025.3.28.13-SNAPSHOT¶
BUNDLE¶
com.snowflake.openflow.runtime | runtime-rag-evaluation-processors-nar
DESCRIPTION¶
Generates synthetic answers for each question in the incoming records using an LLM. The synthetic answers are added to the specified RecordPath within each record. Additionally, the processor tracks the number of answers generated and updates the FlowFile attributes accordingly.
INPUT REQUIREMENT¶
REQUIRED
Supports Sensitive Dynamic Properties¶
false
PROPERTIES¶
Property |
Description |
|---|---|
Answer Record Path |
The RecordPath to the synthetically generated answers. |
Ground Truth Record Path |
The RecordPath to the ground truth field in the record. |
LLM Provider Service |
The provider service for sending evaluation prompts to LLM |
Question Record Path |
The RecordPath to the question field in the record. |
Record Reader |
The Record Reader to use for reading the FlowFile. |
Record Writer |
The Record Writer to use for writing the results. |
RELATIONSHIPS¶
NAME |
DESCRIPTION |
|---|---|
failure |
FlowFiles that cannot be processed are routed to this relationship |
success |
FlowFiles that are successfully processed are routed to this relationship |
WRITES ATTRIBUTES¶
NAME |
DESCRIPTION |
|---|---|
answers.successfully.generated |
The total number of successfully synthetic answers generated for the FlowFile. |
answers.failed.generated |
The total number of failed answer generation for the FlowFile. |
json.parse.failures |
Number of JSON parse failures encountered. |