Skip to content

Push Chunk Node

AI/Generative/Response

Push Chunk

Appends a streaming chunk onto a response

ai_generative_llm_response_push_chunkllm
Inputs3
Outputs2
Security exposure0/10
Packagellm

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
0/10High
PrivacyPotential sensitivity of processed data.
0/10High
PerformanceRuntime or resource pressure.
1/10High
GovernancePolicy, audit, or compliance impact.
1/10High
ReliabilityOperational stability considerations.
0/10High
CostExternal or compute cost impact.
0/10High

Input Pins

3

Input

Execution
exec_in

Start execution before appending

Response

Struct
response

Response object that should receive the chunk

ResponseResponse8 fields
idstring | null
choicesArray<Choice>required
itemsChoicearray item
indexinteger:int32required
format int32
finish_reasonstringrequired
messageResponseMessagerequired
rolestringrequired
contentstring | null
refusalstring | null
annotationsarray | null
audioanyOf (2)
+2 more fields
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
objectstring | null
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
cached_tokensinteger | null
format uint32min 0
audio_tokensinteger | null
format uint32min 0
variant 2nullvariant
+2 more fields
Schema enforced

Chunk

Struct
chunk

Chunk to append

ResponseChunkResponseChunk8 fields
idstringrequired
choicesArray<ResponseChunkChoice>required
itemsResponseChunkChoicearray item
indexinteger:int32required
format int32
deltaanyOf (2)
variant 1Deltavariant
variant 2nullvariant
finish_reasonstring | null
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
usageanyOf (2)
variant 1Usagevariant
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
variant 2nullvariant
+2 more fields
variant 2nullvariant
x_prefill_progressnumber | null
format float
Schema enforced

Output Pins

2

Output

Execution
exec_out

Signals completion once appended

Response

Struct
response_out

Response including the appended chunk

ResponseResponse8 fields
idstring | null
choicesArray<Choice>required
itemsChoicearray item
indexinteger:int32required
format int32
finish_reasonstringrequired
messageResponseMessagerequired
rolestringrequired
contentstring | null
refusalstring | null
annotationsarray | null
audioanyOf (2)
+2 more fields
logprobsanyOf (2)
variant 1LogProbsvariant
variant 2nullvariant
createdinteger | null
format uint64min 0
modelstring | null
service_tierstring | null
system_fingerprintstring | null
objectstring | null
usageUsagerequired
completion_tokensinteger:uint32required
format uint32min 0
prompt_tokensinteger:uint32required
format uint32min 0
total_tokensinteger:uint32required
format uint32min 0
costnumber | null
format double
prompt_tokens_detailsanyOf (2)
variant 1PromptTokenDetailsvariant
cached_tokensinteger | null
format uint32min 0
audio_tokensinteger | null
format uint32min 0
variant 2nullvariant
+2 more fields

Node Info

Internal name
ai_generative_llm_response_push_chunk
Category
AI/Generative/Response