Skip to content

LLM Observe Screen Node

Automation/LLM/Vision

LLM Observe Screen

Uses vision LLM to comprehensively observe and describe the current screen

llm_observe_screenautomationLong running
Inputs4
Outputs4
Security exposure6/10
Packageautomation

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
6/10Medium
PrivacyPotential sensitivity of processed data.
7/10Low
PerformanceRuntime or resource pressure.
6/10Medium
GovernancePolicy, audit, or compliance impact.
5/10Medium
ReliabilityOperational stability considerations.
3/10High
CostExternal or compute cost impact.
5/10Medium

Input Pins

4

Execution
exec_in

Trigger

Model

Struct
model

Vision-capable LLM model

BitBit19 fields
idstring
default ""
typeBitTypes
enum "Llm", "Vlm", "Tts", "Stt"...default "Other"
metaMap<string, Metadata>
default {}
*Metadatamap value
namestringrequired
descriptionstringrequired
long_descriptionstring | null
release_notesstring | null
tagsArray<string>required
itemsstringarray item
+11 more fields
authorsArray<string>
default []
itemsstringarray item
repositorystring | null
default null
download_linkstring | null
default null
file_namestring | null
default null
hashstring
default ""
sizeinteger | null
format uint64default nullmin 0
hubstring
default ""
parametersvalue
default null
versionstring | null
default null
licensestring | null
default null
dependenciesArray<string>
default []
itemsstringarray item
dependency_tree_hashstring
default ""
createdstring
default ""
updatedstring
default ""
model_slugstring | null
default null
+1 more fields
Schema enforced

Screenshot

String
screenshot

Base64-encoded screenshot

Focus Area

String
focus_area

Specific area or aspect to focus on (optional)

Output Pins

4

Execution
exec_out

Continue

Observation

Struct
observation

Complete screen observation

ScreenObservationScreenObservation6 fields
descriptionstringrequired
app_contextstringrequired
interactive_elementsArray<ObservedElement>required
itemsObservedElementarray item
element_typestringrequired
descriptionstringrequired
approximate_locationstringrequired
is_interactivebooleanrequired
current_statestring | null
text_contentArray<string>required
itemsstringarray item
notable_featuresArray<string>required
itemsstringarray item
possible_actionsArray<string>required
itemsstringarray item

Description

String
description

Text description of the screen

Elements

Generic
elements

List of observed elements

Node Info

Internal name
llm_observe_screen
Category
Automation/LLM/Vision
Version
3