Skip to content

Register Hive Parquet Node

Data/DataFusion/Lakes

Register Hive Parquet

Register Hive-partitioned Parquet files as a table in DataFusion using a FlowPath.

df_register_hive_parquetdata
Inputs4
Outputs2
Security exposure1/10
Packagedata

Ratings

Scores range from 0 to 10. Higher values mean more impact, exposure, or operational weight.

SecurityAttack surface and exposure impact.
1/10High
PrivacyPotential sensitivity of processed data.
1/10High
PerformanceRuntime or resource pressure.
1/10High
GovernancePolicy, audit, or compliance impact.
2/10High
ReliabilityOperational stability considerations.
1/10High
CostExternal or compute cost impact.
0/10High

Input Pins

4

Input

Execution
exec_in

Trigger execution

Session

Struct
session

DataFusion session

DataFusionSessionDataFusionSession1 fields
cache_keystringrequired

Path

Struct
path

FlowPath to root directory of partitioned Parquet files

FlowPathFlowPath3 fields
pathstringrequired
store_refstringrequired
cache_store_refstring | null

Table Name

String
table_name

Name to register in DataFusion

Output Pins

2

Done

Execution
exec_out

Table registered

Session

Struct
session_out

DataFusion session

DataFusionSessionDataFusionSession1 fields
cache_keystringrequired

Node Info

Internal name
df_register_hive_parquet
Category
Data/DataFusion/Lakes