ReferenceApplies to: Unified engine deployments
[delta_source_limits]
Settings
Limits the Delta metadata bytes admitted while preparing a source.
- Default:
67108864
- Type: integer (bytes); positive
Example
67108864 gives Delta log and checkpoint metadata a 64 MiB budget. This does not cap all table rows read during execution.
Limits how many Delta metadata objects can be examined.
- Default:
100000
- Type: integer; positive
Example
100000 bounds the count of log and checkpoint-related objects considered while resolving the source.
max_plan_bytes
Limits the size of the encoded Delta read plan.
- Default:
16777216
- Type: integer (bytes); positive
Example
16777216 gives the saved plan a 16 MiB budget. A source with many referenced files may need a larger plan budget.
max_scan_bytes
Limits the total bytes admitted by the Delta scan limit.
- Default:
1073741824
- Type: integer (bytes); positive
Example
1073741824 sets a 1 GiB scan budget. Increasing worker memory does not automatically increase this read limit.
max_scan_objects
Limits how many objects a Delta scan may admit.
- Default:
1000000
- Type: integer; positive
Example
1000000 caps the count at one million objects, even when the objects are small.
Last modified on November 4, 2026
