ReferenceApplies to: Unified engine deployments
[file_source_limits]
Settings
max_files
Limits how many files can be admitted during file-source discovery.
- Default:
10000
- Type: integer; positive
Example
10000 bounds a source listing to 10000 files. Many tiny files can reach this count before reaching a byte limit.
Limits how much file-discovery metadata the engine keeps while preparing a source.
- Default:
8388608
- Type: integer (bytes); positive
Example
8388608 gives filenames and other source metadata an 8 MiB budget, separate from the contents of the data files.
max_multiline_json_bytes
Limits the bytes admitted for a multiline JSON source value.
- Default:
33554432
- Type: integer (bytes); positive
Example
33554432 gives multiline JSON a 32 MiB limit so a single large value cannot require an unbounded read.
max_plan_bytes
Limits the encoded size of a prepared file-source plan.
- Default:
8388608
- Type: integer (bytes); positive
Example
8388608 gives the plan an 8 MiB budget. A listing with many file references can reach this limit even before execution.
Last modified on November 4, 2026