Skip to main content
ReferenceApplies to: Unified engine deployments
[file_source_limits]

Settings

max_files

Limits how many files can be admitted during file-source discovery.
  • Default: 10000
  • Type: integer; positive
Example 10000 bounds a source listing to 10000 files. Many tiny files can reach this count before reaching a byte limit.

max_metadata_bytes

Limits how much file-discovery metadata the engine keeps while preparing a source.
  • Default: 8388608
  • Type: integer (bytes); positive
Example 8388608 gives filenames and other source metadata an 8 MiB budget, separate from the contents of the data files.

max_multiline_json_bytes

Limits the bytes admitted for a multiline JSON source value.
  • Default: 33554432
  • Type: integer (bytes); positive
Example 33554432 gives multiline JSON a 32 MiB limit so a single large value cannot require an unbounded read.

max_plan_bytes

Limits the encoded size of a prepared file-source plan.
  • Default: 8388608
  • Type: integer (bytes); positive
Example 8388608 gives the plan an 8 MiB budget. A listing with many file references can reach this limit even before execution.
Last modified on November 4, 2026