ReferenceApplies to: Unified engine deployments
[workers.runtime.executor]
Storage I/O
io_limits.max_batch_rows
Limits how many rows one connector read returns at once.
- Default:
65536
- Type: integer; positive
Example
65536 caps a connector batch at 65536 rows. A full scan can still read many batches.
io_limits.max_buffered_bytes
Limits how many bytes this component keeps in its data buffer.
- Default:
33554432
- Type: integer (bytes); positive
Example
33554432 gives the buffer 32 MiB. This is one component’s buffer budget, not the whole worker’s memory limit.
io_limits.max_concurrent_requests
Limits how many data-storage requests this component may make at once.
- Default:
4
- Type: integer; positive
Example
4 allows four simultaneous I/O requests. Raising it can improve throughput but increases pressure on storage and memory.
Settings
source_poll_interval
Sets how long execution waits between checks when a source has no new data available.
- Default:
100 ms
- Type: duration
Example
A 100 ms interval checks an idle source about ten times per second. Lowering it increases polling activity.
Last modified on November 4, 2026
