iceberg_compaction_commit_batch_size
Number of merged data files that background Iceberg compaction accumulates before publishing them in a new snapshot. Compaction results are published in any case once there are no candidates left to compact, so this setting only bounds how long already merged files stay unpublished while compaction keeps finding new work.0 restores the old behaviour
of publishing only when compaction runs out of candidates - a state that is never reached while the table keeps
receiving new data files, so every merged output is then written to object storage and never referenced by a snapshot.
iceberg_compaction_data_cleanup
Withenable_cleanup_old_data_files_compaction, the time after which a snapshot of an Iceberg table that a newer one replaced is
expired, together with the files that only it references. The longer of this and iceberg_outdated_snapshot_lifetime_seconds applies.
iceberg_compaction_delay_bias
Minimum time of delay between 2 background compaction operations.iceberg_compaction_max_bytes_to_merge
Max total size of the data files merged by one compaction merge of an Iceberg table, the sum of their sizes in the object storage. The same asmax_bytes_to_merge_at_max_space_in_pool for MergeTree: when the background pool has fewer free entries than
number_of_free_entries_in_pool_to_lower_max_size_of_merge, the limit is lowered down to max_bytes_to_merge_at_min_space_in_pool
(both from the merge_tree section of the config).
The files of a partition that do not fit are merged by the next merges. Does not apply to a merge that applies position delete files.