Skip to main content
These settings are available in system.settings and are autogenerated from source.

iceberg_compaction_commit_batch_size

Number of merged data files that background Iceberg compaction accumulates before publishing them in a new snapshot. Compaction results are published in any case once there are no candidates left to compact, so this setting only bounds how long already merged files stay unpublished while compaction keeps finding new work. 0 restores the old behaviour of publishing only when compaction runs out of candidates - a state that is never reached while the table keeps receiving new data files, so every merged output is then written to object storage and never referenced by a snapshot.

iceberg_compaction_data_cleanup

With enable_cleanup_old_data_files_compaction, the time after which a snapshot of an Iceberg table that a newer one replaced is expired, together with the files that only it references. The longer of this and iceberg_outdated_snapshot_lifetime_seconds applies.

iceberg_compaction_delay_bias

Minimum time of delay between 2 background compaction operations.

iceberg_compaction_max_bytes_to_merge

Max total size of the data files merged by one compaction merge of an Iceberg table, the sum of their sizes in the object storage. The same as max_bytes_to_merge_at_max_space_in_pool for MergeTree: when the background pool has fewer free entries than number_of_free_entries_in_pool_to_lower_max_size_of_merge, the limit is lowered down to max_bytes_to_merge_at_min_space_in_pool (both from the merge_tree section of the config). The files of a partition that do not fit are merged by the next merges. Does not apply to a merge that applies position delete files.

iceberg_compaction_max_rows_to_merge

Max total number of rows of the data files merged by one compaction merge of an Iceberg table. The files of a partition that do not fit are merged by the next merges. Does not apply to a merge that applies position delete files.