Glossary, read 10 Nov 2026
Small files problem
All termsOpen the Compute Bill
The fix is compaction into larger files, run on a schedule or by a managed service. The target size is a setting, and managed services publish their own defaults.
Left alone, it raises both query time and the cost of metadata operations.
A sourced example
The Iceberg maintenance page says more data files means more metadata in manifest files, and its sample rewriteDataFiles call combines small files into 500 MB files for the partition with date 2020-08-18.
Sources
- Iceberg documentation: maintenance, read 10 Nov 2026
Last reviewed 10 Nov 2026.