# Large Iceberg tables and daily compaction cost: what to check on a lakehouse platform

Situation, read 10 Nov 2026

**The short answer.** A team that maintains large Iceberg tables pays for compaction every day, whether through a managed service, scheduled Spark jobs or an accelerator. The checks below cover who runs compaction, the published unit price, which strategies are documented, how deletes are handled, and what has been benchmarked.

## 6 things to check, with the published facts that answer each

### Who runs compaction on each platform: the platform or your team?

Compaction that runs by default costs money you did not schedule. Compaction you schedule costs engineering time.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | S3 Tables compaction is on by default for all tables with a 512 MB default target file size (configurable 64 to 512 MB); Glue Iceberg compaction is disabled by default for new tables, and Athena compaction is manual. | [AWS documentation](https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-maintenance.html), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio runs automatic optimization on a dedicated engine it configures, and the same operations can be run by hand with OPTIMIZE TABLE. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/manage-govern/optimization), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery Iceberg managed tables run automatic storage optimization, so compaction needs no job configuration on Google Cloud. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/iceberg-tables), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse lists a Table Optimizer among its product claims. | [Onehouse page](https://www.onehouse.ai/about-us), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | Iceberg documentation shows compaction as the Spark rewriteDataFiles action, with target-file-size-bytes of 500 MB in its example, run as a job you schedule. | [Apache Iceberg documentation](https://iceberg.apache.org/docs/latest/maintenance/), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy compacts with ALTER TABLE ... EXECUTE optimize; files under file_size_threshold (default 100MB) are merged. | [Starburst documentation](https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-iceberg.html), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### What is the published unit price for compaction?

A per-unit price lets you multiply by your own daily volume. Unit prices differ in what they count: gigabytes, objects, DPU-hours or credits.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | S3 Tables in us-east-1: compaction is $0.005 per GB processed plus $0.002 per 1,000 objects; sort or Z-order compaction is $0.01 per GB plus $0.002 per 1,000 objects. | [AWS price list](https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonS3/current/index.json), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio bills compute in DCUs only while engines are running; billable usage is DCUs for compute, LLM tokens for AI features and storage. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/admin/subscription/usage), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | DualBird states about $2 per TB compacted for itself against about $6 per TB rising past $13 per TB for CPU clusters; DualBird ran the test and part of the saving is attributed to F2 local NVMe. | [DualBird page](https://dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-lower-cost?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery storage optimization is a separate billed item; the dollar rate for it: none found on 2026-11-10 in the pricing page text read. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/iceberg-tables), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse bills in OCUs (1 OCU is a 4-core instance for 1 hour in your account); no dollar rate per OCU was found on 2026-11-10. | [Onehouse documentation](https://docs.onehouse.ai/product/project-settings/usage-and-billing), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy lists table maintenance and data transforms at 0.30 credits per hour and file ingest at 0.60 credits per hour. | [Starburst page](https://www.starburst.io/pricing/pricing-details/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Which Glue and EMR line items apply when your own Spark job compacts?

Self-run compaction is billed as ordinary compute plus storage requests. The AWS price list gives the rates.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | Glue Iceberg compaction costs $0.44 per DPU-hour in us-east-1; Glue 6.0+ ETL jobs cost $0.308 per DPU-hour and older Glue ETL $0.44. | [AWS price list](https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AWSGlue/current/index.json), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | EMR Serverless bills vCPU-hours and GB-hours of workers; the us-east-1 rates in AWS's pricing example are $0.052624 and $0.0057785. | [AWS page](https://aws.amazon.com/emr/pricing/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Which compaction and layout strategies does each platform document?

Bin-pack, sort and Z-order rewrite files differently and cost differently. Check which one the price covers.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | Athena documents OPTIMIZE ... REWRITE DATA USING BIN_PACK; S3 Tables prices sort and Z-order compaction separately from standard compaction. | [AWS documentation](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg-data-optimization.html), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio documents data file compaction, clustering, partition evolution and manifest rewriting for Iceberg tables in its Open Catalog. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/manage-govern/optimization), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | DualBird's published benchmark is sort-based Iceberg compaction on a synthetic table of about 370 million rows and 64 columns with ZSTD level 3. | [DualBird page](https://dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-lower-cost?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery Iceberg managed tables document automatic compaction, clustering and garbage collection. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/iceberg-tables), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | Iceberg documents rewriteDataFiles and manifest rewriting as optional maintenance; Hudi merge-on-read tables need compaction to bound read latency, and Delta Lake documents OPTIMIZE. | [Apache Iceberg documentation](https://iceberg.apache.org/docs/latest/maintenance/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### How are row-level deletes handled during compaction?

Tables with frequent deletes carry delete files. Compaction either applies them or leaves them for readers.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | S3 Tables compaction also applies row-level deletes. | [AWS documentation](https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-maintenance.html), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio handles row-level deletes for Iceberg tables with position deletes on v2 and deletion vectors on v3. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/manage-govern/optimization), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### What has been benchmarked for compaction, and by whom?

Most published results are SQL query or ETL tests, and the one compaction benchmark found is run by its vendor.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Dremio](/platforms/dremio/) | Dremio's published benchmark is a 1 TB TPC-DS query test run by Dremio; it is not a compaction test. | [Dremio page](https://www.dremio.com/blog/breakthrough-announcement-dremio-is-the-fastest-lakehouse-20x-faster-on-tpc-ds/), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | DualBird's compaction white paper (July 1, 2026) restates the results and holds methodology, instance counts and Spark version behind a download form; the blog gives dataset shape and baselines. | [DualBird page](https://dualbird.io/resources/blog/spark-iceberg-compaction-benchmark-whitepaper?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | Iceberg, Delta or Hudi compaction benchmarks for EMR or EKS, with time or cost: none found on 2026-11-10. | [Apache Iceberg documentation](https://iceberg.apache.org/docs/latest/maintenance/), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | A Starburst benchmark of compaction on Galaxy CPU clusters with data size and scripts: none found on 2026-11-10. | [Starburst page](https://www.starburst.io/sitemap.xml), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

## Sources

- AWS documentation: https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-maintenance.html (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/manage-govern/optimization (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/docs/iceberg-tables (read 10 Nov 2026)
- Onehouse page: https://www.onehouse.ai/about-us (read 10 Nov 2026)
- Apache Iceberg documentation: https://iceberg.apache.org/docs/latest/maintenance/ (read 10 Nov 2026)
- Starburst documentation: https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-iceberg.html (read 10 Nov 2026)
- AWS price list: https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonS3/current/index.json (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/admin/subscription/usage (read 10 Nov 2026)
- DualBird page: https://dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-lower-cost (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/project-settings/usage-and-billing (read 10 Nov 2026)
- Starburst page: https://www.starburst.io/pricing/pricing-details/ (read 10 Nov 2026)
- AWS price list: https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AWSGlue/current/index.json (read 10 Nov 2026)
- AWS page: https://aws.amazon.com/emr/pricing/ (read 10 Nov 2026)
- AWS documentation: https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg-data-optimization.html (read 10 Nov 2026)
- Dremio page: https://www.dremio.com/blog/breakthrough-announcement-dremio-is-the-fastest-lakehouse-20x-faster-on-tpc-ds/ (read 10 Nov 2026)
- DualBird page: https://dualbird.io/resources/blog/spark-iceberg-compaction-benchmark-whitepaper (read 10 Nov 2026)
- Starburst page: https://www.starburst.io/sitemap.xml (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://datalakehousecompare.com/situations/iceberg-compaction/
