# Compaction on each platform: what is automated, what is billed

Table maintenance, read 10 Nov 2026

**The short answer.** AWS S3 Tables compacts on by default and Glue on request; Databricks, Dremio, Snowflake and BigQuery document managed compaction; Athena and Starburst Galaxy run it only when you issue a command. DualBird reports its own compaction benchmark, shown here as DualBird's.

## The table

| Platform | Automatic compaction | How it is billed or triggered | Source |
| --- | --- | --- | --- |
| Amazon Athena | No: manual OPTIMIZE ... REWRITE DATA USING BIN_PACK, plus VACUUM | You issue the statements | Athena docs |
| Amazon S3 Tables | Yes, on by default for every table; 512 MB default target (64 to 512 MB); auto, binpack, sort, z-order | $0.005 per GB plus $0.002 per 1,000 objects; sort or z-order $0.01 per GB plus $0.002 per 1,000 objects (us-east-1) | S3 docs and price list |
| AWS Glue Data Catalog | Yes, but off by default; enabled per table with an IAM role; starts above 100 files each under 75% of target | $0.44 per DPU-hour (us-east-1); Parquet tables only | Glue docs and price list |
| BigQuery | Yes, for Iceberg managed tables: compaction, clustering and garbage collection | DCUs billed per second; load and export use Enterprise pay-as-you-go slots | Google Cloud docs |
| Databricks | Yes, predictive optimization on Unity Catalog managed Delta and Iceberg tables; on by default | Serverless jobs SKU; does not run ZORDER | Databricks docs |
| Dremio | Yes, for Iceberg tables in the Open Catalog, on a dedicated engine it configures; OPTIMIZE TABLE for manual runs | Engines bill DCUs; Dremio says it prefers automatic over manual runs | Dremio docs |
| Onehouse | Vendor claims automated asynchronous table services | Billed in OCUs; no dollar rate found | Onehouse docs |
| Snowflake | Yes for Snowflake-managed Iceberg tables, on by default; none for externally managed tables | Billable credits; bundled when only Snowflake writes to Snowflake storage; Automatic Clustering billed separately | Snowflake docs |
| Starburst Galaxy | No: ALTER TABLE ... EXECUTE optimize; files under 100 MB by default are merged | You issue the command; managed ingest table maintenance 0.30 credits per hour | Starburst docs |

Vendors alphabetical, AWS services first. Facts read 2026-11-10 from each vendor's documentation. This table lists automation and does not compare quality or cost.

## Open-source engines and EMR

Open-source Iceberg, Delta Lake and Hudi leave compaction to a job you schedule, with settings such as Delta auto compaction (128 MB target) and Hudi async compaction as partial exceptions. Amazon EMR runs those jobs as Spark on EC2, EKS or Serverless and does not schedule them. The format pages are [Iceberg compaction](/maintenance/iceberg-compaction/), [Delta OPTIMIZE and VACUUM](/maintenance/delta-optimize-and-vacuum/) and [Hudi table services](/maintenance/hudi-table-services/).

Microsoft Fabric documents OPTIMIZE and an auto compaction setting for Delta tables; managed Iceberg compaction for Fabric: none found on 2026-11-10 in the pages read, and Fabric does not run inside AWS.

## What the managed options leave to you

Snapshot expiry and orphan file removal are separate services on some platforms and none were found on others in the pages read; see [snapshot expiry and orphan files](/maintenance/snapshot-expiry-and-orphan-files/). S3 Tables snapshot management fails on tables with user-defined tags or branches. Glue deletes only orphans created after the optimizer was created. Snowflake says it does not support orphan file deletion for Snowflake-managed Iceberg tables. Databricks predictive optimization skips tables outside Unity Catalog management.

## DualBird's own compaction benchmark

DualBird, a Spark plugin vendor, published a sort-based Iceberg compaction benchmark in a blog post dated June 11, 2026, and a white paper landing page dated July 1, 2026. DualBird ran it, and no third-party run was found on 2026-11-10. The dataset is synthetic: about 370 million rows, 64 mixed-type columns, ZSTD level 3, 100 GB. The baselines are vanilla Spark and an unnamed C++ accelerated Spark.

DualBird says it measured roughly 12 to 20 times faster single-task execution, 55% to 85% lower EC2 cost, and a compaction cost of about $2 per TB against about $6 per TB rising past $13 per TB on CPU clusters. It attributes part of the saving to F2 local NVMe replacing EBS volumes. The DualBird home page shows a tile reading X15-X20 for what appears to be the same test, so the two published ranges differ. The white paper with the method is behind a sign-up form, and the blog gives no instance counts, Spark version, configuration or scripts.

DualBird is not a lakehouse. It speeds up Spark on EMR and EKS; a team on a fully managed platform cannot add it. It documents no Spark version list and no table-format support list; Iceberg appears only in its own compaction benchmark.

## Other maintenance pages

- [Iceberg compaction: rewrite_data_files, strategies, platforms](/maintenance/iceberg-compaction/)
- [Iceberg snapshot expiry and orphan file removal](/maintenance/snapshot-expiry-and-orphan-files/)
- [Delta Lake OPTIMIZE and VACUUM: defaults and platform automation](/maintenance/delta-optimize-and-vacuum/)
- [Apache Hudi table services: compaction, clustering, cleaning](/maintenance/hudi-table-services/)

## Sources

- Athena Iceberg optimization: https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg-data-optimization.html (read 10 Nov 2026)
- Amazon S3 Tables maintenance: https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-maintenance.html (read 10 Nov 2026)
- AWS price list, Amazon S3, us-east-1: https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonS3/current/index.json (read 10 Nov 2026)
- AWS Glue compaction optimization: https://docs.aws.amazon.com/glue/latest/dg/compaction-management.html (read 10 Nov 2026)
- AWS price list, AWS Glue, us-east-1: https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AWSGlue/current/index.json (read 10 Nov 2026)
- BigQuery Iceberg tables: https://cloud.google.com/bigquery/docs/iceberg-tables (read 10 Nov 2026)
- Databricks predictive optimization: https://docs.databricks.com/aws/en/optimizations/predictive-optimization (read 10 Nov 2026)
- Dremio Cloud table optimization: https://docs.dremio.com/dremio-cloud/manage-govern/optimization (read 10 Nov 2026)
- Snowflake Iceberg table management: https://docs.snowflake.com/en/user-guide/tables-iceberg-manage (read 10 Nov 2026)
- Snowflake Iceberg storage: https://docs.snowflake.com/en/user-guide/tables-iceberg-storage (read 10 Nov 2026)
- Starburst Galaxy Iceberg: https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-iceberg.html (read 10 Nov 2026)
- Starburst Galaxy pricing details: https://www.starburst.io/pricing/pricing-details/ (read 10 Nov 2026)
- Onehouse about: https://www.onehouse.ai/about-us (read 10 Nov 2026)
- Fabric table compaction: https://learn.microsoft.com/en-us/fabric/data-engineering/table-compaction (read 10 Nov 2026)
- DualBird, Iceberg compaction benchmark blog, 2026-06-11: https://dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-lower-cost (read 10 Nov 2026)
- DualBird, compaction white paper landing page: https://dualbird.io/resources/blog/spark-iceberg-compaction-benchmark-whitepaper (read 10 Nov 2026)
- DualBird home page: https://dualbird.io/ (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://datalakehousecompare.com/maintenance/compaction-on-each-platform/
