# Lakehouse platforms compared, with the bill for the same work on each

Compared, read 10 Nov 2026

**The short answer.** Ten ways to run Spark batch work on a lakehouse, from Amazon EMR and Databricks to Onehouse and Snowflake, sit side by side with 3 table formats: Iceberg, Delta Lake and Hudi. The Compute Bill has 12 lines for one reference job, 10 r6i.4xlarge nodes for 2 hours in us-east-1, each priced from published rates.

- Amazon EMR on EC2: $25.20
- Amazon EMR on EKS (EC2 nodes): $24.42
- Amazon EMR Serverless: $31.63
- Databricks on AWS (Jobs Compute): $32.40
- Open stack: Spark on plain EC2: $20.16
- BigQuery (Enterprise edition slots): $19.20
- Dremio Cloud (Large engine): $102.40
- DualBird on Amazon EMR (F2 instances): $49.50
- Microsoft Fabric (F128 capacity): $46.08
- Onehouse (Quanton, bring-your-own-cloud): No total
- Snowflake (XL standard warehouse): $96.00
- Starburst Galaxy (Pro tier): $60.00

## The job on every line: Nightly Spark batch job, 10 nodes for 2 hours (us-east-1)

The bill beside the headline prices the same ten EC2 nodes first, then the platforms whose own billing unit is mapped to the job by a stated assumption. Both groups are alphabetical. Lines in the second group bill different units and engines, so each total is read against its own assumption, not against the other lines. 1 of 12 lines has no total (Onehouse); the Compute Bill page says why.

- **Assumption 1:** Region us-east-1; all AWS prices are on-demand Linux prices from the AWS Price List API read on 2026-11-10.
- **Assumption 2:** Worker node: r6i.4xlarge, 16 vCPU and 128 GiB. Ten workers for two hours is 20 node-hours, 160 vCPU and 1,280 GiB.
- **Assumption 3:** The driver or primary node is not counted.
- **Assumption 4:** Storage, S3 requests, EBS, data transfer and public IPv4 charges are excluded.
- **Assumption 5:** No discounts, commitments, Savings Plans or Spot.

## Four ways into the facts

### Asset: Lakehouse Compute Bill (12 lines, 11 with a total)
Published unit prices times one stated workload, with the formula and what each line leaves out.
[Open the Compute Bill](/compute-bill/)

### Formats: Iceberg, Delta Lake, Hudi (3 formats, 8 rows each)
The three open table formats in the same rows: releases, engines, compaction, catalogs.
[Read the formats](/formats/)

### Upkeep: Compaction and table maintenance (5 pages)
What compaction, snapshot expiry and table services do, and which platforms run them for you.
[Read the maintenance pages](/maintenance/iceberg-compaction/)

### Profiles: The platforms, A to Z (10 entries)
Same fields in the same order for every entry: what it does well, where it is limited, the published facts.
[Read the profiles](/platforms/)

## What each platform does well, and where it is limited

| Platform | Kind | Does well | Limited |
| --- | --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | Spark and SQL engines on AWS | Per AWS documentation, the EMR runtime for Spark is 100% API-compatible with open-source Spark, so existing jobs need no rewrite (read 2026-11-10). | Per AWS documentation, Athena compaction is manual (you run OPTIMIZE ... REWRITE DATA USING BIN_PACK and VACUUM), and Glue Iceberg compaction is off by default for new tables. |
| [Databricks](/platforms/databricks/) | Managed lakehouse built around Delta Lake | Per Databricks documentation, Photon keeps the Spark Catalyst planner, works with existing Spark API code and falls back to the Spark runtime for unsupported operations (read 2026-11-10). | Per Databricks documentation, serverless compute supports only Spark Connect APIs, so RDD APIs, R and Maven coordinates are unsupported, and ANSI mode on by default can change results of existing jobs. |
| [Dremio](/platforms/dremio/) | Lakehouse with its own SQL engine | Per Dremio documentation, Iceberg tables in the Open Catalog get automatic optimization: data file compaction, row-level delete handling, clustering, partition evolution and manifest rewriting (read 2026-11-10). | Per Dremio documentation, queries run on its own columnar engine, not on Spark, and the pages read describe no mode that runs existing Spark jobs. |
| [DualBird](/platforms/dualbird/) | FPGA Spark plugin for AWS F2 | DualBird says onboarding is two changes: switch the EC2 instance type to F2 and add the DualBird Spark plugin, with Spark still handling planning and scheduling (read 2026-11-10). | DualBird is not a lakehouse. It speeds up Spark on EMR and EKS; a team on a fully managed platform cannot add it. |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | Serverless Google Cloud data warehouse | Per Google documentation, BigQuery Iceberg managed tables store data in buckets you own, support DML and streaming, and run automatic compaction, clustering and garbage collection (read 2026-11-10). | Per Google documentation, BigQuery Omni on S3 does not support DML or CREATE TABLE, so it does not run write-heavy Spark batch ETL on S3. |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | SaaS analytics on Azure with Spark | Per Microsoft Learn, the native execution engine (Apache Gluten and Velox) needs no code changes, falls back to JVM Spark for unsupported operators and supports Parquet and Delta (read 2026-11-10). | Per Microsoft Learn, Fabric runs over OneLake on Azure and the region page lists Azure regions only, so Spark compute does not run inside AWS. |
| [Onehouse](/platforms/onehouse/) | Managed lakehouse in your cloud account | Per Onehouse documentation, its jobs are fully compatible with Apache Spark and EMR code can be reused unless it uses AWS-specific features (read 2026-11-10). | Per Onehouse documentation, billing is in OCUs on a bring-your-own-cloud model, and no dollar rate per OCU was found on 2026-11-10. |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | Self-run Spark with open table formats | Per AWS documentation, EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3, so all three formats are available (read 2026-11-10). | Per the Apache Iceberg documentation, users run table maintenance themselves: expire snapshots, remove orphan files and compact with rewriteDataFiles as jobs they schedule (read 2026-11-10). |
| [Snowflake](/platforms/snowflake/) | Cloud data platform with PySpark support | Per Snowflake documentation, Snowpark Connect runs existing PySpark DataFrame code against the Snowflake engine over Spark Connect, and batch jobs are submitted with the Snowpark Submit CLI (read 2026-11-10). | Per Snowflake documentation, Snowpark Connect supports Apache Spark 3.5 only, and DayTimeIntervalType, YearMonthIntervalType and user-defined types are unsupported (read 2026-11-10). |
| [Starburst](/platforms/starburst/) | Managed Trino service for Iceberg | Per Starburst documentation, Galaxy creates and writes Iceberg tables (Parquet, ORC or Avro) and runs maintenance with ALTER TABLE ... EXECUTE optimize, expire_snapshots and remove_orphan_files (read 2026-11-10). | Per Starburst documentation, Galaxy runs SQL on Trino, not Spark, so DataFrame code, UDFs and PySpark would be rewritten as Trino SQL or kept on Spark (read 2026-11-10). |

Alphabetical. First sentence of each; the full text and sources are on the platform's profile.

## Five situations

- [Spark bill doubled on EMR or EKS](/situations/bill-doubled/): What to check when an EMR or EKS Spark bill doubled: billing units, cost claims, code changes, settings that move spend, and region, with published facts.
- [Nightly pipelines finish after the morning deadline](/situations/late-pipelines/): For nightly pipelines that miss the morning: published runtimes, who ran them, whether a reader can repeat them, failure behavior on large jobs, and Spark versions.
- [AI and feature pipelines wait on data preparation](/situations/ai-data-prep/): For AI training and feature pipelines that wait on data prep: table formats, unchanged Spark code, UDF and fallback behavior, and where data has to live.
- [Leaving Databricks or Snowflake for an open stack](/situations/leaving-managed/): For a team weighing a move from Databricks or Snowflake to an open stack: what you own afterward, shared table formats, Spark changes and cloud coverage.
- [Large Iceberg tables with daily compaction cost](/situations/iceberg-compaction/): For teams paying for daily Iceberg compaction: who runs it, the published unit prices, strategies, delete handling and the benchmarks that exist.

## What a lakehouse is

A lakehouse keeps data as open files, usually Parquet, in object storage such as Amazon S3, and adds a table format over the files. The table format records which files make up a table, so engines can read and write it with transactions. Apache Iceberg, Delta Lake and Apache Hudi are the three open table formats covered here.

Any engine that understands the format can use the same table. The Apache Iceberg home page names Spark, Trino, Flink, Presto, Hive and Impala as engines that work with the same tables at the same time. The Delta Lake home page lists a similar set, and the Hudi home page lists Spark, Flink and others under data processing.

The platforms on this site differ in who runs the engine, who maintains the tables (compaction, snapshot cleanup, file layout) and what they bill for. A team that owns the Spark cluster bill needs those three facts side by side, each with its source and read date.

Data catalogs in the governance sense, lineage, semantic layers and MCP servers for data are outside the subject of this site.

## Guides and glossary

- [What is a data lakehouse: definition, origins, 2021 paper](/guides/what-is-a-data-lakehouse/)
- [Databricks vs Snowflake: published facts side by side](/guides/databricks-vs-snowflake-facts/)
- [Iceberg vs Delta Lake: documented facts, no pick](/guides/iceberg-vs-delta-lake/)
- [EMR cost optimization for an Iceberg lakehouse](/guides/emr-cost-optimization-lakehouse/)
- [Choosing a table format: what to check for Iceberg, Delta, Hudi](/guides/choosing-a-table-format/)
- [The open stack on AWS: Spark, table formats and catalogs](/guides/open-stack-on-aws/)
- [All guides](/guides/)
- [Glossary: 35 terms](/glossary/)

## Sources

- Apache Iceberg home page: https://iceberg.apache.org/ (read 10 Nov 2026)
- Delta Lake home page: https://delta.io/ (read 10 Nov 2026)
- Apache Hudi home page: https://hudi.apache.org/ (read 10 Nov 2026)
- AWS Price List API, Amazon EC2, us-east-1 (published 2026-11-10): https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonEC2/current/us-east-1/index.json (read 10 Nov 2026)
- AWS Price List API, Amazon EMR, us-east-1 (published 2026-11-10): https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/ElasticMapReduce/current/us-east-1/index.json (read 10 Nov 2026)
- Amazon EKS pricing page: https://aws.amazon.com/eks/pricing/ (read 10 Nov 2026)
- Databricks pricing data file loaded by its pricing calculator, AWS: https://www.databricks.com/en-pricing-assets/data/pricing/AWS.json (read 10 Nov 2026)
- Google BigQuery pricing page: https://cloud.google.com/bigquery/pricing (read 10 Nov 2026)
- Azure Retail Prices API, Microsoft Fabric, eastus: https://prices.azure.com/api/retail/prices?$filter=serviceName eq 'Microsoft Fabric' and armRegionName eq 'eastus' (read 10 Nov 2026)
- Starburst Galaxy pricing details: https://www.starburst.io/pricing/pricing-details/ (read 10 Nov 2026)
- Snowflake Service Consumption Table, effective 2026-11-09: https://www.snowflake.com/legal-files/CreditConsumptionTable.pdf (read 10 Nov 2026)
- Dremio pricing page: https://www.dremio.com/pricing (read 10 Nov 2026)
- Dremio Cloud engines documentation: https://docs.dremio.com/dremio-cloud/admin/engines/ (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://datalakehousecompare.com/
