# Spark bill doubled on EMR or EKS: what to check on a lakehouse platform

Situation, read 10 Nov 2026

**The short answer.** A data platform team on EMR or EKS sees the Spark bill double in a year and asks whether another way of running the same work costs less. The checks below cover the billing unit, the cost claims and who tested them, whether jobs run unchanged, the settings that move the bill, and the AWS region.

## 5 things to check, with the published facts that answer each

### Which unit does each platform bill compute in, and is the rate published?

A bill that doubled is a volume times a rate. The unit tells you which of the two you can change, and an unpublished rate cannot be compared before a trial.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | The AWS price list shows an EMR uplift of $0.048 per hour for an m5.xlarge in us-east-1, added to the EC2 price; EMR on EKS adds $0.007084 per vCPU-hour and $0.000777875 per GB-hour. | [AWS price list](https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/ElasticMapReduce/current/index.json), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Databricks bills compute in DBUs per second; the pricing pages render their rates by script, and the data file behind the pricing calculator lists Jobs Compute on AWS at $0.15 per DBU on the Premium plan (read 2026-11-10). | [Databricks pricing data file (AWS), loaded by its pricing calculator](https://www.databricks.com/en-pricing-assets/data/pricing/AWS.json), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio Cloud is priced at $0.20 per DCU, billed only while engines run with a 60-second minimum; Dremio Enterprise pricing is "contact sales". | [Dremio page](https://www.dremio.com/pricing), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | A price or pricing model for the DualBird plugin: none found on 2026-11-10. | [DualBird page](https://dualbird.io/?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery offers on-demand pricing per TiB scanned or capacity pricing per slot-hour; the page text read on 2026-11-10 lists Enterprise edition compute at $0.06 per slot-hour, with no region shown beside the rate. | [Google Cloud documentation](https://cloud.google.com/bigquery/pricing), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | The Azure retail price API lists Fabric Spark capacity usage at $0.18 per CU-hour for eastus, pay-as-you-go. | [Azure retail price API](https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Microsoft%20Fabric'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse bills in OCUs, where 1 OCU is a 4-core instance for 1 hour in your account, plus support costs; you also pay your own AWS or GCP bill. A dollar rate per OCU: none found on 2026-11-10. | [Onehouse documentation](https://docs.onehouse.ai/product/project-settings/usage-and-billing), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | AWS's example in us-east-1 shows a c4.2xlarge EMR charge of $0.105 per hour next to $0.398 per hour for EC2; spot instances are up to a 90% discount versus On-Demand. | [AWS page](https://aws.amazon.com/emr/pricing/), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake's Service Consumption Table, effective 2026-11-09, lists on-demand credits on AWS US East (Northern Virginia) at $2.00 (Standard), $3.00 (Enterprise) and $4.00 (Business Critical); warehouses bill per second with a 60-second minimum on each start. | [Snowflake Service Consumption Table](https://www.snowflake.com/legal-files/CreditConsumptionTable.pdf), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy cluster compute uses 6 credits per hour for 1 worker and 48 for 8 workers; credit prices on AWS start at $0.50 (Pro) in US East (N. Virginia). | [Starburst page](https://www.starburst.io/pricing/pricing-details/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### What does each vendor claim about cost, who ran the test, and is the method published?

A cost claim without a workload, a baseline or a method cannot be tied to your jobs. The party that ran the test matters as much as the percentage.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | AWS states the EMR runtime runs up to 4.5x faster than open-source Spark with 2.7x faster Iceberg writes; the page gives no workload, scale or configuration. | [AWS page](https://aws.amazon.com/emr/features/spark/), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Databricks documentation claims up to 5x better price/performance for Photon versus other cloud data warehouses, with no method given on that page. | [Databricks documentation](https://docs.databricks.com/aws/en/compute/photon), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | DualBird says 50% to 90% lower costs with 10x to 30x faster processing; no method is given for that range, and the claim is DualBird's own. | [DualBird page](https://dualbird.io/?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | Google states Lightning Engine delivers up to 4.9x faster performance than open-source Spark; no method is given on the pricing page. | [Google Cloud documentation](https://cloud.google.com/dataproc-serverless/pricing), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | Microsoft reports up to six times faster than open-source Spark on TPC-DS scale factor 1000 with Delta, with about 83% compute cost savings on a fixed-size cluster; its method: none found on 2026-11-10. | [Microsoft Learn documentation](https://learn.microsoft.com/en-us/fabric/data-engineering/runtime), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse states a guaranteed cost reduction of more than 50% for existing Hudi users moving Spark jobs from EMR or open-source Spark; the guarantee is a vendor statement. | [Onehouse page](https://www.onehouse.ai/blog/announcing-spark-and-sql-on-the-onehouse-compute-runtime-with-quanton), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | AWS reports $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0 on TPC-DS 3 TB, On-Demand pricing; AWS ran the test. | [AWS page](https://aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-than-open-source-spark-with-amazon-emr/), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | A published Snowflake benchmark of Spark batch jobs on Snowpark Connect with its method: none found on 2026-11-10. | [Snowflake documentation](https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-apache-spark), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst reports GPU-accelerated Trino at 3.4x overall on ClickBench in a single-node development environment; that is a SQL query test, not Spark batch work. | [Starburst page](https://www.starburst.io/blog/gpu-accelerated-sql-analytics-how-starburst-and-nvidia-deliver-industry-benchmark-speedups-on-gpu-infrastructure/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Do your existing jobs run unchanged, or does a move to another option need a rewrite?

A rewrite is a cost that does not appear on the vendor price page. Check what each platform says about running existing Spark code.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | AWS describes the EMR runtime for Spark as 100% API-compatible with open-source Spark, so existing Spark jobs need no rewrite. | [AWS page](https://aws.amazon.com/emr/features/spark/), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Databricks serverless compute supports only Spark Connect APIs; RDD APIs, R and Maven coordinates are unsupported, and ANSI mode on by default can change results of existing jobs. | [Databricks documentation](https://docs.databricks.com/aws/en/compute/serverless/limitations), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio runs queries on its own Arrow-based engine, not on Spark, so Spark ETL would stay on Spark or be rewritten as Dremio SQL. | [Dremio documentation](https://docs.dremio.com/current/what-is-dremio/architecture), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | DualBird says onboarding is two changes: switch the EC2 instance type to F2 and add the DualBird Spark plugin. | [DualBird page](https://dualbird.io/?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery runs PySpark or Scala/Java JAR code from SQL through CREATE PROCEDURE ... OPTIONS(engine = "SPARK"), so code must be wrapped as procedures. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/spark-procedures), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | Microsoft says the Fabric native execution engine needs no code changes, falls back to JVM Spark for unsupported operators and supports Parquet and Delta. | [Microsoft Learn documentation](https://learn.microsoft.com/en-us/fabric/data-engineering/runtime), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse documentation lists the EMR migration work: map EMR steps to Onehouse Jobs created through its API or Airflow operators, and configure Glue catalog sync. | [Onehouse documentation](https://docs.onehouse.ai/product/jobs/emr-migration), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | AWS says the EMR runtime provides full API compatibility with open-source Apache Spark and Apache Iceberg; self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite. | [AWS page](https://aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-than-open-source-spark-with-amazon-emr/), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowpark Connect supports Apache Spark 3.5 only; workloads written for 3.4 and below or 4.0 and above are unsupported and may fail. | [Snowflake documentation](https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-limitations.md), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy runs SQL on Trino, so Spark DataFrame code, UDFs and PySpark would be rewritten as Trino SQL or kept on Spark against the same Iceberg tables. | [Starburst documentation](https://docs.starburst.io/starburst-galaxy/index.html), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Which settings or limits can raise the bill without a code change?

Idle capacity, scaling limits and instance choices change spend. A setting you must tune is a cost you own.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | EMR enables adaptive query execution, dynamic partition pruning, bloom filter join and optimized join reorder; AQE adaptive join conversion is on by default and can be switched off. | [AWS documentation](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Photon instance types consume DBUs at a different rate than the same instance without Photon, and API users must set runtime_engine to PHOTON. | [Databricks documentation](https://docs.databricks.com/aws/en/compute/photon), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio engine settings the admin chooses include size, minimum and maximum replicas, last-replica auto-stop (default 2 hours) and a query runtime limit. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/admin/engines/), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | DualBird claims many Spark settings become irrelevant and cluster sizing reduces to the number of F2 nodes; these are vendor claims, and DualBird says skew still costs time, but less. | [DualBird page](https://dualbird.io/product?utm_source=datalakehousecompare.com&utm_medium=referral&utm_campaign=situation), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | Fabric Autoscale Billing for Spark is opt-in, runs on dedicated serverless resources at pay-as-you-go CU-hour rates, and a base capacity is still required. | [Azure pricing page](https://azure.microsoft.com/en-us/pricing/details/microsoft-fabric/), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse clusters need minimum and maximum OCU limits; the documentation warns that at the maximum a cluster stops scaling up, which can delay processing. | [Onehouse documentation](https://docs.onehouse.ai/product/compute/create-cluster), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | EMR on EKS adds an uplift per vCPU-hour and per GB-hour plus $0.10 per hour for each EKS cluster, and the uplift applies to any pod using an EMR runtime image. | [AWS page](https://aws.amazon.com/emr/pricing/), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake documents Optimizing and Troubleshooting sections for Snowpark Connect workloads, so some job-level adjustment is expected after migration. | [Snowflake documentation](https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-troubleshooting.md), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy offers a fault tolerant execution mode for batch-style work that spools intermediate data; its documentation says it can be slightly slower than normal execution. | [Starburst documentation](https://docs.starburst.io/starburst-galaxy/data-engineering/optimization-performance-and-quality/workload-optimization/clusters-with-fte.html), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Does the price or availability change with the AWS region you run in?

The reference prices on this site are us-east-1. A region you cannot use, or a platform tied to another cloud, changes the comparison.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | All services in this entry are AWS services and run only on AWS; EMR, Athena, Glue and S3 are priced here in us-east-1. | [AWS page](https://aws.amazon.com/emr/features/spark/), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Databricks lists many AWS regions including us-east-1, us-east-2, eu-west-1 and eu-central-1, and is also hosted on Azure and Google Cloud; some features are only in a subset of regions. | [Databricks documentation](https://docs.databricks.com/aws/en/resources/supported-regions), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio Cloud runs on AWS in us-east-1, us-east-2, us-west-2, eu-west-1 and eu-central-1; Azure is listed as coming soon. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/about/regions), 10 Nov 2026 |
| [DualBird](/platforms/dualbird/) | AWS lists EC2 F2 instances in eight regions; us-east-2 and eu-west-1 are not among them. DualBird's pages mention no cloud other than AWS. | [AWS documentation](https://docs.aws.amazon.com/ec2/latest/instancetypes/ec2-instance-regions.html), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery Omni reads data in S3 in us-east-1, us-west-2, ap-northeast-2, ap-southeast-2, eu-west-1 and eu-central-1. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/omni-introduction), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | Fabric runs over OneLake on Azure; the region page lists Azure regions and no AWS regions, so Spark compute does not run inside AWS. | [Microsoft Learn documentation](https://learn.microsoft.com/en-us/fabric/fundamentals/microsoft-fabric-overview), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse runs inside your AWS or GCP account; a project is scoped to one region and account, and adding a region needs a support ticket. | [Onehouse documentation](https://docs.onehouse.ai/product/project-settings/usage-and-billing), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | Amazon EMR has regional endpoints in us-east-1, us-east-2, us-west-1, us-west-2 and many other AWS regions; you choose the EC2 instance types. | [AWS documentation](https://docs.aws.amazon.com/general/latest/gr/emr.html), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake runs on AWS, Azure and Google Cloud; each account is hosted in a single region. | [Snowflake documentation](https://docs.snowflake.com/en/user-guide/intro-regions.md), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst lists a different credit price by AWS region: Pro credits cost $0.50 in US East (N. Virginia), $0.56 in Ireland, $0.60 in Frankfurt and $0.64 in Tokyo. | [Starburst page](https://www.starburst.io/pricing/pricing-details/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

## Sources

- AWS price list: https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/ElasticMapReduce/current/index.json (read 10 Nov 2026)
- Databricks pricing data file (AWS), loaded by its pricing calculator: https://www.databricks.com/en-pricing-assets/data/pricing/AWS.json (read 10 Nov 2026)
- Dremio page: https://www.dremio.com/pricing (read 10 Nov 2026)
- DualBird page: https://dualbird.io/ (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/pricing (read 10 Nov 2026)
- Azure retail price API: https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Microsoft%20Fabric'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption' (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/project-settings/usage-and-billing (read 10 Nov 2026)
- AWS page: https://aws.amazon.com/emr/pricing/ (read 10 Nov 2026)
- Snowflake Service Consumption Table: https://www.snowflake.com/legal-files/CreditConsumptionTable.pdf (read 10 Nov 2026)
- Starburst page: https://www.starburst.io/pricing/pricing-details/ (read 10 Nov 2026)
- AWS page: https://aws.amazon.com/emr/features/spark/ (read 10 Nov 2026)
- Databricks documentation: https://docs.databricks.com/aws/en/compute/photon (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/dataproc-serverless/pricing (read 10 Nov 2026)
- Microsoft Learn documentation: https://learn.microsoft.com/en-us/fabric/data-engineering/runtime (read 10 Nov 2026)
- Onehouse page: https://www.onehouse.ai/blog/announcing-spark-and-sql-on-the-onehouse-compute-runtime-with-quanton (read 10 Nov 2026)
- AWS page: https://aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-than-open-source-spark-with-amazon-emr/ (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-apache-spark (read 10 Nov 2026)
- Starburst page: https://www.starburst.io/blog/gpu-accelerated-sql-analytics-how-starburst-and-nvidia-deliver-industry-benchmark-speedups-on-gpu-infrastructure/ (read 10 Nov 2026)
- Databricks documentation: https://docs.databricks.com/aws/en/compute/serverless/limitations (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/current/what-is-dremio/architecture (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/docs/spark-procedures (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/jobs/emr-migration (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-limitations.md (read 10 Nov 2026)
- Starburst documentation: https://docs.starburst.io/starburst-galaxy/index.html (read 10 Nov 2026)
- AWS documentation: https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/admin/engines/ (read 10 Nov 2026)
- DualBird page: https://dualbird.io/product (read 10 Nov 2026)
- Azure pricing page: https://azure.microsoft.com/en-us/pricing/details/microsoft-fabric/ (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/compute/create-cluster (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-troubleshooting.md (read 10 Nov 2026)
- Starburst documentation: https://docs.starburst.io/starburst-galaxy/data-engineering/optimization-performance-and-quality/workload-optimization/clusters-with-fte.html (read 10 Nov 2026)
- Databricks documentation: https://docs.databricks.com/aws/en/resources/supported-regions (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/about/regions (read 10 Nov 2026)
- AWS documentation: https://docs.aws.amazon.com/ec2/latest/instancetypes/ec2-instance-regions.html (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/docs/omni-introduction (read 10 Nov 2026)
- Microsoft Learn documentation: https://learn.microsoft.com/en-us/fabric/fundamentals/microsoft-fabric-overview (read 10 Nov 2026)
- AWS documentation: https://docs.aws.amazon.com/general/latest/gr/emr.html (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/user-guide/intro-regions.md (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://datalakehousecompare.com/situations/bill-doubled/
