Situation, read 10 Nov 2026
Spark bill doubled on EMR or EKS: what to check on a lakehouse platform
All situationsOpen the Compute Bill
5 things to check, with the published facts that answer each
Which unit does each platform bill compute in, and is the rate published?
A bill that doubled is a volume times a rate. The unit tells you which of the two you can change, and an unpublished rate cannot be compared before a trial.
| Option | Published fact | Source, read |
|---|---|---|
| Amazon EMR plus Athena on Iceberg | The AWS price list shows an EMR uplift of $0.048 per hour for an m5.xlarge in us-east-1, added to the EC2 price; EMR on EKS adds $0.007084 per vCPU-hour and $0.000777875 per GB-hour. | AWS price list, 10 Nov 2026 |
| Databricks | Databricks bills compute in DBUs per second; the pricing pages render their rates by script, and the data file behind the pricing calculator lists Jobs Compute on AWS at $0.15 per DBU on the Premium plan (read 2026-11-10). | Databricks pricing data file (AWS), loaded by its pricing calculator, 10 Nov 2026 |
| Dremio | Dremio Cloud is priced at $0.20 per DCU, billed only while engines run with a 60-second minimum; Dremio Enterprise pricing is "contact sales". | Dremio page, 10 Nov 2026 |
| DualBird | A price or pricing model for the DualBird plugin: none found on 2026-11-10. | DualBird page, 10 Nov 2026 |
| Google BigQuery and BigLake | BigQuery offers on-demand pricing per TiB scanned or capacity pricing per slot-hour; the page text read on 2026-11-10 lists Enterprise edition compute at $0.06 per slot-hour, with no region shown beside the rate. | Google Cloud documentation, 10 Nov 2026 |
| Microsoft Fabric | The Azure retail price API lists Fabric Spark capacity usage at $0.18 per CU-hour for eastus, pay-as-you-go. | Azure retail price API, 10 Nov 2026 |
| Onehouse | Onehouse bills in OCUs, where 1 OCU is a 4-core instance for 1 hour in your account, plus support costs; you also pay your own AWS or GCP bill. A dollar rate per OCU: none found on 2026-11-10. | Onehouse documentation, 10 Nov 2026 |
| Open stack on EMR and EKS | AWS's example in us-east-1 shows a c4.2xlarge EMR charge of $0.105 per hour next to $0.398 per hour for EC2; spot instances are up to a 90% discount versus On-Demand. | AWS page, 10 Nov 2026 |
| Snowflake | Snowflake's Service Consumption Table, effective 2026-11-09, lists on-demand credits on AWS US East (Northern Virginia) at $2.00 (Standard), $3.00 (Enterprise) and $4.00 (Business Critical); warehouses bill per second with a 60-second minimum on each start. | Snowflake Service Consumption Table, 10 Nov 2026 |
| Starburst | Starburst Galaxy cluster compute uses 6 credits per hour for 1 worker and 48 for 8 workers; credit prices on AWS start at $0.50 (Pro) in US East (N. Virginia). | Starburst page, 10 Nov 2026 |
What does each vendor claim about cost, who ran the test, and is the method published?
A cost claim without a workload, a baseline or a method cannot be tied to your jobs. The party that ran the test matters as much as the percentage.
| Option | Published fact | Source, read |
|---|---|---|
| Amazon EMR plus Athena on Iceberg | AWS states the EMR runtime runs up to 4.5x faster than open-source Spark with 2.7x faster Iceberg writes; the page gives no workload, scale or configuration. | AWS page, 10 Nov 2026 |
| Databricks | Databricks documentation claims up to 5x better price/performance for Photon versus other cloud data warehouses, with no method given on that page. | Databricks documentation, 10 Nov 2026 |
| DualBird | DualBird says 50% to 90% lower costs with 10x to 30x faster processing; no method is given for that range, and the claim is DualBird's own. | DualBird page, 10 Nov 2026 |
| Google BigQuery and BigLake | Google states Lightning Engine delivers up to 4.9x faster performance than open-source Spark; no method is given on the pricing page. | Google Cloud documentation, 10 Nov 2026 |
| Microsoft Fabric | Microsoft reports up to six times faster than open-source Spark on TPC-DS scale factor 1000 with Delta, with about 83% compute cost savings on a fixed-size cluster; its method: none found on 2026-11-10. | Microsoft Learn documentation, 10 Nov 2026 |
| Onehouse | Onehouse states a guaranteed cost reduction of more than 50% for existing Hudi users moving Spark jobs from EMR or open-source Spark; the guarantee is a vendor statement. | Onehouse page, 10 Nov 2026 |
| Open stack on EMR and EKS | AWS reports $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0 on TPC-DS 3 TB, On-Demand pricing; AWS ran the test. | AWS page, 10 Nov 2026 |
| Snowflake | A published Snowflake benchmark of Spark batch jobs on Snowpark Connect with its method: none found on 2026-11-10. | Snowflake documentation, 10 Nov 2026 |
| Starburst | Starburst reports GPU-accelerated Trino at 3.4x overall on ClickBench in a single-node development environment; that is a SQL query test, not Spark batch work. | Starburst page, 10 Nov 2026 |
Do your existing jobs run unchanged, or does a move to another option need a rewrite?
A rewrite is a cost that does not appear on the vendor price page. Check what each platform says about running existing Spark code.
| Option | Published fact | Source, read |
|---|---|---|
| Amazon EMR plus Athena on Iceberg | AWS describes the EMR runtime for Spark as 100% API-compatible with open-source Spark, so existing Spark jobs need no rewrite. | AWS page, 10 Nov 2026 |
| Databricks | Databricks serverless compute supports only Spark Connect APIs; RDD APIs, R and Maven coordinates are unsupported, and ANSI mode on by default can change results of existing jobs. | Databricks documentation, 10 Nov 2026 |
| Dremio | Dremio runs queries on its own Arrow-based engine, not on Spark, so Spark ETL would stay on Spark or be rewritten as Dremio SQL. | Dremio documentation, 10 Nov 2026 |
| DualBird | DualBird says onboarding is two changes: switch the EC2 instance type to F2 and add the DualBird Spark plugin. | DualBird page, 10 Nov 2026 |
| Google BigQuery and BigLake | BigQuery runs PySpark or Scala/Java JAR code from SQL through CREATE PROCEDURE ... OPTIONS(engine = "SPARK"), so code must be wrapped as procedures. | Google Cloud documentation, 10 Nov 2026 |
| Microsoft Fabric | Microsoft says the Fabric native execution engine needs no code changes, falls back to JVM Spark for unsupported operators and supports Parquet and Delta. | Microsoft Learn documentation, 10 Nov 2026 |
| Onehouse | Onehouse documentation lists the EMR migration work: map EMR steps to Onehouse Jobs created through its API or Airflow operators, and configure Glue catalog sync. | Onehouse documentation, 10 Nov 2026 |
| Open stack on EMR and EKS | AWS says the EMR runtime provides full API compatibility with open-source Apache Spark and Apache Iceberg; self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite. | AWS page, 10 Nov 2026 |
| Snowflake | Snowpark Connect supports Apache Spark 3.5 only; workloads written for 3.4 and below or 4.0 and above are unsupported and may fail. | Snowflake documentation, 10 Nov 2026 |
| Starburst | Starburst Galaxy runs SQL on Trino, so Spark DataFrame code, UDFs and PySpark would be rewritten as Trino SQL or kept on Spark against the same Iceberg tables. | Starburst documentation, 10 Nov 2026 |
Which settings or limits can raise the bill without a code change?
Idle capacity, scaling limits and instance choices change spend. A setting you must tune is a cost you own.
| Option | Published fact | Source, read |
|---|---|---|
| Amazon EMR plus Athena on Iceberg | EMR enables adaptive query execution, dynamic partition pruning, bloom filter join and optimized join reorder; AQE adaptive join conversion is on by default and can be switched off. | AWS documentation, 10 Nov 2026 |
| Databricks | Photon instance types consume DBUs at a different rate than the same instance without Photon, and API users must set runtime_engine to PHOTON. | Databricks documentation, 10 Nov 2026 |
| Dremio | Dremio engine settings the admin chooses include size, minimum and maximum replicas, last-replica auto-stop (default 2 hours) and a query runtime limit. | Dremio documentation, 10 Nov 2026 |
| DualBird | DualBird claims many Spark settings become irrelevant and cluster sizing reduces to the number of F2 nodes; these are vendor claims, and DualBird says skew still costs time, but less. | DualBird page, 10 Nov 2026 |
| Microsoft Fabric | Fabric Autoscale Billing for Spark is opt-in, runs on dedicated serverless resources at pay-as-you-go CU-hour rates, and a base capacity is still required. | Azure pricing page, 10 Nov 2026 |
| Onehouse | Onehouse clusters need minimum and maximum OCU limits; the documentation warns that at the maximum a cluster stops scaling up, which can delay processing. | Onehouse documentation, 10 Nov 2026 |
| Open stack on EMR and EKS | EMR on EKS adds an uplift per vCPU-hour and per GB-hour plus $0.10 per hour for each EKS cluster, and the uplift applies to any pod using an EMR runtime image. | AWS page, 10 Nov 2026 |
| Snowflake | Snowflake documents Optimizing and Troubleshooting sections for Snowpark Connect workloads, so some job-level adjustment is expected after migration. | Snowflake documentation, 10 Nov 2026 |
| Starburst | Starburst Galaxy offers a fault tolerant execution mode for batch-style work that spools intermediate data; its documentation says it can be slightly slower than normal execution. | Starburst documentation, 10 Nov 2026 |
Does the price or availability change with the AWS region you run in?
The reference prices on this site are us-east-1. A region you cannot use, or a platform tied to another cloud, changes the comparison.
| Option | Published fact | Source, read |
|---|---|---|
| Amazon EMR plus Athena on Iceberg | All services in this entry are AWS services and run only on AWS; EMR, Athena, Glue and S3 are priced here in us-east-1. | AWS page, 10 Nov 2026 |
| Databricks | Databricks lists many AWS regions including us-east-1, us-east-2, eu-west-1 and eu-central-1, and is also hosted on Azure and Google Cloud; some features are only in a subset of regions. | Databricks documentation, 10 Nov 2026 |
| Dremio | Dremio Cloud runs on AWS in us-east-1, us-east-2, us-west-2, eu-west-1 and eu-central-1; Azure is listed as coming soon. | Dremio documentation, 10 Nov 2026 |
| DualBird | AWS lists EC2 F2 instances in eight regions; us-east-2 and eu-west-1 are not among them. DualBird's pages mention no cloud other than AWS. | AWS documentation, 10 Nov 2026 |
| Google BigQuery and BigLake | BigQuery Omni reads data in S3 in us-east-1, us-west-2, ap-northeast-2, ap-southeast-2, eu-west-1 and eu-central-1. | Google Cloud documentation, 10 Nov 2026 |
| Microsoft Fabric | Fabric runs over OneLake on Azure; the region page lists Azure regions and no AWS regions, so Spark compute does not run inside AWS. | Microsoft Learn documentation, 10 Nov 2026 |
| Onehouse | Onehouse runs inside your AWS or GCP account; a project is scoped to one region and account, and adding a region needs a support ticket. | Onehouse documentation, 10 Nov 2026 |
| Open stack on EMR and EKS | Amazon EMR has regional endpoints in us-east-1, us-east-2, us-west-1, us-west-2 and many other AWS regions; you choose the EC2 instance types. | AWS documentation, 10 Nov 2026 |
| Snowflake | Snowflake runs on AWS, Azure and Google Cloud; each account is hosted in a single region. | Snowflake documentation, 10 Nov 2026 |
| Starburst | Starburst lists a different credit price by AWS region: Pro credits cost $0.50 in US East (N. Virginia), $0.56 in Ireland, $0.60 in Frankfurt and $0.64 in Tokyo. | Starburst page, 10 Nov 2026 |
Sources
- AWS price list, read 10 Nov 2026
- Databricks pricing data file (AWS), loaded by its pricing calculator, read 10 Nov 2026
- Dremio page, read 10 Nov 2026
- DualBird page, read 10 Nov 2026
- Google Cloud documentation, read 10 Nov 2026
- Azure retail price API, read 10 Nov 2026
- Onehouse documentation, read 10 Nov 2026
- AWS page, read 10 Nov 2026
- Snowflake Service Consumption Table, read 10 Nov 2026
- Starburst page, read 10 Nov 2026
- AWS page, read 10 Nov 2026
- Databricks documentation, read 10 Nov 2026
- Google Cloud documentation, read 10 Nov 2026
- Microsoft Learn documentation, read 10 Nov 2026
- Onehouse page, read 10 Nov 2026
- AWS page, read 10 Nov 2026
- Snowflake documentation, read 10 Nov 2026
- Starburst page, read 10 Nov 2026
- Databricks documentation, read 10 Nov 2026
- Dremio documentation, read 10 Nov 2026
- Google Cloud documentation, read 10 Nov 2026
- Onehouse documentation, read 10 Nov 2026
- Snowflake documentation, read 10 Nov 2026
- Starburst documentation, read 10 Nov 2026
- AWS documentation, read 10 Nov 2026
- Dremio documentation, read 10 Nov 2026
- DualBird page, read 10 Nov 2026
- Azure pricing page, read 10 Nov 2026
- Onehouse documentation, read 10 Nov 2026
- Snowflake documentation, read 10 Nov 2026
- Starburst documentation, read 10 Nov 2026
- Databricks documentation, read 10 Nov 2026
- Dremio documentation, read 10 Nov 2026
- AWS documentation, read 10 Nov 2026
- Google Cloud documentation, read 10 Nov 2026
- Microsoft Learn documentation, read 10 Nov 2026
- AWS documentation, read 10 Nov 2026
- Snowflake documentation, read 10 Nov 2026
Last reviewed 10 Nov 2026.