Skip to content
Lakehouse Compare

Situation, read 10 Nov 2026

Spark bill doubled on EMR or EKS: what to check on a lakehouse platform

All situationsOpen the Compute Bill

5 things to check, with the published facts that answer each

Which unit does each platform bill compute in, and is the rate published?

A bill that doubled is a volume times a rate. The unit tells you which of the two you can change, and an unpublished rate cannot be compared before a trial.

Options in alphabetical order. Vendor statements are the vendor's own.
OptionPublished factSource, read
Amazon EMR plus Athena on IcebergThe AWS price list shows an EMR uplift of $0.048 per hour for an m5.xlarge in us-east-1, added to the EC2 price; EMR on EKS adds $0.007084 per vCPU-hour and $0.000777875 per GB-hour.AWS price list, 10 Nov 2026
DatabricksDatabricks bills compute in DBUs per second; the pricing pages render their rates by script, and the data file behind the pricing calculator lists Jobs Compute on AWS at $0.15 per DBU on the Premium plan (read 2026-11-10).Databricks pricing data file (AWS), loaded by its pricing calculator, 10 Nov 2026
DremioDremio Cloud is priced at $0.20 per DCU, billed only while engines run with a 60-second minimum; Dremio Enterprise pricing is "contact sales".Dremio page, 10 Nov 2026
DualBirdA price or pricing model for the DualBird plugin: none found on 2026-11-10.DualBird page, 10 Nov 2026
Google BigQuery and BigLakeBigQuery offers on-demand pricing per TiB scanned or capacity pricing per slot-hour; the page text read on 2026-11-10 lists Enterprise edition compute at $0.06 per slot-hour, with no region shown beside the rate.Google Cloud documentation, 10 Nov 2026
Microsoft FabricThe Azure retail price API lists Fabric Spark capacity usage at $0.18 per CU-hour for eastus, pay-as-you-go.Azure retail price API, 10 Nov 2026
OnehouseOnehouse bills in OCUs, where 1 OCU is a 4-core instance for 1 hour in your account, plus support costs; you also pay your own AWS or GCP bill. A dollar rate per OCU: none found on 2026-11-10.Onehouse documentation, 10 Nov 2026
Open stack on EMR and EKSAWS's example in us-east-1 shows a c4.2xlarge EMR charge of $0.105 per hour next to $0.398 per hour for EC2; spot instances are up to a 90% discount versus On-Demand.AWS page, 10 Nov 2026
SnowflakeSnowflake's Service Consumption Table, effective 2026-11-09, lists on-demand credits on AWS US East (Northern Virginia) at $2.00 (Standard), $3.00 (Enterprise) and $4.00 (Business Critical); warehouses bill per second with a 60-second minimum on each start.Snowflake Service Consumption Table, 10 Nov 2026
StarburstStarburst Galaxy cluster compute uses 6 credits per hour for 1 worker and 48 for 8 workers; credit prices on AWS start at $0.50 (Pro) in US East (N. Virginia).Starburst page, 10 Nov 2026

What does each vendor claim about cost, who ran the test, and is the method published?

A cost claim without a workload, a baseline or a method cannot be tied to your jobs. The party that ran the test matters as much as the percentage.

Options in alphabetical order. Vendor statements are the vendor's own.
OptionPublished factSource, read
Amazon EMR plus Athena on IcebergAWS states the EMR runtime runs up to 4.5x faster than open-source Spark with 2.7x faster Iceberg writes; the page gives no workload, scale or configuration.AWS page, 10 Nov 2026
DatabricksDatabricks documentation claims up to 5x better price/performance for Photon versus other cloud data warehouses, with no method given on that page.Databricks documentation, 10 Nov 2026
DualBirdDualBird says 50% to 90% lower costs with 10x to 30x faster processing; no method is given for that range, and the claim is DualBird's own.DualBird page, 10 Nov 2026
Google BigQuery and BigLakeGoogle states Lightning Engine delivers up to 4.9x faster performance than open-source Spark; no method is given on the pricing page.Google Cloud documentation, 10 Nov 2026
Microsoft FabricMicrosoft reports up to six times faster than open-source Spark on TPC-DS scale factor 1000 with Delta, with about 83% compute cost savings on a fixed-size cluster; its method: none found on 2026-11-10.Microsoft Learn documentation, 10 Nov 2026
OnehouseOnehouse states a guaranteed cost reduction of more than 50% for existing Hudi users moving Spark jobs from EMR or open-source Spark; the guarantee is a vendor statement.Onehouse page, 10 Nov 2026
Open stack on EMR and EKSAWS reports $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0 on TPC-DS 3 TB, On-Demand pricing; AWS ran the test.AWS page, 10 Nov 2026
SnowflakeA published Snowflake benchmark of Spark batch jobs on Snowpark Connect with its method: none found on 2026-11-10.Snowflake documentation, 10 Nov 2026
StarburstStarburst reports GPU-accelerated Trino at 3.4x overall on ClickBench in a single-node development environment; that is a SQL query test, not Spark batch work.Starburst page, 10 Nov 2026

Do your existing jobs run unchanged, or does a move to another option need a rewrite?

A rewrite is a cost that does not appear on the vendor price page. Check what each platform says about running existing Spark code.

Options in alphabetical order. Vendor statements are the vendor's own.
OptionPublished factSource, read
Amazon EMR plus Athena on IcebergAWS describes the EMR runtime for Spark as 100% API-compatible with open-source Spark, so existing Spark jobs need no rewrite.AWS page, 10 Nov 2026
DatabricksDatabricks serverless compute supports only Spark Connect APIs; RDD APIs, R and Maven coordinates are unsupported, and ANSI mode on by default can change results of existing jobs.Databricks documentation, 10 Nov 2026
DremioDremio runs queries on its own Arrow-based engine, not on Spark, so Spark ETL would stay on Spark or be rewritten as Dremio SQL.Dremio documentation, 10 Nov 2026
DualBirdDualBird says onboarding is two changes: switch the EC2 instance type to F2 and add the DualBird Spark plugin.DualBird page, 10 Nov 2026
Google BigQuery and BigLakeBigQuery runs PySpark or Scala/Java JAR code from SQL through CREATE PROCEDURE ... OPTIONS(engine = "SPARK"), so code must be wrapped as procedures.Google Cloud documentation, 10 Nov 2026
Microsoft FabricMicrosoft says the Fabric native execution engine needs no code changes, falls back to JVM Spark for unsupported operators and supports Parquet and Delta.Microsoft Learn documentation, 10 Nov 2026
OnehouseOnehouse documentation lists the EMR migration work: map EMR steps to Onehouse Jobs created through its API or Airflow operators, and configure Glue catalog sync.Onehouse documentation, 10 Nov 2026
Open stack on EMR and EKSAWS says the EMR runtime provides full API compatibility with open-source Apache Spark and Apache Iceberg; self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite.AWS page, 10 Nov 2026
SnowflakeSnowpark Connect supports Apache Spark 3.5 only; workloads written for 3.4 and below or 4.0 and above are unsupported and may fail.Snowflake documentation, 10 Nov 2026
StarburstStarburst Galaxy runs SQL on Trino, so Spark DataFrame code, UDFs and PySpark would be rewritten as Trino SQL or kept on Spark against the same Iceberg tables.Starburst documentation, 10 Nov 2026

Which settings or limits can raise the bill without a code change?

Idle capacity, scaling limits and instance choices change spend. A setting you must tune is a cost you own.

Options in alphabetical order. Vendor statements are the vendor's own.
OptionPublished factSource, read
Amazon EMR plus Athena on IcebergEMR enables adaptive query execution, dynamic partition pruning, bloom filter join and optimized join reorder; AQE adaptive join conversion is on by default and can be switched off.AWS documentation, 10 Nov 2026
DatabricksPhoton instance types consume DBUs at a different rate than the same instance without Photon, and API users must set runtime_engine to PHOTON.Databricks documentation, 10 Nov 2026
DremioDremio engine settings the admin chooses include size, minimum and maximum replicas, last-replica auto-stop (default 2 hours) and a query runtime limit.Dremio documentation, 10 Nov 2026
DualBirdDualBird claims many Spark settings become irrelevant and cluster sizing reduces to the number of F2 nodes; these are vendor claims, and DualBird says skew still costs time, but less.DualBird page, 10 Nov 2026
Microsoft FabricFabric Autoscale Billing for Spark is opt-in, runs on dedicated serverless resources at pay-as-you-go CU-hour rates, and a base capacity is still required.Azure pricing page, 10 Nov 2026
OnehouseOnehouse clusters need minimum and maximum OCU limits; the documentation warns that at the maximum a cluster stops scaling up, which can delay processing.Onehouse documentation, 10 Nov 2026
Open stack on EMR and EKSEMR on EKS adds an uplift per vCPU-hour and per GB-hour plus $0.10 per hour for each EKS cluster, and the uplift applies to any pod using an EMR runtime image.AWS page, 10 Nov 2026
SnowflakeSnowflake documents Optimizing and Troubleshooting sections for Snowpark Connect workloads, so some job-level adjustment is expected after migration.Snowflake documentation, 10 Nov 2026
StarburstStarburst Galaxy offers a fault tolerant execution mode for batch-style work that spools intermediate data; its documentation says it can be slightly slower than normal execution.Starburst documentation, 10 Nov 2026

Does the price or availability change with the AWS region you run in?

The reference prices on this site are us-east-1. A region you cannot use, or a platform tied to another cloud, changes the comparison.

Options in alphabetical order. Vendor statements are the vendor's own.
OptionPublished factSource, read
Amazon EMR plus Athena on IcebergAll services in this entry are AWS services and run only on AWS; EMR, Athena, Glue and S3 are priced here in us-east-1.AWS page, 10 Nov 2026
DatabricksDatabricks lists many AWS regions including us-east-1, us-east-2, eu-west-1 and eu-central-1, and is also hosted on Azure and Google Cloud; some features are only in a subset of regions.Databricks documentation, 10 Nov 2026
DremioDremio Cloud runs on AWS in us-east-1, us-east-2, us-west-2, eu-west-1 and eu-central-1; Azure is listed as coming soon.Dremio documentation, 10 Nov 2026
DualBirdAWS lists EC2 F2 instances in eight regions; us-east-2 and eu-west-1 are not among them. DualBird's pages mention no cloud other than AWS.AWS documentation, 10 Nov 2026
Google BigQuery and BigLakeBigQuery Omni reads data in S3 in us-east-1, us-west-2, ap-northeast-2, ap-southeast-2, eu-west-1 and eu-central-1.Google Cloud documentation, 10 Nov 2026
Microsoft FabricFabric runs over OneLake on Azure; the region page lists Azure regions and no AWS regions, so Spark compute does not run inside AWS.Microsoft Learn documentation, 10 Nov 2026
OnehouseOnehouse runs inside your AWS or GCP account; a project is scoped to one region and account, and adding a region needs a support ticket.Onehouse documentation, 10 Nov 2026
Open stack on EMR and EKSAmazon EMR has regional endpoints in us-east-1, us-east-2, us-west-1, us-west-2 and many other AWS regions; you choose the EC2 instance types.AWS documentation, 10 Nov 2026
SnowflakeSnowflake runs on AWS, Azure and Google Cloud; each account is hosted in a single region.Snowflake documentation, 10 Nov 2026
StarburstStarburst lists a different credit price by AWS region: Pro credits cost $0.50 in US East (N. Virginia), $0.56 in Ireland, $0.60 in Frankfurt and $0.64 in Tokyo.Starburst page, 10 Nov 2026

Sources

  1. AWS price list, read 10 Nov 2026
  2. Databricks pricing data file (AWS), loaded by its pricing calculator, read 10 Nov 2026
  3. Dremio page, read 10 Nov 2026
  4. DualBird page, read 10 Nov 2026
  5. Google Cloud documentation, read 10 Nov 2026
  6. Azure retail price API, read 10 Nov 2026
  7. Onehouse documentation, read 10 Nov 2026
  8. AWS page, read 10 Nov 2026
  9. Snowflake Service Consumption Table, read 10 Nov 2026
  10. Starburst page, read 10 Nov 2026
  11. AWS page, read 10 Nov 2026
  12. Databricks documentation, read 10 Nov 2026
  13. Google Cloud documentation, read 10 Nov 2026
  14. Microsoft Learn documentation, read 10 Nov 2026
  15. Onehouse page, read 10 Nov 2026
  16. AWS page, read 10 Nov 2026
  17. Snowflake documentation, read 10 Nov 2026
  18. Starburst page, read 10 Nov 2026
  19. Databricks documentation, read 10 Nov 2026
  20. Dremio documentation, read 10 Nov 2026
  21. Google Cloud documentation, read 10 Nov 2026
  22. Onehouse documentation, read 10 Nov 2026
  23. Snowflake documentation, read 10 Nov 2026
  24. Starburst documentation, read 10 Nov 2026
  25. AWS documentation, read 10 Nov 2026
  26. Dremio documentation, read 10 Nov 2026
  27. DualBird page, read 10 Nov 2026
  28. Azure pricing page, read 10 Nov 2026
  29. Onehouse documentation, read 10 Nov 2026
  30. Snowflake documentation, read 10 Nov 2026
  31. Starburst documentation, read 10 Nov 2026
  32. Databricks documentation, read 10 Nov 2026
  33. Dremio documentation, read 10 Nov 2026
  34. AWS documentation, read 10 Nov 2026
  35. Google Cloud documentation, read 10 Nov 2026
  36. Microsoft Learn documentation, read 10 Nov 2026
  37. AWS documentation, read 10 Nov 2026
  38. Snowflake documentation, read 10 Nov 2026

Last reviewed 10 Nov 2026.