Skip to content
Lakehouse Compare

Side by side, read 10 Nov 2026

Amazon EMR plus Athena on Iceberg and Databricks: the published facts in the same rows

Amazon EMR plus Athena on Iceberg profileDatabricks profile

The same rows for both

Alphabetical order. Vendor statements are the vendor's own. Read 10 Nov 2026.
RowAmazon EMR plus Athena on IcebergDatabricks
KindSpark and SQL engines on AWSManaged lakehouse built around Delta Lake
Does wellPer AWS documentation, the EMR runtime for Spark is 100% API-compatible with open-source Spark, so existing jobs need no rewrite (read 2026-11-10). AWS publishes the setup for its TPC-DS 3 TB Iceberg benchmark in GitHub repositories, so a reader can repeat the run (read 2026-11-10).Per Databricks documentation, Photon keeps the Spark Catalyst planner, works with existing Spark API code and falls back to the Spark runtime for unsupported operations (read 2026-11-10). Per Databricks documentation, Delta tables can generate Iceberg metadata from Runtime 14.3 LTS, so Iceberg clients read Delta data without rewriting files (read 2026-11-10).
LimitedPer AWS documentation, Athena compaction is manual (you run OPTIMIZE ... REWRITE DATA USING BIN_PACK and VACUUM), and Glue Iceberg compaction is off by default for new tables. Every service in this entry runs only on AWS, and Athena supports Iceberg 1.4.2 only for tables in the Glue Data Catalog (read 2026-11-10).Per Databricks documentation, serverless compute supports only Spark Connect APIs, so RDD APIs, R and Maven coordinates are unsupported, and ANSI mode on by default can change results of existing jobs. Per Databricks, compute is billed in DBUs in addition to the cloud bill for the same instances, so a Jobs Compute run pays Databricks and AWS separately; the Compute Bill line adds $12.24 of DBUs to $20.16 of EC2 (read 2026-11-10).
Published speed resultsAWS states its runtime executes up to 4.5x faster than open-source Spark and gives 2.7x faster Iceberg write performance; the page gives no workload, scale or configuration.Docs claim Photon gives up to 5x better price/performance for data and analytics workloads versus other cloud data warehouses; no method is given on this page. Databricks announced an audited 100TB TPC-DS result of 32,941,245 QphDS for Databricks SQL, 2.2x the previous record held by Alibaba, with total system cost 10% lower on list pricing. This is a SQL warehouse result, not a Spark batch ETL result. The same Databricks blog says research from Barcelona Supercomputing Center found Databricks 2.7x faster and 12x better in price-performance than Snowflake on a TPC-DS derivative. This is a vendor-reported claim of a third-party study; the study itself was not fetched.
Published prices and cost resultsEMR on EC2 adds a per-instance uplift in addition to EC2: the AWS price list shows $0.048 per hour for EMR m5.xlarge in us-east-1 (publication 2026-11-10). EMR on EKS uplift in us-east-1 is $0.007084 per vCPU-hour and $0.000777875 per GB-hour, in addition to the EC2 or Fargate cost. The EMR pricing page worked example for EMR Serverless uses $0.052624 per vCPU-hour and $0.0057785 per GB-hour; a job with 100 vCPU for 30 minutes plus 200 more vCPU for 15 minutes costs $9.596275 in that example. Athena SQL costs $5.00 per TB scanned in us-east-1; Athena for Apache Spark costs $0.35 per DPU-hour; provisioned capacity costs $0.30 per DPU-hour. Glue Iceberg compaction costs $0.44 per DPU-hour in us-east-1; Glue 6.0+ ETL jobs cost $0.308 per DPU-hour and older Glue ETL $0.44. S3 Tables in us-east-1: compaction is $0.005 per GB processed plus $0.002 per 1,000 objects compacted; sort or Z-order compaction is $0.01 per GB plus $0.002 per 1,000 objects; storage is $0.0265 per GB-month for the first 50 TB.Databricks bills compute in DBUs at per-second granularity with pay-as-you-go or committed-use discounts, and no up-front costs. The pricing pages render their rates by script; the AWS pricing data file those pages load lists Jobs Compute at $0.15 per DBU on the plan it names Premium (r6i.4xlarge: 4.08 DBU per hour). The file names no region. Jobs pricing offers serverless (Performance Optimized and Standard modes) and classic clusters; the jobs pricing page maps plan names across clouds (its Premium tier on Azure corresponds to Enterprise on AWS and GCP), while the AWS pricing data file lists the $0.15 Jobs Compute rate under a plan it names Premium. Photon instances consume DBUs at a different rate.
Code changes and migrationThe EMR runtime for Spark is described as 100% API-compatible with open-source Spark, so existing Spark jobs need no rewrite; EMR is native Spark on EC2, EKS or Serverless. Athena for Apache Spark (version 3.5) accepts Spark code from SageMaker Unified Studio notebooks or any Spark Connect compatible client; PySpark engine version 3 offers the console notebook experience.Photon is a native C++ vectorized engine that keeps Spark's Catalyst planner and works with existing Spark API code; unsupported operations fall back to the Spark runtime. Serverless compute for notebooks and jobs supports only Spark Connect APIs; Spark RDD APIs, R, Maven coordinates, global temp views, DBFS mounts with instance profiles and Databricks Container Services are not supported. ANSI mode is on by default and the default time zone is UTC, which can change results of existing jobs.
Tuning and table upkeepEMR enables adaptive query execution, dynamic partition pruning, bloom filter join and optimized join reorder; docs say AQE adaptive join conversion is on by default and can be switched off with a Spark setting. Athena compaction is manual: run OPTIMIZE ... REWRITE DATA USING BIN_PACK and VACUUM yourself on Iceberg tables. Glue Data Catalog Iceberg compaction is disabled by default for new tables and must be enabled per table with an IAM role. S3 Tables compaction is on by default for all tables with a 512 MB default target file size (configurable 64 to 512 MB) and also applies row-level deletes.Photon is on by default for classic all-purpose compute, jobs compute and classic pipelines; API users must set runtime_engine to PHOTON. Photon instance types use DBUs at a different rate than the same instance without Photon. On serverless compute Databricks allocates and manages compute so users do not provision clusters; the Spark UI and Spark logs are not available, query profile and client-side logs are used instead. Serverless compute runs workloads without provisioning compute in your cloud account, and Databricks says this reduces the need to manage compute resources. It requires Unity Catalog to reach external data sources.
Spark versions and table formatsEMR 7.x release table lists Spark 3.5.x builds (up to 3.5.8-amzn-0); the EMR Spark feature page says EMR supports Apache Iceberg v3 and Spark 4.0. Athena supports Apache Iceberg 1.4.2 for read, time travel, write and DDL, only with tables in the AWS Glue Data Catalog and Glue optimistic locking; DDL is not supported on tables registered with Lake Formation.Databricks Runtime 18 LTS ships Apache Spark 4.1.0 (released June 10, 2026); Runtime 17.3 LTS ships Spark 4.0.0; Runtime 16.4 LTS and 15.4 LTS ship Spark 3.5.x. Runtime 19 ships Spark 4.2.0 (July 23, 2026). Delta Lake tables can generate Iceberg metadata (UniForm, Iceberg reads) from Databricks Runtime 14.3 LTS so Iceberg clients read Delta data without rewriting files.
Where it runsAll of these are AWS services, so they run only on AWS; EMR, Athena, Glue and S3 are priced in us-east-1 on the AWS price list.Databricks on AWS lists many AWS regions including us-east-1 (US East, Northern Virginia), us-east-2, us-west-1, eu-west-1, eu-central-1, ap-southeast-2 and us-gov-west-1; the platform is also hosted on Azure and Google Cloud. Some features are only in a subset of regions.
How open its benchmarks areNone found on 10 Nov 2026.None found on 10 Nov 2026.
Compute BillAmazon EMR on EKS (EC2 nodes): $24.42; Amazon EMR on EC2: $25.20; Amazon EMR Serverless: $31.63Databricks on AWS (Jobs Compute): $32.40

How to read this page

The rows hold what each vendor or a named third party published, with no conclusion drawn. Benchmarks in the two columns ran on different hardware, data and baselines, so their numbers are not comparable across columns. The Compute Bill method explains the cost lines.

Sources

  1. Amazon EMR plus Amazon Athena on Apache Iceberg: aws.amazon.com/emr/features/spark, read 10 Nov 2026
  2. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-app-versions-7.x, read 10 Nov 2026
  3. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-performance.html, read 10 Nov 2026
  4. Amazon EMR plus Amazon Athena on Apache Iceberg: pricing.us-east-1.amazonaws.com/offers/v1.0/aws/ElasticMapReduce/current, read 10 Nov 2026
  5. Amazon EMR plus Amazon Athena on Apache Iceberg: aws.amazon.com/emr/pricing, read 10 Nov 2026
  6. Amazon EMR plus Amazon Athena on Apache Iceberg: pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonAthena/current/ind, read 10 Nov 2026
  7. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html, read 10 Nov 2026
  8. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html, read 10 Nov 2026
  9. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/athena/latest/ug/querying-iceberg-data-optimization., read 10 Nov 2026
  10. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/glue/latest/dg/enable-compaction.html, read 10 Nov 2026
  11. Amazon EMR plus Amazon Athena on Apache Iceberg: pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AWSGlue/current/index.js, read 10 Nov 2026
  12. Amazon EMR plus Amazon Athena on Apache Iceberg: docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-maintenance.html, read 10 Nov 2026
  13. Amazon EMR plus Amazon Athena on Apache Iceberg: pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonS3/current/index.j, read 10 Nov 2026
  14. Databricks Data Intelligence Platform on AWS: docs.databricks.com/aws/en/compute/photon, read 10 Nov 2026
  15. Databricks Data Intelligence Platform on AWS: docs.databricks.com/aws/en/compute/serverless/limitations, read 10 Nov 2026
  16. Databricks Data Intelligence Platform on AWS: docs.databricks.com/aws/en/compute/serverless, read 10 Nov 2026
  17. Databricks Data Intelligence Platform on AWS: docs.databricks.com/aws/en/release-notes/runtime, read 10 Nov 2026
  18. Databricks Data Intelligence Platform on AWS: docs.databricks.com/aws/en/delta/uniform, read 10 Nov 2026
  19. Databricks Data Intelligence Platform on AWS: docs.databricks.com/aws/en/resources/supported-regions, read 10 Nov 2026
  20. Databricks Data Intelligence Platform on AWS: databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing, read 10 Nov 2026
  21. Databricks Data Intelligence Platform on AWS: databricks.com/product/aws-pricing, read 10 Nov 2026
  22. Databricks Data Intelligence Platform on AWS: databricks.com/product/pricing/jobs, read 10 Nov 2026

Last reviewed 10 Nov 2026.