Side by side, read 10 Nov 2026
Open stack on EMR and EKS and Snowflake: the published facts in the same rows
Open stack on EMR and EKS profileSnowflake profile
The same rows for both
| Row | Open stack on EMR and EKS | Snowflake |
|---|---|---|
| Kind | Self-run Spark with open table formats | Cloud data platform with PySpark support |
| Does well | Per AWS documentation, EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3, so all three formats are available (read 2026-11-10). AWS ran TPC-DS 3 TB on 9 x r5d.4xlarge and reports $4.81 for EMR 7.12 against $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0, with repositories to repeat it. | Per Snowflake documentation, Snowpark Connect runs existing PySpark DataFrame code against the Snowflake engine over Spark Connect, and batch jobs are submitted with the Snowpark Submit CLI (read 2026-11-10). Per Snowflake documentation, Iceberg tables can keep data in customer-managed S3, GCS or Azure storage through external volumes and a catalog integration such as AWS Glue. |
| Limited | Per the Apache Iceberg documentation, users run table maintenance themselves: expire snapshots, remove orphan files and compact with rewriteDataFiles as jobs they schedule (read 2026-11-10). A cost comparison of open-stack Spark against managed lakehouses by a party other than AWS or a vendor: none found on 2026-11-10. | Per Snowflake documentation, Snowpark Connect supports Apache Spark 3.5 only, and DayTimeIntervalType, YearMonthIntervalType and user-defined types are unsupported (read 2026-11-10). On-demand credit prices on AWS US East (Northern Virginia) are $2.00 (Standard), $3.00 (Enterprise) and $4.00 (Business Critical) per the Snowflake Service Consumption Table effective 2026-11-09 (read 2026-11-10); the Snowflake pricing page itself renders by script. |
| Published speed results | AWS ran TPC-DS 3 TB (104 SparkSQL queries, 3 rounds, 9 x r5d.4xlarge, Hadoop catalog) and reports EMR 7.12 averaged 1,349.62 s versus 6,113.92 s for open-source Spark 3.5.6 with Iceberg 1.10.0 and 1,535.62 s for EMR 7.5. AWS notes results are not comparable to official TPC-DS. The run is by the vendor of EMR. | None found on 10 Nov 2026. |
| Published prices and cost results | EMR on EC2 charges an EMR price in addition to the EC2 price (and EBS), billed per second with a one-minute minimum. AWS's example in us-east-1: c4.2xlarge EMR charge $0.105/hour next to EC2 $0.398/hour; one master and two core nodes for a month total $1,101.57. Spot instances are up to a 90% discount versus On-Demand. EMR on EKS adds an uplift per vCPU-hour and per GB-hour to EKS/EC2 or Fargate costs, plus $0.10 per hour for each EKS cluster. AWS's worked example uses $0.007084 per vCPU-hour and $0.000777875 per GB-hour (100 vCPU and 300 GB for 30 minutes = $0.4709 EMR uplift). The uplift applies to any pod using an EMR runtime image, including with the Spark operator. EMR Serverless is billed per vCPU-hour and GB-hour. AWS's worked example uses $0.052624 per vCPU-hour and $0.0057785 per GB-hour for a job with 100 vCPU and 750 GB for 30 minutes, then 200 more vCPU for 15 minutes, totaling $9.596275. In the same AWS benchmark the cost was $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0. Cost formula uses r5d.4xlarge at $1.152/hour plus $0.27/hour EMR plus EBS, On-Demand. | Warehouses bill credits per second with a 60-second minimum on each start; each size step roughly doubles credits per hour (Small is 2 credits per hour, Medium is 4). Snowflake's Service Consumption Table (effective 2026-11-09) lists on-demand credits on AWS US East at $2.00 (Standard), $3.00 (Enterprise) and $4.00 (Business Critical). |
| Code changes and migration | The EMR runtime for Spark provides 'full API compatibility with open source Apache Spark and Apache Iceberg', so existing Spark jobs run as is. Optimized runtimes are used by EMR on EC2, EMR Serverless, EMR on EKS, EMR on Outposts and AWS Glue. Self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite. | Snowpark Connect for Apache Spark runs existing PySpark DataFrame code against the Snowflake engine over the Spark Connect protocol; there is no Spark cluster, all workloads run on a Snowflake warehouse. Batch jobs are submitted with the Snowpark Submit CLI. Because Snowflake rather than Spark is the engine, there are semantic differences: DayTimeIntervalType, YearMonthIntervalType and user-defined types are unsupported, and ByteType, ShortType and IntegerType are returned as LongType. The docs list unsupported APIs for DataFrame and Dataset. Docs say the Spark DataFrame and Spark SQL code can be reused with minimal migration or changes; the compatibility notes say Spark Connect defers plan resolution, which changes behavior versus Spark Classic. |
| Tuning and table upkeep | Iceberg docs say users must run maintenance: expire snapshots, remove old metadata files and delete orphan files are 'recommended'; compacting data files with the Spark rewriteDataFiles action (for example target-file-size-bytes of 500 MB) and rewriting manifests are 'optional' maintenance, run as jobs you schedule. Hudi merge-on-read tables need compaction to merge log files into base files and bound read latency. Compaction has two steps, scheduling (plan written to the timeline) and execution; the docs describe strategies for choosing which file slices to compact. Delta Lake OSS docs list file management features the user applies: compaction (bin-packing) with OPTIMIZE, auto compaction, data skipping, Z-ordering, multi-part checkpointing, log compactions and optimized write. | Docs provide a separate Optimizing Snowpark Connect for Spark workloads section and a Troubleshooting section covering known limitations, so some job-level adjustment is expected after migration. |
| Spark versions and table formats | Amazon EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3. All three table formats are available on EMR. EMR on EKS supports the Kubernetes Operator for Apache Spark (Spark operator) as a job submission model with the EMR runtime on your own EKS clusters. The Kubeflow Spark Operator is Apache-2.0 licensed with Helm installation. | Snowpark Connect supports Apache Spark 3.5 only; workloads written for 3.4 and below or 4.0 and above are not supported and may produce protocol errors or missing API failures. Snowflake supports Iceberg tables (Parquet) with data in customer-managed S3, GCS or Azure storage via external volumes, an external catalog integration such as AWS Glue, and Delta files read through Delta Direct; Hudi was not listed on the page. |
| Where it runs | Amazon EMR has regional endpoints in the US (us-east-1, us-east-2, us-west-1, us-west-2) and many other AWS regions per the AWS general reference endpoints table. Spark runs on EC2 instances the user chooses (the AWS benchmark used r5d.4xlarge). | Snowflake runs on AWS, Azure and Google Cloud; AWS regions include us-east-1, us-west-2, eu-west-1 and ca-central-1. Each account is hosted in a single region. |
| How open its benchmarks are | AWS publishes the setup in GitHub repositories (aws-samples/emr-on-eks-benchmark branch tpcds-v2.13_iceberg, and aws-samples/emr-spark-benchmark) with build instructions, so the TPC-DS Iceberg benchmark can be repeated. | None found on 10 Nov 2026. |
| Compute Bill | Open stack: Spark on plain EC2: $20.16 | Snowflake (XL standard warehouse): $96.00 |
How to read this page
The rows hold what each vendor or a named third party published, with no conclusion drawn. Benchmarks in the two columns ran on different hardware, data and baselines, so their numbers are not comparable across columns. The Compute Bill method explains the cost lines.
Sources
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/emr/pricing, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-t, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-app-versions-7.x, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/spark-operato, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: iceberg.apache.org/docs/latest/maintenance, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: hudi.apache.org/docs/compaction, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.delta.io/latest/optimizations-oss.html, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/general/latest/gr/emr.html, read 10 Nov 2026
- Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: github.com/aws-samples/emr-on-eks-benchmark, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/user-guide/cost-understanding-compute, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/user-guide/tables-iceberg, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/user-guide/intro-regions.md, read 10 Nov 2026
- Snowflake: docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-, read 10 Nov 2026
Last reviewed 10 Nov 2026.