Skip to content
Lakehouse Compare

Side by side, read 10 Nov 2026

Dremio and Open stack on EMR and EKS: the published facts in the same rows

Dremio profileOpen stack on EMR and EKS profile

The same rows for both

Alphabetical order. Vendor statements are the vendor's own. Read 10 Nov 2026.
RowDremioOpen stack on EMR and EKS
KindLakehouse with its own SQL engineSelf-run Spark with open table formats
Does wellPer Dremio documentation, Iceberg tables in the Open Catalog get automatic optimization: data file compaction, row-level delete handling, clustering, partition evolution and manifest rewriting (read 2026-11-10). Dremio publishes DCU rates by engine size, from 16 DCUs per hour for 2XSmall to 2048 for 3XLarge, with a 60-second minimum (read 2026-11-10).Per AWS documentation, EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3, so all three formats are available (read 2026-11-10). AWS ran TPC-DS 3 TB on 9 x r5d.4xlarge and reports $4.81 for EMR 7.12 against $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0, with repositories to repeat it.
LimitedPer Dremio documentation, queries run on its own columnar engine, not on Spark, and the pages read describe no mode that runs existing Spark jobs. Dremio Cloud documentation lists Iceberg and Delta Lake as table formats; Hudi support: none found on 2026-11-10.Per the Apache Iceberg documentation, users run table maintenance themselves: expire snapshots, remove orphan files and compact with rewriteDataFiles as jobs they schedule (read 2026-11-10). A cost comparison of open-stack Spark against managed lakehouses by a party other than AWS or a vendor: none found on 2026-11-10.
Published speed resultsDremio's founder reported a full 1 TB TPC-DS run (all 99 queries) in 22 seconds on an 8-node m7gd.4xlarge cluster, with no caching, and attributes it to Autonomous Reflections and automatic Iceberg clustering. This is a BI query benchmark run by the vendor, not a Spark batch ETL or compaction test.AWS ran TPC-DS 3 TB (104 SparkSQL queries, 3 rounds, 9 x r5d.4xlarge, Hadoop catalog) and reports EMR 7.12 averaged 1,349.62 s versus 6,113.92 s for open-source Spark 3.5.6 with Iceberg 1.10.0 and 1,535.62 s for EMR 7.5. AWS notes results are not comparable to official TPC-DS. The run is by the vendor of EMR.
Published prices and cost resultsDremio Cloud is priced at $0.20 per DCU (Dremio Compute Unit). Dremio Enterprise (self-managed) pricing is 'contact sales'. The free trial for Dremio Cloud is a $400 credit for 30 days. DCUs are consumed only while engines run. Usage equals engine and replica uptime in seconds (60-second minimum) times the DCU rate for the engine size. Published rates per hour: 2XSmall 16, XSmall 32, Small 64, Medium 128, Large 256, XLarge 512, 2XLarge 1024, 3XLarge 2048. Storage billed in TB-months only for Dremio-hosted storage; LLM tokens billed separately. Billable usage is DCUs (compute), LLM tokens (AI features) and storage. Compute is billed in DCUs only while engines are running.EMR on EC2 charges an EMR price in addition to the EC2 price (and EBS), billed per second with a one-minute minimum. AWS's example in us-east-1: c4.2xlarge EMR charge $0.105/hour next to EC2 $0.398/hour; one master and two core nodes for a month total $1,101.57. Spot instances are up to a 90% discount versus On-Demand. EMR on EKS adds an uplift per vCPU-hour and per GB-hour to EKS/EC2 or Fargate costs, plus $0.10 per hour for each EKS cluster. AWS's worked example uses $0.007084 per vCPU-hour and $0.000777875 per GB-hour (100 vCPU and 300 GB for 30 minutes = $0.4709 EMR uplift). The uplift applies to any pod using an EMR runtime image, including with the Spark operator. EMR Serverless is billed per vCPU-hour and GB-hour. AWS's worked example uses $0.052624 per vCPU-hour and $0.0057785 per GB-hour for a job with 100 vCPU and 750 GB for 30 minutes, then 200 more vCPU for 15 minutes, totaling $9.596275. In the same AWS benchmark the cost was $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0. Cost formula uses r5d.4xlarge at $1.152/hour plus $0.27/hour EMR plus EBS, On-Demand.
Code changes and migrationDremio runs queries on its own columnar execution engine built on Apache Arrow, not on Spark. Docs describe Spark and Flink only as external engines that can use the Open Catalog (Iceberg REST) alongside Dremio. The pages read describe no mode that runs existing Spark jobs, so Spark ETL would stay on Spark or be rewritten as Dremio SQL.The EMR runtime for Spark provides 'full API compatibility with open source Apache Spark and Apache Iceberg', so existing Spark jobs run as is. Optimized runtimes are used by EMR on EC2, EMR Serverless, EMR on EKS, EMR on Outposts and AWS Glue. Self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite.
Tuning and table upkeepFor Iceberg tables in the Open Catalog, Dremio runs automatic optimization on a dedicated engine it configures: data file compaction, row-level delete handling (position deletes on v2, deletion vectors on v3), clustering, partition evolution and manifest rewriting. The same operations can be run by hand with OPTIMIZE TABLE. Optimization works in batches sized to engine resources. Engines have settings the admin chooses: size (executors per replica), min and max replicas, last-replica auto-stop (default 2 hours), enqueued time limit (default 5 minutes) and query runtime limit. Default concurrency per replica ranges from 2 (2XSmall) to 20 (3XLarge).Iceberg docs say users must run maintenance: expire snapshots, remove old metadata files and delete orphan files are 'recommended'; compacting data files with the Spark rewriteDataFiles action (for example target-file-size-bytes of 500 MB) and rewriting manifests are 'optional' maintenance, run as jobs you schedule. Hudi merge-on-read tables need compaction to merge log files into base files and bound read latency. Compaction has two steps, scheduling (plan written to the timeline) and execution; the docs describe strategies for choosing which file slices to compact. Delta Lake OSS docs list file management features the user applies: compaction (bin-packing) with OPTIMIZE, auto compaction, data skipping, Z-ordering, multi-part checkpointing, log compactions and optimized write.
Spark versions and table formatsThe Dremio Cloud data formats page lists Apache Iceberg and Delta Lake as table formats (plus Parquet and text formats). Hudi is not listed on that page. The Open Catalog is built on Apache Polaris and supports the Iceberg REST Catalog API; the docs list AWS Glue Data Catalog as a connectable catalog.Amazon EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3. All three table formats are available on EMR. EMR on EKS supports the Kubernetes Operator for Apache Spark (Spark operator) as a job submission model with the EMR runtime on your own EKS clusters. The Kubeflow Spark Operator is Apache-2.0 licensed with Helm installation.
Where it runsDremio Cloud runs on AWS (Azure listed as coming soon). Supported regions: us-east-1, us-east-2, us-west-2, eu-west-1 and eu-central-1. Dremio Enterprise can be deployed on Kubernetes, on premises, or in AWS, Azure or GCP.Amazon EMR has regional endpoints in the US (us-east-1, us-east-2, us-west-1, us-west-2) and many other AWS regions per the AWS general reference endpoints table. Spark runs on EC2 instances the user chooses (the AWS benchmark used r5d.4xlarge).
How open its benchmarks areDremio published a 2020 TPC-DS methodology post (SF1000 and SF10000, Parquet on S3, Apache JMeter test plans, 58 of 99 queries that ran unmodified on Dremio and Presto distributions). The 2025 22-second TPC-DS post pages read give cluster type but no scripts, scale-factor files or configuration repository.AWS publishes the setup in GitHub repositories (aws-samples/emr-on-eks-benchmark branch tpcds-v2.13_iceberg, and aws-samples/emr-spark-benchmark) with build instructions, so the TPC-DS Iceberg benchmark can be repeated.
Compute BillDremio Cloud (Large engine): $102.40Open stack: Spark on plain EC2: $20.16

How to read this page

The rows hold what each vendor or a named third party published, with no conclusion drawn. Benchmarks in the two columns ran on different hardware, data and baselines, so their numbers are not comparable across columns. The Compute Bill method explains the cost lines.

Sources

  1. Dremio: dremio.com/pricing, read 10 Nov 2026
  2. Dremio: docs.dremio.com/dremio-cloud/admin/engines, read 10 Nov 2026
  3. Dremio: docs.dremio.com/dremio-cloud/admin/subscription/usage, read 10 Nov 2026
  4. Dremio: docs.dremio.com/current/what-is-dremio/architecture, read 10 Nov 2026
  5. Dremio: docs.dremio.com/dremio-cloud/developer/data-formats, read 10 Nov 2026
  6. Dremio: docs.dremio.com/dremio-cloud/manage-govern/optimization, read 10 Nov 2026
  7. Dremio: docs.dremio.com/dremio-cloud/about/regions, read 10 Nov 2026
  8. Dremio: dremio.com/blog/breakthrough-announcement-dremio-is-the, read 10 Nov 2026
  9. Dremio: dremio.com/blog/dremio-benchmarking-methodology, read 10 Nov 2026
  10. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/emr/pricing, read 10 Nov 2026
  11. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-t, read 10 Nov 2026
  12. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-app-versions-7.x, read 10 Nov 2026
  13. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/spark-operato, read 10 Nov 2026
  14. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: iceberg.apache.org/docs/latest/maintenance, read 10 Nov 2026
  15. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: hudi.apache.org/docs/compaction, read 10 Nov 2026
  16. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.delta.io/latest/optimizations-oss.html, read 10 Nov 2026
  17. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/general/latest/gr/emr.html, read 10 Nov 2026
  18. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: github.com/aws-samples/emr-on-eks-benchmark, read 10 Nov 2026

Last reviewed 10 Nov 2026.