Skip to content
Lakehouse Compare

Side by side, read 10 Nov 2026

Microsoft Fabric and Open stack on EMR and EKS: the published facts in the same rows

Microsoft Fabric profileOpen stack on EMR and EKS profile

The same rows for both

Alphabetical order. Vendor statements are the vendor's own. Read 10 Nov 2026.
RowMicrosoft FabricOpen stack on EMR and EKS
KindSaaS analytics on Azure with SparkSelf-run Spark with open table formats
Does wellPer Microsoft Learn, the native execution engine (Apache Gluten and Velox) needs no code changes, falls back to JVM Spark for unsupported operators and supports Parquet and Delta (read 2026-11-10). Per Microsoft Learn, OneLake S3 shortcuts give read-only access to data in an S3 bucket in any file format without copying it (read 2026-11-10).Per AWS documentation, EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3, so all three formats are available (read 2026-11-10). AWS ran TPC-DS 3 TB on 9 x r5d.4xlarge and reports $4.81 for EMR 7.12 against $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0, with repositories to repeat it.
LimitedPer Microsoft Learn, Fabric runs over OneLake on Azure and the region page lists Azure regions only, so Spark compute does not run inside AWS. Writes to S3 through a OneLake shortcut are not possible, and the method for Microsoft's native engine benchmark: none found on 2026-11-10.Per the Apache Iceberg documentation, users run table maintenance themselves: expire snapshots, remove orphan files and compact with rewriteDataFiles as jobs they schedule (read 2026-11-10). A cost comparison of open-stack Spark against managed lakehouses by a party other than AWS or a vendor: none found on 2026-11-10.
Published speed resultsMicrosoft reports that on TPC-DS scale factor 1000 with Delta the native engine was up to six times faster than open-source Spark, with about 83% compute cost savings on a fixed-size cluster.AWS ran TPC-DS 3 TB (104 SparkSQL queries, 3 rounds, 9 x r5d.4xlarge, Hadoop catalog) and reports EMR 7.12 averaged 1,349.62 s versus 6,113.92 s for open-source Spark 3.5.6 with Iceberg 1.10.0 and 1,535.62 s for EMR 7.5. AWS notes results are not comparable to official TPC-DS. The run is by the vendor of EMR.
Published prices and cost resultsThe Azure retail price API lists Fabric Spark capacity usage at $0.18 per CU-hour for eastus (Spark Memory Optimized and autoscale for Spark entries, pay-as-you-go). In Fabric each capacity unit maps to two Spark VCores, and Spark jobs are admitted by available VCores with FIFO queueing and throttling. Autoscale Billing for Spark is an opt-in pay-as-you-go model that runs Spark on dedicated serverless resources at standard PAYG CU-hour rates; reserved capacity discounts do not apply and a base capacity is still required.EMR on EC2 charges an EMR price in addition to the EC2 price (and EBS), billed per second with a one-minute minimum. AWS's example in us-east-1: c4.2xlarge EMR charge $0.105/hour next to EC2 $0.398/hour; one master and two core nodes for a month total $1,101.57. Spot instances are up to a 90% discount versus On-Demand. EMR on EKS adds an uplift per vCPU-hour and per GB-hour to EKS/EC2 or Fargate costs, plus $0.10 per hour for each EKS cluster. AWS's worked example uses $0.007084 per vCPU-hour and $0.000777875 per GB-hour (100 vCPU and 300 GB for 30 minutes = $0.4709 EMR uplift). The uplift applies to any pod using an EMR runtime image, including with the Spark operator. EMR Serverless is billed per vCPU-hour and GB-hour. AWS's worked example uses $0.052624 per vCPU-hour and $0.0057785 per GB-hour for a job with 100 vCPU and 750 GB for 30 minutes, then 200 more vCPU for 15 minutes, totaling $9.596275. In the same AWS benchmark the cost was $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0. Cost formula uses r5d.4xlarge at $1.152/hour plus $0.27/hour EMR plus EBS, On-Demand.
Code changes and migrationThe Fabric native execution engine, based on Apache Gluten and Velox, needs no code changes, falls back to JVM Spark for unsupported operators, and supports Parquet and Delta.The EMR runtime for Spark provides 'full API compatibility with open source Apache Spark and Apache Iceberg', so existing Spark jobs run as is. Optimized runtimes are used by EMR on EC2, EMR Serverless, EMR on EKS, EMR on Outposts and AWS Glue. Self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite.
Tuning and table upkeepStarter pools start in 5 to 10 seconds with no setup; custom Spark pools let you tune node size and scaling, and native execution can be toggled per application with a Spark setting.Iceberg docs say users must run maintenance: expire snapshots, remove old metadata files and delete orphan files are 'recommended'; compacting data files with the Spark rewriteDataFiles action (for example target-file-size-bytes of 500 MB) and rewriting manifests are 'optional' maintenance, run as jobs you schedule. Hudi merge-on-read tables need compaction to merge log files into base files and bound read latency. Compaction has two steps, scheduling (plan written to the timeline) and execution; the docs describe strategies for choosing which file slices to compact. Delta Lake OSS docs list file management features the user applies: compaction (bin-packing) with OPTIMIZE, auto compaction, data skipping, Z-ordering, multi-part checkpointing, log compactions and optimized write.
Spark versions and table formatsFabric Runtime 1.3 uses Apache Spark 3.5 and Runtime 2.0 uses Spark 4.1; OneLake handles Delta and Iceberg through metadata virtualization so Iceberg tables read as Delta and vice versa.Amazon EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3. All three table formats are available on EMR. EMR on EKS supports the Kubernetes Operator for Apache Spark (Spark operator) as a job submission model with the EMR runtime on your own EKS clusters. The Kubeflow Spark Operator is Apache-2.0 licensed with Helm installation.
Where it runsFabric workloads run over OneLake, described as built on Azure Data Lake Storage; the region availability page lists Azure regions and no AWS regions, so Spark compute does not run inside AWS. OneLake S3 shortcuts give read-only access to data in an S3 bucket in any file format without copying; file caching can reduce cross-cloud egress costs. Writes to S3 are not possible through the shortcut.Amazon EMR has regional endpoints in the US (us-east-1, us-east-2, us-west-1, us-west-2) and many other AWS regions per the AWS general reference endpoints table. Spark runs on EC2 instances the user chooses (the AWS benchmark used r5d.4xlarge).
How open its benchmarks areNone found on 10 Nov 2026.AWS publishes the setup in GitHub repositories (aws-samples/emr-on-eks-benchmark branch tpcds-v2.13_iceberg, and aws-samples/emr-spark-benchmark) with build instructions, so the TPC-DS Iceberg benchmark can be repeated.
Compute BillMicrosoft Fabric (F128 capacity): $46.08Open stack: Spark on plain EC2: $20.16

How to read this page

The rows hold what each vendor or a named third party published, with no conclusion drawn. Benchmarks in the two columns ran on different hardware, data and baselines, so their numbers are not comparable across columns. The Compute Bill method explains the cost lines.

Sources

  1. Microsoft Fabric: learn.microsoft.com/en-us/fabric/fundamentals/microsoft-fabric-overview, read 10 Nov 2026
  2. Microsoft Fabric: learn.microsoft.com/en-us/fabric/onelake/create-s3-shortcut, read 10 Nov 2026
  3. Microsoft Fabric: prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Microsoft, read 10 Nov 2026
  4. Microsoft Fabric: learn.microsoft.com/en-us/fabric/data-engineering/spark-job-concurrency-, read 10 Nov 2026
  5. Microsoft Fabric: azure.microsoft.com/en-us/pricing/details/microsoft-fabric, read 10 Nov 2026
  6. Microsoft Fabric: learn.microsoft.com/en-us/fabric/data-engineering/runtime, read 10 Nov 2026
  7. Microsoft Fabric: learn.microsoft.com/en-us/fabric/onelake/onelake-iceberg-tables, read 10 Nov 2026
  8. Microsoft Fabric: learn.microsoft.com/en-us/fabric/data-engineering/spark-compute, read 10 Nov 2026
  9. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/emr/pricing, read 10 Nov 2026
  10. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-t, read 10 Nov 2026
  11. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-app-versions-7.x, read 10 Nov 2026
  12. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/spark-operato, read 10 Nov 2026
  13. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: iceberg.apache.org/docs/latest/maintenance, read 10 Nov 2026
  14. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: hudi.apache.org/docs/compaction, read 10 Nov 2026
  15. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.delta.io/latest/optimizations-oss.html, read 10 Nov 2026
  16. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/general/latest/gr/emr.html, read 10 Nov 2026
  17. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: github.com/aws-samples/emr-on-eks-benchmark, read 10 Nov 2026

Last reviewed 10 Nov 2026.