Skip to content
Lakehouse Compare

Side by side, read 10 Nov 2026

Google BigQuery and BigLake and Open stack on EMR and EKS: the published facts in the same rows

Google BigQuery and BigLake profileOpen stack on EMR and EKS profile

The same rows for both

Alphabetical order. Vendor statements are the vendor's own. Read 10 Nov 2026.
RowGoogle BigQuery and BigLakeOpen stack on EMR and EKS
KindServerless Google Cloud data warehouseSelf-run Spark with open table formats
Does wellPer Google documentation, BigQuery Iceberg managed tables store data in buckets you own, support DML and streaming, and run automatic compaction, clustering and garbage collection (read 2026-11-10). Per Google documentation, stored procedures for Apache Spark run PySpark or Scala/Java JAR code from SQL on Google Cloud (read 2026-11-10).Per AWS documentation, EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3, so all three formats are available (read 2026-11-10). AWS ran TPC-DS 3 TB on 9 x r5d.4xlarge and reports $4.81 for EMR 7.12 against $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0, with repositories to repeat it.
LimitedPer Google documentation, BigQuery Omni on S3 does not support DML or CREATE TABLE, so it does not run write-heavy Spark batch ETL on S3. Google's pricing page text lists Enterprise edition compute at $0.06 per slot-hour, with no region shown beside the rate (read 2026-11-10). Per-TiB on-demand and Spark DCU rates are not used on this site.Per the Apache Iceberg documentation, users run table maintenance themselves: expire snapshots, remove orphan files and compact with rewriteDataFiles as jobs they schedule (read 2026-11-10). A cost comparison of open-stack Spark against managed lakehouses by a party other than AWS or a vendor: none found on 2026-11-10.
Published speed resultsGoogle states Lightning Engine delivers up to 4.9x faster performance than open source Spark and up to 2.5x the price-performance over a high-speed Spark offering Google does not name; no method is given on the pricing page.AWS ran TPC-DS 3 TB (104 SparkSQL queries, 3 rounds, 9 x r5d.4xlarge, Hadoop catalog) and reports EMR 7.12 averaged 1,349.62 s versus 6,113.92 s for open-source Spark 3.5.6 with Iceberg 1.10.0 and 1,535.62 s for EMR 7.5. AWS notes results are not comparable to official TPC-DS. The run is by the vendor of EMR.
Published prices and cost resultsBigQuery offers on-demand pricing per TiB scanned (first 1 TiB per month free) or capacity pricing per slot-hour. BigQuery Omni has its own on-demand per TiB pricing for AWS regions. The page text shows $0.06 per slot-hour for Enterprise edition pay-as-you-go compute, with no region shown beside the rate (read 2026-11-10). Google's Spark service (Managed Service for Apache Spark, formerly Dataproc) bills serverless Spark per second in Data Compute Units with a 1-minute minimum, plus shuffle storage; Standard tier is for batch ETL, Premium tier uses Lightning Engine.EMR on EC2 charges an EMR price in addition to the EC2 price (and EBS), billed per second with a one-minute minimum. AWS's example in us-east-1: c4.2xlarge EMR charge $0.105/hour next to EC2 $0.398/hour; one master and two core nodes for a month total $1,101.57. Spot instances are up to a 90% discount versus On-Demand. EMR on EKS adds an uplift per vCPU-hour and per GB-hour to EKS/EC2 or Fargate costs, plus $0.10 per hour for each EKS cluster. AWS's worked example uses $0.007084 per vCPU-hour and $0.000777875 per GB-hour (100 vCPU and 300 GB for 30 minutes = $0.4709 EMR uplift). The uplift applies to any pod using an EMR runtime image, including with the Spark operator. EMR Serverless is billed per vCPU-hour and GB-hour. AWS's worked example uses $0.052624 per vCPU-hour and $0.0057785 per GB-hour for a job with 100 vCPU and 750 GB for 30 minutes, then 200 more vCPU for 15 minutes, totaling $9.596275. In the same AWS benchmark the cost was $4.81 for EMR 7.12, $5.47 for EMR 7.5 and $17.65 for open-source Spark 3.5.6 with Iceberg 1.10.0. Cost formula uses r5d.4xlarge at $1.152/hour plus $0.27/hour EMR plus EBS, On-Demand.
Code changes and migrationOn BigQuery Omni, DML statements and CREATE TABLE are not supported, BigQuery ML statements are not supported, and only EXPORT DATA queries are allowed for destination tables, so it does not run write-heavy Spark batch ETL on S3. Standard and Enterprise Plus editions do not support Omni regions. BigQuery stored procedures for Apache Spark let you run PySpark or Scala/Java JAR code from SQL via CREATE PROCEDURE ... OPTIONS(engine = "SPARK", runtime_version = "2.2"), using a Cloud Storage file or inline code and a connection; this runs on Google Cloud, so code must be wrapped as procedures.The EMR runtime for Spark provides 'full API compatibility with open source Apache Spark and Apache Iceberg', so existing Spark jobs run as is. Optimized runtimes are used by EMR on EC2, EMR Serverless, EMR on EKS, EMR on Outposts and AWS Glue. Self-run Spark on EKS uses the open-source Spark operator and needs no job rewrite.
Tuning and table upkeepIceberg managed tables run automatic storage optimization (adaptive file sizing, clustering, garbage collection), so compaction needs no job configuration on Google Cloud; storage optimization is a separate billed item.Iceberg docs say users must run maintenance: expire snapshots, remove old metadata files and delete orphan files are 'recommended'; compacting data files with the Spark rewriteDataFiles action (for example target-file-size-bytes of 500 MB) and rewriting manifests are 'optional' maintenance, run as jobs you schedule. Hudi merge-on-read tables need compaction to merge log files into base files and bound read latency. Compaction has two steps, scheduling (plan written to the timeline) and execution; the docs describe strategies for choosing which file slices to compact. Delta Lake OSS docs list file management features the user applies: compaction (bin-packing) with OPTIMIZE, auto compaction, data skipping, Z-ordering, multi-part checkpointing, log compactions and optimized write.
Spark versions and table formatsBigQuery Iceberg managed tables store data in buckets you own, support DML, streaming and Spark connectors, export Iceberg V2 snapshots for open engines, and do automatic compaction, clustering and garbage collection. BigLake tables let you query structured data in Cloud Storage, Amazon S3 and Blob Storage with access delegation and row and column security.Amazon EMR 7.14.0 packages Spark 3.5.8-amzn-0, Delta 3.3.2-amzn-3, Iceberg 1.10.1-amzn-1 and Hudi 1.0.2-amzn-3. All three table formats are available on EMR. EMR on EKS supports the Kubernetes Operator for Apache Spark (Spark operator) as a job submission model with the EMR runtime on your own EKS clusters. The Kubeflow Spark Operator is Apache-2.0 licensed with Helm installation.
Where it runsBigQuery Omni lets BigQuery analytics run on data in Amazon S3 through BigLake tables, in AWS regions us-east-1, us-west-2, ap-northeast-2, ap-southeast-2, eu-west-1 and eu-central-1.Amazon EMR has regional endpoints in the US (us-east-1, us-east-2, us-west-1, us-west-2) and many other AWS regions per the AWS general reference endpoints table. Spark runs on EC2 instances the user chooses (the AWS benchmark used r5d.4xlarge).
How open its benchmarks areNone found on 10 Nov 2026.AWS publishes the setup in GitHub repositories (aws-samples/emr-on-eks-benchmark branch tpcds-v2.13_iceberg, and aws-samples/emr-spark-benchmark) with build instructions, so the TPC-DS Iceberg benchmark can be repeated.
Compute BillBigQuery (Enterprise edition slots): $19.20Open stack: Spark on plain EC2: $20.16

How to read this page

The rows hold what each vendor or a named third party published, with no conclusion drawn. Benchmarks in the two columns ran on different hardware, data and baselines, so their numbers are not comparable across columns. The Compute Bill method explains the cost lines.

Sources

  1. Google BigQuery and BigLake: cloud.google.com/bigquery/docs/omni-introduction, read 10 Nov 2026
  2. Google BigQuery and BigLake: cloud.google.com/bigquery/docs/spark-procedures, read 10 Nov 2026
  3. Google BigQuery and BigLake: cloud.google.com/bigquery/docs/iceberg-tables, read 10 Nov 2026
  4. Google BigQuery and BigLake: cloud.google.com/bigquery/docs/biglake-intro, read 10 Nov 2026
  5. Google BigQuery and BigLake: cloud.google.com/bigquery/pricing, read 10 Nov 2026
  6. Google BigQuery and BigLake: cloud.google.com/dataproc-serverless/pricing, read 10 Nov 2026
  7. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/emr/pricing, read 10 Nov 2026
  8. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: aws.amazon.com/blogs/big-data/run-apache-spark-and-iceberg-4-5x-faster-t, read 10 Nov 2026
  9. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-app-versions-7.x, read 10 Nov 2026
  10. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/spark-operato, read 10 Nov 2026
  11. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: iceberg.apache.org/docs/latest/maintenance, read 10 Nov 2026
  12. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: hudi.apache.org/docs/compaction, read 10 Nov 2026
  13. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.delta.io/latest/optimizations-oss.html, read 10 Nov 2026
  14. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: docs.aws.amazon.com/general/latest/gr/emr.html, read 10 Nov 2026
  15. Open stack: Spark on EMR or EKS with Iceberg, Delta or Hudi: github.com/aws-samples/emr-on-eks-benchmark, read 10 Nov 2026

Last reviewed 10 Nov 2026.