# Leaving a managed platform for an open stack: what to check on a lakehouse platform

Situation, read 10 Nov 2026

**The short answer.** A team on Databricks or Snowflake weighs a move to an open stack of Spark and open table formats on AWS. The checks below cover what the team would own afterward, whether data stays readable in both places during the move, which Spark features change, and which clouds each option supports.

## 5 things to check, with the published facts that answer each

### What table maintenance would the team own after the move?

A managed platform runs compaction and cleanup for you. On an open stack, someone schedules it and pays for it.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | Athena compaction is manual: run OPTIMIZE ... REWRITE DATA USING BIN_PACK and VACUUM yourself on Iceberg tables; S3 Tables compaction is on by default. | [AWS documentation](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg-data-optimization.html), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio runs automatic optimization on Iceberg tables in its Open Catalog: compaction, row-level delete handling, clustering, partition evolution and manifest rewriting. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/manage-govern/optimization), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery Iceberg managed tables run automatic storage optimization (adaptive file sizing, clustering, garbage collection); it is a separate billed item. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/iceberg-tables), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse claims automatic scaling and automated async table services; its docs pages give no per-job Spark tuning list. | [Onehouse documentation](https://docs.onehouse.ai/product/compute/create-cluster), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | Iceberg documentation says expiring snapshots, removing old metadata files and deleting orphan files are recommended, and compacting with rewriteDataFiles is optional, all as jobs you schedule. | [Apache Iceberg documentation](https://iceberg.apache.org/docs/latest/maintenance/), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy runs Iceberg maintenance with ALTER TABLE ... EXECUTE commands: optimize, drop_extended_stats, expire_snapshots and remove_orphan_files. | [Starburst documentation](https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-iceberg.html), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Can the same tables stay readable from both platforms during the move?

A staged move needs one copy of the data readable by both engines. Check which format bridges the platforms document.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | Athena supports Iceberg 1.4.2 only for tables in the AWS Glue Data Catalog, with Glue optimistic locking. | [AWS documentation](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Databricks UniForm generates Iceberg metadata for Delta tables from Runtime 14.3 LTS, so Iceberg clients read Delta data without rewriting files. | [Databricks documentation](https://docs.databricks.com/aws/en/delta/uniform), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio Cloud documentation lists Iceberg and Delta Lake and a Polaris-based Open Catalog with the Iceberg REST Catalog API, and lists AWS Glue Data Catalog as connectable. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/developer/data-formats/), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery Iceberg managed tables export Iceberg V2 snapshots for open engines. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/iceberg-tables), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | Fabric OneLake handles Delta and Iceberg through metadata virtualization. | [Microsoft Learn documentation](https://learn.microsoft.com/en-us/fabric/onelake/onelake-iceberg-tables), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Apache XTable (formerly OneTable) translates table metadata between Hudi, Delta Lake and Iceberg; it is incubating at the Apache Software Foundation, and Onehouse says it created Hudi and XTable. | [Apache XTable site](https://xtable.apache.org/), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake supports Iceberg tables in customer-managed storage with an external catalog integration such as AWS Glue, and reads Delta files through Delta Direct. | [Snowflake documentation](https://docs.snowflake.com/en/user-guide/tables-iceberg), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy creates and writes Iceberg tables and reads Delta Lake; Hudi tables are read-only. | [Starburst documentation](https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-hudi.html), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Which Spark behavior changes when the code leaves the managed runtime?

Each platform documents gaps against open-source Spark. The list of gaps is the migration work.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | AWS's documentation states 100% API compatibility for the EMR runtime for Spark; that is AWS's claim about its own runtime. | [AWS page](https://aws.amazon.com/emr/features/spark/), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | On Databricks serverless compute, Spark RDD APIs, R, Maven coordinates, global temp views and Databricks Container Services are unsupported. | [Databricks documentation](https://docs.databricks.com/aws/en/compute/serverless/limitations), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse documentation says EMR code can be reused unless it uses AWS-specific features, and lists the EMR step and catalog work. | [Onehouse documentation](https://docs.onehouse.ai/product/jobs/emr-migration), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | EMR on EKS supports the Kubernetes Operator for Apache Spark on your own EKS clusters; the Kubeflow Spark Operator is Apache-2.0 licensed with Helm installation. | [AWS documentation](https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/spark-operator.html), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake documentation says Spark DataFrame and Spark SQL code can be reused with minimal migration, and that Spark Connect defers plan resolution, which changes behavior versus Spark Classic. | [Snowflake documentation](https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-apache-spark), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Which rates are published, and which are unreadable?

An exit is justified by a bill, so the rates must be readable. Some managed platforms render their rates by script, so the line says which were read.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Databricks](/platforms/databricks/) | Databricks bills DBUs per second with pay-as-you-go or committed-use discounts; the data file behind the pricing calculator lists Jobs Compute on AWS at $0.15 per DBU on the Premium plan, with 4.08 DBU per node-hour for r6i.4xlarge (read 2026-11-10). | [Databricks pricing data file (AWS), loaded by its pricing calculator](https://www.databricks.com/en-pricing-assets/data/pricing/AWS.json), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery capacity pricing is per slot-hour; the pricing page text read on 2026-11-10 lists Enterprise edition compute at $0.06 per slot-hour, with no region shown beside the rate. | [Google Cloud documentation](https://cloud.google.com/bigquery/pricing), 10 Nov 2026 |
| [Microsoft Fabric](/platforms/microsoft-fabric/) | The Azure retail price API lists Fabric Spark capacity usage at $0.18 per CU-hour for eastus. | [Azure retail price API](https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Microsoft%20Fabric'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'), 10 Nov 2026 |
| [Open stack on EMR and EKS](/platforms/open-stack-emr-eks/) | AWS's EMR pricing example in us-east-1 shows an EMR charge of $0.105 per hour next to EC2 at $0.398 per hour for a c4.2xlarge, billed per second with a one-minute minimum. | [AWS page](https://aws.amazon.com/emr/pricing/), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake's Service Consumption Table, effective 2026-11-09, lists $3.00 per credit for the Enterprise edition on AWS US East (Northern Virginia); warehouses bill credits per second with a 60-second minimum. | [Snowflake Service Consumption Table](https://www.snowflake.com/legal-files/CreditConsumptionTable.pdf), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy credit prices start at $0.50 (Pro) and $0.75 (Enterprise) per credit, with a Free tier of up to 3 clusters. | [Starburst page](https://www.starburst.io/pricing/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

### Which clouds and regions does each option document?

A move off one platform can tie the team to a single cloud when the target runs in only one.

| Option | Published fact | Source, read |
| --- | --- | --- |
| [Amazon EMR plus Athena on Iceberg](/platforms/aws-emr-athena-iceberg/) | The Amazon EMR, Athena, Glue and S3 services run only on AWS. | [AWS page](https://aws.amazon.com/emr/features/spark/), 10 Nov 2026 |
| [Databricks](/platforms/databricks/) | Databricks lists many AWS regions and is also hosted on Azure and Google Cloud. | [Databricks documentation](https://docs.databricks.com/aws/en/resources/supported-regions), 10 Nov 2026 |
| [Dremio](/platforms/dremio/) | Dremio Cloud runs on AWS; Dremio Enterprise can be deployed on Kubernetes, on premises, or in AWS, Azure or GCP. | [Dremio documentation](https://docs.dremio.com/dremio-cloud/about/regions), 10 Nov 2026 |
| [Google BigQuery and BigLake](/platforms/bigquery-biglake/) | BigQuery Omni reads S3 data in six AWS regions, and runs on Google Cloud. | [Google Cloud documentation](https://cloud.google.com/bigquery/docs/omni-introduction), 10 Nov 2026 |
| [Onehouse](/platforms/onehouse/) | Onehouse runs in the customer's AWS or GCP account; Azure is not listed in its billing documentation. | [Onehouse documentation](https://docs.onehouse.ai/product/project-settings/usage-and-billing), 10 Nov 2026 |
| [Snowflake](/platforms/snowflake/) | Snowflake runs on AWS, Azure and Google Cloud, with each account in a single region. | [Snowflake documentation](https://docs.snowflake.com/en/user-guide/intro-regions.md), 10 Nov 2026 |
| [Starburst](/platforms/starburst/) | Starburst Galaxy prices are listed for AWS, Azure and GCP regions. | [Starburst page](https://www.starburst.io/pricing/pricing-details/), 10 Nov 2026 |

Options in alphabetical order. Vendor statements are the vendor's own.

## Sources

- AWS documentation: https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg-data-optimization.html (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/manage-govern/optimization (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/docs/iceberg-tables (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/compute/create-cluster (read 10 Nov 2026)
- Apache Iceberg documentation: https://iceberg.apache.org/docs/latest/maintenance/ (read 10 Nov 2026)
- Starburst documentation: https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-iceberg.html (read 10 Nov 2026)
- AWS documentation: https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html (read 10 Nov 2026)
- Databricks documentation: https://docs.databricks.com/aws/en/delta/uniform (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/developer/data-formats/ (read 10 Nov 2026)
- Microsoft Learn documentation: https://learn.microsoft.com/en-us/fabric/onelake/onelake-iceberg-tables (read 10 Nov 2026)
- Apache XTable site: https://xtable.apache.org/ (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/user-guide/tables-iceberg (read 10 Nov 2026)
- Starburst documentation: https://docs.starburst.io/starburst-galaxy/data-engineering/working-with-data-lakes/table-formats/gl-hudi.html (read 10 Nov 2026)
- AWS page: https://aws.amazon.com/emr/features/spark/ (read 10 Nov 2026)
- Databricks documentation: https://docs.databricks.com/aws/en/compute/serverless/limitations (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/jobs/emr-migration (read 10 Nov 2026)
- AWS documentation: https://docs.aws.amazon.com/emr/latest/EMR-on-EKS-DevelopmentGuide/spark-operator.html (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/developer-guide/snowpark-connect/snowpark-connect-apache-spark (read 10 Nov 2026)
- Databricks pricing data file (AWS), loaded by its pricing calculator: https://www.databricks.com/en-pricing-assets/data/pricing/AWS.json (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/pricing (read 10 Nov 2026)
- Azure retail price API: https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Microsoft%20Fabric'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption' (read 10 Nov 2026)
- AWS page: https://aws.amazon.com/emr/pricing/ (read 10 Nov 2026)
- Snowflake Service Consumption Table: https://www.snowflake.com/legal-files/CreditConsumptionTable.pdf (read 10 Nov 2026)
- Starburst page: https://www.starburst.io/pricing/ (read 10 Nov 2026)
- Databricks documentation: https://docs.databricks.com/aws/en/resources/supported-regions (read 10 Nov 2026)
- Dremio documentation: https://docs.dremio.com/dremio-cloud/about/regions (read 10 Nov 2026)
- Google Cloud documentation: https://cloud.google.com/bigquery/docs/omni-introduction (read 10 Nov 2026)
- Onehouse documentation: https://docs.onehouse.ai/product/project-settings/usage-and-billing (read 10 Nov 2026)
- Snowflake documentation: https://docs.snowflake.com/en/user-guide/intro-regions.md (read 10 Nov 2026)
- Starburst page: https://www.starburst.io/pricing/pricing-details/ (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://datalakehousecompare.com/situations/leaving-managed/
