Crunch compatibility

Supported platforms and file formats for Granica Crunch.

Granica Crunch supports a range of platforms, file formats, and cloud providers. This page details what's compatible today and what's coming soon.

Supported formats

CloudStorageFormatVersions / notes
AWSAmazon S3Delta Lake3.2.x, 3.3.x, 4.1.x · Unity
AWSAmazon S3Apache Iceberg1.6.1, 1.10.1 · HMS, Polaris, more catalogs coming
AWSAmazon S3Apache Parquet1.13.x, 1.15.x · 1.16.x coming soon
AWSAmazon S3HiveExternal tables · Managed tables
GCPGoogle Cloud StorageDelta Lake3.2.x, 3.3.x, 4.1.x · Unity
GCPGoogle Cloud StorageApache Iceberg1.6.1, 1.10.1 · HMS, Polaris, more catalogs coming
GCPGoogle Cloud StorageApache Parquet1.13.x, 1.15.x · 1.16.x coming soon
GCPGoogle Cloud StorageHiveExternal tables · Managed tables
AzureBlob Storage · ADLS Gen2Delta Lake3.2.x, 3.3.x, 4.1.x · Unity
AzureBlob Storage · ADLS Gen2Apache Iceberg1.6.1, 1.10.1 · HMS, Polaris, more catalogs coming
AzureBlob Storage · ADLS Gen2Apache Parquet1.13.x, 1.15.x · 1.16.x coming soon
AzureBlob Storage · ADLS Gen2HiveExternal tables · Managed tables
All cloudsS3, GCS, ADLS Gen2Object maintenanceNon-ACID, PB-scale object stores

Runtime Crunch compatibility

Runtime Crunch currently works with Apache Spark. Support for additional engines is planned:

  • Apache Spark — V3.5.x supported, EMR 7.x · Spark V4 and EMR 8.x coming soon
  • Apache Flink — Coming soon
  • Trino — Coming soon

Background Crunch compatibility

Background Crunch currently works with Apache Spark. Support for additional engines is planned:

  • Apache Spark — V3.5.x supported, EMR 7.x · Spark V4 and EMR 8.x coming soon
  • Apache Flink — Coming soon
  • Trino — Coming soon

Crunch maintains full data integrity and format compliance. Crunched files remain valid Parquet files that any standards-compliant reader can process without modification.

Was this page helpful?

On this page