This document outlines the roadmap for the Unity Catalog open source project. As always, features may move in/out of milestones pending available resources, priorities, and community discussions.
Views provide governed, reusable definitions over tables. We will start with supporting basic Spark SQL views and then progress toward broader engine interoperability.
The Iceberg REST Catalog provides an open interface for engines and tools to discover and access Iceberg tables. We will continue to strengthen interoperability through this interface, including Delta Uniform table access and Iceberg table lifecycle support, so more engines can access data registered in Unity Catalog through open standards.
S3-compatible storage support will allow Unity Catalog deployments to use object stores that expose an S3-compatible API. This allows Unity Catalog to be deployed across a broader range of on-prem and cloud environments.
Production hardening focuses on the reliability and operational maturity needed for broader production deployments. The roadmap includes monitoring and telemetry, database schema upgrades, server-side storage credential and FileIO caching, and managed table and volume lifecycle support.
Note: The projected roadmap is tentative and may change. For details of what shipped in each release, see the Unity Catalog release notes.
| Feature | Area | v0.3 | v0.4 | v0.5 | v0.6 | v0.7 | v0.8+ |
| Core | |||||||
| Catalog | API + Server |  |
|
|
|
|
|
| Schema | API + Server | |
|
|
|
|
|
| Managed location in catalog | API + Server | |
|
|
|
|
|
| Managed location in schema | API + Server | |
|
|
|
|
|
| Credential | API + Server | 🛠️ | |
|
|
|
|
| External Location | API + Server | 🛠️ | |
|
|
|
|
| Multi-tenancy | API + Server | |
|||||
| S3-compatible storage | API + Server | |
|||||
| Identity & Authentication | |||||||
| Local identity management (user) | API + Server | |
|
|
|
|
|
| Group management | API + Server | |
|||||
| Support for Machine identities (SPs) | API + Server | |
|||||
| SCIM to support identity sync from IdP (users and groups) | API + Server | |
|
|
|
|
|
| OAuth/OIDC for Users | API + Server | |
|
|
|
|
|
| OAuth/OIDC for Services | API + Server | |
|||||
| OAuth client-side support | Spark integration | |
|
|
|
|
|
| SAML authentication support | API + Server | ❓ | |||||
| Access Control & Governance | |||||||
| Support for change of ownership | API + Server | |
|||||
| Add permission/privilege support for MODIFY, CREATE_X, BROWSE | API + Server | |
|
||||
| Add remaining permissions/privileges (MANAGE etc) | API + Server | |
|
||||
| Temporary credential vending for tables | API + Server | |
|
|
|
|
|
| Temporary credential vending for volumes | API + Server | |
|
|
|
|
|
| Temporary credential vending for models | API + Server | |
|
|
|
|
|
| Basic grants | API + Server | |
|
|
|
|
|
| Auditing | API + Server | |
|||||
| SQL DCL changes | Spark Integration | ❓ | |||||
| RBAC | API + Server | ❓ | |||||
| Row level filters | API + Server | ❓ | |||||
| Column level masks | API + Server | ❓ | |||||
| ABAC | API + Server | ❓ | |||||
| Lineage | API + Server | ❓ | |||||
| Server production-readiness (support running as a HMS replacement) | |||||||
| Monitoring and Telemetry | API + Server | |
|
||||
| Database schema upgrades | API + Server | |
|
||||
| Change events | API + Server | ❓ | |||||
| Server-side storage credential and FileIO caching | API + Server | |
|
||||
| Managed tables and volumes lifecycle | API + Server | |
|
||||
| Tables | |||||||
| External table reads & writes | API + Server | |
|
|
|
|
|
| Spark integration | |
|
|
|
|
||
| Delta integration | |
|
|
|
|
||
| Managed Delta table reads | API + Server | |
|
|
|
|
|
| Delta+Spark integration | |
|
|
|
|
|
|
| Managed Delta tables creates+writes with catalog-managed commits | API + Server | |
|
|
|
|
|
| Delta-Spark integration | |
|
|
|
|
||
| Delta Kernel integration | |
|
|
|
|
||
| Delta Uniform tables with read as Iceberg via Iceberg REST API | API + Server | 🛠️ | 🛠️ | |
|
|
|
| Delta integration | |
|
|
|
|||
| Iceberg tables with create+read+write | API + Server | |
|
||||
| Multi-engine data types for column definitions | API + Server | |
|
|
|
||
| Views | |||||||
| Basic Spark SQL flavor views | API + Server | |
|
|
|||
| Multi-dialect views | API + Server | |
|||||
| Iceberg view support | API + Server | |
|||||
| Materialized views | API + Server | ❓ | |||||
| Metric views | API + Server | |
|
|
|||
| Streaming tables | API + Server | ❓ | |||||
| Shallow clones | API + Server | |
|||||
| Non-tabular and AI assets | |||||||
| Functions (SQL UDFs, Python UDFs) | API + Server | |
|
|
|
|
|
| ML integrations with advanced python SDK | |
|
|
|
|
||
| Spark integration | |
||||||
| Multi-engine functions (SQL) | API + Server | ❓ | |||||
| Remote functions | API + Server | ❓ | |||||
| External volumes | API + Server | |
|
|
|
|
|
| Spark integration | |
||||||
| Managed volumes | API + Server | |
|
|
|
||
| Spark integration | |
||||||
| Models and model versions | API + Server | |
|
|
|
|
|
| MLflow integration | |
|
|
|
|
||
| Spark integration | |
||||||
| Features tables | API + Server | ❓ | |||||
| Data monitors | API + Server | ❓ | |||||
| Sharing | |||||||
| Open Sharing | API + Server | |
|||||
| Shares | API + Server | |
|||||
| Recipients | API + Server | |
|||||
| Providers | API + Server | |
|||||
| Federation | |||||||
| Connections | API + Server | ❓ | |||||
| Foreign objects (catalogs, schemas, tables) | API + Server | ❓ | |||||
| Support for different data sources: JDBC, Iceberg REST, HMS | API + Server | |
|||||