LogoLogo
  • Welcome to e6data
  • Introduction to e6data
    • Concepts
    • Architecture
      • e6data in VPC Deployment Model
      • Connect to e6data serverless compute
  • Get Started
  • Sign Up
  • Setup
    • AWS Setup
      • In VPC Deployment (AWS)
        • Prerequisite Infrastructure
        • Infrastructure & Permissions for e6data
        • Setup Kubernetes Components
        • Setup using Terraform in AWS
          • Update a AWS Terraform for your Workspace
        • AWS PrivateLink and e6data
        • VPC Peering | e6data on AWS
      • Connect to e6data serverless compute (AWS)
        • Workspace Creation
        • Catalog Creation
          • Glue Metastore
          • Hive Metastore
          • Unity Catalog
        • Cluster Creation
    • GCP Setup
      • In VPC Deployment (GCP)
        • Prerequisite Infrastructure
        • Infrastructure & Permissions for e6data
        • Setup Kubernetes Components
        • Setup using Terraform in GCP
        • Update a GCP Terraform for your Workspace
      • Connect to e6data serverless compute (GCP)
    • Azure Setup
      • Prerequisite Infrastructure
      • Infrastructure & Permissions for e6data
      • Setup Kubernetes Components
      • Setup using Terraform in AZURE
        • Update a AZURE Terraform for your Workspace
  • Workspaces
    • Create Workspaces
    • Enable/Disable Workspaces
    • Update a Workspace
    • Delete a Workspace
  • Catalogs
    • Create Catalogs
      • Hive Metastore
        • Connect to a Hive Metastore
        • Edit a Hive Metastore Connection
        • Delete a Hive Metastore Connection
      • Glue Metastore
        • Connect to a Glue Metastore
        • Edit a Glue Metastore Connection
        • Delete a Glue Metastore Connection
      • Unity Catalog
        • Connect to Unity Catalog
        • Edit Unity Catalog
        • Delete Unity Catalog
      • Cross-account Catalog Access
        • Configure Cross-account Catalog to Access AWS Hive Metastore
        • Configure Cross-account Catalog to Access Unity Catalog
        • Configure Cross-account Catalog to Access AWS Glue
        • Configure Cross-account Catalog to Access GCP Hive Metastore
    • Manage Catalogs
    • Privileges
      • Access Control
      • Column Masking
      • Row Filter
  • Clusters
    • Edit & Delete Clusters
    • Suspend & Resume Clusters
    • Cluster Size
    • Load Based Sizing
    • Auto Suspension
    • Query Timeout
    • Monitoring
    • Connection Info
  • Pools
    • Delete Pools
  • Query Editor
    • Editor Pane
    • Results Pane
    • Schema Explorer
    • Data Preview
  • Notebook
    • Editor Pane
    • Results Pane
    • Schema Explorer
    • Data Preview
  • Query History
    • Query Count API
  • Connectivity
    • IP Sets
    • Endpoints
    • Cloud Resources
    • Network Firewall
  • Access Control
    • Users
    • Groups
    • Roles
      • Permissions
      • Policies
    • Single Sign-On (SSO)
      • AWS SSO
      • Okta
      • Microsoft My Apps-SSO
      • Icons for IdP
    • Service Accounts
    • Multi-Factor Authentication (Beta)
  • Usage and Cost Management
  • Audit Log
  • User Settings
    • Profile
    • Personal Access Tokens (PAT)
  • Advanced Features
    • Cross-Catalog & Cross-Schema Querying
  • Supported Data Types
  • SQL Command Reference
    • Query Syntax
      • General functions
    • Aggregate Functions
    • Mathematical Functions & Operators
      • Arithematic Operators
      • Rounding and Truncation Functions
      • Exponential and Root Functions
      • Trigonometric Functions
      • Logarithmic Functions
    • String Functions
    • Date-Time Functions
      • Constant Functions
      • Conversion Functions
      • Date Truncate Function
      • Addition and Subtraction Functions
      • Extraction Functions
      • Format Functions
      • Timezone Functions
    • Conditional Expressions
    • Conversion Functions
    • Window Functions
    • Comparison Operators & Functions
    • Logical Operators
    • Statistical Functions
    • Bitwise Functions
    • Array Functions
    • Regular Expression Functions
    • Generate Functions
    • Cardinality Estimation Functions
    • JSON Functions
    • Checksum Functions
    • Unload Function (Copy into)
    • Struct Functions
  • Equivalent Functions & Operators
  • Connectors & Drivers
    • DBeaver
    • DbVisualiser
    • Apache Superset
    • Jupyter Notebook
    • Tableau Cloud
    • Tableau Desktop
    • Power BI
    • Metabase
    • Zeppelin
    • Python Connector
      • Code Samples
    • JDBC Driver
      • Code Samples
      • API Support
    • Configure Cluster Ingress
      • ALB Ingress in Kubernetes
      • GCE Ingress in Kubernetes
      • Ingress-Nginx in Kubernetes
  • Security & Trust
    • Best Practices
      • AWS Best Practices
    • Features & Responsibilities Matrix
    • Data Protection Addendum(DPA)
  • Tutorials and Best Practices
    • How to configure HIVE metastore if you don't have one?
    • How-To Videos
  • Known Limitations
    • SQL Limitations
    • Other Limitations
    • Restart Triggers
    • Cloud Provider Limitations
  • Error Codes
    • General Errors
    • User Account Errors
    • Workspace Errors
    • Catalog Errors
    • Cluster Errors
    • Data Governance Errors
    • Query History Errors
    • Query Editor Errors
    • Pool Errors
    • Connectivity Errors
  • Terms & Condition
  • Privacy Policy
    • Cookie Policy
  • FAQs
    • Workspace Setup
    • Security
    • Catalog Privileges
  • Services Utilised for e6data Deployment
    • AWS supported regions
    • GCP supported regions
    • AZURE supported regions
  • Release Notes & Updates
    • 6th Sept 2024
    • 6th June 2024
    • 18th April 2024
    • 9th April 2024
    • 30th March 2024
    • 16th March 2024
    • 14th March 2024
    • 12th March 2024
    • 2nd March 2024
    • 10th February 2024
    • 3rd February 2024
    • 17th January 2024
    • 9th January 2024
    • 3rd January 2024
    • 18th December 2023
    • 12th December 2023
    • 9th December 2023
    • 4th December 2023
    • 27th November 2023
    • 8th September 2023
    • 4th September 2023
    • 26th August 2023
    • 21st August 2023
    • 19th July 2023
    • 23rd May 2023
    • 5th May 2023
    • 28th April 2023
    • 19th April 2023
    • 15th April 2023
    • 10th April 2023
    • 30th March 2023
Powered by GitBook
On this page
  • Catalog Privileges (Beta)
  • Key Features:
  • Limitations:
  • Support for Liquid Clustering
  • Support for Unnest Operator for Primitive Types
  • Impersonation Feature for Metabase BI Tool only via Apache Ranger
  • Supporting New Function
  1. Release Notes & Updates

2nd March 2024

Covers the latest e6data updates, including catalog privileges (Beta), support for liquid clustering, new functions, and the impersonation feature for the Metabase BI tool via Apache Ranger.

Previous12th March 2024Next10th February 2024

Last updated 1 month ago

We're pleased to introduce the latest updates to the e6data platform. Below, you'll find the list of new features and enhancements now available on the e6data platform.

Catalog Privileges (Beta)

e6data launches support for data governance capabilities for its Lakehouse SQL Engine. With this new feature, users can seamlessly manage and enforce data access privileges, ensuring data security and compliance at every level. Catalog privileges offer a system for managing authentication and access across catalog, database, table, and column levels. For instructions on enabling catalog privileges, please refer to the .

Please note that this is a beta feature in a private preview. Please reach out to the e6data team to enable this in your workspace.

Key Features:

  • Granular Access Control: Define access privileges at the catalog, schema, table, and column levels, precisely controlling who can access what data.

  • User-Friendly Interface: Easily manage access privileges directly through the intuitive interface of e6.

  • Transparent Query History: Gain insight into denied access attempts through the transparent query history feature.

  • Future Enhancements: Anticipate upcoming enhancements, including support for row filtering and column masking.

  • Role-Based Access: Empower users with the Data Admin role to create and manage access privileges, ensuring centralized control and oversight.

  • Automatic Access Provisioning: Experience seamless access provisioning as any new user added to the workspace automatically inherits access to all data assets.

Limitations:

  • Column masking and row filtering functionalities are scheduled for future releases and unavailable in the current version.

  • Changes to access privileges may take 60 seconds to become effective after saving.

Support for Liquid Clustering

In this release, the e6data cluster is now capable of effectively managing tables with liquid clustering enabled on a delta table. It leverages clustering keys to enhance performance when reading the tables, thereby improving query execution speed.

Support for Unnest Operator for Primitive Types

Introducing support for the unnest operator for primitive types, allowing users to efficiently work with nested data structures.

Impersonation Feature for Metabase BI Tool only via Apache Ranger

  • A new parameter has been added which identifies the session user in the Metabase BI tool.

  • Enables clear attribution of queries to the correct user, aiding data governance and security efforts.

  • To utilize this feature, users must employ the latest engine alongside the e6data Clojure driver. (Please contact e6data support for Clojure driver)

Supporting New Function

Introducing a range of new functions to enhance query capabilities:

  • ENDSWITH - Returns TRUE if the first expression ends with second expression, simplifying substring search operations.

  • ASCII - Return the ASCII code for the first character of a given string.

  • MD5 - Returns a 32-character hex-encoded string.

  • REPEAT - Generate a string by duplicating the input by number of repetitions specified.

  • SIGN - The SIGN (SIGNUM) function returns the signum value of its argument.

  • TO_TIMESTAMP_NTZ - Returns timestamp with UTC timezone (timestamp with no time zone).

documentation
Catalog Privileges (Beta)
Support for Liquid Clustering
Support for Unnest Operator for Primitive Types
Impersonation Feature for Metabase BI Tool only via Apache Ranger
Supporting New Functions