LogoLogo
  • Welcome to e6data
  • Introduction to e6data
    • Concepts
    • Architecture
      • e6data in VPC Deployment Model
      • Connect to e6data serverless compute
  • Get Started
  • Sign Up
  • Setup
    • AWS Setup
      • In VPC Deployment (AWS)
        • Prerequisite Infrastructure
        • Infrastructure & Permissions for e6data
        • Setup Kubernetes Components
        • Setup using Terraform in AWS
          • Update a AWS Terraform for your Workspace
        • AWS PrivateLink and e6data
        • VPC Peering | e6data on AWS
      • Connect to e6data serverless compute (AWS)
        • Workspace Creation
        • Catalog Creation
          • Glue Metastore
          • Hive Metastore
          • Unity Catalog
        • Cluster Creation
    • GCP Setup
      • In VPC Deployment (GCP)
        • Prerequisite Infrastructure
        • Infrastructure & Permissions for e6data
        • Setup Kubernetes Components
        • Setup using Terraform in GCP
        • Update a GCP Terraform for your Workspace
      • Connect to e6data serverless compute (GCP)
    • Azure Setup
      • Prerequisite Infrastructure
      • Infrastructure & Permissions for e6data
      • Setup Kubernetes Components
      • Setup using Terraform in AZURE
        • Update a AZURE Terraform for your Workspace
  • Workspaces
    • Create Workspaces
    • Enable/Disable Workspaces
    • Update a Workspace
    • Delete a Workspace
  • Catalogs
    • Create Catalogs
      • Hive Metastore
        • Connect to a Hive Metastore
        • Edit a Hive Metastore Connection
        • Delete a Hive Metastore Connection
      • Glue Metastore
        • Connect to a Glue Metastore
        • Edit a Glue Metastore Connection
        • Delete a Glue Metastore Connection
      • Unity Catalog
        • Connect to Unity Catalog
        • Edit Unity Catalog
        • Delete Unity Catalog
      • Cross-account Catalog Access
        • Configure Cross-account Catalog to Access AWS Hive Metastore
        • Configure Cross-account Catalog to Access Unity Catalog
        • Configure Cross-account Catalog to Access AWS Glue
        • Configure Cross-account Catalog to Access GCP Hive Metastore
    • Manage Catalogs
    • Privileges
      • Access Control
      • Column Masking
      • Row Filter
  • Clusters
    • Edit & Delete Clusters
    • Suspend & Resume Clusters
    • Cluster Size
    • Load Based Sizing
    • Auto Suspension
    • Query Timeout
    • Monitoring
    • Connection Info
  • Pools
    • Delete Pools
  • Query Editor
    • Editor Pane
    • Results Pane
    • Schema Explorer
    • Data Preview
  • Notebook
    • Editor Pane
    • Results Pane
    • Schema Explorer
    • Data Preview
  • Query History
    • Query Count API
  • Connectivity
    • IP Sets
    • Endpoints
    • Cloud Resources
    • Network Firewall
  • Access Control
    • Users
    • Groups
    • Roles
      • Permissions
      • Policies
    • Single Sign-On (SSO)
      • AWS SSO
      • Okta
      • Microsoft My Apps-SSO
      • Icons for IdP
    • Service Accounts
    • Multi-Factor Authentication (Beta)
  • Usage and Cost Management
  • Audit Log
  • User Settings
    • Profile
    • Personal Access Tokens (PAT)
  • Advanced Features
    • Cross-Catalog & Cross-Schema Querying
  • Supported Data Types
  • SQL Command Reference
    • Query Syntax
      • General functions
    • Aggregate Functions
    • Mathematical Functions & Operators
      • Arithematic Operators
      • Rounding and Truncation Functions
      • Exponential and Root Functions
      • Trigonometric Functions
      • Logarithmic Functions
    • String Functions
    • Date-Time Functions
      • Constant Functions
      • Conversion Functions
      • Date Truncate Function
      • Addition and Subtraction Functions
      • Extraction Functions
      • Format Functions
      • Timezone Functions
    • Conditional Expressions
    • Conversion Functions
    • Window Functions
    • Comparison Operators & Functions
    • Logical Operators
    • Statistical Functions
    • Bitwise Functions
    • Array Functions
    • Regular Expression Functions
    • Generate Functions
    • Cardinality Estimation Functions
    • JSON Functions
    • Checksum Functions
    • Unload Function (Copy into)
    • Struct Functions
  • Equivalent Functions & Operators
  • Connectors & Drivers
    • DBeaver
    • DbVisualiser
    • Apache Superset
    • Jupyter Notebook
    • Tableau Cloud
    • Tableau Desktop
    • Power BI
    • Metabase
    • Zeppelin
    • Python Connector
      • Code Samples
    • JDBC Driver
      • Code Samples
      • API Support
    • Configure Cluster Ingress
      • ALB Ingress in Kubernetes
      • GCE Ingress in Kubernetes
      • Ingress-Nginx in Kubernetes
  • Security & Trust
    • Best Practices
      • AWS Best Practices
    • Features & Responsibilities Matrix
    • Data Protection Addendum(DPA)
  • Tutorials and Best Practices
    • How to configure HIVE metastore if you don't have one?
    • How-To Videos
  • Known Limitations
    • SQL Limitations
    • Other Limitations
    • Restart Triggers
    • Cloud Provider Limitations
  • Error Codes
    • General Errors
    • User Account Errors
    • Workspace Errors
    • Catalog Errors
    • Cluster Errors
    • Data Governance Errors
    • Query History Errors
    • Query Editor Errors
    • Pool Errors
    • Connectivity Errors
  • Terms & Condition
  • Privacy Policy
    • Cookie Policy
  • FAQs
    • Workspace Setup
    • Security
    • Catalog Privileges
  • Services Utilised for e6data Deployment
    • AWS supported regions
    • GCP supported regions
    • AZURE supported regions
  • Release Notes & Updates
    • 6th Sept 2024
    • 6th June 2024
    • 18th April 2024
    • 9th April 2024
    • 30th March 2024
    • 16th March 2024
    • 14th March 2024
    • 12th March 2024
    • 2nd March 2024
    • 10th February 2024
    • 3rd February 2024
    • 17th January 2024
    • 9th January 2024
    • 3rd January 2024
    • 18th December 2023
    • 12th December 2023
    • 9th December 2023
    • 4th December 2023
    • 27th November 2023
    • 8th September 2023
    • 4th September 2023
    • 26th August 2023
    • 21st August 2023
    • 19th July 2023
    • 23rd May 2023
    • 5th May 2023
    • 28th April 2023
    • 19th April 2023
    • 15th April 2023
    • 10th April 2023
    • 30th March 2023
Powered by GitBook
On this page
  • Catalog Privileges Supporting Column Masking and Row Filter
  • Column Masking
  • Row Filtering
  • Query History Query Count API
  • Support for Deletion Vector in Iceberg Tables
  • New Functions Support
  1. Release Notes & Updates

30th March 2024

This page covers recent e6data updates, including catalog privileges for column masking and row filtering, query history enhancements, and support for deletion vectors in Iceberg tables.

Previous9th April 2024Next16th March 2024

Last updated 1 year ago

We're excited to announce the latest updates and enhancements to e6data. This release brings a host of new features, improvements, and bug fixes to enhance your experience with our platform.

Catalog Privileges Supporting Column Masking and Row Filter

We're excited to announce the latest enhancements to our platform! In this release, we've introduced powerful new features: column masking and row filtering privileges. These capabilities empower administrators to control access to sensitive data within their databases finely, ensuring enhanced data security and compliance.

Column Masking

Column masking privilege allows administrators to control the visibility of specific column data within a database table. It enables the hiding of sensitive information based on predefined rules, ensuring data security and privacy. Authorised users can apply masking techniques like redaction, partial display, or hashing to protect confidential data. For more information, please refer to the .

Row Filtering

Row filtering privilege enables users to control access to specific rows of data within a database table. It allows administrators to define conditions based on SQL expressions, restricting the visibility of sensitive or confidential information. Authorised users can create row filters to limit access to data based on criteria such as user roles, departments, or other relevant factors, ensuring data security and compliance with privacy regulations. For more information, please refer to the .

Query History Query Count API

We're excited to announce the launch of our latest API feature: the Query History Query Count API.

Support for Deletion Vector in Iceberg Tables

We're thrilled to announce that the SQL engine now supports reading deletion vectors for enhanced storage optimization in Iceberg tables.

Deletion vectors enable DELETE operations to mark existing rows as removed without rewriting the entire Parquet file, thereby improving performance and efficiency.

Limitations:

  • Applying filters on columns from which data has been deleted in complex data types is not currently supported.

This enhancement brings significant benefits to your data management processes, offering improved performance and storage efficiency.

New Functions Support

We're excited to introduce a variety of new functions to enhance your querying capabilities:

  • STRPOS: This function enables you to find the position of a substring within a string. It returns the position of the first occurrence of the substring within the string. If the substring is not found, it returns zero.

  • LENGTH: The LENGTH function allows you to determine the length of a string.

  • STARTSWITH: The STARTSWITH function simplifies substring search operations by returning TRUE if the first expression starts with the second expression.

These new functions provide additional flexibility and efficiency to your data manipulation tasks.

This powerful tool allows users to retrieve the count of queries executed within a specified time range, filtered based on selections made in the query history. With this API, users can now effortlessly track query activity, analyze usage trends, and gain valuable insights into their data analytics workflows. Whether you're monitoring system performance or optimizing query efficiency, the Query History Query Count API provides a streamlined solution for accessing vital query execution metrics. For more information, please refer to the .

documentation
documentation
documentation
Catalog Privileges Supporting Column Masking and Row Filter
Column Masking
Row Filtering
Query History Query Count API
Support for Deletion Vector in Iceberg Tables
New Functions Support