LogoLogo
  • Welcome to e6data
  • Introduction to e6data
    • Concepts
    • Architecture
      • e6data in VPC Deployment Model
      • Connect to e6data serverless compute
  • Get Started
  • Sign Up
  • Setup
    • AWS Setup
      • In VPC Deployment (AWS)
        • Prerequisite Infrastructure
        • Infrastructure & Permissions for e6data
        • Setup Kubernetes Components
        • Setup using Terraform in AWS
          • Update a AWS Terraform for your Workspace
        • AWS PrivateLink and e6data
        • VPC Peering | e6data on AWS
      • Connect to e6data serverless compute (AWS)
        • Workspace Creation
        • Catalog Creation
          • Glue Metastore
          • Hive Metastore
          • Unity Catalog
        • Cluster Creation
    • GCP Setup
      • In VPC Deployment (GCP)
        • Prerequisite Infrastructure
        • Infrastructure & Permissions for e6data
        • Setup Kubernetes Components
        • Setup using Terraform in GCP
        • Update a GCP Terraform for your Workspace
      • Connect to e6data serverless compute (GCP)
    • Azure Setup
      • Prerequisite Infrastructure
      • Infrastructure & Permissions for e6data
      • Setup Kubernetes Components
      • Setup using Terraform in AZURE
        • Update a AZURE Terraform for your Workspace
  • Workspaces
    • Create Workspaces
    • Enable/Disable Workspaces
    • Update a Workspace
    • Delete a Workspace
  • Catalogs
    • Create Catalogs
      • Hive Metastore
        • Connect to a Hive Metastore
        • Edit a Hive Metastore Connection
        • Delete a Hive Metastore Connection
      • Glue Metastore
        • Connect to a Glue Metastore
        • Edit a Glue Metastore Connection
        • Delete a Glue Metastore Connection
      • Unity Catalog
        • Connect to Unity Catalog
        • Edit Unity Catalog
        • Delete Unity Catalog
      • Cross-account Catalog Access
        • Configure Cross-account Catalog to Access AWS Hive Metastore
        • Configure Cross-account Catalog to Access Unity Catalog
        • Configure Cross-account Catalog to Access AWS Glue
        • Configure Cross-account Catalog to Access GCP Hive Metastore
    • Manage Catalogs
    • Privileges
      • Access Control
      • Column Masking
      • Row Filter
  • Clusters
    • Edit & Delete Clusters
    • Suspend & Resume Clusters
    • Cluster Size
    • Load Based Sizing
    • Auto Suspension
    • Query Timeout
    • Monitoring
    • Connection Info
  • Pools
    • Delete Pools
  • Query Editor
    • Editor Pane
    • Results Pane
    • Schema Explorer
    • Data Preview
  • Notebook
    • Editor Pane
    • Results Pane
    • Schema Explorer
    • Data Preview
  • Query History
    • Query Count API
  • Connectivity
    • IP Sets
    • Endpoints
    • Cloud Resources
    • Network Firewall
  • Access Control
    • Users
    • Groups
    • Roles
      • Permissions
      • Policies
    • Single Sign-On (SSO)
      • AWS SSO
      • Okta
      • Microsoft My Apps-SSO
      • Icons for IdP
    • Service Accounts
    • Multi-Factor Authentication (Beta)
  • Usage and Cost Management
  • Audit Log
  • User Settings
    • Profile
    • Personal Access Tokens (PAT)
  • Advanced Features
    • Cross-Catalog & Cross-Schema Querying
  • Supported Data Types
  • SQL Command Reference
    • Query Syntax
      • General functions
    • Aggregate Functions
    • Mathematical Functions & Operators
      • Arithematic Operators
      • Rounding and Truncation Functions
      • Exponential and Root Functions
      • Trigonometric Functions
      • Logarithmic Functions
    • String Functions
    • Date-Time Functions
      • Constant Functions
      • Conversion Functions
      • Date Truncate Function
      • Addition and Subtraction Functions
      • Extraction Functions
      • Format Functions
      • Timezone Functions
    • Conditional Expressions
    • Conversion Functions
    • Window Functions
    • Comparison Operators & Functions
    • Logical Operators
    • Statistical Functions
    • Bitwise Functions
    • Array Functions
    • Regular Expression Functions
    • Generate Functions
    • Cardinality Estimation Functions
    • JSON Functions
    • Checksum Functions
    • Unload Function (Copy into)
    • Struct Functions
  • Equivalent Functions & Operators
  • Connectors & Drivers
    • DBeaver
    • DbVisualiser
    • Apache Superset
    • Jupyter Notebook
    • Tableau Cloud
    • Tableau Desktop
    • Power BI
    • Metabase
    • Zeppelin
    • Python Connector
      • Code Samples
    • JDBC Driver
      • Code Samples
      • API Support
    • Configure Cluster Ingress
      • ALB Ingress in Kubernetes
      • GCE Ingress in Kubernetes
      • Ingress-Nginx in Kubernetes
  • Security & Trust
    • Best Practices
      • AWS Best Practices
    • Features & Responsibilities Matrix
    • Data Protection Addendum(DPA)
  • Tutorials and Best Practices
    • How to configure HIVE metastore if you don't have one?
    • How-To Videos
  • Known Limitations
    • SQL Limitations
    • Other Limitations
    • Restart Triggers
    • Cloud Provider Limitations
  • Error Codes
    • General Errors
    • User Account Errors
    • Workspace Errors
    • Catalog Errors
    • Cluster Errors
    • Data Governance Errors
    • Query History Errors
    • Query Editor Errors
    • Pool Errors
    • Connectivity Errors
  • Terms & Condition
  • Privacy Policy
    • Cookie Policy
  • FAQs
    • Workspace Setup
    • Security
    • Catalog Privileges
  • Services Utilised for e6data Deployment
    • AWS supported regions
    • GCP supported regions
    • AZURE supported regions
  • Release Notes & Updates
    • 6th Sept 2024
    • 6th June 2024
    • 18th April 2024
    • 9th April 2024
    • 30th March 2024
    • 16th March 2024
    • 14th March 2024
    • 12th March 2024
    • 2nd March 2024
    • 10th February 2024
    • 3rd February 2024
    • 17th January 2024
    • 9th January 2024
    • 3rd January 2024
    • 18th December 2023
    • 12th December 2023
    • 9th December 2023
    • 4th December 2023
    • 27th November 2023
    • 8th September 2023
    • 4th September 2023
    • 26th August 2023
    • 21st August 2023
    • 19th July 2023
    • 23rd May 2023
    • 5th May 2023
    • 28th April 2023
    • 19th April 2023
    • 15th April 2023
    • 10th April 2023
    • 30th March 2023
Powered by GitBook
On this page
  • Summary
  • Usage Notes
  • Platform Release Notes
  • Tab Management in Query Editor
  • Improvements to Automatically Added Workspace & Clusters Tags
  • Engine Release Notes
  • SQL Optimizations
  • Bug Fixes
  • Know Limitations
  1. Release Notes & Updates

5th May 2023

page covers tab management, cluster tag improvements, SQL optimizations, bug fixes, and known limitations.

Previous23rd May 2023Next28th April 2023

Last updated 1 month ago

Summary

The 5th May 2023 release of e6data includes the following features & enhancements:

Usage Notes

To get access to all features from this release:

  • Update all Workspaces

  • Suspend and resume all Clusters

Platform Release Notes

Tab Management in Query Editor

Users will now be able to drag and move tabs to change their order in the Query Editor. Each user's tab order will be auto-saved for future sessions.

Improvements to Automatically Added Workspace & Clusters Tags

A tag containing the email address of the user who creates a Workspace or Cluster will be added automatically. This will help map usage and costs back to a specific user.

More information:

  • Workspace Tags

Engine Release Notes

SQL Optimizations

  • Better handling of CTEs

    • When the same Common Table Expression (CTE) is used multiple times in a query, the engine now processes it in an optimized fashion to avoid duplicate processing.

  • Optimizations for RIGHT JOIN and LEFT JOIN operators

    • Queries containing RIGHT JOIN operations now leverage more cores when possible to process queries more efficiently. Additionally, we have optimized some LEFT JOINs to behave as RIGHT JOINs, which triggers this optimization.

  • COUNT DISTINCT optimization for high cardinality cases

    • If a COUNT DISTINCT operation is performed on a table with a large number of unique values, the engine now processes queries in a much more optimized manner.

  • Improvements in high cardinality aggregations

    • If aggregations have many unique group values, the engine now processes queries more optimally by using all available cores.

  • Improvements in dynamic filters and filter push-down

    • The engine now pushes down more complex filter types, reducing the data processed during table scans. We have also added more complex filter conditions to the list of filters we can push down. Example functions: DATE_TRUNC, DATETIME, UPPER, and LOWER

Bug Fixes

  • DATE_DIFF correctness fixes:

    • Issue: Timestamps were considered during DATE_DIFF operations

    • Solution: Only dates are now accepted as a parameter and the difference will be provided in days by default.

  • Complete list of tables from Catalog:

    • Issue: If the number of tables exceeded 100, the 101st table and after were not visible in the Schema Explorer. And it was arranged in alphabetical order

    • Solution: All tables are now listed in the Schema Explorer

  • Column listing of delta tables

    • Issue: The columns for delta tables were not getting listed in the Schema explorer

    • Solution: The columns for delta tables are now getting listed on the schema explorer

Know Limitations

  1. Tables with partitioned columns are currently not visible in the Schema Explorer but it is available for querying purposes.

  2. Filter pushdown for queries with multiple CTEs is currently not happening due to a known bug.

  3. Usage of STDDEV_SAMP function leads to row count mismatch issue.

More information:

Platform Release Notes
Tab Management in Query Editor
Improvements to Automatically Added Clusters Tags
Engine Release Notes
SQL Optimizations
Bug Fixes
Known Limitations
Tab Management