Clusters

Configure a cluster

Clusters consist of the compute, storage & IOPS resources that e6data requires to process queries.

Clusters can contain one or more compute nodes (instances) and can be connected to other notebooks, BI tools, dashboards, etc. for your teams to query the data they need.

Note: To ensure e6data clusters can be created seamlessly in your cloud account, kindly be aware of any quotas or limits on resources such as VMs, static IPs, etc.

Create a Cluster

In some cases, not all executors will come online immediately when a cluster is created due to infrastructure availability limitations. The remaining executors will become active as soon as resources are available.

Users will still be able to run queries using a partially active cluster.

To create a cluster, open your workspace and click on the button in the sidebar.
Click Create Cluster
Next, fill in the following information :
- Cluster Name
- Select one or multiple catalogs that should be connected to this cluster from the dropdown.
- Choose a cluster size from the predefined options or select Custom to enter a different value.
- Enable Load Based Sizing - Set QPS to optimize cluster size for efficient workload management
- Enabling Result Set Caching - Cache query results for faster performance
The following Advanced Settings can be selected as per your requirements :
- Enable Auto Suspension and set a time limit for cluster suspension. This feature suspends clusters that are inactive for longer than the defined period.
- Set a Query Timeout - Stops queries running longer than the defined period.
- Enable No LIMIT Warning - Warn Query Editor users when attempting to run queries without a LIMIT.
Click Create.
The Cluster Listing page will be displayed. The status of the newly created cluster will become ACTIVE after a few minutes.
This cluster can now be used to execute queries using the Query Editor.

If the cluster has not been created an error will be displayed when hovering over the status bar. Please refer to the Cluster Error List for additional information.

PreviousRow Filter NextEdit & Delete Clusters

Last updated 4 months ago

Create a Cluster

Users will still be able to run queries using a partially active cluster.

To create a cluster, open your workspace and click on the button in the sidebar.

Click Create Cluster

Next, fill in the following information :

Cluster Name
Select one or multiple catalogs that should be connected to this cluster from the dropdown.
Choose a cluster size from the predefined options or select Custom to enter a different value.
Enable Load Based Sizing - Set QPS to optimize cluster size for efficient workload management
Enabling Result Set Caching - Cache query results for faster performance

The following Advanced Settings can be selected as per your requirements :

Enable Auto Suspension and set a time limit for cluster suspension. This feature suspends clusters that are inactive for longer than the defined period.
Set a Query Timeout - Stops queries running longer than the defined period.
Enable No LIMIT Warning - Warn Query Editor users when attempting to run queries without a LIMIT.

Click Create.

The Cluster Listing page will be displayed. The status of the newly created cluster will become ACTIVE after a few minutes.

This cluster can now be used to execute queries using the Query Editor.

If the cluster has not been created an error will be displayed when hovering over the status bar. Please refer to the Cluster Error List for additional information.

Cluster Creation Process