Through the Clusters section, you can efficiently manage your compute resources, allowing for optimal allocation and monitoring of your computational power.

​
Enter Basic Details

  • Name: Provide a name for your cluster. This name will become your cluster slug.
  • Cloud Account: Select the cloud account where the cluster will be created.
  • Region: Choose the region for your cluster.
  • Hosted Zone: Select the appropriate hosted zone.

After entering all the necessary details, click on the Create Cluster button to create the cluster.

​
Node Group Addition

  • When you see the Success status, it means your cluster including the Auxiliary node pool is fully provisioned, allowing you to move forward with creating a Node Group.

  • Click on the Add Node Group button on the top-right.
  • Name: Provide a descriptive name for your node group.
  • Accelerator: Select the appropriate accelerator for your workloads.
  • Capacity Type: You can choose the node to be a On Demand instance or a Spot instance.
  • Machine Type: Choose the machine size that meets your performance requirements.
  • Scaling Configuration: Define the minimum and maximum number of nodes.

​
Viewing Cluster Details

  • The status will show success once the node group is successfully created and the cluster is now ready for use.
  • Once the Node Group is created, you can view its information by clicking on the Overview tab.
  • Click on the Deploy button to deploy the model to the node. You can find the deployment page here.

​
Monitoring your cluster

You can track the overall usage and performance of your cluster to ensure optimal operation, by clicking on the Monitor tab.

  • Date Range: Select the date range for which you want to view monitoring metrics.
  • Pod Info: View detailed information about the pods in your cluster.
  • GPU and GRAM Utilization: Monitor the usage and performance of GPUs and GRAM.