Bring-your-own-compute (BYOC) allows you to use your own compute solution for deploying and running your ML models.

​
Benefits of BYOC

  • Control over infrastructure: Utilize your existing resources and configurations.
  • Cost savings: Avoid additional costs associated with using our infrastructure.
  • Scalability: Scale deployments according to your own infrastructure capabilities.

​
Deploying a model using your own compute

To deploy your model using your own compute resources, complete the necessary prerequisite integrations and set up your workflow seamlessly on the model suite using the processes outlined below:

  1. Integrating your accounts You can add your cloud accounts, hosted zones and create secrets for your secure information, within the integrations page.
  2. Adding your cluster Add your compute cluster by navigating to the Clusters page and providing the necessary details.
  3. Model Optimisation
    • To optimise a model, you can either choose an available model from our model marketplace, or add your own.
    • Optimise your model for deployment by visiting the Models page and using our optimisation tools.
  4. Model Deployment Deploy your optimised model through the steps mentioned in the Deployments page.
  5. Monitoring your deployment Keep track of your deployment using the monitoring tools available on the deployments page.
  6. Running a benchmarking job Additionally, you can perform benchmark your deployed model for specific scenarios.
  7. Inferencing You can invoke your deployed models from the API tab of the model deployment.