To deploy your model using your own compute resources, complete the necessary prerequisite integrations and set up your workflow seamlessly on the model suite using the processes outlined below:
Integrating your accounts
You can add your cloud accounts, hosted zones and create secrets for your secure information, within the integrations page.
Adding your cluster
Add your compute cluster by navigating to the Clusters page and providing the necessary details.
Model Optimisation
To optimise a model, you can either choose an available model from our model marketplace, or add your own.
Optimise your model for deployment by visiting the Models page and using our optimisation tools.
Model Deployment
Deploy your optimised model through the steps mentioned in the Deployments page.
Monitoring your deployment
Keep track of your deployment using the monitoring tools available on the deployments page.
Running a benchmarking job
Additionally, you can perform benchmark your deployed model for specific scenarios.
Inferencing
You can invoke your deployed models from the API tab of the model deployment.