Skip to main content
Manage deployments using simplismart deployments.

List Deployments

Lists deployments with optional filtering.

Status Options

Example:
Expected output

List Model Deployments

Lists all model deployments for an organization.
Example:

Create Deployment

Creates a deployment for a model repo.
A deployment scales using one of two approaches, and they cannot be combined:
  • Traffic-based (--scale-to-zero-enabled): scales down when the deployment is idle.
  • Cron-based / schedule-based (cronScaling): runs on a fixed schedule. Set --min-pod-replicas 0 if you also want it to scale to zero outside the scheduled window.
Example: The command below deploys a model on an H100 serving 1 to 2 replicas, autoscaling on GPU utilization (target 80%), with fast scale-up, async request handling, and endpoint auth enabled.
The targets in --autoscale-config accept these metrics: These are the same scaling metrics you set when creating a deployment on the Simplismart Platform. For what each metric measures and how thresholds trigger scaling, see Add Scaling Metrics. Cron-based scaling (called schedule-based scaling on the Simplismart platform) runs the deployment on a fixed schedule. For example, to keep it up on weekdays 9am to 6pm UTC and scale to zero outside that window, set --min-pod-replicas 0 and pass a cronScaling config. Each cronScaling rule requires timezone, start, end, and desiredReplicas:
Each cronScaling rule accepts: You can also pass the config as a file with --autoscale-config @autoscale.json, where autoscale.json contains:

Get Deployment

Gets deployment details by ID.
Example:
Expected output Returns a single deployment object with full details (e.g. deployment_id, deployment_name, model_repo_id, model_repo_name, status, accelerator_type, accelerator_count, and other configuration fields).

Update Deployment

Updates deployment configuration.
Example:

Stop Deployment

Stops a running deployment.
Example:

Start Deployment

Starts a stopped deployment.
Example:

Scale Deployment

Updates the autoscaling configuration of a live deployment.
On this endpoint cronScaling, targets, scaleDownBehavior, and scaleUpBehavior are top-level fields (unlike create / update, where they nest inside --autoscale-config). Two rules are validated client-side before the request: --min-replicas 0 requires --cron-scaling, and --scale-to-zero cannot be combined with --cron-scaling.
Examples:

Delete Deployment

Deletes a deployment.
Example:

BYOC Deployment

Create a BYOC deployment with a payload (cluster, nodegroup, etc.). See Bring your own compute and Deploy on imported cluster.