Creating a Deployment

• Deployment Name: Provide a unique name for your deployment.
• Model: Choose the model you want to deploy from the dropdown.
• Cloud: Select Simplismart Cloud to deploy as a Dedicated Endpoint, or BYOC to deploy on your own cluster.

• Dedicated Deployment
• BYOC Deployment

1

Choose Accelerator

For dedicated deployments please ensure you have enough quota of the desired resources.

Choose the desired accelerator type based on your model size and SLA requirements.

To deploy on a GPU type not listed or for CPU-only deployments, email support@simplismart.tech.

2

SSH Access

SSH access lets you connect directly to a running container in your deployment, which is useful for debugging, inspecting logs, or running ad-hoc commands without rebuilding and redeploying.Toggle SSH Access on during deployment creation to configure it. You can add up to 5 users per deployment, choose the SSH runtime (sidecar or main container), and assign an SSH key secret to each user.For runtime options, bringing your own image, generating a key pair, and connecting to a running deployment, see the SSH Access guide.

3

Scaling Parameters

Define how your deployment scales based on demand:

• Range: Minimum and maximum number of instances. The limits are governed by your account quota.
• Scaling Metric: The metric used to trigger scaling. Choose from:
  • Memory Usage: Average memory usage across all pods.
  • Latency: Response time per request.
  • Throughput: Number of requests processed per second.
  • Concurrency: Number of concurrent requests being processed.

Available scaling metrics may vary depending on the model type.

• Threshold: The metric value that triggers a scaling event for both scale-out and scale-in (e.g. scale out at 80% memory, scale in when it drops back below the threshold).

Advanced Options

• Enable Scale to Zero: Scales the deployment down to zero instances when there is no incoming traffic, reducing idle costs. When traffic resumes, the deployment scales back up automatically.
  • Cooldown Period: The amount of time (in seconds) to wait after traffic stops before scaling down to zero. A longer cooldown avoids premature scale-downs during brief traffic lulls.

Enable Rapid AutoscalingRapid Autoscaling allows your deployment to scale out significantly faster during sudden traffic bursts.

Rapid Autoscaling is available on Simplismart Cloud (Dedicated) deployments only. To enable it, contact support@simplismart.tech.

4

Schedule-Based Autoscaling

Enable Schedule Based Scaling when you know your traffic pattern in advance. For example, if most of your load arrives on weekdays during office hours, you can define time windows for those periods and let the deployment scale to zero, or fall back to a lower replica count, outside them.

Schedule Based Scaling and Enable Scale to Zero (in the Advanced Options of Scaling Parameters) are mutually exclusive. Use the Scale to 0 outside windows option below if you want pods to scale to zero on a schedule.

Scale to 0 outside windowsChoose what happens outside your configured windows:

Setting	Outside windows	Endpoint behaviour
Enabled	Deployment runs 0 pods. It wakes up at the start of the next window.	Returns 503 Service Unavailable until the next window starts.
Disabled	Deployment falls back to your standard min/max replicas.	Continues to serve traffic.

Pick Disabled if the endpoint must accept requests outside windows.Configuring windowsEach window defines a time range during which a guaranteed minimum number of pods is maintained. Click + Add Window to add more windows. When multiple rules are active (schedule windows, overlapping windows, standard scaling), whichever produces the higher pod count wins at any given time. The cool-down period is fixed at 5 minutes and cannot be modified.Each window can be configured using either the Guided visual picker or Custom cron expressions:

• Guided
• Custom

Use the visual picker to configure your schedule:

• Timezone: the timezone for interpreting wake-up and cool-down times.
• Days: select one or more days of the week (Mon–Sun).
• Wake up at: the time at which pods scale up to the configured minimum.
• Cool down at: the time at which pods begin scaling down.
• Minimum Pods during window: number of pods guaranteed during the window (1–8).

Enter cron expressions directly for more flexibility:

• Timezone: the timezone for interpreting the cron schedule.
• Start: cron expression for when pods scale up (e.g. 0 9 * * 1,2,3,4,5 for 09:00 AM on weekdays).
• End: cron expression for when pods scale down (e.g. 0 18 * * 1,2,3,4,5 for 06:00 PM on weekdays).
• Minimum Pods during window: number of pods guaranteed during the window (1–8).

A human-readable summary of each cron expression is shown below the input field.

5

Autoscaling Policy

Fine-tune how aggressively your deployment scales up and down by configuring policies and stabilization windows for each direction. This controls the rate of pod changes once the scaling metrics cross their configured thresholds.Scale UpControls how quickly new pods are added when demand rises above the scaling threshold.

• Stabilization Window: the look-back period (in seconds) used to smooth out scaling decisions. Default: 60 s. Range: 0–3600 s.
• Select Policy: when multiple policies are configured, determines which one wins:
  • Max (default): picks the policy that allows the most pods to be added.
  • Min: picks the policy that allows the fewest pods to be added.
  • Disabled: disables scale-up entirely.
• Policies: one or more rate-limiting rules. Click Add Policy to configure:
  • Type: Pods (fixed number per period) or Percent (percentage of current count, max 100).
  • Value: the number of pods or percentage to add per period.
  • Period Seconds: the duration of each evaluation window (1–1800 s).

When multiple policies are active, Select Policy = Max picks the policy that allows the largest increase.

Scale DownControls how gradually pods are removed when demand drops below the threshold.

• Stabilization Window: the look-back period (in seconds) before pods are removed. Default: 180 s. Range: 0–3600 s.
• Select Policy: when multiple policies are configured, determines which one wins:
  • Min (default): picks the policy that removes the fewest pods.
  • Max: picks the policy that removes the most pods.
  • Disabled: disables scale-down entirely.
• Policies: same fields as Scale Up.

When multiple policies are active, Select Policy = Min picks the policy that removes the fewest pods. This ensures scale-down is gradual even if metrics drop sharply.

Autoscaling Policy is an advanced configuration. If left unconfigured, standard min/max replica scaling based on the configured scaling metrics applies without rate limiting.

6

Tags

Add key-value tags to organize and filter your deployments. Tags are useful for tracking environment, team, or cost-center metadata.

• Click + Add Tag to add a new key-value pair.
• Tags can be used to filter deployments on the Deployments page.

7

Deploy

Click Deploy Model to initiate the deployment process.

• Check the right side of the screen to see the creation status of your deployment.
• Monitor the deployment status to know when the model is ready for use.
• The status will show deployed once done. Your model is now ready for use.

1

Cloud Details

For BYOC deployments it is mandatory to have a linked cloud account and an active cluster with the required resources.

Select the cluster and the required node group based on the model.

• Cluster: Select the target cluster.
• Node Group: Select the node group based on the GPU type and compute specs required by your model (e.g., A100, H100, T4).

This ensures compatibility and optimal resource allocation during deployment.Resource DetailsChoose the appropriate CPU and memory resources based on the selected node group.

• CPU Request: Minimum guaranteed CPU for the container.
• CPU Limit: Maximum CPU the container can use. Throttled if exceeded.
• Memory Request: Minimum guaranteed memory.
• Memory Limit: Maximum memory allowed. Exceeding it results in termination (OOM error).

2

Scaling Parameters

Define how your deployment scales based on demand:

• Range: Minimum and maximum number of instances. The limits are governed by your account quota.
• Scaling Metric: The metric used to trigger scaling. Choose from:
  • Memory Usage: Average memory usage across all pods.
  • Latency: Response time per request.
  • Throughput: Number of requests processed per second.
  • Concurrency: Number of concurrent requests being processed.

Available scaling metrics may vary depending on the model type.

• Threshold: The metric value that triggers a scaling event for both scale-out and scale-in (e.g. scale out at 80% memory, scale in when it drops back below the threshold).

Advanced Options

• Enable Scale to Zero: Scales the deployment down to zero instances when there is no incoming traffic, reducing idle costs. When traffic resumes, the deployment scales back up automatically.
  • Cooldown Period: The amount of time (in seconds) to wait after traffic stops before scaling down to zero. A longer cooldown avoids premature scale-downs during brief traffic lulls.

Enable Rapid AutoscalingRapid Autoscaling allows your deployment to scale out significantly faster during sudden traffic bursts.

Rapid Autoscaling is available on Simplismart Cloud (Dedicated) deployments only. To enable it, contact support@simplismart.tech.

3

Schedule-Based Autoscaling

Enable Schedule Based Scaling when you know your traffic pattern in advance. For example, if most of your load arrives on weekdays during office hours, you can define time windows for those periods and let the deployment scale to zero, or fall back to a lower replica count, outside them.

Schedule Based Scaling and Enable Scale to Zero (in the Advanced Options of Scaling Parameters) are mutually exclusive. Use the Scale to 0 outside windows option below if you want pods to scale to zero on a schedule.

Scale to 0 outside windowsChoose what happens outside your configured windows:

Setting	Outside windows	Endpoint behaviour
Enabled	Deployment runs 0 pods. It wakes up at the start of the next window.	Returns 503 Service Unavailable until the next window starts.
Disabled	Deployment falls back to your standard min/max replicas.	Continues to serve traffic.

Pick Disabled if the endpoint must accept requests outside windows.Configuring windowsEach window defines a time range during which a guaranteed minimum number of pods is maintained. Click + Add Window to add more windows. When multiple rules are active (schedule windows, overlapping windows, standard scaling), whichever produces the higher pod count wins at any given time. The cool-down period is fixed at 5 minutes and cannot be modified.Each window can be configured using either the Guided visual picker or Custom cron expressions:

• Guided
• Custom

Use the visual picker to configure your schedule:

• Timezone: the timezone for interpreting wake-up and cool-down times.
• Days: select one or more days of the week (Mon–Sun).
• Wake up at: the time at which pods scale up to the configured minimum.
• Cool down at: the time at which pods begin scaling down.
• Minimum Pods during window: number of pods guaranteed during the window (1–8).

Enter cron expressions directly for more flexibility:

• Timezone: the timezone for interpreting the cron schedule.
• Start: cron expression for when pods scale up (e.g. 0 9 * * 1,2,3,4,5 for 09:00 AM on weekdays).
• End: cron expression for when pods scale down (e.g. 0 18 * * 1,2,3,4,5 for 06:00 PM on weekdays).
• Minimum Pods during window: number of pods guaranteed during the window (1–8).

A human-readable summary of each cron expression is shown below the input field.

4

Autoscaling Policy

Fine-tune how aggressively your deployment scales up and down by configuring policies and stabilization windows for each direction. This controls the rate of pod changes once the scaling metrics cross their configured thresholds.Scale UpControls how quickly new pods are added when demand rises above the scaling threshold.

• Stabilization Window: the look-back period (in seconds) used to smooth out scaling decisions. Default: 60 s. Range: 0–3600 s.
• Select Policy: when multiple policies are configured, determines which one wins:
  • Max (default): picks the policy that allows the most pods to be added.
  • Min: picks the policy that allows the fewest pods to be added.
  • Disabled: disables scale-up entirely.
• Policies: one or more rate-limiting rules. Click Add Policy to configure:
  • Type: Pods (fixed number per period) or Percent (percentage of current count, max 100).
  • Value: the number of pods or percentage to add per period.
  • Period Seconds: the duration of each evaluation window (1–1800 s).

When multiple policies are active, Select Policy = Max picks the policy that allows the largest increase.

Scale DownControls how gradually pods are removed when demand drops below the threshold.

• Stabilization Window: the look-back period (in seconds) before pods are removed. Default: 180 s. Range: 0–3600 s.
• Select Policy: when multiple policies are configured, determines which one wins:
  • Min (default): picks the policy that removes the fewest pods.
  • Max: picks the policy that removes the most pods.
  • Disabled: disables scale-down entirely.
• Policies: same fields as Scale Up.

When multiple policies are active, Select Policy = Min picks the policy that removes the fewest pods. This ensures scale-down is gradual even if metrics drop sharply.

Autoscaling Policy is an advanced configuration. If left unconfigured, standard min/max replica scaling based on the configured scaling metrics applies without rate limiting.

5

Tags

Add key-value tags to organize and filter your deployments. Tags are useful for tracking environment, team, or cost-center metadata.

• Click + Add Tag to add a new key-value pair.
• Tags can be used to filter deployments on the Deployments page.

6

Deploy

Click Deploy Model to initiate the deployment process.

• Check the right side of the screen to see the creation status of your deployment.
• Monitor the deployment status to know when the model is ready for use.
• The status will show deployed once done. Your model is now ready for use.

​

Monitoring and Access

​

Health states

• Health Status: Shows Healthy on the deployment page.
• Deployment URL: Direct link to your running deployment. Use the API tab to find the endpoint URL and a pre-generated inference script. See Inference & Monitoring for a full walkthrough.
• Events Tab: Tracks lifecycle events such as health transitions, scale-out, scale-in, and instance restarts. Start here when debugging unexpected behaviour.

​

Managing Your Deployment

1. Open the Deployments tab from the main menu.
2. Select the deployment you want to modify.
3. Click the kebab menu (⋮) in the top-right of the deployment card and choose Pause, Edit, Clone, or Delete.