> ## Documentation Index
> Fetch the complete documentation index at: https://docs.simplismart.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Introduction

> Discover Simplismart’s benchmarking suite to evaluate model performance & quality

Simplismart’s benchmarking suite lets you evaluate any deployment for **Performance** (speed & throughput), **Quality** (accuracy & relevance), or **Advanced evaluation** (predefined evaluator-based assessment). Follow these steps to create, configure, and run benchmarks end-to-end.

<CardGroup cols="3">
  <Card title="Performance" icon="stopwatch" href="/benchmarking/performance-benchmarking">
    Measures **Throughput**, **TTFT** (time‑to‑first‑token), and **TPOT** (time‑per‑output‑token).

    ##
  </Card>

  <Card title="Quality" icon="bullseye" href="/benchmarking/quality-benchmarking">
    Evaluates model responses for **accuracy, relevance, and output quality** on selected datasets.
  </Card>

  <Card title="Advanced " icon="rocket" iconType="regular" href="/benchmarking/advanced-benchmarking">
    Measures quality using a suite of advanced predefined evaluators for deeper assessment.
  </Card>
</CardGroup>

## Model Types

| Model       | Type                 | Status        |
| ----------- | -------------------- | ------------- |
| **LLM**     | Text generation      | ✅ Available   |
| **Whisper** | Speech-to-Text (STT) | ⏳ Coming soon |
| **Flux**    | Image generation     | ⏳ Coming soon |

## **Prerequisites**

You have at least one **Deployment** in an active **Cluster**.