Performance
Measures Throughput, TTFT (time‑to‑first‑token), and TPOT (time‑per‑output‑token).
Quality
Evaluates model responses for accuracy, relevance, and output quality on selected datasets.
Advanced
Measures quality using a suite of advanced predefined evaluators for deeper assessment.
Model Types
| Model | Type | Status |
|---|---|---|
| LLM | Text generation | ✅ Available |
| Whisper | Speech-to-Text (STT) | ⏳ Coming soon |
| Flux | Image generation | ⏳ Coming soon |