We support a variety of language models (LLMs) and vision-language models (VLMs). Below is a list of the available models:

Language Models (LLMs)

Model NameVersionTypeDescription
meta-llama/Llama-3.1-8B-Instruct3.1, 8BLLMLlama 3.1, 8B, Instruct tuned version
meta-llama/Llama-3.1-8B3.1, 8BLLMLlama 3.1, 8B base model
meta-llama/Llama-3.2-1B3.2, 1BLLMLlama 3.2, 1B base model
meta-llama/Llama-3.2-1B-Instruct3.2, 1BLLMLlama 3.2, 1B, Instruct tuned version
meta-llama/Llama-3.2-3B3.2, 3BLLMLlama 3.2, 3B base model
meta-llama/Llama-3.2-3B-Instruct3.2, 3BLLMLlama 3.2, 3B, Instruct tuned version
meta-llama/Llama-2-7B-chat-hf2, 7BLLMLlama 2, 7B, Chat (Hugging Face variant)
meta-llama/Llama-2-7B-chat2, 7BLLMLlama 2, 7B, Chat model
meta-llama/Llama-2-13B-chat-hf2, 13BLLMLlama 2, 13B, Chat (Hugging Face variant)
meta-llama/Llama-2-13B-chat2, 13BLLMLlama 2, 13B, Chat model
meta-llama/Llama-2-7B2, 7BLLMLlama 2, 7B base model
meta-llama/Llama-2-13B2, 13BLLMLlama 2, 13B base model

Vision-Language Models (VLMs)

Model NameVersionTypeDescription
mistral-7b-v0.37B, v0.3VLMMistral 7B, Vision-Language Instruct v0.3
mistral-7b-v0.27B, v0.2VLMMistral 7B, Vision-Language Instruct v0.2
mistral-7b-v0.17B, v0.1VLMMistral 7B, Vision-Language Instruct v0.1
llama-3.2-11B-vision-instruct11BVLMLlama 3.2, Vision-Instruct
opengvlab/InternVL2_5-1B1BVLMOpenGVLab InternVL2_5-1B
opengvlab/InternVL2_5-2B2BVLMOpenGVLab InternVL2_5-2B
opengvlab/InternVL2_5-4B4BVLMOpenGVLab InternVL2_5-4B
opengvlab/InternVL2_5-8B8BVLMOpenGVLab InternVL2_5-8B
opengvlab/InternVL2-1B1BVLMOpenGVLab InternVL2-1B
opengvlab/InternVL2-2B2BVLMOpenGVLab InternVL2-2B
opengvlab/InternVL2-4B4BVLMOpenGVLab InternVL2-4B
opengvlab/InternVL2-8B8BVLMOpenGVLab InternVL2-8B
aidc-ai/Ovis1.6-Gemma29BVLMAIDC AI Ovis1.6 Gemma2
aidc-ai/Ovis1.6-Llama-3.23BVLMAIDC AI Ovis1.6 Llama 3.2
aidc-ai/Ovis2-1B1BVLMAIDC AI Ovis2-1B
aidc-ai/Ovis2-2B2BVLMAIDC AI Ovis2-2B
aidc-ai/Ovis2-4B4BVLMAIDC AI Ovis2-4B
aidc-ai/Ovis2-8B8BVLMAIDC AI Ovis2-8B
aidc-ai/Ovis2-16B16BVLMAIDC AI Ovis2-16B
aidc-ai/Ovis2-34B34BVLMAIDC AI Ovis2-34B

Flux (Image Generation)

Model NameVersionTypeDescription
black-forest-labs/FLUX.1-dev1.0, DevImage GenFlux, black-forest-labs/FLUX.1-dev, for advanced image generation and processing tasks.