Skip to main content
POST
Create chat completion with Qwen 32B

Authorizations

Authorization
string
header
required

JWT token for authentication

Body

application/json
messages
object[]
required

Array of messages in the conversation

model
enum<string>
default:RedHatAI/QwQ-32B-FP8-dynamic
required

Model identifier

Available options:
RedHatAI/QwQ-32B-FP8-dynamic
stream
boolean
default:false

Whether to stream the response

temperature
number
default:0.7

Sampling temperature

Required range: 0 <= x <= 2
max_tokens
integer
default:1024

Maximum number of tokens to generate

Required range: 1 <= x <= 4096
top_p
number
default:0.95

Nucleus sampling parameter

Required range: 0 <= x <= 1
stop
string[] | null

Sequences where the API will stop generating

Response

Successful chat completion

id
string

Unique identifier for the completion

choices
object[]