Question 1

Can I turn off thinking mode?

Accepted Answer

No. This variant supports only thinking mode; the chat template automatically opens a <think> block and the model reasons before every answer. If you need direct short answers, use a non-thinking Qwen3 instruct variant instead.

Question 2

What context window does it support?

Accepted Answer

262,144 tokens natively, per config.json and the model card. That budget is shared between your prompt and the model's thinking plus answer, so leave generous headroom for reasoning output.

Question 3

How many parameters are actually used per token?

Accepted Answer

22B of the 235B total. The model routes each token through 8 of its 128 experts, which gives large-model quality at a much lower per-token compute cost than a dense 235B model.

Question 4

What max_tokens should I set?

Accepted Answer

The Qwen team recommends 32,768 output tokens for most queries and up to 81,920 for highly complex math or programming problems. The chute's default is 1024, which will truncate serious reasoning, so set max_tokens explicitly.

Question 5

What sampling settings does the model card recommend?

Accepted Answer

Temperature 0.6, top_p 0.95, top_k 20, min_p 0, matching the shipped generation_config.json. A presence_penalty between 0 and 2 can reduce endless repetition, though high values may cause occasional language mixing.

Question 6

How do I call it from the OpenAI SDK?

Accepted Answer

Point the SDK at base_url https://llm.chutes.ai/v1 with your Chutes API key and set model to Qwen/Qwen3-235B-A22B-Thinking-2507-TEE. Streaming chat completions work unchanged; the thinking content arrives as part of the response stream.

Question 7

What does the TEE suffix mean?

Accepted Answer

The chute runs inside a Trusted Execution Environment: confidential-compute hardware that keeps prompts and outputs protected in memory and attestable. It is a serving-level guarantee on Chutes and does not alter the model itself.

Question 8

Is it licensed for commercial use?

Accepted Answer

Yes. The upstream repository is Apache-2.0, permitting commercial use, modification, and redistribution with attribution. Chutes endpoint usage is billed per token through your account, separate from the license.

Qwen3 235B A22B Thinking 2507

Sign in to use the playground

Qwen3 235B A22B Thinking 2507

Sign in to use the playground