mirror of https://github.com/ollama/ollama.git
5f57b0ef42
- Both `/api/generate` and `/api/chat` now accept a `"think"` option that allows specifying whether thinking mode should be on or not - Templates get passed this new option so, e.g., qwen3's template can put `/think` or `/no_think` in the system prompt depending on the value of the setting - Models' thinking support is inferred by inspecting model templates. The prefix and suffix the parser uses to identify thinking support is also automatically inferred from templates - Thinking control & parsing is opt-in via the API to prevent breaking existing API consumers. If the `"think"` option is not specified, the behavior is unchanged from previous versions of ollama - Add parsing for thinking blocks in both streaming/non-streaming mode in both `/generate` and `/chat` - Update the CLI to make use of these changes. Users can pass `--think` or `--think=false` to control thinking, or during an interactive session they can use the commands `/set think` or `/set nothink` - A `--hidethinking` option has also been added to the CLI. This makes it easy to use thinking in scripting scenarios like `ollama run qwen3 --think --hidethinking "my question here"` where you just want to see the answer but still want the benefits of thinking models |
||
|---|---|---|
| .. | ||
| testdata | ||
| alfred.gotmpl | ||
| alfred.json | ||
| alpaca.gotmpl | ||
| alpaca.json | ||
| chatml.gotmpl | ||
| chatml.json | ||
| chatqa.gotmpl | ||
| chatqa.json | ||
| codellama-70b-instruct.gotmpl | ||
| codellama-70b-instruct.json | ||
| command-r.gotmpl | ||
| command-r.json | ||
| falcon-instruct.gotmpl | ||
| falcon-instruct.json | ||
| gemma-instruct.gotmpl | ||
| gemma-instruct.json | ||
| gemma3-instruct.gotmpl | ||
| gemma3-instruct.json | ||
| granite-instruct.gotmpl | ||
| granite-instruct.json | ||
| index.json | ||
| llama2-chat.gotmpl | ||
| llama2-chat.json | ||
| llama3-instruct.gotmpl | ||
| llama3-instruct.json | ||
| magicoder.gotmpl | ||
| magicoder.json | ||
| mistral-instruct.gotmpl | ||
| mistral-instruct.json | ||
| openchat.gotmpl | ||
| openchat.json | ||
| phi-3.gotmpl | ||
| phi-3.json | ||
| solar-instruct.gotmpl | ||
| solar-instruct.json | ||
| starcoder2-instruct.gotmpl | ||
| starcoder2-instruct.json | ||
| template.go | ||
| template_test.go | ||
| vicuna.gotmpl | ||
| vicuna.json | ||
| zephyr.gotmpl | ||
| zephyr.json | ||