ollama/llm
Jesse Gross fdb109469f llm: Allow overriding flash attention setting
As we automatically enable flash attention for more models, there
are likely some cases where we get it wrong. This allows setting
OLLAMA_FLASH_ATTENTION=0 to disable it, even for models that usually
have flash attention.
2025-10-02 12:07:20 -07:00
..
llm_darwin.go
llm_linux.go
llm_windows.go
memory.go llm: Allow overriding flash attention setting 2025-10-02 12:07:20 -07:00
memory_test.go Use runners for GPU discovery (#12090) 2025-10-01 15:12:32 -07:00
server.go llm: Allow overriding flash attention setting 2025-10-02 12:07:20 -07:00
server_test.go Use runners for GPU discovery (#12090) 2025-10-01 15:12:32 -07:00
status.go