ollama/llm
Jesse Gross 734b57da0e ggml: Remove allocation status reporting
For each memory allocation we report the size of the (attempted)
allocation and whether it succeeded or failed. The latter status
reporting proved to be not that useful in practice as systems
such as Windows can automatically overflow from VRAM into RAM,
resultings in successful allocations even when there isn't
enough memory where we wanted.

As a result, this information is only used for debug logging,
which isn't worthwhile enough for the amount of code. It
also isn't fully accurate, as multiple allocations may result
in partial failures.
2025-09-30 15:04:43 -07:00
..
llm_darwin.go
llm_linux.go
llm_windows.go
memory.go llm: Remove unneeded warning with flash attention enabled 2025-09-10 16:40:45 -07:00
memory_test.go llm: New memory management 2025-08-14 15:24:01 -07:00
server.go ggml: Remove allocation status reporting 2025-09-30 15:04:43 -07:00
server_test.go ggml: Remove allocation status reporting 2025-09-30 15:04:43 -07:00
status.go