mirror of https://github.com/ollama/ollama.git
e4340667e3
The CUDA APIs for reporting free VRAM are useless on NVIDIA iGPU systems as they only return the kernels actual free memory and ignore buff/cache allocations which on a typical system will quickly fill up most of the free system memory. As a result, we incorrectly think there's very little available for GPU allocations which is wrong. |
||
|---|---|---|
| .. | ||
| cpu_linux.go | ||
| cpu_linux_test.go | ||
| cpu_windows.go | ||
| cpu_windows_test.go | ||
| gpu.go | ||
| gpu_darwin.go | ||
| gpu_info_darwin.h | ||
| gpu_info_darwin.m | ||
| path.go | ||
| runner.go | ||
| runner_test.go | ||
| types.go | ||