mirror of https://github.com/ollama/ollama.git
074bac8447
In some cases, we can't find a cache slot when using sliding window attention. It would be helpful in this (and other cases) to know what the batch size is. Bug #10127 |
||
|---|---|---|
| .. | ||
| cache.go | ||
| causal.go | ||
| causal_test.go | ||
| encoder.go | ||
| wrapper.go | ||