ollama/model
Michael Yang 3f6642f6fc
model: implement bert in ollama engine (#9080)
* fix truncate

* s/SentencePieceModel/SentencePiece/

* bert

* wordpiece

* refactor pooling

* more tokenizers

* normalize embeddings
2025-09-15 15:35:59 -07:00
..
imageproc imageproc mllama refactor (#7537) 2024-12-14 19:50:15 -08:00
input batch: use tensors for outputs (#12185) 2025-09-15 14:33:06 -07:00
models model: implement bert in ollama engine (#9080) 2025-09-15 15:35:59 -07:00
testdata gemma2 impl 2025-03-11 14:35:08 -07:00
bytepairencoding.go embedding gemma model (#12181) 2025-09-04 09:09:07 -07:00
bytepairencoding_test.go model: add bpe roundtripping tests 2025-08-19 22:05:48 -07:00
model.go model: implement bert in ollama engine (#9080) 2025-09-15 15:35:59 -07:00
model_test.go update vendored llama.cpp and ggml (#11823) 2025-08-14 14:42:58 -07:00
sentencepiece.go model: implement bert in ollama engine (#9080) 2025-09-15 15:35:59 -07:00
sentencepiece_test.go model: implement bert in ollama engine (#9080) 2025-09-15 15:35:59 -07:00
textprocessor.go model: handle multiple eos tokens (#10577) 2025-05-16 13:40:23 -07:00
vocabulary.go embedding gemma model (#12181) 2025-09-04 09:09:07 -07:00
vocabulary_test.go model: treat 'user defined' tokens as special tokens (#11077) 2025-06-16 16:03:16 -07:00
wordpiece.go model: implement bert in ollama engine (#9080) 2025-09-15 15:35:59 -07:00
wordpiece_test.go model: implement bert in ollama engine (#9080) 2025-09-15 15:35:59 -07:00