root
/
elasticsearch
mirror of https://github.com/elastic/elasticsearch.git
1
0
Fork 0
Code Issues Actions 1 Packages Projects Releases Wiki Activity
elasticsearch/docs/reference/ml/trained-models/apis
History
Benjamin Trent 9dc8aea1cb
[ML] adds new mpnet tokenization for nlp models (#82234) 
This commit adds support for MPNet based models.

MPNet models differ from BERT style models in that:

 - Special tokens are different
 - Input to the model doesn't require token positions.

To configure an MPNet tokenizer for your pytorch MPNet based model:

```
"tokenization": {
  "mpnet": {...}
}
```
The options provided to `mpnet` are the same as the previously supported `bert` configuration.
 		2022-01-05 12:56:47 -05:00
..
delete-trained-models-aliases.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
delete-trained-models.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
get-trained-models-stats.asciidoc [ML] Improve reporting of trained model size stats (#82000) 2021-12-22 18:20:47 +02:00
get-trained-models.asciidoc [ML] adds new mpnet tokenization for nlp models (#82234) 2022-01-05 12:56:47 -05:00
index.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
infer-trained-model-deployment.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
ml-trained-models-apis.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
put-trained-model-definition-part.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
put-trained-model-vocabulary.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
put-trained-models-aliases.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
put-trained-models.asciidoc [ML] adds new mpnet tokenization for nlp models (#82234) 2022-01-05 12:56:47 -05:00
start-trained-model-deployment.asciidoc [ML][DOCS] Add note about max values of thread settings (#81367) 2021-12-14 13:07:34 +00:00
stop-trained-model-deployment.asciidoc [DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00