2023-09-29 16:12:07 +08:00
|
|
|
[role="xpack"]
|
|
|
|
[[inference-apis]]
|
|
|
|
== {infer-cap} APIs
|
|
|
|
|
2023-11-02 20:02:29 +08:00
|
|
|
experimental[]
|
|
|
|
|
2024-04-04 21:42:03 +08:00
|
|
|
IMPORTANT: The {infer} APIs enable you to use certain services, such as built-in
|
2024-05-28 21:21:33 +08:00
|
|
|
{ml} models (ELSER, E5), models uploaded through Eland, Cohere, OpenAI, Azure, Google AI Studio or
|
2024-04-04 21:42:03 +08:00
|
|
|
Hugging Face. For built-in models and models uploaded though Eland, the {infer}
|
|
|
|
APIs offer an alternative way to use and manage trained models. However, if you
|
|
|
|
do not plan to use the {infer} APIs to use these models or if you want to use
|
|
|
|
non-NLP models, use the <<ml-df-trained-models-apis>>.
|
2024-01-09 22:46:46 +08:00
|
|
|
|
2024-04-04 21:42:03 +08:00
|
|
|
The {infer} APIs enable you to create {infer} endpoints and use {ml} models of
|
|
|
|
different providers - such as Cohere, OpenAI, or HuggingFace - as a service. Use
|
|
|
|
the following APIs to manage {infer} models and perform {infer}:
|
2023-09-29 16:12:07 +08:00
|
|
|
|
|
|
|
* <<delete-inference-api>>
|
|
|
|
* <<get-inference-api>>
|
|
|
|
* <<post-inference-api>>
|
|
|
|
* <<put-inference-api>>
|
|
|
|
|
|
|
|
|
|
|
|
include::delete-inference.asciidoc[]
|
|
|
|
include::get-inference.asciidoc[]
|
|
|
|
include::post-inference.asciidoc[]
|
2024-05-16 19:22:01 +08:00
|
|
|
include::put-inference.asciidoc[]
|
2024-07-01 16:12:16 +08:00
|
|
|
include::service-azure-ai-studio.asciidoc[]
|
|
|
|
include::service-azure-openai.asciidoc[]
|
|
|
|
include::service-cohere.asciidoc[]
|
|
|
|
include::service-elasticsearch.asciidoc[]
|
|
|
|
include::service-elser.asciidoc[]
|
|
|
|
include::service-google-ai-studio.asciidoc[]
|
2024-07-02 20:47:14 +08:00
|
|
|
include::service-google-vertex-ai.asciidoc[]
|
2024-07-01 16:12:16 +08:00
|
|
|
include::service-hugging-face.asciidoc[]
|
|
|
|
include::service-mistral.asciidoc[]
|
|
|
|
include::service-openai.asciidoc[]
|