root
/
elasticsearch
mirror of https://github.com/elastic/elasticsearch.git
1
0
Fork 0
Code Issues Actions 1 Packages Projects Releases Wiki Activity
elasticsearch/docs/reference
History
Benjamin Trent a5716c8f99
Add new experimental rank_vectors mapping for late-interaction second order ranking (#118804) 
Late-interaction models are powerful rerankers. While their size and
overall cost doesn't lend itself for HNSW indexing, utilizing them as
second order "brute-force" reranking can provide excellent boosts in
relevance. At generally lower inference times than large cross-encoders.


This commit exposes a new experimental `rank_vectors` field that allows
for maxSim operations. This unlocks the initial, and most common use of
late-interaction dense-models. 

For example, this is how you would use it via the API:

```
PUT index
{
  "mappings": {
    "properties": {
      "late_interaction_vectors": {
        "type": "rank_vectors"
      }
    }
  }
}
```

Then to index:

```
POST index/_doc
{
  "late_interaction_vectors": [[0.1, ...],...]
}
```

For querying, scoring can be exposed with scripting:

```
POST index/_search
{
  "query": {
    "script_score": {
      "query": {
        "match_all": {}
      },
      "script": {
        "source": "maxSimDotProduct(params.query_vector, 'my_vector')",
        "params": {
          "query_vector": [[0.42, ...], ...]
        }
      }
    }
  }
}
```

Of course, the initial ranking should be done before re-scoring or
combining via the `rescore` parameter, or simply passing whatever first
phase retrieval you want as the inner query in `script_score`.
 		2025-01-07 04:06:59 +11:00
..
aggregations DOCS: Correct explanation of percentiles_bucket (#116499) 2024-11-08 12:40:53 -05:00
analysis Provide access to new settings for HyphenationCompoundWordTokenFilter (#115585) 2024-11-18 17:38:49 +01:00
autoscaling [DOCS] Link to new API site (#119038) 2024-12-30 16:52:16 +00:00
behavioral-analytics/apis [DOCS] Link to new API site (#119038) 2024-12-30 16:52:16 +00:00
cat [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
ccr [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
cluster Add ESQL telemetry collection (#119474) 2025-01-02 14:05:21 -07:00
commands Remove cluster state from `/_cluster/reroute` response (#114231) 2024-10-08 07:59:57 +01:00
connector [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
data-management
…
data-streams [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
docs [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
eql [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
esql [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
features/apis [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
fleet [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
graph [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
health [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
high-availability Round up shard allocation / recovery / relocation concepts (#109943) 2024-07-25 14:44:57 -04:00
how-to (Doc+) Flush out Slow Logs (#118518) 2024-12-27 10:12:00 -07:00
ilm [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
images Updated ilm docs as per the issue (#118148) 2024-12-18 10:32:39 +11:00
index-modules (Doc+) Flush out Slow Logs (#118518) 2024-12-27 10:12:00 -07:00
indices [DOCS] update recommended template priority for override to 500 (#119450) 2025-01-03 11:12:25 +01:00
inference [DOCS] Adds note on default ELSER and E5 endpoints to service pages (#119507) 2025-01-03 15:53:17 +01:00
ingest [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
licensing [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
mapping Add new experimental rank_vectors mapping for late-interaction second order ranking (#118804) 2025-01-07 04:06:59 +11:00
migration [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
ml [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
modules [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
monitoring [Docs] Update Monitoring docs with integration assets info (#112164) 2024-09-04 16:07:45 -04:00
query-dsl Refactor semantic text field to align with text field behaviour (#119183) 2024-12-30 09:31:02 +01:00
query-rules/apis [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
quickstart [DOCS][101] Aggregations quickstart tutorial (#116251) 2024-12-11 16:06:24 +01:00
release-notes Bump 8.x to 8.18.0 2024-11-21 14:37:05 -05:00
repositories-metering-api [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
reranking [DOCS] Add Elastic Rerank usage docs (#117625) 2024-11-28 08:23:28 +01:00
rest-api [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
rollup [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
scripting [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
search [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
search-application/apis [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
searchable-snapshots [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
security Deprecating data_frame_transforms roles (#117519) 2025-01-06 11:00:16 -05:00
settings Introduce Email Address Allow Lists For Watcher (#116672) 2024-11-14 12:38:14 +01:00
setup [DOCS] Make Wolfi hardened Docker option more prominent (#118755) 2024-12-18 13:54:17 +01:00
shutdown/apis [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
slm/apis [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
snapshot-restore [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
sql [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
synonyms/apis [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
tab-widgets Changes elser service to elasticsearch service in the Semantic search with the inference API page (#118536) 2024-12-12 12:15:17 +01:00
text-structure/apis [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
transform [DOCS] More links to new API site (#119380) 2024-12-31 12:02:59 -08:00
troubleshooting (Doc+) Videos of rejected requests (#119311) 2024-12-27 13:49:57 -07:00
upgrade (Doc+) Link Gateway Settings to Full Restart (#110902) 2024-07-25 09:10:19 -06:00
vectors Correct bit * byte and bit * float script comparisons (#117404) 2024-11-26 03:38:06 +11:00
watcher Update email.asciidoc (#117867) 2024-12-03 09:10:02 -05:00
aggregations.asciidoc
…
alias.asciidoc Update alias.asciidoc (#118553) 2024-12-17 10:09:22 -06:00
analysis.asciidoc
…
api-conventions.asciidoc (Doc+) Flush out Slow Logs (#118518) 2024-12-27 10:12:00 -07:00
cat.asciidoc [DOCS] Link to new API site (#119038) 2024-12-30 16:52:16 +00:00
cluster.asciidoc [DOCS] Link to new API site (#119038) 2024-12-30 16:52:16 +00:00
data-management.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
data-rollup-transform.asciidoc
…
data-store-architecture.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
datatiers.asciidoc Clarify docs around disk capacity expectation. (#115745) 2024-11-11 15:59:11 +01:00
dependencies-versions.asciidoc
…
docs.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
geospatial-analysis.asciidoc Make spatial search functions not preview (#117489) 2024-11-25 17:04:48 +01:00
gs-index.asciidoc
…
high-availability.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
how-to.asciidoc [DOCS] Rename how-to subsection, move recipes to search relevance (#117044) 2024-11-19 18:27:05 +01:00
index-modules.asciidoc Fix invalid index mode (#118579) 2024-12-12 10:59:47 -05:00
index.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
index.x.asciidoc
…
indices.asciidoc [DOCS] Link to new API site (#119038) 2024-12-30 16:52:16 +00:00
ingest.asciidoc [DOCS] Port connector docs from Enterprise Search guide (#112953) 2024-09-30 10:22:37 +02:00
intro.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
landing-page.asciidoc Adds hands-on learning for Search link to the landing page (#116007) 2024-10-31 14:49:11 +01:00
links.asciidoc
…
mapping.asciidoc [DOCS][101] Update first quick start with mappings examples (#113558) 2024-10-02 20:00:09 +02:00
nodes-shards.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
query-dsl.asciidoc Group vector queries into new section (#110722) 2024-07-11 14:45:35 +02:00
redirects.asciidoc Remove old _knn_search tech preview API in v9 (#118104) 2024-12-11 02:01:25 +11:00
release-notes.asciidoc Prep docs for v9 (#115375) 2024-10-31 09:46:19 -05:00
run-elasticsearch-locally.asciidoc Update quickstart overview, add local install instructions (#115746) 2024-10-28 14:13:14 +01:00
scripting.asciidoc
…
search.asciidoc [DOCS] More links to new API site (#119377) 2024-12-31 11:32:29 -08:00
setup.asciidoc [DOCS] Concept cleanup (extracting conceptual docs from reference content pt I of ?) (#119016) 2025-01-02 15:05:08 +00:00
troubleshooting.asciidoc (Doc+) Capture Elasticsearch diagnostic (#108259) 2024-05-09 10:27:19 -06:00
upgrade.asciidoc [DOCS] Refactor book-scoped variables in `docs/reference/index.asciidoc` (#107413) 2024-04-17 14:37:07 +02:00