Commit Graph

80339 Commits

Author SHA1 Message Date
Nik Everett f633148d10
Docs: ESQL doesn't preserve `null`s in a list (#114335)
The doc values don't preserve `null`s in a list so ESQL doesn't either.

Closes #114324
2024-10-09 03:17:56 +11:00
Oleksandr Kolomiiets 965265a1a4
Don't generate invalid combination of subobjects parameter in logsdb tests (#114265) 2024-10-08 18:14:03 +02:00
David Kyle 3a83fcdef9
[ML] Remove scale to zero feature flag (#114323) 2024-10-08 17:37:04 +02:00
elasticsearchmachine ae38b9091f Mute org.elasticsearch.xpack.rank.rrf.RRFRankClientYamlTestSuiteIT test {yaml=rrf/700_rrf_retriever_search_api_compatibility/rrf retriever with top-level collapse} #114331 2024-10-09 02:30:01 +11:00
elasticsearchmachine 72b7d5ecf8 Mute org.elasticsearch.xpack.inference.services.cohere.CohereServiceTests testInfer_StreamRequest_ErrorResponse #114327 2024-10-09 02:05:32 +11:00
Mike Pellegrini 0cc05448c3
Use ELSER By Default For Semantic Text (#113563)
Co-authored-by: David Kyle <david.kyle@elastic.co>
2024-10-08 10:49:59 -04:00
elastic-renovate-prod[bot] 0a0a4cb9ad
Update docker.elastic.co/wolfi/chainguard-base:latest Docker digest to 90888b1 (#114284)
This PR contains the following updates:

| Package | Update | Change | |---|---|---| |
docker.elastic.co/wolfi/chainguard-base | digest | `c16d3ad` ->
`90888b1` |

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once
you are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

 - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MjUuMSIsInVwZGF0ZWRJblZlciI6IjM3LjQyNS4xIiwidGFyZ2V0QnJhbmNoIjoibWFpbiIsImxhYmVscyI6W119-->
2024-10-09 01:39:19 +11:00
elasticsearchmachine a68fd70b15 Mute org.elasticsearch.backwards.MixedClusterClientYamlTestSuiteIT test {p0=aggregations/stats_metric_fail_formatting/fail formatting} #114320 2024-10-09 01:06:40 +11:00
Dan Rubinstein b5d6fa0130
Add chunking settings configuration to CohereService, AmazonBedrockService, and AzureOpenAiService (#113897)
* Add chunking settings configuration to CohereService, AmazonBedrockService, and AzureOpenAiService

* Update docs/changelog/113897.yaml

* Run spotlessApply

* Updating CohereServiceMixedIT to account for clusters without chunking settings in index mapping

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-10-08 09:57:46 -04:00
Simon Cooper d9dc165db2
Further conversions to ChunkedXContentBuilder (#114237) 2024-10-08 14:32:57 +01:00
David Turner 6f518d437f
Remove unnecessary test overrides (#114291)
These test overrides were introduced so that we had somewhere to hang an
`@AwaitsFix` annotation, but now the tests are unmuted again there's no
need for the overrides.

Relates #108336
2024-10-08 14:14:35 +01:00
Liam Thompson 10f6f25506
[DOCS] Update re-ranking intro to remove confusion about stages (#114302) 2024-10-08 08:08:47 -04:00
Liam Thompson b80272a1a4
[DOCS] Update URL (#114292) 2024-10-08 13:51:02 +02:00
elasticsearchmachine ffea594158 Mute org.elasticsearch.index.SearchSlowLogTests testTwoLoggersDifferentLevel #114301 2024-10-08 22:16:31 +11:00
elasticsearchmachine 24d9864fed Mute org.elasticsearch.index.SearchSlowLogTests testLevelPrecedence #114300 2024-10-08 22:16:13 +11:00
Nikolaj Volgushev ce07060dce
Remove role mapping block check (#114223)
This method is used in multiple contexts that may not all handle
cluster-block exceptions gracefully, esp. since some types of cluster
blocks are retryable. Removing this, and may follow up with handling the
cluster state block for the affected transport actions instead.
2024-10-08 22:09:39 +11:00
David Turner 436d4cc877
Remove `SearchableSnapshotIndexMetadataUpgrader` (#114290)
This service only exists to fix up the metadata on 7.x searchable
snapshot indices during/after an upgrade to 8.x, so we don't need it in
9.x.
2024-10-08 12:44:31 +02:00
Simon Cooper cbde7f456d
Add a size limit to outputs from mustache (#114002) 2024-10-08 11:42:22 +01:00
Chris Hegarty 6d6fc66e90
Delegate xorBitCount to Lucene (#114249)
Now that we're on Lucene 9.12 we don't need our own optimized xorBitCount, can just delegate to Lucene's optimized one (which is identical).
2024-10-08 10:45:35 +01:00
ChrisHegarty 2a0d5ffc02 Fix simdvec gradle runtime java check 2024-10-08 09:39:21 +01:00
Christoph Büscher 09d5e7f20f
Remove dangling AwaitsFix (#113941)
The issue referenced seems to be closed, maybe this just wasn't removed
properly.
2024-10-08 10:31:16 +02:00
elastic-renovate-prod[bot] c3fd8a7a9a
Configure Renovate to auto update chainguard image (#114172)
* Adds renovate.json
* Only auto update chainguard image
---------

Co-authored-by: elastic-renovate-prod[bot] <174716857+elastic-renovate-prod[bot]@users.noreply.github.com>
Co-authored-by: Rene Groeschke <rene@elastic.co>
2024-10-08 10:19:03 +02:00
kosabogi 4af241b5d6
Adds note on reindexing existing data for semantic_text usage (#113590)
* Adds note on reindexing existing data for semantic_text usage

* Adds note about full crawl and full sync

* Style guide related fix

* Update docs/reference/search/search-your-data/semantic-search-semantic-text.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2024-10-08 09:58:18 +02:00
David Turner bb9d612eb6
Show only committed cluster UUID in `GET /` (#114275)
Today we show `Metadata#clusterUUID` in the response to `GET /`
regardless of whether this value is committed or not, which means that
in theory users may see this value change even if nothing is going
wrong. To avoid any doubt about the stability of this cluster UUID, this
commit suppresses the cluster UUID in this API response until it is
committed.
2024-10-08 08:47:28 +01:00
Panagiotis Bailis 4ecc5bd53e
Text_similarity_reranker retriever rework to be evaluated during rewrite phase (#114085) 2024-10-08 10:15:10 +03:00
David Turner 07c3acf1c0
Remove cluster state from `/_cluster/reroute` response (#114231)
Including the cluster state in responses to the `POST _cluster/state`
API  was deprecated in #90399 (v8.6.0) requiring callers to pass
`?metric=none` to avoid the deprecation warning. This commit adjusts the
behaviour as promised in v9 so that this API never returns the cluster
state, and deprecates the `?metric` parameter itself.

Closes #88978
2024-10-08 07:59:57 +01:00
István Zoltán Szabó 40bddafd92
[DOCS] Adds DeBERTa v2 tokenization params to infer trained model API docs (#114242)
* [DOCS] Adds DeBERTa v2 tokenization params to infer trained model API docs.

* [DOCS] Mode edits.
2024-10-08 08:41:11 +02:00
Nick Tindall 1c40954037
Publish APM metrics from the Azure BlobStore (#113913)
Closes ES-9550
2024-10-08 17:01:42 +11:00
David Turner 740cb2e0c7
Document that `?wait_for_active_shards=0` is permitted (#114091)
Today the docs for the `?wait_for_active_shards` parameter say that it
must be a positive integer, proscribing `0`, yet `0` is a legitimate
value for this parameter. This commit fixes this point and rewords the
docs slightly for clarity.
2024-10-08 07:59:30 +02:00
Panagiotis Bailis 44f3791899
Updating toXContent implementation for retrievers (#114017) 2024-10-08 08:27:06 +03:00
Keith Massey 7bbebbd37d
Supporting more maxmind fields in the geoip processor (#114268) 2024-10-07 22:24:12 -03:00
elasticsearchmachine 3595956d7e Mute org.elasticsearch.ingest.geoip.IpinfoIpDataLookupsTests org.elasticsearch.ingest.geoip.IpinfoIpDataLookupsTests #114266 2024-10-08 08:06:42 +11:00
Joe Gallo e7cd5c9dea
Add postal_code support to the City and Enterprise databases (#114193) 2024-10-07 14:31:05 -05:00
Pat Whelan 7753c5216a
[ML] Add Streaming Inference spec (#113812)
API for `/_inference/{task_type}/{inference_id}/_stream` and `/_inference/{inference_id}/_stream`

Request is `application/json`
Response is `text/event-stream`
2024-10-07 21:10:36 +02:00
Pat Whelan e065a3789b
[ML] Stream Cohere Completion (#114080)
Implement and enable streaming for Cohere chat completions (v1).

Includes processor for ND JSON streaming responses.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2024-10-07 21:07:59 +02:00
David Kyle ce73a908cc
[ML] Use the same chunking configurations for models in the Elasticsearch service (#111336) 2024-10-07 20:06:13 +01:00
Iraklis Psaroudakis 4990276147
Fast refresh indices should use search shards (#113478)
Fast refresh indices should now behave like non fast refresh indices in
how they execute (m)gets and searches. I.e., they should use the search
shards.

For BWC, we define a new transport version. We expect search shards to
be upgraded first, before promotable shards. Until the cluster is fully
upgraded, the promotable shards (whether upgraded or not) will still
receive and execute gets/searches locally.

Relates ES-9573
Relates ES-9579
2024-10-07 21:15:04 +03:00
Tim Brooks 8f24f43aed
Fix issue with releasing resources in bulk tests (#114186)
A recent commit incidentally changed a release resources call from
doBefore to doAfter. Several tests depending on resources being released
synchronously which requires doBefore.

Closes #114181
Closes #114182
2024-10-07 11:38:48 -06:00
elasticsearchmachine 7987c01f36 Mute org.elasticsearch.logsdb.datageneration.DataGeneratorTests testDataGeneratorProducesValidMappingAndDocument #114188 2024-10-08 04:37:03 +11:00
Joe Gallo b769059398
IPinfo ASN and Country (#114192)
Adding the building blocks to support IPinfo ASN and Country data
2024-10-07 12:31:47 -05:00
Panagiotis Bailis d8cc7d3d2a
Updating RRF-related test cases to work with multiple shards and/or replicas (#114189) 2024-10-07 20:15:44 +03:00
Nik Everett bafdd81d3d
ESQL: Reenable part of heap attack test (#114252)
This reenables a test and adds more debugging to another one. We'll use
this to collect more information the next time it fails.
2024-10-08 04:02:14 +11:00
Rene Groeschke d47ca34b16
Fix Gradle configuration in idea for :libs:simdvec (#114251) 2024-10-07 18:51:15 +02:00
Kostas Krikellas 9cfe679173
Avoid using `dynamic:strict` with `subobjects:false` at root (#114247) 2024-10-07 18:06:23 +02:00
Benjamin Trent a83046a85a
Fixing span gap builder tests (#114218) (#114219)
With #113251 having a SpanMatchNoDocsQuery is a valid response to the rewrite.

closes #114218
2024-10-07 12:05:09 -04:00
Simon Cooper 67f1b02d56
Add an UpdateForV9/10 to reroute cluster state (#114213) 2024-10-07 15:50:02 +01:00
Ignacio Vera 58cc37922c
Improve performance of LongLongHash#removeAndAdd (#114230)
remove some unnecessary manipulation of the keys in the method removeAndAdd.
2024-10-07 16:23:54 +02:00
Chris Hegarty 7decd52132
Allow incubating Panama Vector in simdvec, and add vectorized ipByteBin (#112933)
Add support for vectorized ipByteBin.

The structure of the implementation and loading framework mirror that of Lucene, but is simplified by avoiding reflective loading since ES has support for a MRJar section for 21.

For now, we just disable warnings-as-errors in this small sourceset, since -Xlint:-incubating is only support since JDK 22. The number of source files is small here. Will investigate how to assert that just the single incubating warning is emitted by javac, at a later point.
2024-10-07 15:08:23 +01:00
moxarth-elastic e1bba9b390
[Zoom] Update existing scopes with granular scopes (#113994) 2024-10-07 15:48:32 +02:00
Parker Timmins fe36a4543d
Make randomInstantBetween return in range [minInstant, maxInstant] (#114177)
randomInstantBetween can produce a result which is not within the [minInstant, maxInstant] range. This occurs when the epoch second picked matches the min bound and the nanos are below the min nanos, or the second picked matches the max bound seconds and nanos are above the max bound nanos. This change fixes the function by setting a bound on which nano values can be picked if the min or max epoch second value is picked.
2024-10-07 08:34:05 -05:00