Commit Graph

12422 Commits

Author SHA1 Message Date
Craig Taverner d3d9a00fb1
[9.0] ESQL autogenerate docs v3 (#124312) (#124786)
Manual backport of https://github.com/elastic/elasticsearch/pull/124312
and https://github.com/elastic/elasticsearch/pull/124742
2025-03-14 06:33:18 +11:00
Charlotte Hoblik 40a3716a12
[DOCS][Backport][9.0] Reference cleanup (#124720)
* Fix external URI images (#124350)

* [DOCS] Plugin management reference cleanup (#124578)

* add content to plugin management

* add content to Plugin Management

* Update docs/reference/elasticsearch-plugins/plugin-management.md

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>

* fix applies-to tag

* add ech to docset.yml

---------

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>

---------

Co-authored-by: florent-leborgne <florent.leborgne@elastic.co>
2025-03-13 11:55:40 +01:00
Carlos Delgado a4af548e43
ES|QL - Add scoring for full text functions disjunctions (#121793) (#124573) 2025-03-11 17:43:21 +01:00
Liam Thompson 00b1373cba
Remove subs attribute (#124551) (#124560)
(cherry picked from commit 435d1db5b9)

Co-authored-by: Jan Calanog <nejcalanog@gmail.com>
2025-03-11 23:38:35 +11:00
David Kilfoyle b7c9af101b
[Docs] Fix cross-repo links to Beats docs (#124360) (#124377)
Co-authored-by: Colleen McGinnis <colleen.mcginnis@elastic.co>
2025-03-08 07:05:36 +11:00
Kostas Krikellas 8b1c98d27e
[DOCS] Document source-related restrictions (#124011) (#124250)
* Document source-related restrictions

* Update mapping-source-field.md

* Update docs/reference/elasticsearch/mapping-reference/mapping-source-field.md



* Update mapping-source-field.md

---------

Co-authored-by: Marci W <333176+marciw@users.noreply.github.com>
2025-03-07 04:05:26 +11:00
Liam Thompson cff38b9f1e
add missing pages (#123774) (#124211)
(cherry picked from commit db5acd8976)

Co-authored-by: Colleen McGinnis <colleen.mcginnis@elastic.co>
2025-03-06 16:58:39 +01:00
Liam Thompson 8275ac8d1f
Split ESQL functions/operators docs files (#123904) (#124214)
* Port from asciidocalypse

* Fix links for operator lists

* Remove unused image files after moving/editing them

* Fix lists links

* Fix like/rlike links

* Fix remaining bad references to /elasticsearch/docs

* Fix logstash and beats references

* Fix logstash and beats references

* Fix image links

(cherry picked from commit efe7379e67)

Co-authored-by: Craig Taverner <craig@amanzi.com>
2025-03-06 16:58:30 +01:00
Liam Thompson 3fb135c13f
Update node-settings.md (#123997) (#124215)
* Update node-settings.md

Port change https://github.com/elastic/elasticsearch/pull/123939 forward to new docs system

* Update docs/reference/elasticsearch/configuration-reference/node-settings.md

(cherry picked from commit a06c8ea5b8)

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2025-03-06 16:58:26 +01:00
Liam Thompson 4fffe26ca8
Add note to servicenow connector ref (#124101) (#124217)
(cherry picked from commit 2456cd375a)
2025-03-06 16:57:57 +01:00
Liam Thompson f596523d71
Update Flatten Graph Docs to Include a Real Flattened Graph 9.x (#123901) (#124212)
updated flatten graph docs to include a real flattened graph

(cherry picked from commit be577e382d)

Co-authored-by: John Wagster <john.wagster@elastic.co>
2025-03-06 09:06:03 -06:00
Marci W 4b6096acb7
[DOCS] Clarify support for doc_values (#124047) (#124222)
* Update doc-values.md

* Make the note more visible

* fix link
2025-03-07 01:26:38 +11:00
Liam Thompson 21f8a7ed95
Cleanup search connectors, add some reference -> docs content signposts in various sections (#123733) (#124210)
(cherry picked from commit 6b27e420fe)
2025-03-07 01:03:51 +11:00
Liam Thompson b98606e712
[9.0] [docs] Migrate docs from AsciiDoc to Markdown (#123507) (#124124)
* [docs] Migrate docs from AsciiDoc to Markdown (#123507)

* delete asciidoc files

* add migrated files

* fix errors

* Disable docs tests

* Clarify release notes page titles

* Revert "Clarify release notes page titles"

This reverts commit 8be688648d.

* Comment out edternal URI images

* Clean up query languages landing pages, link to conceptual docs

* Add .md to url

* Fixes inference processor nesting.

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Liam Thompson <leemthompo@gmail.com>
Co-authored-by: Martijn Laarman <Mpdreamz@gmail.com>
Co-authored-by: István Zoltán Szabó <szabosteve@gmail.com>
(cherry picked from commit b7e3a1e14b)

# Conflicts:
#	docs/build.gradle
#	docs/reference/migration/index.asciidoc
#	docs/reference/migration/migrate_9_0.asciidoc
#	docs/reference/release-notes.asciidoc
#	docs/reference/release-notes/9.0.0.asciidoc
#	docs/reference/release-notes/highlights.asciidoc

* Fix build file

* Really fix build file

---------

Co-authored-by: Colleen McGinnis <colleen.j.mcginnis@gmail.com>
2025-03-06 07:53:46 +01:00
Kathleen DeRusso c2603083eb
Deprecate Behavioral Analytics CRUD apis (#122960) (#123383)
* Deprecate Behavioral Analytics CRUD APIs

* Add allowed warning for REST Compatibility tests

* Update docs/changelog/122960.yaml

* Update changelog

* Update docs to add deprecation flags and fix failing tests

* Update changelog

* Update changelog again

* Update docs formatting



* Skip asciidoc test

---------

Co-authored-by: Efe Gürkan YALAMAN <efeyalaman@gmail.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: Efe Gürkan YALAMAN <efeguerkan.yalaman@elastic.co>
2025-02-26 03:34:16 +11:00
Craig Taverner 4e5f9b821f
Add support to VALUES aggregation for spatial types (#122886) (#123356)
The original work at https://github.com/elastic/elasticsearch/pull/106065 did not support geospatial types with this comment:

> I made this work for everything but geo_point and cartesian_point because I'm not 100% sure how to integrate with those. We can grab those in a follow up.

The geospatial types should be possible to collect using the VALUES aggregation with similar behavior to the `ST_COLLECT` OGC function, based on the Elasticsearch convention that treats multi-value geospatial fields as behaving similarly to any geometry collection. So this implementation is a trivial addition to the existing values types support.
2025-02-25 22:50:06 +11:00
Luke Whiting 007149c192
Allow data stream reindex tasks to be re-run after completion (#122510) (#123035)
* Allow data stream reindex tasks to be re-run after completion

* Docs update

* Update docs/reference/migration/apis/data-stream-reindex.asciidoc



---------

Co-authored-by: Keith Massey <keith.massey@elastic.co>
2025-02-21 03:16:57 +11:00
David Turner f328b3d613
Clarify breaking change note for #112903 (#122998) (#123016)
Closes #122994
2025-02-20 23:36:55 +11:00
Lee Hinman 29d645839f
Allow setting the `type` in the reroute processor (#122409) (#122892)
* Allow setting the `type` in the reroute processor

This allows configuring the `type` from within the ingest `reroute` processor. Similar to `dataset`
and `namespace`, the type defaults to the value extracted from the index name. This means that
documents sent to `logs-mysql.access.default` will have a default value of `logs` for the type.

Resolves #121553

* Update docs/changelog/122409.yaml
2025-02-19 07:48:21 +11:00
elasticsearchmachine 61f3d57a5f
Add release notes for v9.0.0 release (#122884) 2025-02-18 12:24:02 -08:00
Nik Everett f5d0a85b0d
ESQL: Update kibana signatures (#121951) (#122032)
This updates the kibana signature json files in two ways:
* Renames `eval` to `scalar` - that's the name we use inside of ESQL and
  we may as well make the name the same.
* Calls the `CATEGORIZE` and `BUCKET` function `grouping` because they
  can only be used in the "grouping" positions of the `STATS` command.

Closes #113411
2025-02-08 03:00:54 +11:00
Fang Xing 783d8720b6
[ES|QL] Change function_named_parameters in Kibana doc to expected format (#121585) (#121687)
* change function_named_parameters in kibana doc to expected format
2025-02-05 05:34:33 +11:00
Jim Ferenczi fb3c666663
Remove outdated reference to internal semantic text format (#121276)
The semantic text format was updated in #119183. This commit removes the last remaining reference to the old format from the documentation to ensure consistency.
2025-01-30 15:01:55 +01:00
Chris Hegarty 4baffe4de1
Upgrade to Lucene 10.1.0 (#119308)
This commit upgrades to Lucene 10.1.0.
2025-01-30 13:41:02 +00:00
Liam Thompson c8dfb4ea9e
[DOCS] Fix missing id syntax (#121264)
* [DOCS] Fix missing id syntax

* Update docs/reference/troubleshooting/common-issues/disk-usage-exceeded.asciidoc

* fix id
2025-01-30 12:52:37 +01:00
Jim Ferenczi dbeb55cb3d
Enable Mapped Field Types to Override Default Highlighter (#121176)
This commit introduces the `MappedFieldType#getDefaultHighlighter`, allowing a specific highlighter to be enforced for a field.
The semantic field mapper utilizes this new functionality to set the `semantic` highlighter as the default.
All other fields will continue to use the `unified` highlighter by default.
2025-01-29 21:55:53 +00:00
Slobodan Adamović c5ab17c3aa
Deprecate certificate-based remote cluster security model (#120806)
Today, Elasticsearch supports two models to establish secure connections
and trust between two Elasticsearch clusters:

- API key based security model
- Certificate based security model

This PR deprecates the _Certificate based security model_ in favour of *API key based security model*.
The _API key based security model_ is preferred way to configure remote clusters,
as it allows to follow security best practices when setting up remote cluster connections
and defining fine-grained access control.

Users are encouraged to migrate remote clusters from certificate to API key authentication.
2025-01-29 19:43:04 +01:00
Kuni Sen a0f1856a40
(Doc+) Expand watermark resolution (#119174)
* (Doc+) Expand watermark resolution

Relaunch https://github.com/elastic/elasticsearch/pull/116892 since the original one seems to be outdated and hard to update branch.

* Apply suggestions from code review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

---------

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2025-01-29 19:31:50 +01:00
Luiz Santos c0f3024c3f
Make it clear that previous enrich indices are deleted every 15 minutes (#109085)
Before this change, one could interpret that enrich policies are executed every 15 minutes, which is not true.
2025-01-29 19:28:43 +01:00
Liam Thompson 9edd64e608
[DOCS] Fix failing docs test (at least try) (#118934)
Fix failing docs test:

* Unmute test
* Replace hardcoded values with regex in snippet test
2025-01-29 19:21:58 +01:00
Nikolaj Volgushev 51b4fffb5e
Default to `SSHA-256` as API key stored credential hasher (#120997)
API keys are high-entropy secure random strings. This means that the
additional work factor of functions like PBKDF or bcrypt are not
necessary, and a faster hash function like salted SHA-256 provides
adequate security against offline attacks (hash collision, brute force,
etc.).

This PR adds `SSHA-256` to the list of supported stored hash algorithms
for API key secrets, and makes it the default algorithm. Additionally,
this PR changes the format of API key secrets, moving from an encoded
UUID to a random string which increase the entropy of API keys from 122
bits to 128 bits, without changing overall secret length. 

Relates: ES-9504
2025-01-30 05:14:15 +11:00
Michael Peterson d3f20e5b4b
Updated resolve/cluster end user docs with information about the timeout flag and no index expression endpoint (#121199) 2025-01-29 18:22:40 +01:00
Stanislav Malyshev 3669e061d4
Fix typo in docs example (#121206) 2025-01-29 09:44:42 -07:00
Peter Straßer 6b76457a23
Fix syntax errors in the rescore retriever example (#121024) 2025-01-29 16:10:59 +01:00
Michael Peterson e9b877e58b
Clarify the behavior of remote/info and resolve/cluster for connected status of remotes (#118993) 2025-01-29 10:08:25 -05:00
Kathleen DeRusso 4b4c59de7f
Fix error in docs code snippet (#121187) 2025-01-29 16:05:05 +01:00
Benjamin Trent 038aab864e
Mark bbq indices as GA and add rolling upgrade integration tests (#121105)
With the introduction of our new backing algorithm and making rescoring
easier with the `rescore_vector` API, let's mark bbq as GA. 

Additionally, this commit adds rolling upgrade tests to ensure
stability.
2025-01-30 01:58:08 +11:00
Pat Whelan 9009606a47
[Transform] add support for extended_stats (#120340)
Building off of `stats` and multi-value aggregations, including the
limitation:
- all values of extended_stats will be mapped to `double` if mapping
  deduction is used

Relates #51925
2025-01-29 15:33:16 +01:00
Martijn van Groningen 952bf229fb
Conditionally enable logsdb by default (#121049)
Enable logsdb by default if logsdb.prior_logs_usage has not been set to true.

Meaning that if no data streams were created matching with the logs-- pattern in 8.x, then logsdb will be enabled by default for data streams matching with logs-*-* pattern.

Also removes LogsPatternUsageService as with version 9.0 and beyond, this component is no longer necessary.

Followup from #120708
Closes #106489
2025-01-29 15:03:28 +01:00
Liam Thompson f5f0e3bd7f
[DOCS] Update getting-started.asciidoc (#116151) (#121173)
Update `new_field` to `language` which is the actual new field added in dynamic mapping

Co-authored-by: Ekwinder <ekwindersaini@gmail.com>
2025-01-30 00:52:11 +11:00
Valeriy Khakhutskyy 15b93fefdb
Extend documentation note. (#121146) 2025-01-29 13:03:42 +01:00
Jihyun(Brian) Jeong e1207398c7
(Doc+) Clarify dimension field requirements for time_series aggregation (#119442)
* (Doc+) Clarify dimension field requirements for time_series aggregation

👋 howdy, team!

This PR adds a note explaining that time series indices require:
- index.mode set to "time_series"
- at least one dimension field with time_series_dimension: true
- a routing_path array listing those dimension fields

Without these settings, the time_series aggregation may return empty buckets or behave unexpectedly. By emphasizing the dimension field requirement, we help users configure their time series indices correctly and see meaningful aggregation results.

* Apply suggestions from code review

Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
Co-authored-by: shainaraskas <58563081+shainaraskas@users.noreply.github.com>
2025-01-29 13:03:11 +01:00
Stef Nestor 31597b3897
(Doc+) System Index definition (#120327) 2025-01-29 11:14:36 +01:00
Kofi B 5bcd170a0b
[DOCS] Added additional context to page (#120569) 2025-01-29 09:48:25 +01:00
Kofi B 2258911112
[DOCS] Search multiple indices added info (#120572)
* [DOCS] Search multiple indices added info

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

* Update docs/reference/search/search-your-data/search-multiple-indices.asciidoc

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>

---------

Co-authored-by: George Wallace <georgewallace@users.noreply.github.com>
2025-01-29 09:46:39 +01:00
Kofi B 63a890e30d
[DOCS] Upsert documentation clarification (#120684)
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2025-01-29 09:46:01 +01:00
Martijn van Groningen 8185cafaf2
Emit deprecation warning when executing one of the rollup APIs (#113131)
Relates to #112690
2025-01-29 08:48:53 +01:00
Parker Timmins 635a4c21de
Add docs for reindex data stream REST endpoints (#120653)
Add documentation for new REST endpoints related to data stream upgrade. 
Endpoints:
- /_migration/reindex
- /_migration/reindex/{index}/_status
- /_migration/reindex/{index}/_cancel
- /_create_from/{source}/{dest}
2025-01-28 19:44:56 -06:00
Lisa Cawley bfeba89e0c
[DOCS] Move ML function reference out of appendix (#121111) 2025-01-28 23:56:24 +01:00
Panagiotis Bailis 375814d007
Adding linear retriever to support weighted sums of sub-retrievers (#120222) 2025-01-28 19:33:12 +02:00