Commit Graph

10962 Commits

Author SHA1 Message Date
Andrei Dan 74ea04fb2d
[DOCS] document tail merging and create tutorial for migrating to DSL (#101117)
This documents tail merging, the enabled flag, and
adds a tutorial to migrate a data stream from ILM to DSL.
2023-10-25 11:12:36 +01:00
Felix Barnsteiner 75d9bd7790
Rename component templates and pipelines according to the new naming conventions (#99975)
- Creates a new StackTemplateRegistry that uses the new names
- The new registry only respects stack.templates.enabled for index templates
- Renames the old registry to LegacyStackTemplateRegistry
- Component templates are not duplicated but registered under two different names
- Documents the new naming convention
- Index templates are not renamed, at least for now, as there are some challenges with it
  See 7fd0423 for more details.
2023-10-25 11:56:28 +02:00
Martijn van Groningen 311185311f
Remove index.codec setting from setting up tsdb docs. (#101276)
This is not needed for tsdb, because of synthetic source and slows down indexing / refreshes.
2023-10-25 08:21:18 +02:00
Volodymyr Krasnikov 66f7298e83
Update doc as per SDH finding (#101285) 2023-10-24 15:17:34 -07:00
Nik Everett 46f95a67b4
ESQL: More MV_* tests (#100564)
This adds more tests for some of the `MV_` functions and updates their
docs now that the railroad diagram and table generated by the tests
covers all of the types.
2023-10-24 16:55:17 -04:00
AlexB 48f1e4cf89
ESQL small doc improvement (#101226)
Move command list to the top

Co-authored-by: Alexandros Batsakis <abatsakis@splunk.com>
2023-10-23 12:23:58 -07:00
AlexB 931dcae41d
Add improvements to the ES|QL docs (#101195)
Content and structural improvements to the ES|QL docs

---------

Co-authored-by: Alexandros Batsakis <abatsakis@splunk.com>
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-10-23 07:45:42 -07:00
Daniel Mitterdorfer a579504e11
Remove auto_configure privilege for profiling (#101026)
With this commit we remove the `auto_configure` privilege for the Fleet
service account that targets profiling-related indices. This privilege
was needed to automatically create indices and data streams in the past
but as this managed by the Elasticsearch plugin, there is no need to
grant this privilege to Fleet-managed components.
2023-10-23 13:14:14 +02:00
Abdon Pijpelink fcdeb21993
[DOCS] Expand ES|QL ENRICH documentation (#101079)
* [DOCS] Expand ES|QL ENRICH documentation

* Add examples to 'Enrich data' page

* Add another diagram

* Remove redirect that's no longer needed

* Review feedback
2023-10-19 17:14:21 +02:00
gchaps cfa11d2df3
[DOCS] Adds enrich policies and data retention for Index Management (#100922)
* [DOCS] Adds enrich policies and data retention for Index Management

* Update docs/reference/indices/index-mgmt.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/indices/index-mgmt.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/indices/index-mgmt.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/indices/index-mgmt.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* Update docs/reference/indices/index-mgmt.asciidoc

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>

* [DOCS] Incorporates review comments

---------

Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-10-19 07:24:52 -07:00
Carlos Delgado b803f0fcdd
Fix examples in synonym graph token filter docs (#101101) 2023-10-19 14:13:14 +02:00
Abdon Pijpelink 7f5b68711d
[DOCS] Inconsistent ulimit (#100948)
* [DOCS] Inconsistent ulimit

* Another one
2023-10-19 11:34:21 +02:00
Mike Pellegrini 3b8825c5d3
Clarify search application search API documentation (#100930)
Clarify the Search Application Search API & Render Search Application Query API documentation
2023-10-18 13:00:38 -04:00
Luigi Dell'Aquila 8d89f913a1
ESQL: Add warning header when default LIMIT is applied (#100894)
Fixes https://github.com/elastic/elasticsearch/issues/100555

ESQL [by default](https://github.com/elastic/elasticsearch/pull/99816)
adds an implicit `LIMIT 500` to queries that do not define a limit.
Since this can be confusing for the end user, with this PR we also add a
warning to the response, making this default clear and explicit.
2023-10-18 07:44:33 -04:00
István Zoltán Szabó 9b404099b4
[DOCS] Adds links to token section in ESLER conceptual. (#101033) 2023-10-18 11:30:38 +02:00
David Turner 76488e2525
Add/fix known issue docs for 8.10.4 (#101013)
8.10.4 includes a partial mitigation for the snapshots downgrades bug
introduced in 8.10.0. This commit adds known-issue docs for 8.10.4, and
adjusts the known-issue docs for earlier 8.10.x issues.
2023-10-18 08:06:42 +01:00
Abdon Pijpelink 8ac4ba751e
Restructure ES|QL docs (#100806)
* Break out 'Limitations' into separate page

* Add REST API docs

* Restructure commands, functions, and operators refs

* Add placeholder for getting started guide

* Group 'Syntax', 'Metafields', and 'MV fields' under 'Language'

* Add placeholder for Kibana page

* Add link from landing page

* Apply uniform formatting to ACOS, CASE, and DATE_PARSE function refs

* Reword default LIMIT

* Add support for COUNT(*)

* Move 'Commands' and 'Functions and operators' to individual pages

---------

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2023-10-17 17:36:14 +02:00
Keith Massey 92ec9d6605
Add executed pipelines to bulk api response (#100031)
This change allows users to pass a new list_executed_pipelines parameter
to the bulk API, which results in an executed_pipelines list being returned.
2023-10-17 09:39:09 -05:00
Lisa Cawley 3418c6a2af
[DOCS] Alerts-as-data for anomaly detection rules (#100864) 2023-10-17 07:37:22 -07:00
Andrei Dan abf6c16762
[DOCS] Remove the `coming[8.10.4]` from release notes (#100979) 2023-10-17 10:29:14 -04:00
Carlos Delgado 888813d815
Fix synonyms documentation (#100916) 2023-10-17 15:50:51 +02:00
David Kyle f52d5fab7c
[ML] Rename the ELSER service (#100944) 2023-10-17 09:58:38 +01:00
Jake Landis 1eaa907052
Fix manage/monitor_enrich documentation (#100781)
manage_enrich is a cluster privilege, not a built in role. 
manage_enrich is already documented as a cluster privilege.
This commit remove manage_enrich from the role documentation.
This commit also makes mention of the monitor_enrich introduced in #99646.

related: #85877
2023-10-13 11:29:48 -05:00
gheorghepucea cb30096c65
Referenced the svgs of starts_with and trim in asciidoc for consistency. (#100834) 2023-10-13 16:01:47 +02:00
Andrei Dan c73a3b4d25
[Docs] Document a bit more the implicit rollover conditions (#100750) 2023-10-13 14:37:48 +01:00
Kathleen DeRusso bfc87d46c0
[Query Rules] clarify query rules API documentation (#100732)
* Update example in query rules docs

* Ensure GET docs are also consistent

* Update docs/reference/query-rules/apis/put-query-ruleset.asciidoc

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>

---------

Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2023-10-13 08:12:16 -04:00
Andrei Dan cea4dc9fc4
Update docs for v8.10.4 release (#100772) (#100819)
(cherry picked from commit 78ac64f013)
Signed-off-by: Andrei Dan <andrei.dan@elastic.co>
2023-10-13 07:52:19 -04:00
Liam Thompson eab813f8cb
[DOCS] Migrate Behavioral Analytics docs to ES ref (#100704)
* [DOCS] Migrate Behavioral Analytics docs to ES ref

* Fix typo

* Fix attributes

* Rename top level heading, fix requirements

* Address review suggestions
2023-10-13 09:05:23 +02:00
David Turner cf97e967a9
More S3-compatible repo deflection (#100754)
Call out explicitly that users need to reproduce issues with the real S3
before reporting them to ES.
2023-10-12 05:41:50 -04:00
Tanguy Leroux 583a787618
[Docs] Link to AWS SDK documentation for requests logging (#100491)
Co-authored-by: David Turner david.turner@elastic.co
2023-10-12 09:48:45 +02:00
Mayya Sharipova b582276dd6
Update kNN search guide with knn parallelization (#100705)
Relates to PR #98204
2023-10-11 15:31:03 -04:00
István Zoltán Szabó 446ac9f378
[DOCS] Updates ELSER tutorial with inference processor changes (#100420)
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@elastic.co>
2023-10-11 17:33:20 +02:00
Brandon Morelli a3ba9f9888
Update 8.10.3.asciidoc (#100590) (#100614)
* Update 8.10.3.asciidoc

* Update docs/reference/release-notes/8.10.3.asciidoc

Co-authored-by: David Turner <david.turner@elastic.co>

* Update docs/reference/release-notes/8.10.3.asciidoc

---------

Co-authored-by: David Turner <david.turner@elastic.co>
(cherry picked from commit 5ba96f2e2e)
2023-10-10 08:31:03 -07:00
David Turner 2712dc5da5
Add known-issue docs for snapshot downgrades bug (#100412) 2023-10-10 10:25:39 +01:00
Abdon Pijpelink 62b85b1d0f
[DOCS] Refresh "Search your data" (#99482)
* Restructure existing docs

* Add draft content

* Changes for MVP

* Reword

* Move Search Applications docs to ES reference

- Renamed files and changed ids per https://github.com/elastic/elasticsearch/pull/100032
- Updated URL syntax for absolute URLs using attribute
- Deleted redirects in redirects.asciidoc

* Fix json source formatting

* Use `source, js`, not `javascript`

* Idem

* Fix console-reponse

* Skip tests for js blocks

* This will definitely fix things

* Use attributes

* Remove commented out redirects

* Fix header level in search-with-synonyms.asciidoc

* Update docs/reference/search/search-your-data/knn-search.asciidoc

Co-authored-by: Chris Cressman <chris@chriscressman.com>

* Fix trailing comma bug

Flagged in #enterprise-search Slack

* Move semantic search under vector search

---------

Co-authored-by: Liam Thompson <leemthompo@gmail.com>
Co-authored-by: Chris Cressman <chris@chriscressman.com>
Co-authored-by: Liam Thompson <32779855+leemthompo@users.noreply.github.com>
2023-10-10 10:47:35 +02:00
Chris Cressman cab1429c72
[DOCS] Update links to migrating Search docs (#100237)
Some Search docs are migrating from Enterprise Search to Elasticsearch.
Update links to these docs to use the new locations. Also update
titles and surrounding text.
2023-10-09 17:11:39 -04:00
Keith Massey 606fc13af5
Update docs for v8.10.3 release (#100432) (#100512) 2023-10-09 09:44:41 -04:00
Daniel Mitterdorfer dfaec0dbf0
Enable Universal Profiling as Enterprise feature (#100333)
With this commit we ensure that Universal Profiling can only be used
with an Enterprise license.
2023-10-09 07:58:04 +02:00
David Kyle 6cde0df463
[ML] More checks and tests for parsing Inference processor config (#100335)
Following on from #100205 this PR adds more tests and checks 
for corner cases when parsing the configuration.
2023-10-06 15:10:45 +01:00
Carlos Delgado f2dfbfe8c4
[DOCS] Add sparse-vector field type to docs, changed references (#100348) 2023-10-06 14:25:27 +02:00
Nik Everett 38eac268b4
ESQL: Build tracked block in EVAL (#100268)
This changes `EVAL` to build tracked blocks so we can trip the breaker
when there are too many tracked blocks hanging about.
2023-10-04 10:29:54 -04:00
Matt Culbreth 132220bf83 Bump to version 8.12.0 2023-10-04 09:09:08 -04:00
Andrei Dan 632c97b234
Document ILM waits for tsds end_time to lapse in some actions (#100204) 2023-10-04 07:55:58 -04:00
Nik Everett 9620512a89
ESQL: Tests for large concat and many evals (#100159) 2023-10-03 14:41:40 -04:00
David Kyle b055204b43
[ML] Simplify the Inference Ingest Processor configuration (#100205)
Adds a `input_ouput` option the removes the need for a `field_map` and/or
target fields. Multiple inputs can be specified in `input_output`
2023-10-03 18:42:31 +01:00
Andrei Dan 839afdc331
Promote the Data stream lifecycle feature to Technical Preview (#100187)
This releases the Data stream lifecycle feature as a
Technical Preview feature.

Data stream lifecycle, albeit in technical preview, will allow data streams
to take advantage of a native simplified and resilient lifecycle implementation.
2023-10-03 17:12:35 +01:00
Luca Cavanna f660427739 Merge branch 'main' into lucene_snapshot_9_8 2023-10-03 12:36:37 +02:00
Andrei Dan 1369ff2b78
Remove managing ds by default for now (#100149)
This removes the DSL functionality that would automatically
configure the lifecycle to all new data streams in preparation
for marking Data stream lifecycle as ready for Technical Preview.
2023-10-02 20:28:31 +01:00
Luigi Dell'Aquila 6e79013088
ESQL: enhance SHOW FUNCTIONS command (#99736)
Fixes https://github.com/elastic/elasticsearch/issues/99507

Enhance SHOW FUNCTIONS command to return as _structured_ information as
possible about the function signature, ie. - function name - return type
- param names - param types - param descriptions

For now, as an example, the annotations are used only on `sin()` and
`date_parse()` functions; **if we agree on this approach**, I'll proceed
to - enhance all the currently implemented functions with the needed
information - improve the function tests to verify that every new
implemented function provides meaningful information

---

This feature can be useful for the end user, but the main goal is to
give Kibana an easy way to produce in-line documentation (contextual
messages, autocomplete) for functions

Similar to current implementation, that has a `@Named("paramName")`
annotation for function parameters, this PR introduces two more
annotations `@Param(name, type, description, optional)` and
`@FunctionInfo()` to provide information about single parameters and
functions.

The result of `SHOW FUNCTIONS` query will have the following columns: -
name (keyword): the function name - synopsis (keyword): the full
signature of the funciton, eg. `double sin(n:integer|long|double)` -
argNames (keyword MV): the function argument names - argTypes (keyword
MV): the function argument types - argDescriptions (keyword MD): a
textual description of each function argument - returnType (keyword):
the return type of the function - description (keyword): a textual
description of the function

---

Open questions: - ~~how structured shoud *types* be? Eg. should we have
a strict `@Typed("keyword")`/`@Typed({"keyword", "text"})` or should we
have a more generic type description, eg. `@Typed("numeric")`,
`@Typed("any")`? The first one is more useful for API consumption but
it's hard with our complex type system (type classes, custom types,
unsupported and so on); the second one is less structured, but probably
more useful for documentation, that is the most immediate use case of
this feature.~~ All the types are listed explicitly

- ~~we have alternatives for the synopsis, eg.~~
  - ~~`functionName(<paramName>:<paramType>, ...): <returnType>`~
  - ~~`<returnType> functionName(<paramName>:<paramType>, ...)`~~
  - ~~`<returnType> functionName(<paramType> <paramName>, ...)`~~
  Using `<returnType> functionName(<paramName>:<paramType>, ...)` for now. If multiple types are supported, then they will be separated by pipes, eg. `double sin(n:integer|long|double)`.
2023-10-02 13:56:41 -04:00
Luca Cavanna 689a1e490a Merge branch 'main' into lucene_snapshot_9_8 2023-10-02 13:56:12 +02:00