Commit Graph

9768 Commits

Author SHA1 Message Date
Stuart Tettemer d42211c431
Ingest: IngestDocument requires non-null version (#87665)
Changes the type of the version parameter in `IngestDocument` from
`Long` to `long` and moves it to the third argument, so all required
values occur before nullable arguments.

The `IngestService` expects a non-null version for a document and will
throw an `NullPointerException` if one is not provided.

Related: #87309
2022-06-15 07:50:45 -05:00
Lisa Cawley 5b6838e6ec
[DOCS] Fix typo in anomaly detection example (#87668) 2022-06-14 14:34:33 -07:00
Jake Landis 51ea9c39ba
forward port 8.2.3 release notes (#87663) 2022-06-14 13:52:00 -05:00
David Turner fcf293f87c
Report overall mapping size in cluster stats (#87556)
Adds measures of the total size of all mappings and the total number of
fields in the cluster (both before and after deduplication).

Relates #86639
Relates #77466
2022-06-14 13:55:14 +01:00
Luca Cavanna fe327c6e1a
[DOCS] Clarify index_prefix in prefix query docs (#87450)
The current docs mention that Elasticsearch indexes prefixes between 2 and 5 characters in a separate field. 2 and 5 are default values, and the size of the prefixes indexed depend on the configuration settings.
2022-06-14 14:32:37 +02:00
Leaf-Lin ed0fb8b819
Move fix common cluster issues to troubleshooting (#87440)
* Move fix common cluster issues to troubleshooting

* Include fix common cluster issues in the troubleshooting doc

* [DOCS] Remove extra include from How-To

Co-authored-by: Deb Adair <debadair@elastic.co>
2022-06-13 17:16:17 -07:00
Elasticsearch addict 336df7a266
Update disabling _source doc mentioning highlight (#87582)
Closes #87311
2022-06-13 09:11:25 -04:00
Elasticsearch addict b5a635cae9
[DOCS] Add note for tokenizers that don't support keep types token filter (#87553)
Closes #85946
2022-06-13 11:28:32 +02:00
Julie Tibshirani fab547bef2
Improve kNN with filtering docs (#87538)
This change tries to make it easier to find kNN with filtering in the docs:
* Mention filtering support in the kNN API description
* In kNN tutorial, link to the kNN search API page more prominently
2022-06-09 10:42:54 -07:00
Nik Everett b18bafb207
Docs for synthetic source (#87416)
This adds some basic docs for synthetic source both to get us started
documenting it and to show how I'd like to get it documented - with a
central section in the docs for `_source` and "satellite" sections in
each of the supported field types that link back to the central section.

[Preview](https://elasticsearch_87416.docs-preview.app.elstc.co/guide/en/elasticsearch/reference/master/mapping-source-field.html#synthetic-source)
2022-06-09 09:42:06 -04:00
Armin Braun 2a5d65c17f
Remove shards per gb of heap guidance (#86223)
This guidance does not apply any longer.
The overhead per shard has been significantly reduced in recent versions
and removed rule of thumb will be too pessimistic in many if not
most cases and might be too optimistic in other specific ones.

=> Replace guidance with rule of thumb per field count on data nodes and
rule of thumb by index count (which is far more relevant nowadays than
shards) for master nodes.

relates #77466

Co-authored-by: David Turner <david.turner@elastic.co>
Co-authored-by: Henning Andersen <33268011+henningandersen@users.noreply.github.com>
2022-06-09 15:31:01 +02:00
Przemysław Witek 8656a29675
[Transform] Implement per-transform num_failure_retries setting. (#87361) 2022-06-09 15:22:06 +02:00
Luigi Dell'Aquila 3dc4176a1a Revert "Add support for VERSION field type in SQL and EQL (#85502)"
This reverts commit 79b0078b0d.
2022-06-09 09:34:26 +02:00
Luigi Dell'Aquila 79b0078b0d
Add support for VERSION field type in SQL and EQL (#85502) 2022-06-09 08:43:23 +02:00
Keith Massey 6caf39c109
How to increase node capacity docs (#87188)
This adds troubleshooting documentation for the case when the ShardsAvailabilityHealthIndicatorService
reports that there are not enough nodes in the data tier (user action "increase_node_capacity_for_allocations" or
"increase_tier_capacity_for_allocations_". This covers both the cloud and self-managed environments. For
cloud we first recommend increasing the number of availability zones (because you cannot directly add nodes), and
decreasing index.number_of_replicas if that is not possible. For self-managed, we first recommend adding nodes,
and decreasing index.number_of_replicas if that is not possible.
2022-06-08 14:06:47 -05:00
Nik Everett 86effae55c
Docs: Data streams only support `create` (#87263)
This removes "data streams" from the docs for the `index`, `delete`,
and `update` actions because data streams only support the `update`
action.

Closes #87231
2022-06-08 13:41:42 -04:00
Yang Wang f5ceed19fc
User Profile - remove feature flag (#87383)
The feature flag is no longer necessary in the 8.4 release cycle. The
feature itself is still in beta.
2022-06-08 10:18:18 -04:00
James Baiera b3ff079794
Improve the Health API documentation page with recent additions (#87139)
This PR overhauls the new health API documentation page, updating it with information on the new 
request formatting and response features.
2022-06-07 15:22:09 -04:00
Andrei Dan 15b8fc3151
Fix troubleshooting doc tab to point to self-managed (#87465)
This fixes the Self Managed tab to load the
self-managed instructions.
2022-06-07 16:29:54 +01:00
Mayya Sharipova 4dabd5eb8e
Add mapping stats for indexed dense_vectors (#86859)
Add cluster mapping stats for indexed dense_vectors

Currently _cluster/stats mapping section displays all mapping types
along with their count. In 8.0 we introduced indexed dense_vector
types, and we would like to collect more enhanced stats on them:
- number of indexed dense_vector fields
- sum of dims across all indexed dense_vector fields

This allows to differentiate how indexed dense_vector types are
used as opposed to unindexed dense_vector types.
2022-06-07 08:40:28 -04:00
Martijn van Groningen 7154608abf
Allow pipeline processor to ignore missing pipelines (#87354)
Add `ignore_missing_pipeline` option to `pipeline` processor. This
controls whether the `pipeline` processor should fail with an error if
no pipeline with a name specified in the `name` option exists.

This enhancement is useful to setup a pipeline infrastructure that
lazily adds extension points for overwrites. So that for specific
cluster setups custom pre-processing can be added at a later point in
time.

Relates to #87323
2022-06-07 07:02:18 -04:00
Leaf-Lin 7bd4708886 Revert "Move fix common issues into troubleshooting"
This reverts commit 4a563e9bfb.
2022-06-07 17:14:38 +10:00
Leaf-Lin 4a563e9bfb Move fix common issues into troubleshooting 2022-06-07 17:07:03 +10:00
David Turner 80f7af58f8
More detail in discovery troubleshooting docs (#86930)
In #85074 we added docs on discovery troubleshooting that really only
talked about troubleshooting master elections. There's also the case
where the master is elected fine but some other node can't join it. This
commit adds troubleshooting docs about that too.

Co-authored-by: Adam Locke <adam.locke@elastic.co>
2022-06-06 08:33:45 +01:00
Adam Locke 03f75416b5
[DOCS] JWT doc enhancements (#86411)
* [DOCS] Add examples for run-as privileges

* Add JWT run_as and realm examples

* Adding examples for run_as, moving that section, and other 🔥 edits

* Add section headers 🖍️

* Incorporate Justin's suggestions from code review

Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>

* Edits and clarifications based on reviewer feedback.

* Clarify run_as privilege in roles

* Fix typo

* Add redirect to fix cross-book linking

* Expand the run_as examples

* Update request

* Remove NOTCONSOLE from curl commands

* Update run_as example and expand section on unsupported realms

* Split note for unsupported realms

* Remove note that OAuth2 tokens aren't supported and clarify run_as from unsupported realms

* Apply Justin's suggestions from code review

Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>

* Update support for different authentication mechanisms

* Apply suggestions from code review

Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>

* Add note from review, cleanup, and typo fixes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Justin Cranford <89857999+justincr-elastic@users.noreply.github.com>
2022-06-03 18:12:36 -04:00
Justin Cranford 7b75311382
List rp.signature_algorithm supported values in docs (#87365) 2022-06-03 13:56:00 -04:00
Lisa Cawley 32f6082b7e
[DOCS] Typo in time functions (#87373) 2022-06-03 08:40:12 -07:00
Craig Taverner a4e0d9b9dd
Added migration/index.asciidoc generation support (#87318)
Including extracting static content from migration/index, so the template would be as light as possible.

The reason for this work is because the gradle task `generateReleaseNotes` was not correctly adding new links and imports to the migrations/index and that caused documentation to fail building for 8.3.0.
2022-06-02 16:05:18 +02:00
Luca Cavanna 50793a68a8
Fields API to allow fetching values when _source is disabled (#87267)
Back when we introduced the fields parameter to the search API, it could only fetch values from _source, hence
the corresponding sub-fetch phase fails early whenever _source is disabled. Today though runtime fields can
be retrieved from a separate value fetcher that reads from fielddata, and metadata fields can be retrieved
from stored fields. These two scenarios currently throw an unnecessary error whenever _source is disabled.

This commit removes the check for disabled _source, so that runtime fields and metadata fields can be retrieved even when _source is disabled. Fields that need to be loaded from _source are simply skipped whenever _source is disabled, similar to when a field is not found in _source.

Closes #87072
2022-06-02 11:28:36 +02:00
István Zoltán Szabó a71ad6e407
[DOCS] Expands AD and Transform alert docs with info on context for recovered alerts (#87118) 2022-06-02 09:52:47 +02:00
Jean-Fabrice Bobo 37c346cb2f
Update error-handling.asciidoc (#86795)
Co-authored-by: Lee Hinman <dakrone@users.noreply.github.com>
2022-06-01 14:57:38 -06:00
David Kilfoyle 91175851a2
Update macOS install steps to use curl instead of wget (#87186) 2022-05-31 17:34:24 -04:00
Yannick Welsch 46b386be16
Docs for snapshots as simple archives (#86261)
Adds documentation for the new snapshots as archive feature.

Relates #81210
2022-05-30 13:23:53 +02:00
Lisa Cawley cd14d9cc75
[DOCS] Remove 8.2.2 coming tags (#87176) 2022-05-26 09:11:03 -07:00
Luigi Dell'Aquila bdebb25b60
Implement support for partial search results in SQL CLI (#86982)
Add support for

   allow_partial_search_results = true/false

command in SQL CLI.

If true, returns partial results if there are shard request timeouts or shard failures.
If false, returns an error with no partial results.
2022-05-26 16:59:37 +02:00
Lisa Cawley 900bdd640d
[DOCS] Update docs for v8.2.2 release (#87092) (#87137)
Co-authored-by: Nikola Grcevski <6207777+grcevski@users.noreply.github.com>
2022-05-25 14:17:32 -07:00
Nik Everett 5079f4ff45
Document example loss of precision from floats (#87122)
This adds an example of the precision loss for `double`, `float`, and
`half_float` numbers that we can link folks to when explaining what
happened to their numbers. You can link directly to it with something
like:
```
/guide/number.html#floating_point
```
2022-05-25 16:45:23 -04:00
Leaf-Lin ad0228fd2f
[DOCS] Adding Getting Help section to troubleshooting docs (#87095)
* Adding Getting Help section

Add getting help section in the troubleshooting guide to be pointed by health API when issues are too complicated to be addressed. 

This is taken from https://www.elastic.co/guide/en/cloud/current/ec-get-help.html, someone might want to elaborate it a bit more?

* Fix broken partintro, modify headings, and update wording

Co-authored-by: Adam Locke <adam.locke@elastic.co>
2022-05-25 15:58:41 -04:00
Andrei Dan 3fb60a1551
Update get kibana guide in troubleshooting docs (#87075) 2022-05-25 16:11:18 +01:00
Pooya Salehi beadcaf631
Increase force_merge threadpool size (#87082)
Changes the default size used for the force_merge threadpool to 1/8 of
the allocated processors, with a minimum value of 1.

Closes #84943
2022-05-25 15:45:28 +02:00
Ryan Ernst dd686ebe6d
Fix expand_wildcards default in docs (#87086)
The get settings api has accepts the expand_wildcards option. The docs
state the default value is `all`, but it is actually now `open` (which
does not include hidden or closed indices by default). This commit
changes the docs to match the existing behavior.
2022-05-24 13:11:35 -07:00
Andrei Dan 08b323131f
Troubleshooting guides for disabled allocations (#86789)
This adds the troubleshooing guides when index and cluster allocations are
disabled.

Co-authored-by: Lee Hinman <dakrone@users.noreply.github.com>
2022-05-24 10:27:15 +01:00
Andrei Dan 20802a9f66
Add migrate to tiers troubleshooting doc (#86738)
This adds a troubleshooting doc for indices that mix index filtering allocation
with data tiers routing.

Co-authored-by: Lee Hinman <dakrone@users.noreply.github.com>
2022-05-24 10:12:28 +01:00
Andrei Dan 490f417efd
Troubleshooting guide for diagnosing unassigned shards (#86996)
Co-authored-by: Leaf-Lin <39002973+Leaf-Lin@users.noreply.github.com>
Co-authored-by: Lee Hinman <dakrone@users.noreply.github.com>
2022-05-24 09:56:23 +01:00
Elasticsearch addict c3a6190173
Fix docs link to Lucene stop filter (#87037)
Updates the docs with the new Javadoc location for Lucene's stop filter.

Closes #87034.
2022-05-23 11:06:35 -07:00
David Roberts 93bc2e382f
[ML] Replace the implementation of the categorize_text aggregation (#85872)
This replaces the implementation of the categorize_text aggregation
with the new algorithm that was added in #80867. The new algorithm
works in the same way as the ML C++ code used for categorization jobs
(and now includes the fixes of elastic/ml-cpp#2277).

The docs are updated to reflect the workings of the new implementation.
2022-05-23 18:46:13 +01:00
Joe Gallo 79990fa49b
Remove "Push back excessive requests for stats (#83832)" (#87054) 2022-05-23 12:58:02 -04:00
wallrik 10f53f8766
Clarify environments with strict firewalls and GEOIP (RE: #85637) (#86648) 2022-05-23 06:43:26 -06:00
Ignacio Vera e6b4097fc8
new geo_grid query to be used with geogrid aggregations (#86596)
Query that allows users to define a query where the input is the key of the bucket and it will match the 
documents inside that bucket.
2022-05-23 11:38:07 +02:00
István Zoltán Szabó 2804ff49b6
[DOCS] Improves warning message in Update transform API docs (#86920)
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2022-05-23 10:10:03 +02:00