Commit Graph

9370 Commits

Author SHA1 Message Date
William Chaparro c8e8104f66
[DOCS] Remove experimental language from HDR Histo percentiles/ranks (#81773)
per issue 60780, decision from team to remove experimental language from HDR Histogram percentiles and ranks. Feature has been in production for quite some time.
closes #60780
2021-12-15 14:35:08 -05:00
James Rodewig 04318961b9
[DOCS] Clarify supported parameters for `terms` value source (#81775)
The composite aggregation's `terms` value source doesn't support the same set of
parameters as the `terms` aggregation.

Closes #81431.
2021-12-15 14:32:16 -05:00
Adam Locke 1bd0561a91
[DOCS] Add docs for verifying CA fingerprint (#81279)
* [DOCS] Add docs for verifying CA fingerprint

* Update openssl command and explanatory text

* Explain copying CA cert if fingerprint validation isn't possible

* Incorporate new section into the main security config page

* Clarify how cert is used

Co-authored-by: Ioannis Kakavas <ikakavas@protonmail.com>

* Split into two, separate sections

* Rename file and update text based on feedback

* Update ref to use new filename

* Remove extra word

Co-authored-by: Ioannis Kakavas <ikakavas@protonmail.com>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-12-15 14:08:20 -05:00
Adam Locke 7b47214e5e
[DOCS] Rework manual security docs for 8.0+ (#80285)
* [DOCS] Remove sentence about security being disabled by default

* Updating introduction

* Remove minimal security page

* Clarify configuring security before starting ES

* Clarifications

* Remove old file

* Add set passwords page

* Update change passwords page, clarify TLS adjustments, and other edits

* Update test

* Minor clarification to intro text

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-12-14 10:58:53 -05:00
Ignacio Vera 8c6ed1efc0
Remove experimental flag from geo field format mvt (#81721)
Small left over from 7.16 where mvt feature become GA
2021-12-14 15:21:05 +01:00
David Kyle d1ee756da8
[ML][DOCS] Add note about max values of thread settings (#81367) 2021-12-14 13:07:34 +00:00
David Roberts 0559dd087b
[ML] Model snapshot upgrade needs a stats endpoint (#81641)
Previously the ML model snapshot upgrade endpoint did not
provide a way to reliably monitor progress. This could lead
to the upgrade assistant UI thinking that a model snapshot
upgrade had finished when it actually hadn't.

This change adds a new "stats" API that allows external
interested parties to find out the status of each model
snapshot upgrade and which node (if any) each is running on.

Fixes #81519
2021-12-14 08:31:49 +00:00
Lisa Cawley 1751ced80a
[DOCS] Fix formatting in get anomaly job API (#81682) 2021-12-13 12:56:27 -08:00
eltomello 38a74a4545
[DOCS] Fix field name to match description (#81621) 2021-12-13 15:51:42 -05:00
David Turner 30bda56f9a
Readonly repos don't cache (#81674)
We say to mark repos as readonly to prevent corruption, but there's
other ways to prevent corruption that people sometimes use instead (e.g.
denying writes at the filesystem/bucket level). It's reasonable to think
that the readonly flag is redundant in that situation but it's not: they
should still mark the repo as readonly tho to bypass the cache and
re-read its contents on each access. This commit adds docs to that
effect.

Co-authored-by: James Rodewig <james.rodewig@elastic.co>
2021-12-13 18:36:26 +00:00
James Rodewig 6c8f0b170b
[DOCS] Fix ordered list formatting in data stream docs (#81667) 2021-12-13 12:53:48 -05:00
James Rodewig 5354e50316
[DOCS] Fix anchor for 'Shrink an index' section (#81665)
Reverts an anchor change from #46711.

Previous versions of the docs use the `_shrinking_an_index` anchor for this
section. Preserving that anchor will prevent doc build breaks in future releases.
2021-12-13 12:24:31 -05:00
Mary Gouseti 175c4793f9
Expose the index age in ILM explain output. (#81273)
* Expose the index age in ILM explain output.

 ILM already exposes the `age` that ILM will use to transition to the next phase, based on that phase's `min_age`. The `index_age` is based only on the index creation date and it's used to trigger a rollover.

 Resolves #64429
2021-12-13 15:38:25 +01:00
mushaoqiong d467aae67e
Force merge rest api support wait_for_completion (#80463)
Force merge action is a very costly action. It may take several hours to run for big indices. But current force merge rest api do not support wait_for_completion parameter.
This adds support for the wait_for_completion parameter.
2021-12-13 10:32:03 +00:00
James Rodewig cec4a79a8e [DOCS] Fix formatting typo 2021-12-09 15:46:44 -05:00
Przemyslaw Gomulka 09dc47f352
[DOCS] Add description of X-Opaque-ID and trace.id (#81433)
Documenting headers x-opaque-id and traceparent (emitted as trace.id)
and their usage in logs
2021-12-09 15:54:05 +01:00
James Rodewig 03afcf1a88
[DOCS] Clarify rolling upgrade support for minor versions (#81444)
We only support rolling upgrades between minor versions of the same
major.

It also adds some tags to reuse duplicated content.
2021-12-09 09:04:10 -05:00
Olivier Cavadenti 90e4e8ce63
Add index pressure stats in cluster stats (#80303)
`GET _nodes/stats` returns statistics about indexing pressure for each node.
With this commit `GET _cluster/stats` now returns stats about indexing pressure
computed by aggregating the indexing pressure stats of each node in the
cluster.

Closes #79788
2021-12-09 12:41:08 +00:00
David Turner 7d69f1a974
Oversharding is also indices and fields (#81511)
Today the _Size your shards_ docs focus on shard size and count, but in
fact index count and field count are also important. This commit expands
these docs a bit to cover this observation too.
2021-12-09 08:51:36 +00:00
David Turner 5b9ce9e820
Remove dead code from same-shard decider (#81520)
Today the same-shard allocation decider falls back to checking the
hostname if the node has no host address. In practice nodes will always
have an address so the fallback is dead code. This commit removes that
dead code.

Relates #80702 which will add the ability to distinguish nodes by
hostname regardless of whether they have an address or not, and #80767
which optimizes this area of code - this refactoring should make the
optimization simpler.
2021-12-09 08:42:25 +00:00
David Kyle 3c974a1e5d
[ML][DOCS] Remove orphaned GET deployment stats doc (#81505) 2021-12-09 08:32:33 +00:00
Julie Tibshirani 19eed47159
Improve kNN error message when index is disabled (#81561)
In order to perform a kNN search on a `dense_vector` field, it must have
`index: true` in its mapping. This commit clarifies the error message. Before
the message was confusing, because the user likely didn't touch the `index`
parameter and might not even be aware of it.

It adds a note to the docs clarifying that when coming from 7.x, you must
explicitly update `index: true` and reindex the vectors.

Relates to #78473.
2021-12-08 16:20:35 -08:00
Joe Gallo 27186ceda7
_tier_preference docs tweaks (#81453) 2021-12-08 10:34:30 -05:00
James Rodewig 1519bb6ecb
[DOCS] Update snapshot defaults for system indices (#81226)
Updates the snapshot and restore docs for https://github.com/elastic/elasticsearch/pull/79670.

Closes https://github.com/elastic/elasticsearch/issues/81183
2021-12-08 10:15:14 -05:00
Nhat Nguyen d0d91c690e
Handle partial search result with point in time (#81349)
Today, a search request with PIT would fail immediately if any 
associated indices or nodes are gone, which is inconsistent when
allow_partial_search_results is true.

Relates #81256
2021-12-08 10:04:38 -05:00
Leaf-Lin 9edfed81cb
[DOCS] Clarifying tiers order in rolling_upgrade (#79617)
* Update rolling_upgrade.asciidoc

adding node attributes comment in the upgrade order

* Update docs/reference/upgrade/rolling_upgrade.asciidoc

Co-authored-by: David Turner <david.turner@elastic.co>

* Update docs/reference/upgrade/rolling_upgrade.asciidoc

Co-authored-by: David Turner <david.turner@elastic.co>

* Apply suggestions from code review

adding retrieval of the tier list

* Update docs/reference/upgrade/rolling_upgrade.asciidoc

* format to 80 width wide

* Remove paragraph break

* Update rolling_upgrade.asciidoc

* Update rolling_upgrade.asciidoc

* Update docs/reference/upgrade/rolling_upgrade.asciidoc

Co-authored-by: David Turner <david.turner@elastic.co>

* Update docs/reference/upgrade/rolling_upgrade.asciidoc

Co-authored-by: David Turner <david.turner@elastic.co>

Co-authored-by: David Turner <david.turner@elastic.co>
2021-12-08 21:24:26 +11:00
Gordon Brown 50794a1b51
Mention dot-prefixed patterns in hidden index docs (#81464)
The hidden index docs did not mention that dot-prefixed patterns default
to matching hidden indices. This PR adds a note explaining the behavior
and why it's like that.
2021-12-07 19:02:01 -05:00
James Rodewig dd1ed30731
[DOCS] Fix `combined_fields` query ref in `multi_match` query docs (#81456)
The current `multi_match` docs contain an erroneous reference to the `combined_fields` query. This updates the reference to reference the correct query.

Relates to https://github.com/elastic/elasticsearch/pull/76893
2021-12-07 16:47:44 -05:00
Tanguy Leroux 061d38ca5a
Mention prefixes of mounted index in ILM Searchable Snapshot action (#81421)
The searchable snapshot action mounts snapshots as indices 
with a different prefix depending of the phase. This commit
tries to mention them in the docs.
2021-12-07 15:35:53 +01:00
Joe Gallo 0db66b87aa
_tier_preference docs changes for 8.0 (#81389) 2021-12-06 19:40:47 -05:00
David Turner 9955b49fab
Add explicit warning not to touch repository contents (#81295)
Manipulating the contents of a snapshot repository is a very bad idea,
but it turns out we don't call this out in the docs anywhere. This
commit adds a warning about this.
2021-12-06 13:22:01 +00:00
Lisa Cawley b18f5fd2c6
[DOCS] Fixes link to language identification example (#81347) 2021-12-03 17:21:04 -08:00
Salvatore Campagna 2b5ebba94a
[DOCS] Fix the weighed average documentation (#81307)
The documentations states that if the `weight` field is missing, and no
explicit missing configuration is provided, a default value of 1 is used.
This is incorrect and does not match the implementation of the weighted
average aggregator. In this specific case the document is skipped, instead.
2021-12-03 23:28:41 +01:00
Keith Massey 68a9eaa4dc
Adding discovery.zen.bwc_ping_timeout to the list of removed zen settings (#81310)
This commit adds the discovery.zen.bwc_ping_timeout setting our documentation about the
settings that have been removed in 8.0.
2021-12-03 16:16:48 -06:00
Lisa Cawley 429bdd9afc
[DOCS] Move trained model APIs out of dataframe analytics (#81315) 2021-12-03 09:21:09 -08:00
Lisa Cawley 4ed6e8ad3c
[DOCS] Adds missing timeout parameter to transform APIs (#81129) 2021-12-02 13:28:28 -08:00
James Rodewig cf818edcde
[DOCS] Fix syntax error in bulk `dynamic_templates` docs (#81264) 2021-12-02 14:05:21 -05:00
James Rodewig e999ad0061
[DOCS] Relocate 8.0 `repositories.fs.compress` breaking change (#81216)
The change removes a node-level setting. It was accidentally placed with REST API changes as part of https://github.com/elastic/elasticsearch/issues/79162. This moves the breaking change to the cluster and node setting changes section.
2021-12-01 09:53:10 -05:00
James Rodewig ca8c9be016
[DOCS] Remove source query params from update/delete by query APIs (#81131)
Removes source-related query parameters from the update by query
and delete by query API documentation. These parameters don't return
source fields as part of the response.
2021-12-01 09:06:12 -05:00
David Kyle aba14aacfa
[ML][DOCS] Add zero shot example and setting truncation at inference (#81003)
More examples for the _infer endpoint
2021-12-01 11:44:04 +00:00
Ignacio Vera 00aa197399
Fields API should return normalize geometries (#80649)
Fields API deliver now the normalize geometries instead of the plain geometries from source

Co-authored-by: James Rodewig <james.rodewig@elastic.co
2021-12-01 08:10:54 +01:00
James Rodewig 229d2d7a77
[DOCS] Add high-level guide for kNN search (#80857)
Adds a high-level guide for running an approximate or exact kNN search in Elasticsearch.

Relates to https://github.com/elastic/elasticsearch/issues/78473.
2021-11-30 14:17:39 -05:00
David Turner 7dd32fb027
Reduce verbosity-increase timeout to 3m (#81118)
Today we increase the verbosity of discovery failures after 5 minutes
without a master. Unfortunately 5 minutes is a common orchestration
timeout, so if discovery is broken then we see nodes being shut down
just before they start to emit useful logs. This commit reduces the
default timeout to 3 minutes to address that.
2021-11-30 09:52:39 +00:00
Martijn van Groningen e20fe6d639
Add replicated field to get data stream api response. (#80988)
Internally we already kept track of whether a data stream is replicated by CCR.
It is part of the `DataStream` class. This just adds it to the xcontent serialization
of the get data stream api response class.

Relates to elastic/kibana#118899
2021-11-30 09:30:05 +01:00
Ioannis Kakavas 537f371f34
URL option for BaseRunAsSuperuserCommand (#81025)
Add a --url option for elasticsearch-reset-password and
elasticsearch-create-enrollment-token CLI Tools ( and any tools
that would extend BaseRunAsSuperuserCommand ).
The tools use CommandLineHttpClient internally, which tries its
best to deduce the URL of the local node based on the configuration
but there are certain cases where it either fails or returns an
unwanted result. Concretely:

- CommandLineHttpClient#getDefaultURL will always return a URL with
the port set to 9200, unless otherwise explicitly set in the
configuration. When running multiple nodes on the same host,
subsequent nodes get sequential port numbers after 9200 by default
and this means that the CLI tool will always connect the first of
n nodes in a given host. Since these tools depend on a file realm
local user, requests to other nodes would fail
- When an ES node binds and listens to many addresses, there can
be the case that not all of the IP addresses are added as SANs in
the certificate that is used for TLS on the HTTP layer.
CommandLineHttpClient#getDefaultURL will pick an address based on
a preference order but that address might not be in the SANs and
thus all requests to the node would fail due to failed hostname
verification.

Manually setting `--url` to an appropriate value allows users to
overcome these edge cases.
2021-11-29 23:49:27 +02:00
David Turner ca65718923
Clarify `unassigned.reason` docs (#81017)
Today we indicate that the `unassigned.reason` field in various APIs
indicates the reason why a shard is unassigned. This isn't really true,
it tells you some information about the event that caused the shard to
_become_ unassigned (or which most recently changed its routing table
entry while remaining unassigned) but tells you almost nothing about why
the shard _is now_ unassigned and how to fix it. That's what the
allocation explain API is for. This commit clarifies this point in the
docs.

Closes #80892

Co-authored-by: James Rodewig <james.rodewig@elastic.co>
2021-11-29 18:47:01 +00:00
James Rodewig 4d19702221
[DOCS] Update xrefs for snapshot restore docs (#81023)
Changes:

* Removes a leading slash from the restore snapshot API's prerequisites.
* Updates several xrefs that point to redirected pages.
2021-11-29 11:52:02 -05:00
David Turner 54e0370b3e
Track histogram of transport handling times (#80581)
Adds to the transport node stats a record of the distribution of the
times for which a transport thread was handling a message, represented
as a histogram.

Closes #80428
2021-11-29 15:41:33 +00:00
Lisa Cawley e5de9d8ad7
[DOCS] Add actual and typical values in ML alerting docs (#80571) 2021-11-25 10:06:52 -08:00
Lisa Cawley 8da1236bca
[DOCS] Clarify impact of force stop trained model deployment (#81026) 2021-11-25 09:08:46 -08:00