Commit Graph

9319 Commits

Author SHA1 Message Date
James Rodewig 2a30dfe4d2
[DOCS] Fix `type` response values for index recovery API (#81000)
We updated the `type` response values in https://github.com/elastic/elasticsearch/pull/19516. This updates the docs with the correct values.

Closes https://github.com/elastic/elasticsearch/issues/80264

Co-authored-by: David Turner <david.turner@elastic.co>
2021-11-24 14:34:25 -05:00
Lisa Cawley d1af86cfdd
[DOCS] Fixes start and stop trained model deployment APIs (#80978) 2021-11-24 10:09:45 -08:00
Colin Ng dd2424b79c
Fix typo (#80925) 2021-11-23 16:28:53 -05:00
James Rodewig cbcd901096
[DOCS] Relocate `index.mapping.dimension_fields.limit` setting docs (#80964)
Moves `index.mapping.dimension_fields.limit` so that its co-located with
other mapping limit settings.
2021-11-23 14:51:28 -05:00
Adam Locke b9ae8fdb13
[DOCS] Fix elasticsearch-reset-password typo (#80919) 2021-11-23 07:42:56 -05:00
Lisa Cawley 38cbd116c9
[DOCS] Fixes query parameters for get buckets API (#80643) 2021-11-22 11:34:43 -08:00
James Rodewig cf30b54a58
[DOCS] Fix typo in gap_policy's default value for serial differencing aggregation (#80893) (#80912)
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Simon Stücher <stchr@users.noreply.github.com>
2021-11-22 13:43:16 -05:00
Lisa Cawley f3a69ae4b1
[DOCS] Adds missing query parameters to ML APIs (#80863) 2021-11-22 09:25:01 -08:00
Adam Locke 2d83013fe8
[DOCS] Update Docker commands with variables (#80885)
* [DOCS' Update Docker commands with variables

* Modify "VERSION" to lowercase

Co-authored-by: James Rodewig <james.rodewig@elastic.co>

* Remove errant + icons

Co-authored-by: James Rodewig <james.rodewig@elastic.co>
2021-11-19 16:16:09 -05:00
James Rodewig 58f32b361f
[DOCS] Update 8.0 breaking change for searchable snapshot shared cache (#80793)
You can no longer configure `xpack.searchable.snapshot.shared_cache.size` as a user setting in ESS on 7.13+ deployments. This PR removes the ESS icon from the related 8.0 breaking change for the setting.

It also clarifies the breaking change text to indicate that configuring the setting on non-frozen nodes will result in an error on startup.

Relates to https://github.com/elastic/elasticsearch/pull/80795
2021-11-19 11:25:55 -05:00
Artem Prigoda f6caaee7b1
[DOCS] Remove deprecation of 408 status code on `_cluster/health` from 8.0.0 release notes (#80852)
It was reverted in #80821
2021-11-19 11:02:11 +01:00
Artem Prigoda 89bbac9216
Revert "Return 200 OK response code for a cluster health timeout (#78968)" (#80821)
* Revert "Return 200 OK response code for a cluster health timeout (#78968)"

This reverts commit a2c3daea

* Revert "Allow deprecation warning for the return_200_for_cluster_health_timeout parameter (#80178)"

This reverts commit 1c711e35fc.

* Revert "Drop pre-7.2.0 wire format in ClusterHealthRequest (#79551)"

This reverts commit b9fbe66ab0.

* Revert "Adjust the BWC version for the return200ForClusterHealthTimeout field (#79436)"

This reverts commit f60bda5685.

* Revert "Use query param instead of a system property for opting in for new cluster health response code (#79351)"

This reverts commit 8901a999

* Revert "Deprecate returning 408 for a server timeout on `_cluster/health` (#78180)"

This reverts commit f266eb32

* Drop pre-7.2.0 wire format in ClusterHealthRequest (#79551)

This reverts commit fa4d562c

* Revert "Disable BWC for #80821 (#80839)"

This reverts commit cb0e73e2fc.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-11-18 19:55:16 +01:00
William Brafford 47c2cfa6ee
Add known issues for remaining system indices work (#80373)
* Add known issues for remaining system indices work

Co-authored-by: Adam Locke <adam.locke@elastic.co>
Co-authored-by: Fabio Busatto <52658645+bytebilly@users.noreply.github.com>
2021-11-18 12:59:09 -05:00
Lisa Cawley fffac5bd08
[DOCS] Adds missing query parameters in get influencer and get snapshot APIs (#80801) 2021-11-18 08:24:24 -08:00
Adam Locke 247d124666
[DOCS] Update ES quick start for security ON by default (#80735)
* [DOCS] Update ES quick start for security ON by default

* Remove code.asciidoc, which is part of the overall doc build now

* Update node names for cleanup

* Add note with links to tools

* Add --net elastic network

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-11-17 17:48:07 -05:00
Adam Locke a72a26696c
[DOCS] Update Windows .zip install instructions for security ON by default (#80552)
* [DOCS] Update Windows .zip install instructions for security ON by default

* Rework instructions for running as a service on Windows

* Update wording and add variable for back/forward slashes

* Relocating enroll nodes steps and introducing variables

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-11-17 17:35:09 -05:00
Lisa Cawley d6f48dc5bd
[DOCS] Add query parameters to update datafeed API (#80777) 2021-11-17 07:40:31 -08:00
James Rodewig 2c8840ee95
[DOCS] Fix subject-verb agreement typo (#80774) (#80783)
Co-authored-by: Chris Keele <christopher.l.keele@gmail.com>
2021-11-16 18:35:35 -05:00
James Rodewig 2f4143267e
[DOCS] Un-deprecate transient cluster settings (#80766) (#80780)
#80556 reverted the deprecation of transient cluster settings. This replaces deprecation language in the docs with a warning/recommendation to avoid transient settings.

Closes #80557
# Conflicts:
#	docs/reference/migration/migrate_7_16.asciidoc
2021-11-16 16:00:13 -05:00
James Rodewig a48060313a
[DOCS] Remove soft limit for snapshot repositories (#80745)
As part of #74350, snapshot repositories no longer have a 200 snapshot soft limit. This removes docs related to the limit.
2021-11-16 12:24:18 -05:00
Jan Doberstein 73b3d8f639
Update execute-enrich-policy.asciidoc (#80750)
Changed the wording, as the execution of the policy does not trigger the delete. That delete is done periodical and can be configured with the `enrich.cleanup_period` 

https://www.elastic.co/guide/en/elasticsearch/reference/7.16/enrich-setup.html#ingest-enrich-settings
2021-11-16 11:57:04 +01:00
James Rodewig 5061c460e6
[DOCS] Remove unneeded breaking changes files (#80729)
Removes some unneeded files related to the previous organization of breaking changes.

Relates to #79162 and https://github.com/elastic/stack-docs/pull/1877
2021-11-15 17:24:58 -05:00
James Rodewig 659e0d3fd3
[DOCS] Overhaul snapshot and restore docs (#79081)
Makes several changes to consolidate snapshot and backup-related docs.

Highlights:

* Adds info about supported ESS snapshot repository types
* Adds docs for Kibana's Snapshot and Restore feature
* Combines tutorial pages related to taking and managing snapshots
* Consolidates explanations of the snapshot process
* Incorporates SLM into the snapshot tutorial
* Removes duplicate "back up a cluster" pages
2021-11-15 12:45:07 -05:00
James Rodewig 987010db47
[DOCS] Fix 8.0 breaking change tags (#80725)
Includes command line tool deprecations in the notable changes tag.
2021-11-15 12:00:35 -05:00
James Rodewig 767a23727e
[DOCS] Organize breaking changes by component (#79162)
* Reorganizes the 8.0.0 and 8.1.0 breaking changes and deprecations into component-based categories.
* Adds an ESS icon to cluster settings on the ESS user settings allowlist.
* Adds tips for sections that aren't relevant to Cloud users.
* Updates the labels for some items to provide better context.

Co-authored-by: debadair <debadair@elastic.co>
2021-11-15 10:42:12 -05:00
James Rodewig 63d0d66a07
[DOCS] Remove `timeout` and `master_timeout` parameters from request body (#80708) (#80709)
The put repository API doesn't accept these parameters in the request body.

Co-authored-by: Ivonne Botello <87008515+ibotello@users.noreply.github.com>
2021-11-15 09:02:27 -05:00
David Turner 57dbefe4fb
Set LIBFFI_TMPDIR at startup (#80651)
Today if `libffi` cannot allocate pages of memory which are both
writeable and executable then it will attempt to write code to a
temporary file. Elasticsearch configures itself a suitable temporary
directory for use by JNA but by default `libffi` won't find this
directory and will try various other places. In certain configurations,
none of the other places that `libffi` tries are suitable. With older
versions of JNA this would result in a `SIGSEGV`; since #80617 the JVM
will exit with an exception.

With this commit we use the `LIBFFI_TMPDIR` environment variable to
configure `libffi` to use the same directory as JNA for its temporary
files if they are needed.

Closes #18272
Closes #73309
Closes #74545
Closes #77014
Closes #77053
Relates #77285

Co-authored-by: Rory Hunter <roryhunter2@gmail.com>
2021-11-15 08:18:58 +00:00
Yannick Welsch 064936e790
Add field usage support for vectors (#80608)
Add field usage tracking support for the new vectors functionality.
2021-11-15 08:44:02 +01:00
Dimitris Athanasiou c7f745b40a
[ML] Force delete trained models (#80595)
Adds a `force` parameter to the delete trained models API
which when set to `true` allows deletion of a model that
is referenced by ingest pipelines or has a started deployment.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-11-11 10:54:01 +02:00
Stef Nestor a8ae234dbe
[+Doc] Performance Tune ILM ForceMerge (#80448)
* [+Doc] Performance Tune ILM ForceMerge
Co-authored-by: Deb Adair <debadair@elastic.co>
2021-11-10 08:48:07 -07:00
Stef Nestor bc7c82c6b2
[+DOC] Tasks' Queue backup (#80447)
* Add Tasks queue backup troubleshooting
Co-authored-by: Deb Adair <debadair@elastic.co>
2021-11-10 08:47:16 -07:00
Benjamin Trent 5627dc66e1
[ML] deprecate estimated_heap_memory_usage_bytes and replace with model_size_bytes (#80554)
This deprecates estimated_heap_memory_usage_bytes on model put and replaces it with model_size_bytes.

On GET, only model_size_bytes is returned unless v7 rest-api compatibility is requested.

For the ml/info API, only model_size_bytes is returned

A forward-port of: #80545
2021-11-10 10:23:25 -05:00
Dan Hermann 1a0ae11f0d
[DOCS] Data stream modification API (#80094) 2021-11-10 08:37:12 -06:00
Dan Hermann 0d21b032b6
[DOCS] Custom routing for data streams 2021-11-10 07:11:50 -06:00
happybin92 0aa9767f3d
Support combining _shards preference param with <custom-string> (#80024)
Adds support for combining the _shards search preference parameter with the <custom-string> search preference parameter.

Closes #80021
2021-11-10 14:08:27 +01:00
Rory Hunter ba87234f51
Use almalinux as the Docker base image (#80524)
Closes #76681. Our approach to using `scratch` for building Docker
images has caused problems at Docker Hub. Fix this situation by
removing the whole process of using scratch and instead bases the
default distribution on `almalinux:8.4-minimal`. Alma Linux is
binary-compatible with RHEL, and therefore very similar to UBI.
2021-11-10 13:04:56 +00:00
David Turner f9afa8750f
Fix up docs for #78876 (#80580)
Follow-up to #78876 to rework the deprecation docs slightly.
2021-11-10 10:23:01 +00:00
David Roberts a61088063e
[ML] use_auto_machine_memory_percent now defaults max_model_memory_limit (#80532)
If the xpack.ml.use_auto_machine_memory_percent setting is true,
and xpack.ml.max_model_memory_limit is not set then
xpack.ml.max_model_memory_limit is now considered to be set to
the largest size that could be assigned in the cluster.

This functionality will be crucial for Cloud once the Elasticsearch
startup code is setting the Elasticsearch JVM heap size. Then the
Cloud code will no longer be able to accurately set
xpack.ml.max_model_memory_limit, so will not set it at all.
Instead the Cloud code will just set
xpack.ml.use_auto_machine_memory_percent and the ML code will
calculate the appropriate maximum model_memory_limit that should
be permitted.
2021-11-10 08:38:02 +00:00
Lisa Cawley 6ecc495d15
[DOCS] Clarify parameters in delete expired data, forecast, and flush job APIs (#80517) 2021-11-09 14:57:35 -08:00
Lisa Cawley 1c98a23ca8
[DOCS] Edits stop and start datafeed APIs (#80461) 2021-11-09 14:39:13 -08:00
Nikola Grcevski 3308dd5c00
Undo transient settings deprecation (#80558)
This change removes the deprecation warning when calling
the cluster settings APIs with transient settings.

Relates to #80556
2021-11-09 17:07:55 -05:00
Benjamin Trent cf5f521fac
[ML] add deployment_stats to trained model stats (#80531)
This commit adds a new field deployment_stats that is optionally set for models that are deployed.

If a model does not have a deployment, it will be null.

Also, removes the get deployment stats API and makes the deployment stats action internal only.
2021-11-09 16:09:47 -05:00
Julie Tibshirani 8ca693b271
Add docs for kNN search endpoint (#80378)
This commit adds docs for the new `_knn_search` endpoint.

It focuses on being an API reference and is light on details in terms of how
exactly the kNN search works, and how the endpoint contrasts with
`script_score` queries. We plan to add a high-level guide on kNN search that
will explain this in depth.

Relates to #78473.
2021-11-09 09:28:12 -08:00
Julie Tibshirani 44198c6f34
Check nested fields earlier in kNN search (#80516)
Currently, we don't support kNN search against fields in a `nested` mapping.
Before, we were checking this at search-time. This commit moves it earlier, so
you aren't even allowed to set `index: true` if the vector is in a nested
mapping. That way, users are aware of the limitation before they start to index
documents.

Relates to #78473.
2021-11-09 09:06:53 -08:00
Benjamin Trent c3c3f88000
[ML] validate model definition on start deployment (#80439)
When a deployment is started, we do not validate that the definition
documents are all present and not truncated. This commit adds a
validation on _start that prevents a bad state from occurring where the
deployment starts, but the model is incorrectly defined, or some unknown
error occurs to late in the deployment process.
2021-11-09 10:33:55 -05:00
Adam Locke 7b1bd8cf4b
[8.x] [DOCS] Remove coming tag from 8.0.0-beta1 release notes (#80192)
DO NOT MERGE UNTIL RELEASE DAY
2021-11-09 10:14:04 -05:00
Jake Landis 7ff1b6d848
Update release notes for BC2 of 8.0.0-beta1 (#80519)
* updates for BC2

* Apply suggestions from code review

Co-authored-by: Adam Locke <adam.locke@elastic.co>
2021-11-09 08:27:49 -05:00
Artem Prigoda 27fd66d084
Deprecate lenient parsing of bulk actions (#78876)
Make sure there are no arbitrary fields after an action declaration and that it gets properly closed by a curly bracket.

Resolves #43774
2021-11-09 13:09:19 +01:00
Przemysław Witek 9b058da548
[Transform] Transform Reset API (#79828) 2021-11-09 10:21:57 +01:00
David Turner 8cf4c7b6fb
Remove last few mentions of Zen discovery (#80410)
We have a few leftover mentions of `zen` discovery, mostly for
historical/BwC reasons, which this commit removes.

Prior to this commit the default value for `discovery.type` was `zen`
but this was not written down anywhere or officially supported: the two
options were to set it to `single-node` or to omit it entirely. This
commit changes the default to `multi-node` and documents this.

Co-authored-by: Adam Locke <adam.locke@elastic.co>
2021-11-09 09:52:06 +01:00