Commit Graph

9089 Commits

Author SHA1 Message Date
James Rodewig 0c01bcdd9f
[DOCS] Remove index API's `types` option (#78335)
Adds an 8.0 breaking change for PR #47203.
2021-09-28 08:44:25 -04:00
James Rodewig 1764fa0e8f
[DOCS] Remove `type` query (#78334)
Adds an 8.0 breaking change for PR #47207.
2021-09-28 08:44:06 -04:00
Benjamin Trent 00defa38a9
[ML] adding some initial document for our pytorch NLP model support (#78270)
Adding docs for:

put vocab
put model definition part
start deployment
all the new NLP configuration objects for trained model configurations
2021-09-27 12:46:13 -04:00
David Turner 4782cf4d91
Add docs for pre-release version compatibility (#78317)
The reference manual includes docs on version compatibility in various
places, but it's not clear that these docs only apply to released
versions and that the rules for pre-release versions are stricter than
folks expect. This commit adds some words to the docs for unreleased
versions which explains this subtlety.
2021-09-27 16:56:35 +01:00
Przemyslaw Gomulka 8c0d7fa2fa
[doc] Improve documentation for deprecation logging (#78326)
adding a section on WARN messages

relates #77030
2021-09-27 16:56:26 +02:00
James Rodewig b20939f071
[DOCS] Document empty first line support for msearch API (#78284)
Adds an 8.0 breaking change for PR #41011
2021-09-27 08:58:22 -04:00
Lukas Wegmann 421b3e80de
Document missing_order param for composite aggregations (#77839)
Documents the missing_order parameter for composite aggregations introduced in #76740
2021-09-27 09:57:45 +02:00
James Rodewig 38125c147d
[DOCS] Remove `gateway.auto_import_dangling_indices` setting (#78280)
Adds an 8.0 breaking change for PR #59698.
2021-09-26 19:24:01 -04:00
James Rodewig 181aebd1dc
[DOCS] Watcher history now writes to a data stream (#78277)
Adds an 8.0 breaking change for PR #64252.
2021-09-23 16:07:01 -04:00
James Rodewig 96c4bd96a9
[DOCS] Remove support for `unmapped_type:string` sort (#78272)
* [DOCS] Remove support for `unmapped_type:string` sort

Adds an 8.0 breaking change for PR #45675.

* Clarify error

* Reset mapping changes
2021-09-23 13:37:46 -04:00
James Rodewig b3cdf60ab3
Adding priority list and executing description to the pending tasks doc (#74456) (#78259)
* Adding priority to the pending tasks doc

https://github.com/elastic/elasticsearch/pull/19448#discussion_r70969307
917fea7c5d/core/src/main/java/org/elasticsearch/common/Priority.java (L29)

* Adding executing into the cluster pending tasks

* Update docs/reference/cluster/pending.asciidoc

Co-authored-by: Henning Andersen <33268011+henningandersen@users.noreply.github.com>

Co-authored-by: Henning Andersen <33268011+henningandersen@users.noreply.github.com>

Co-authored-by: Leaf-Lin <39002973+Leaf-Lin@users.noreply.github.com>
Co-authored-by: Henning Andersen <33268011+henningandersen@users.noreply.github.com>
2021-09-23 11:17:18 -04:00
István Zoltán Szabó 1d367abffc
[DOCS] Modifies aggregations title abbreviation to follow convention. (#78252) 2021-09-23 16:22:27 +02:00
James Rodewig ce4b95e5b0
[DOCS] Document `time_series_metric` mapping parameter (#78013)
Changes:
* Documents the `time_series_metric` mapping parameter for PR #76766.
* Renames the `dimension` parameter to `time_series_dimension` for PR #78012.
* Adds support for `unsigned_long` to `time_series_dimension` for PR #78204.
2021-09-23 08:54:19 -04:00
Ignacio Vera 9033faffff
Add cross cluster search test for mvt end point (#78054)
This commit adds a test to check that it is supported and document it.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-09-23 07:59:44 +02:00
Tim Vernum 6125067145
Add 'show' command to the keystore CLI (#76693)
This adds a new "elasticsearch-keystore show" command that displays
the value of a single secure setting from the keystore.

An optional `-o` (or `--output`) parameter can be used to direct
output to a file.

The `-o` option is required for binary keystore values
because the CLI `Terminal` class does not support writing binary data.
Hence this command:

    elasticsearch-keystore show xpack.watcher.encryption_key > watcher.key

would not produce a file with the correct contents.

Co-authored-by: Ioannis Kakavas <ikakavas@protonmail.com>
2021-09-23 12:37:20 +10:00
James Rodewig 80ba92f1b1
[DOCS] Add breaking change for unsupported `script` fields (#78217)
Adds an 8.0 breaking change for PR #59507.
2021-09-22 17:41:06 -04:00
Adam Locke 6940673e8a
[DOCS] Update remote cluster docs (#77043)
* [DOCS] Update remote cluster docs

* Add files, rename files, write new stuff

* Plethora of changes

* Add test and update snippets

* Redirects, moved files, and test updates

* Moved file to x-pack for tests

* Remove older CCS page and add redirects

* Cleanup, link updates, and some rewrites

* Update image

* Incorporating user feedback and rewriting much of the remote clusters page

* More changes from review feedback

* Numerous updates, including request examples for CCS and Kibana

* More changes from review feedback

* Minor clarifications on security for remote clusters

* Incorporate review feedback

Co-authored-by: Yang Wang <ywangd@gmail.com>

* Some review feedback and some editorial changes

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: Yang Wang <ywangd@gmail.com>
2021-09-22 16:02:33 -04:00
James Rodewig 15baf4017a
[DOCS] Remove `_term` and `_time` agg order keys (#78209)
Adds an 8.0 breaking change for the removal of the `_term` and `_time`
agg `order` keys.

Relates to #39450
2021-09-22 15:54:14 -04:00
James Rodewig ce56c19346
[DOCS] Remove support for EOL OSs and `SysV init` (#78199)
Adds an 8.0 breaking change for the removal of support for several EOL operating
systems and `SysV init`.

Relates to #51480 and #51716
2021-09-22 13:41:52 -04:00
James Rodewig 2b2f0e1d7f
[DOCS] Remove the `listener` thread pool (#78194)
Changes:
* Removes docs for the `listener` thread pool
* Adds an 8.0 breaking change for the thread pool removal

Relates to #53314 and #53049
2021-09-22 13:41:05 -04:00
Ryan Ernst a06aff9b01
Revert "Fail index creation using custom data path (#76792)" (#78031)
This reverts commit 79d91ed9d3.
2021-09-22 09:02:56 -07:00
Adam Locke 7d61b0261c
[DOCS] Add composite runtime fields (#78050)
* [DOCS] Add composite runtime fields

* Update snippets and tests

* Add note that composite runtime fields cannot be indexed yet
2021-09-22 07:56:50 -04:00
Ignacio Vera 75b7b0db03
Add track_total_hits support in mvt API (#78074)
This allows consumers of the API to be able to know exactly if all the features in a tile has been considered 
when building the hits layer of a vector tile

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-09-22 08:37:50 +02:00
James Rodewig db1aac1d8b [DOCS] Edit dedicated hosts section heading 2021-09-21 17:53:07 -04:00
Stef Nestor e1062803bb
[DOCS] Use dedicated hosts for ES (#77582)
In production, we recommend you run {es} on a dedicated host or as a primary service.
This adds that best practice to our setup documentation.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-09-21 17:50:21 -04:00
Tim Vernum ea0dc45146
Remove HTTPS check for API Keys & Service Accounts (#76801)
This commit removes the checks that prevented the use of API Keys and
Service Account (Service Tokens) on nodes without HTTPS
(xpack.security.http.ssl.enabled)

As a consequence of removing this check, the API Key service is now
automatically enabled, but can be explicitly disabled with

     xpack.security.authc.api_key.enabled: false
2021-09-22 07:32:03 +10:00
James Rodewig 36372b9743
[DOCS] Remove unneeded anchor from restore snapshot docs (#78041)
This anchor was added to fix a broken docs build. With
https://github.com/elastic/kibana/pull/112597 merged, this fix is no longer
needed.
2021-09-21 12:10:27 -04:00
James Rodewig a321313778
[DOCS] Note exclusive force merge API options (#78006)
You can't specify `max_num_segments` and `max_num_segments` in the same request.

Relates to PR #44761.
2021-09-21 09:20:50 -04:00
James Rodewig 49444ccd10
[DOCS] Add breaking change for ECS user agent (#77971)
In 8.x, we'll ignore the `ecs` option for the `user_agent` ingest processor.
This adds a related breaking change to the 8.0 migration docs.

Relates to #38828
2021-09-21 09:19:44 -04:00
Ignacio Vera 2c98de99f6
Add documentation for _index property in mvt response (#78019)
Document that we are including a _index property for each hit in _mvt response.
2021-09-21 07:13:09 +02:00
James Rodewig 91fabb3b72 [DOCS] Add anchor to fix broken docs build 2021-09-20 14:01:47 -04:00
James Rodewig 2fc3d40a13
[DOCS] Convert 'Restore a snapshot' to tutorial (#76929)
Updates the 'Restore a snapshot' guide to be more tutorial-focused.
Adds a tutorial for restoring an entire cluster.

Closes #72497.
2021-09-20 13:17:24 -04:00
James Rodewig f3f11ab365
[DOCS] Add breaking change for `moving_avg` (#78018)
Documents the removal of the `moving_avg` aggregation in the 8.0 breaking changes.

Relates to #29594.
2021-09-20 13:16:11 -04:00
edh-oss 62a471aefe
Update JSON parser and snippets (#77983)
Related to issue  #77823

This does the following:

- Updates several asciidoc files that contained code snippets with
  invalid JSON, most involving unnecessary trailing commas.

- Makes the switch from the Groovy JSON parser to the Jackson parser,
  pursuant to the general goal of eliminating Groovy dependence.

- Makes testing of JSON validity at build time more strict.

Note that this update still allows backslash escaping for any
character. Currently that matters because of the file
"docs/reference/ml/anomaly-detection/apis/get-datafeed-stats.asciidoc",
specifically this part:

    "attributes" : {
      "ml.machine_memory" :
        "$body.datafeeds.0.node.attributes.ml\.machine_memory",
      "ml.max_open_jobs" : "512"
    }

It's not clear to me what change, if any, is appropriate there. So,
I've left in the escaped period and configured the parser to ignore
it for the time being.
2021-09-20 11:08:26 +01:00
AndyHunt66 a5030ef407
[DOCS] Fix typo for `script.painless.regex.enabled` setting value (#77853)
The value is `limited`, not `limit`.
2021-09-16 13:59:58 -04:00
James Rodewig 5ccb1b4c62
[DOCS] Fix ESS install lead-in (#77887)
Replaces the hard-coded ESS lead-in with the docs attribute.

Previously, this copy omitted Microsoft Azure. This ensures these docs are better maintained.
2021-09-16 12:04:04 -04:00
Jake Landis ea74d34b7e
8.0.0-alpha2 release notes (#77821)
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-09-15 19:40:46 -05:00
James Rodewig 3a23dd919c
[DOCS] Fix deprecation version for cluster recovery breaking change (#77787) 2021-09-15 10:35:26 -04:00
James Rodewig f57695ad15
[DOCS] Add placeholder for 8.0.0-alpha2 release notes (#77782) 2021-09-15 10:13:13 -04:00
Armin Braun 2544d913cf
Implement from_sort_value Parameter in Get Snapshots API (#77618)
Add `from_sort_value` parameter to allow for filtering snapshots by comparing to concrete sort column
values similar to the existing after parameter`.
2021-09-15 13:37:22 +02:00
David Turner f2a5706d22
Add docs on searchable snaps costs (#77607)
* Add docs on searchable snaps costs

Adds a note on why searchable snapshots is cheaper, including warnings
that it might be more expensive too.

* Split into sections

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

* data -> the shard contents

* More wording tweaks

* Apply suggestions from code review

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-09-15 03:27:52 -04:00
James Rodewig 201a328d0c
[DOCS] Remove shrink snippet from 'Size your shards' (#77593)
The current shrink API snippet doesn't show you how to remove replicas or reduce primary shards.

Rather than duplicate those instructions from the shrink API docs, this removes the snippet. A link to the shrink API and shrink ILM action docs is already provided.

It also updates a delete index API snippet to avoid wildcards. Wildcard expansion for the delete index API is disabled by default in 8.0.
2021-09-14 08:59:41 -04:00
Jim Ferenczi aacd761838
Honour max segment size when setting only_expunge_deletes on force merge (#77478)
This commit changes the es merge policy to apply the maximum segment size
on force merges that only expunge deletes (forceMergeDeletes).
This option is useful for read-write use cases that wants to reclaim deleted docs
more aggressively than the `index.merge.policy.deletes_pct_allowed`.

Closes #61764
Relates #77270
2021-09-14 14:31:13 +02:00
István Zoltán Szabó db239e2b50
[DOCS] Adds update datafeeds API changes to the migration guide. (#77689) 2021-09-14 13:55:42 +02:00
James Rodewig 88fcb67839
[DOCS] Update ES intro for stretched clusters (#77651)
PR #77360 clarifies that a cluster's nodes don't need to be in the same data
center. This adds a similar clarification to the ES introduction docs.

Co-authored-by: David Turner <david.turner@elastic.co>
2021-09-13 16:50:08 -04:00
Nik Everett ed522ba26b
Disable bwc tests before backporting #77633 (#77639)
We make wire changes in #77633 so we need to disable the backwards
compatibility tests in master before merging the wire changes. We'll
re-enable them after the backport is merged.
2021-09-13 14:58:27 -04:00
David Turner c1a199ffda
Fix URL repo docs for searchable snapshots (#77624)
Today we document that you can use URL repositories with searchable
snapshots, but in fact it only works for HTTP(S) repositories. This
commit adjusts the docs to clarify.

Relates #69521
2021-09-13 15:53:51 +01:00
Nik Everett c2c0165fd2
Profile the fetch phase (#77064)
This adds profiling to the fetch phase so we can tell when fetching is
slower than we'd like and we can tell which portion of the fetch is
slow. The output includes which stored fields were loaded, how long it
took to load stored fields, which fetch sub-phases were run, and how
long those fetch sub-phases took.

Closes #75892

* Skip bwc

* Don't compare fetch profiles

* Use passed one

* no npe

* Do last rename

* Move method down

* serialization tests

* Fix sneaky serialization

* Test for sneaky bug

* license header

* Document

* Fix test

* newline

* Restore assertion

* unit test merging

* Handle inner hits

* Fixup

* Revert unneeded

* Revert inner hits profiling

* Fix names

* Fixup names

* Move results building

* Drop loaded_nested

* Checkstyle

* Fixup more

* Finish writeable cleanup

Add unit tests for merge

* Remove null checking builder

* Fix wire mistake

How did this pass before?!

* Rename

* Remove funny builder

* Remove name munging
2021-09-13 10:00:36 -04:00
James Rodewig 3f71a979c1
[DOCS] Fix impact sentences for removed system properties (#77601)
Several sentences in the 8.0 breaking changes reference setting
system properties in `elasticsearch.yml`, which is not supported. This corrects
those sentences.

It also fixes a sentence that references the `http.content_type.required`
setting as a system property.
2021-09-13 09:06:59 -04:00
Johan Nilsson Hansen 553e8dcb07
Create a sha-256 hash of the shard request cache key (#74877)
We currently use the plaintext body of a shard request as the key to the 
request cache.  This has the disadvantage that very large requests can
quickly fill up the cache due to the size of their keys.  With this commit, 
we instead use a sha-256 hash of the shard request as the cache key, 
which will use a constant (and much smaller) number of bytes.
2021-09-13 08:55:59 +01:00