Commit Graph

618 Commits

Author SHA1 Message Date
Francisco Fernández Castaño 2c132fe5f7
Keep track of data recovered from snapshots in RecoveryState (#76499)
Adds new field to recovery API to keep track of amount of data
recovered from snapshots.

The normal recovered_bytes field remains and is also increased for
recovery from snapshot but can go backwards in the unlikely case
that recovery from snapshot fails to download a file.

Relates #73496
2021-08-16 18:18:37 +02:00
James Rodewig fc0ac1923d
[DOCS] Correct spelling for geo terms (#76028)
Changes:
* Use "geopoint" when not referring to the literal field type
* Use "geoshape" when not referring to the literal field type or query type
* Use "GeoJSON" consistently
2021-08-03 09:55:48 -04:00
Adrien Grand d15445e0f3
Remove usage of RAM accounting of segments (#75674)
This is a pre-requisite for the upgrade to Lucene 9, which removes the ability to estimate RAM usage of segments.
2021-07-29 08:36:09 +02:00
James Rodewig 6078349106
[DOCS] Update index template API docs for data stream aliases (#75688)
With #73867, you can use component and index templates to add data stream
aliases.
2021-07-26 14:42:54 -04:00
Martijn van Groningen 3dde09a7b4
Add filter support to data stream aliases (#74784)
This allows specifying a query as filter on data stream alias,
which will then always be applied when searching via this alias.

Relates #66163
2021-07-20 11:21:27 +02:00
Yannick Welsch db814f403b
Track Lucene field usage (#74227)
Adds a field usage API that reports shard-level statistics about which Lucene fields have been accessed, and which
parts of the Lucene data structures have been accessed.

Field usage statistics are automatically captured when queries are runnning on a cluster. A shard-level search request
that accesses a given field, even if multiple times during that request, is counted as a single use.
2021-07-14 13:21:11 +02:00
Liam MacPherson ba227f99f0
[DOCS] Fix <index> param def for delete index API (#74674)
Clarifies that you cannot specify an alias in the delete index API. You _can_ delete indices with an alias.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-07-01 10:07:14 -04:00
Nhat Nguyen c23cb99b71
Add index disk usage API (#74051)
This change adds a new API that supports analyzing the disk usage of 
each field of an index.
2021-06-30 11:50:01 -04:00
James Rodewig ed1999e935
[DOCS] Update wildcard support for removing aliases (#74561)
You can now use a wildcard pattern to remove data stream and index
aliases in the same action/request.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-06-28 08:53:45 -04:00
James Rodewig 2fe07014d9
[DOCS] Move ES glossary to Stack docs (#74579)
The ES glossary is now incorporated into the [Elastic glossary](https://www.elastic.co/guide/en/elastic-stack-glossary/current/terms.html).

Depends on https://github.com/elastic/stack-docs/pull/1722 and https://github.com/elastic/docs/pull/2141
2021-06-24 19:04:31 -04:00
Robin Clarke 7aaf209e47
[DOCS] Fix capitalization (#74470) 2021-06-23 12:02:57 -04:00
David Turner 8055f680d5
Fix clone API settings docs bug (#74175)
In #74138 we noted that index settings aren't copied in a clone. In fact
that's not true, we copy everything except explicitly-excluded ones,
`number_of_replicas` and `auto_expand_replicas`. This fixes the mistake.

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-06-16 13:54:29 +01:00
James Rodewig 48a8405213
[DOCS] Clone index API doesn't apply index templates or settings (#74138)
Changes:
* Notes that Elasticsearch doesn't apply index templates to cloned indices.
* Notes the clone API doesn't copy index settings.
2021-06-15 16:38:36 -04:00
James Rodewig 3fbc182076
[DOCS] Clone index API doesn't copy index metadata (#73787)
Notes that the clone index API doesn't copy index metadata and highlights some affected features.

Closes #69490
2021-06-07 08:36:58 -04:00
Alexander Reelsen f5a1d94cc9
[DOCS] Fix create component template API request path (#72874) 2021-06-02 09:04:58 -04:00
James Rodewig f1e1661088
[DOCS] Reuse `aliases` object properties in API docs (#73421)
Changes:
* Reuses the same `aliases` object properties in the following API docs:
  * Clone index API
  * Create index API
  * Put component template API
  * Put legacy index template API
  * Put index template API
  * Rollover index API
  * Shrink index API
  * Simulate template API
  * Split index API
* Updates the `aliases` object properties for the simulate index API docs.

Closes #73044
2021-06-02 08:31:42 -04:00
James Rodewig 74bc81c23e
[DOCS] Update alias API docs for data stream aliases (#73419)
Updates the docs for several alias APIs for data stream aliases. Also
removes some redundant examples now covered in the [aliases guide][0].

[0]: https://www.elastic.co/guide/en/elasticsearch/reference/master/alias.html
2021-06-01 08:45:22 -04:00
Dan Hermann 7dd8fb7c66
[DOCS] Mark unfreeze API as deprecated (#73505) 2021-05-28 08:51:41 -05:00
Dan Hermann 40a029f5ba
Deprecate freeze index API (#72618) 2021-05-27 15:14:50 -05:00
James Rodewig 5729bb8d49
[DOCS] Update alias references (#73427)
Updates several `index aliases` references to `aliases`.
2021-05-27 16:00:57 -04:00
James Rodewig 2aa4c3602b [DOCS] Fix typos 2021-05-26 09:43:26 -04:00
James Rodewig 39a0314d30
[DOCS] Update alias xrefs (#73380)
Updates several internal 'alias' xrefs to point to the aliases guide rather than
API docs.
2021-05-25 16:19:00 -04:00
James Rodewig b1ad71b077
[DOCS] Add alias guide (#73062)
Creates a guide for aliases. We can use this guide to house concepts, examples,
and tips for aliases.
2021-05-25 11:52:16 -04:00
James Rodewig 12c2c1f12a
[DOCS] Fix formatting (#73338) 2021-05-24 14:19:52 -04:00
James Rodewig 0f1fb46d58
[DOCS] Expand and reuse `aliases` parameters (#73296)
Changes:

* Expands the `aliases` parameter for the create index API to better document
  supported properties.

* Reuses `aliases` parameter in the following API docs:
  * Clone index API
  * Shrink index API
  * Split index API
2021-05-24 08:39:05 -04:00
James Rodewig 6c5ab8c04c
[DOCS] Fix data stream ref in index template docs (#73292)
Updates an outdated reference to empty `data_stream` objects. The create index
template API's `data_stream` parameter now supports the `hidden` property.
2021-05-20 15:42:54 -04:00
James Rodewig 41a9eae803
[DOCS] Update `hidden` anchor (#73287) 2021-05-20 14:40:10 -04:00
James Rodewig cb943dbe9b
[DOCS] Reuse index template body params in simulate template API (#73177)
Changes:

* Reuses and reorders the index template API's body parameters in the simulate template API docs.
* Replaces several includes with a shorter xref.
* Reformats a sidebar on naming collisions with built-in index templates.
2021-05-20 12:21:20 -04:00
James Rodewig a11ea87041
[DOCS] Update exists API for data streams (#73180)
Updates the exists API docs to better reflect its support of data streams and
aliases.

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-05-20 12:08:40 -04:00
Martijn van Groningen 4b2c3ab0b7
The get aliases api should not return entries for data streams with no aliases (#72953)
The get alias api should take into account the aliases parameter when
returning aliases that refer to data streams and don't return entries
for data streams that don't have any aliases pointing to it.

Relates to #66163
2021-05-19 10:07:11 +02:00
James Rodewig c9223a25a4
[DOCS] Update anchor for alias write index (#73108)
Updates the anchor for our alias write index content. Changes are no-op, but this helps prepare for future work on alias docs.
2021-05-14 12:35:25 -04:00
James Rodewig 34d5f6c246
[DOCS] Consolidate `routing` parameter definitions (#73107)
Combines duplicate definitions for the `routing` parameter.
2021-05-14 12:27:19 -04:00
James Rodewig b564650ed0
[DOCS] Rename `Bulk index alias` API to `Aliases` API (#73077)
In 7.14, the API supports both index and data stream aliases.
2021-05-14 07:41:11 -04:00
James Rodewig 8ec893a425
[DOCS] Change field alias anchor (#73043) 2021-05-13 09:32:36 -04:00
James Rodewig ce41fd7e2a [DOCS] Mark `filter` param as optional 2021-05-12 16:25:39 -04:00
James Rodewig 8dddca77aa
[DOCS] Remove and redirect frozen index overview content (#72990)
Changes:

* Removes and adds redirects for the frozen indices [overview][0], [best
  practices][1], [search][2], and [monitoring][3] pages.
* Removes glossary terms related to frozen indices.
* Updates several xrefs to point to the freeze index API docs.

Relates to elastic/elasticsearch#72946 and elastic/elasticsearch#70192.

[0]: https://www.elastic.co/guide/en/elasticsearch/reference/7.12/frozen-indices.html
[1]: https://www.elastic.co/guide/en/elasticsearch/reference/master/best_practices.html
[2]: https://www.elastic.co/guide/en/elasticsearch/reference/master/searching_a_frozen_index.html
[3]: https://www.elastic.co/guide/en/elasticsearch/reference/master/monitoring_frozen_indices.html
2021-05-12 12:54:20 -04:00
Dan Hermann d0fd686600
[DOCS] Mark freeze API as deprecated (#72946) 2021-05-11 14:27:40 -05:00
Martijn van Groningen 6689b8bf1c
Add basic alias support for data streams (#72613)
Aliases to data streams can be defined via the existing update aliases api.
Aliases can either only refer to data streams or to indices (not both).
Also the existing get aliases api has been modified to support returning
aliases that refer to data streams.

Aliases for data streams are stored separately from data streams and
and refer to data streams by name and not to the backing indices of
a data stream. This means that when backing indices are added or removed
from a data stream that then the data stream alias doesn't need to be
updated.

The authorization model for aliases that refer to data streams is the
same as for aliases the refer to indices. In security privileges can
be defined on aliases, indices and data streams. When a privilege is
granted on an alias then access is also granted on the indices that
an alias refers to (irregardless whether privileges are granted or denied
on the actual indices). The same will apply for aliases that refer
to data streams. See for more details:
https://github.com/elastic/elasticsearch/issues/66163#issuecomment-824709767

Relates to #66163
2021-05-11 09:51:05 +02:00
James Rodewig 97054d6570
[DOCS] Replace 'log into' with 'log in to' (#72324) 2021-04-27 15:27:22 -04:00
Pierre Grimaud 3c44dfec60
[DOCS] Fix typos (#72227) 2021-04-26 12:40:38 -04:00
Jay Modi a7dbb31765
Add Fleet action results system data stream (#71667)
This commit adds support for system data streams and also the first use
of a system data stream with the fleet action results data stream. A
system data stream is one that is used to store system data that users
should not interact with directly. Elasticsearch will manage these data
streams. REST API access is available for external system data streams
so that other stack components can store system data within a system
data stream. System data streams will not use the system index read and
write threadpools.
2021-04-20 13:33:12 -06:00
Adam Locke 5baabff667
[DOCS] Update mapping API to require index name (#71489) 2021-04-08 13:54:37 -04:00
David Turner 6ed2d25458
Include node roles in cluster state JSON response (#71386)
Today the response to `GET _cluster/state` does not include the roles of
the nodes in the cluster. In the past this made sense, roles were
relatively unchanging things that could be determined from elsewhere.
These days we have an increasingly rich collection of roles, with
nontrivial BWC implications, so it is important for debugging to be able
to see the specific roles as viewed by the master. This commit adds the
role names to the cluster state API output.

Relates #71385
2021-04-07 10:44:35 +01:00
James Rodewig 9fff70c3b2 [DOCS] Fix xref 2021-04-06 12:10:39 -04:00
James Rodewig 65be40ac7b
[DOCS] Refactor rollover API docs (#70938) 2021-04-06 11:51:02 -04:00
James Rodewig d3c56e6fca [DOCS] Remove unneeded articles for Elasticsearch Service and Elastic Agent 2021-04-02 16:01:59 -04:00
James Rodewig f41320616c
[DOCS] Refactor data stream setup tutorial (#71074) 2021-03-31 17:28:55 -04:00
Yash Jipkate 60f4d22722
Change default value of `action.destructive_requires_name` to True. (#66908)
This PR sets the default value of `action.destructive_requires_name`
to `true.` Fixes #61074. Additionally, we set this value explicitly in
test classes that rely on wildcard deletions to clear test state.
2021-03-31 15:59:57 -04:00
James Rodewig 693807a6d3
[DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
James Rodewig 955df4337b
[DOCS] Fix typos for Elasticsearch Service and Elastic Agent (#71076) 2021-03-31 08:36:21 -04:00