elasticsearch/docs/reference/data-streams
Mary Gouseti bed6e18fa3
Exclude internal data streams from global retention (#112100)
With #111972 we enable users to set up global retention for data streams that are managed by the data stream lifecycle. This will allow users of elasticsearch to have a more control over their data retention, and consequently better resource management of their clusters.

However, there is a small number of data streams that are necessary for the good operation of elasticsearch and should not follow user defined retention to avoid surprises.

For this reason, we put forth the following definition of internal data streams.

A data stream is internal if it's either a system index (system flag is true) or if its name starts with a dot.

This PR adds the `isInternalDataStream` param in the effective retention calculation making explicit that this is also used to determine the effective retention.
2024-08-28 11:28:35 +03:00
..
lifecycle Exclude internal data streams from global retention (#112100) 2024-08-28 11:28:35 +03:00
change-mappings-and-settings.asciidoc (Doc+) Link API doc to parent object - part1 (#111951) 2024-08-20 14:58:18 -06:00
data-stream-apis.asciidoc
data-streams.asciidoc
downsampling-dsl.asciidoc
downsampling-ilm.asciidoc
downsampling-manual.asciidoc (Doc+) Link API doc to parent object - part1 (#111951) 2024-08-20 14:58:18 -06:00
downsampling.asciidoc
logs.asciidoc Rename `logs` index mode to `logsdb` (#111054) 2024-07-19 13:38:58 +02:00
modify-data-streams-api.asciidoc (Doc+) Link API doc to parent object - part1 (#111951) 2024-08-20 14:58:18 -06:00
promote-data-stream-api.asciidoc (Doc+) Link API doc to parent object - part1 (#111951) 2024-08-20 14:58:18 -06:00
set-up-a-data-stream.asciidoc
set-up-tsds.asciidoc
tsds-index-settings.asciidoc
tsds-reindex.asciidoc (Doc+) Link API doc to parent object - part1 (#111951) 2024-08-20 14:58:18 -06:00
tsds.asciidoc Add support for boolean dimensions (#111457) 2024-07-31 23:00:32 +10:00
use-a-data-stream.asciidoc