Commit Graph

7259 Commits

Author SHA1 Message Date
Benjamin Trent a43ff95f2d
[ML] calculate cache misses for inference and return in stats (#58252)
When a local model is constructed, the cache hit miss count is incremented.

When a user calls _stats, we will include the sum cache hit miss count across ALL nodes. This statistic is important to in comparing against the inference_count. If the cache hit miss count is near the inference_count it indicates that the cache is overburdened, or inappropriately configured.
2020-06-18 17:18:43 -04:00
James Rodewig f739b31fe1
[DOCS] Document get data stream API response body (#58344) 2020-06-18 16:18:32 -04:00
James Rodewig 1bc256078a
[DOCS] Prohibit deletion of a data stream's write index (#58341) 2020-06-18 15:46:25 -04:00
Lisa Cawley 27111f9faa
[DOCS] Updates pull and issue release attributes (#58348) 2020-06-18 12:38:49 -07:00
Tal Levy c765993d82
add geo_shape documentation for supported aggregations (#58284)
This commit adds documentation for geo_shape fields in aggregations

Closes #55495.
2020-06-18 10:17:49 -07:00
Jason Tedor 2e0274266f
Allow follower indices to override leader settings (#58103)
Today when creating a follower index via the put follow API, or via an
auto-follow pattern, it is not possible to specify settings overrides
for the follower index. Instead, we copy all of the leader index
settings to the follower. Yet, there are cases where a user would want
some different settings on the follower index such as the number of
replicas, or allocation settings. This commit addresses this by allowing
the user to specify settings overrides when creating follower index via
manual put follower calls, or via auto-follow patterns. Note that not
all settings can be overrode (e.g., index.number_of_shards) so we also
have detection that prevents attempting to override settings that must
be equal between the leader and follow index. Note that we do not even
allow specifying such settings in the overrides, even if they are
specified to be equal between the leader and the follower
index. Instead, the must be implicitly copied from the leader index, not
explicitly set by the user.
2020-06-18 10:55:17 -04:00
James Rodewig 865b7ac920
[DOCS] Reformat data stream API docs (#58322) 2020-06-18 10:46:01 -04:00
Dan Hermann 34a47f7fc6
[DOCS] Add data stream APIs to main API page (#58204) 2020-06-18 08:05:56 -05:00
James Rodewig f00c8abe20
[DOCS] Add data streams to search docs (#58278)
Changes:

* Adds additional examples to the `Search a data stream` section of
  `Use a data stream`
* Updates existing search docs to make them aware of data streams
2020-06-18 08:43:02 -04:00
Marios Trivyzas 9d6b679a5d
SQL: [Docs] Fix TIME_PARSE documentation (#58182)
TIME_PARSE works correctly if both date and time parts are specified,
and a TIME object (that contains only time is returned).

Adjust docs and add a unit test that validates the behavior.

Follows: #55223
2020-06-18 12:35:58 +02:00
Yannick Welsch b305454e23
Add new flag to check whether alias exists on remove (#58100)
This allows doing true CAS operations on aliases, making sure that an alias is actually properly
moved from a given source index onto a given target index. This is useful to ensure that an
alias is actually moved from a given index to another one, and not just added to another index.
2020-06-18 10:05:14 +02:00
James Rodewig 21e28bbdc8 [DOCS] Fix typo in create data stream API docs 2020-06-17 17:16:27 -04:00
James Rodewig 7c26d09d3c [DOCS] Fix typo in create data stream API docs 2020-06-17 17:14:02 -04:00
James Rodewig e738d38992 [DOCS] Remove redundant links in data stream docs 2020-06-17 17:06:28 -04:00
Jim Ferenczi 90c9b95ca0
Allow index filtering in field capabilities API (#57276)
* Add index filtering in field capabilities API

This change allows to use an `index_filter` in the
field capabilities API. Indices are filtered from
the response if the provided query rewrites to `match_none`
on every shard:

````
GET metrics-*
{
  "index_filter": {
    "bool": {
      "must": [
        "range": {
          "@timestamp": {
            "gt": "2019"
          }
        }
      }
  }
}
````

The filtering is done on a best-effort basis, it uses the can match phase
to rewrite queries to `match_none` instead of fully executing the request.
The first shard that can match the filter is used to create the field
capabilities response for the entire index.

Closes #56195
2020-06-17 22:53:53 +02:00
James Rodewig c0191eb84c
[DOCS] Fix routing param in search API docs (#58267) 2020-06-17 15:05:20 -04:00
Dan Hermann 204bc0ea13
Document the prohibition on freezing data stream write indices (#58058) 2020-06-17 10:16:18 -05:00
James Rodewig 20a7d73333
[DOCS] Add 'update/delete docs in a data stream' tutorial (#58194)
Adds a tutorial for updating and deleting documents in the backing
indices of a data stream.
2020-06-17 11:07:52 -04:00
Lisa Cawley 751e2d0deb
[DOCS] Fixes license management links (#58213) 2020-06-16 16:43:54 -07:00
debadair 59cae7ee5c
[DOCS] Remove unused file (#58208) 2020-06-16 15:55:20 -07:00
James Rodewig 3bf1b86688
[DOCS] Add resolve index API check to DS setup tutorial (#58167)
Updates the set up a data stream tutorial to include a name check
using the resolve index API.
2020-06-16 16:15:02 -04:00
James Rodewig 0fc2bd8e62
[DOCS] Add 'Change DS mappings and settings' tutorial (#58148)
Adds a tutorial for updating the mappings and
index settings of a data stream's backing indices.
2020-06-16 16:04:38 -04:00
debadair 99c75f1e6c
[DOCS] Fixes problematic terminology (#58178)
* [DOCS] Fixes problematic terminology.

* Update docs/reference/snapshot-restore/register-repository.asciidoc

Co-authored-by: James Rodewig <james.rodewig@elastic.co>
2020-06-16 09:23:11 -07:00
Elastic Machine adae213bef
Merge branch 'master' into feature/async-eql 2020-06-16 08:15:02 -06:00
Jake Landis 5088ab151a
Update hh to HH in date processor example (#58089) (#58142)
Co-authored-by: Leaf-Lin <39002973+Leaf-Lin@users.noreply.github.com>
2020-06-15 17:03:42 -05:00
debadair d756cd6866
[DOCS] Reformat release highlights as What's new. (#58074)
* [DOCS] Reformat release highlights as What's new.

* Removed line break.
2020-06-15 13:26:30 -07:00
Adam Locke 961a85e1e6
[DOCS] Add documentation for near real-time search (#57560)
* Adding documentation for near real-time search.

* Adding link to NRT topic and clarifying some text.

* Adding diagrams and incorporating changes from David T.
2020-06-15 14:49:33 -04:00
James Rodewig cdfb528c33 [DOCS] Fix typo in data stream docs 2020-06-15 12:59:18 -04:00
James Rodewig dbf101ad74 [DOCS] Fix xref in data stream docs 2020-06-15 09:48:58 -04:00
Andrei Dan 25cbbe56dd
[DOCS] Make ILM documentation data stream aware (#58035)
Co-authored-by: James Rodewig <james.rodewig@elastic.co>
Co-authored-by: Lee Hinman <dakrone@users.noreply.github.com>
2020-06-15 14:14:07 +01:00
James Rodewig e9279d6299 [DOCS] Update prohibited ops for ds write index
Adds 'clone' and 'split' to a list of actions that are prohibited on a data
stream's write index
2020-06-15 08:54:11 -04:00
James Rodewig 9aa87fe2d7
[DOCS] Add get and delete steps to data stream setup tutorial (#58068)
Adds corresponding steps for the get and delete data stream APIs to the
data stream setup tutorial. Also provides some guidance on how to
determine the current write index for a data stream.
2020-06-15 08:38:08 -04:00
bellengao efc4c9a210
Add ignore_empty_value parameter in set ingest processor (#57030) 2020-06-15 07:26:57 -05:00
István Zoltán Szabó bea47ecf94
[DOCS] Adds web session details example to painless transform examples (#57942) 2020-06-15 14:15:34 +02:00
James Rodewig 73e6ae677a [DOCS] Reword prohibited ops for data stream write index 2020-06-12 14:00:01 -04:00
Elastic Machine e61bf1b758
Merge branch 'master' into feature/async-eql 2020-06-12 10:03:01 -06:00
Gordon Brown 34018f2b12
Clarify `expand_wildcard` option in snapshot docs (#58016)
This commit clarifies that the `expand_wildcards` option (as well as other
`IndicesOptions` parameters) can be used with the Create Snapshot API, but that
they must be in the body of the request.

Also clarifies the connection between `expand_wildcards` and hidden indices as
it relates to snapshots.
2020-06-12 09:00:43 -06:00
James Rodewig d5e6b13151
[DOCS] Document reindex for data streams (#58013)
Changes:

* Adds new 'Reindex with a data stream' section to 'Use a data stream'

* Makes the existing reindex API docs aware of data streams

* Rewrites the reindex glossary definition to include data streams
2020-06-12 10:40:59 -04:00
Elastic Machine e25a29c528
Merge branch 'master' into feature/async-eql 2020-06-12 08:37:23 -06:00
James Rodewig 34049d3aee
[DOCS] Add data streams glossary def (#58014) 2020-06-12 10:24:06 -04:00
Igor Motov 95afb2ef52 Merge remote-tracking branch 'elastic/master' into feature/async-eql 2020-06-12 09:32:47 -04:00
James Rodewig 9c19f66fda [DOCS] Remove unneeded comma in data stream docs 2020-06-12 09:14:36 -04:00
Martijn van Groningen eb6f46a342
Enforce valid field mapping exists for timestamp_field in templates. (#57741)
Relates to #53100
2020-06-12 13:22:20 +02:00
James Rodewig 54c29311fc [DOCS] Remove extra word from data stream docs 2020-06-11 17:44:30 -04:00
James Rodewig 22169748c9 [DOCS] Fix typos in data stream docs 2020-06-11 16:20:22 -04:00
Elastic Machine 7015738e2b
Merge branch 'master' into feature/async-eql 2020-06-11 10:28:37 -07:00
Lisa Cawley e9d13ec629
[DOCS] Rename monitoring collection from internal to legacy (#56395) 2020-06-11 10:16:53 -07:00
James Rodewig bb66d594d1
[DOCS] Reformat `pattern_replace` token filter (#57699)
Changes:

* Rewrites description and adds Lucene link
* Adds analyze example
* Adds parameter definitions
* Adds custom analyzer example
2020-06-11 12:04:22 -04:00
James Rodewig 039f19d13a [DOCS] Fix typo in data stream docs 2020-06-11 11:29:05 -04:00
James Rodewig 30cc10d3ac
[DOCS] Reformat data streams intro and overview (#57954)
Changes:

* Updates 'Data streams' intro page to focus on problem solution and
  benefits.

* Adds 'Data streams overview' page to cover conceptual information,
  based on existing content in the 'Data streams' intro.

* Adds diagrams for data streams and search/indexing request examples.

* Moves API jump list and API docs to a new 'Data streams APIs' section.
  Links to these APIs will be available through tutorials.

* Add xrefs to existing docs for concepts like generation, write index,
  and append-only.
2020-06-11 11:17:21 -04:00