Commit Graph

5280 Commits

Author SHA1 Message Date
Przemyslaw Gomulka 3a76c3045e
Date_math_expression doc to inform about format (#39840)
The format since 7 should be compatible with java-time. Users should be informed about this on this page
2019-03-12 09:18:57 +01:00
Adrien Grand 8905d77ca4
Update the how-to section of the docs for 7.0: (#37717)
- new `rank_feature`/`script_score` queries
 - new `index_phrases`/`index_prefixes` options
 - disabling `_field_names` doesn't help anymore
 - adaptive replica selection is on by default
2019-03-12 08:23:53 +01:00
Yannick Welsch 28a14e3e04
Add note about cluster state diffs (#39847)
Mentions cluster state diffs in CS publishing docs.
2019-03-11 15:36:41 +01:00
David Kyle abb814012b
[ML] Correct small inconsistencies in ml APIs spec and docs (#39801) 2019-03-11 10:01:02 +00:00
MK Swanson 347e8cf69b
[DOCS] Edited intro sentence for clarity. Closes #39865 (#39866) 2019-03-08 17:29:37 -05:00
Mayya Sharipova aad93977f5 Correct errors in min_hash filter documentation
Related to #39671
2019-03-08 16:16:03 -05:00
Lisa Cawley dda8cf82f8
[DOCS] Adds notable changes section (#38238) 2019-03-08 10:51:27 -08:00
Jason Tedor 8c156ed47c
Introduce forget follower API (#39718)
This commit introduces the forget follower API. This API is needed in cases that
unfollowing a following index fails to remove the shard history retention leases
on the leader index. This can happen explicitly through user action, or
implicitly through an index managed by ILM. When this occurs, history will be
retained longer than necessary. While the retention lease will eventually
expire, it can be expensive to allow history to persist for that long, and also
prevent ILM from performing actions like shrink on the leader index. As such, we
introduce an API to allow for manual removal of the shard history retention
leases in this case.
2019-03-07 10:29:10 -05:00
Mayya Sharipova 5b852fa184
Add documentation for min_hash filter (#39671)
* Add documentation for min_hash filter

Closes #20757
2019-03-07 08:47:32 -05:00
Jake Landis 66ec35801c
Execute ingest node pipeline before creating the index (#39607)
Prior to this commit (and after 6.5.0), if an ingest node changes
the _index in a pipeline, the original target index would be created.
For daily indexes this could create an extra, empty index per day.

This commit changes the TransportBulkAction to execute the ingest node
pipeline before attempting to create the index. This ensures that the 
only index created is the original or one set by the ingest node pipeline. 
This was the execution order prior to 6.5.0 (#32786). 

The execution order was changed in 6.5 to better support default pipelines. 
Specifically the execution order was changed to be able to read the settings
from the index meta data. This commit also includes a change in logic such 
that if the target index does not exist when ingest node pipeline runs, it 
will now pull the default pipeline (if one exists) from the settings of the 
best matched of the index template. 

Relates #32786
Relates #32758 
Closes #36545
2019-03-06 16:18:43 -06:00
Ian 98bbb4176e Correct date in daterange-aggregation.asciidoc (#39727) 2019-03-06 11:30:17 +01:00
David Roberts 6242beef7a
[ML] Use scaling thread pool and xpack.ml.max_open_jobs cluster-wide dynamic (#39320)
This change does the following:

1. Makes the per-node setting xpack.ml.max_open_jobs
   into a cluster-wide dynamic setting
2. Changes the job node selection to continue to use the
   per-node attributes storing the maximum number of open
   jobs if any node in the cluster is older than 7.1, and
   use the dynamic cluster-wide setting if all nodes are on
   7.1 or later
3. Changes the docs to reflect this
4. Changes the thread pools for native process communication
   from fixed size to scaling, to support the dynamic nature
   of xpack.ml.max_open_jobs
5. Renames the autodetect thread pool to the job comms
   thread pool to make clear that it will be used for other
   types of ML jobs (data frame analytics in particular)

Closes #29809
2019-03-06 09:45:13 +00:00
Jason Tedor 669d1937c4
Remove beta label from CCR (#39722)
This commit removes the beta label from CCR.
2019-03-05 22:19:19 -05:00
jimczi 89b80c64ee fix typo in synonym graph filter docs 2019-03-05 18:18:45 +01:00
Tim Brooks ee41b22e51
Add documentation on remote recovery (#39483)
This is related to #35975. It adds documentation on the remote recovery
process. Additionally, it adds documentation about the various settings
that can impact the process.
2019-03-05 09:50:58 -07:00
Samuel Cifuentes García ff6ffe8ba1 Improved Terms Aggregation documentation (#38892)
Added a note after the first query example talking about fielddata.
2019-03-05 10:17:01 -05:00
Yannick Welsch 3b71a31557
Remove Zen1 (#39466)
Removes all traces of Zen1 from the code base. Some of these commits will also be backported to
7.0/7.x (#39470) as the cluster.coordination package was making use of some things in
discovery.zen and we want to keep 7.x as close as possible to master.
2019-03-04 15:51:12 +01:00
Lisa Cawley fc3dd248fe
[DOCS] Adds link to list of built-in users (#39529) 2019-03-01 10:29:59 -08:00
Andrei Stefan 9e0df64b2d
SQL: ignore UNSUPPORTED fields for JDBC and ODBC modes in 'SYS COLUMNS' (#39518)
* SYS COLUMNS will skip UNSUPPORTED field types in ODBC and JDBC, as well.
NESTED and OBJECT types were already skipped in ODBC mode, now they are
skipped in JDBC mode, as well.
2019-03-01 15:23:15 +02:00
Henning Andersen ac7ec99bea
Unify blob store compress setting (#39346)
Blob store compression was all implemented generally, except reading the
setting for it. Moved the setting to BlobStoreRepository to unify this.
Also removed deprecated env setting 'repositories.fs.compress'.

This is a follow up on #39073
2019-02-28 12:34:13 +01:00
Lisa Cawley 7642badfdf
[DOCS] Fix image warnings in CCR documentation (#39430) 2019-02-27 07:34:06 -08:00
Jason Tedor f7a5b7d64c
Remove outdated DNS caching docs from HTTP exporter (#39394)
These docs are out of date, now that we override the infinite DNS cache
within Elasticsearch. This commit completely removes this content, as
specific guidance is no longer needed here.
2019-02-27 08:08:06 -05:00
Andrei Stefan dbb93310b0
SQL: change the default precision for CURRENT_TIMESTAMP function (#39391) 2019-02-27 09:48:10 +02:00
Andrei Stefan 5b7e0de237
SQL: introduce the columnar option for REST requests (#39287)
* Add "columnar" option for REST requests (but be lenient for non-"plain"
modes) for json, yaml, smile and cbor formats.
* Updated documentation
2019-02-27 09:24:52 +02:00
Neeraj Jain 027c59228f Use pkill to shutdown elasticsearch using pid file (#39135)
While running these commands from alias, facing issues using kill `cat pid`, In some situations, the more compact:
```
pkill -F /var/run/myProcess.pid
```
is the way to go.
2019-02-26 16:28:57 +01:00
Christoph Büscher 6e3e3b1530
Move some token filter migration notes (#39072)
The removal of the "nGram" and "edgeNGram" token filter was filed in a new
migrate_8_0/mappings.asciidoc document but it should better be in an
analysis.asciidoc section and file.
2019-02-26 15:02:43 +01:00
Lee Hinman 0994eb2db3
Remove Hipchat support from Watcher (#39199)
Hipchat has been shut down and has previously been deprecated in
Watcher (#39160), therefore we should remove support for these actions.
2019-02-25 13:17:35 -07:00
Luca Cavanna 5a9250a687 [DOCS] Fix typo in network-host.asciidoc 2019-02-25 17:12:14 +01:00
Darren Meiss 7b0210a7b7 Edits to text in Optimistic Concurrency Ctrl doc (#39191) 2019-02-25 17:12:14 +01:00
Darren Meiss e2a96a2bc1 Minor edits to text in Reindex API doc (#39137) 2019-02-25 17:12:14 +01:00
Tal Levy 3ac77ae1c1
add missing `test2` index in alias example (#39212)
* missing 'test2' index example (#39055)

If I got the idea of aliases properly, I think that the index "test2" should have a reference in the example above of the following sentence:

" ... we associate the alias `alias1` to both `test` and `test2` ... "

* add PUT test2

* Update aliases.asciidoc

swap which is write/read
2019-02-20 16:27:34 -08:00
Lisa Cawley bdd3a82784
[DOCS] Unset machine learning upgrade mode (#39149) 2019-02-20 12:03:41 -08:00
James Baiera c253277c90
Fix the OS sensing code in ClusterFormationTasks (#38457)
This fixes a bug in the sensing of the current OS family in the test cluster
formation code. Previously all builds would assume every environment 
was windows and would jump to using the windows zip build. This fixes 
the OS sensing code as well as updates some tests to account for 
different build flavors.
2019-02-20 11:45:26 -05:00
Darren Meiss 8daf793cf1 Edits to text in Phrase Suggester doc (#38966) 2019-02-20 13:12:49 +01:00
Darren Meiss be7fa87cf2 Edits to text in API Conventions docs (#39001) 2019-02-20 13:12:49 +01:00
Mayya Sharipova 3260fd1fc8
Distance measures for dense and sparse vectors (#37947)
* Distance measures for dense and sparse vectors

Introduce painless functions of
cosineSimilarity and dotProduct distance
measures for dense and sparse vector fields.

```js
{
  "query": {
    "script_score": {
      "query": {
        "match_all": {}
      },
      "script": {
        "source": "cosineSimilarity(params.queryVector, doc['my_dense_vector'].value)",
        "params": {
          "queryVector": [4, 3.4, -1.2]
        }
      }
    }
  }
}
```

```js
{
  "query": {
    "script_score": {
      "query": {
        "match_all": {}
      },
      "script": {
        "source": "cosineSimilaritySparse(params.queryVector, doc['my_sparse_vector'].value)",
        "params": {
          "queryVector": {"2": -0.5, "10" : 111.3, "50": -13.0, "113": 14.8, "4545": -156.0}
        }
      }
    }
  }
}
```

Closes #31615
2019-02-20 07:01:17 -05:00
Darren Meiss 12006ea29a Fix a typo in the cat shards API docs (#38536) 2019-02-20 11:37:27 +01:00
Darren Meiss ff87932c21 Edits to text in Bulk API doc (#39083) 2019-02-20 11:34:36 +01:00
Darren Meiss 34b4262302 Edits to text in Multi Get API doc (#39082) 2019-02-20 11:34:36 +01:00
Darren Meiss f14235c94f Edits to text in Update By Query API doc (#39078) 2019-02-20 11:34:36 +01:00
Darren Meiss 73ccf819aa Edits to text in Update API doc (#39069) 2019-02-20 11:34:36 +01:00
Darren Meiss 9b8a1665ff Edits to text in Delete By Query API doc (#39017) 2019-02-20 11:34:36 +01:00
Darren Meiss cb044312e9 Edits to text in Index API doc (#39010) 2019-02-20 11:34:36 +01:00
Andrei Stefan 38fbf9792b
Added "validate.properties" property to JDBC's list of allowed properties. (#39050)
This defaults to "true" (current behavior) and will throw an exception
if there is a property that cannot be recognized. If "false", it will
ignore anything unrecognizable.
2019-02-20 11:23:47 +02:00
Jake Landis 6aafe47191
stronger wording for ilm+rollover in docs (#39159) 2019-02-19 17:58:29 -06:00
Lisa Cawley a3c44c0270
[DOCS] Edits the remote clusters documentation (#38996) 2019-02-19 11:53:35 -08:00
Tim Brooks a5cbef9d1b
Rebuild remote connections on profile changes (#37678)
Currently remote compression and ping schedule settings are dynamic.
However, we do not listen for changes. This commit adds listeners for
changes to those two settings. Additionally, when those settings change
we now close existing connections and open new ones with the settings
applied.

Fixes #37201.
2019-02-19 11:32:21 -07:00
Lee Hinman 237d7559bb
Document 'max_size' parameter as shard size for rollover (#38750)
It was not clear that this is *primary* shard size, not the entire shard size.

Resolves #37981
2019-02-19 10:54:15 -07:00
Jim Ferenczi f3e8d66ffb
Remove beta marker from the synonym_graph docs (#38185) 2019-02-19 10:47:59 +01:00
Jason Tedor 331ef9dc59
Introduce retention lease state file (#39004)
This commit moves retention leases from being persisted in the Lucene
commit point to being persisted in a dedicated state file.
2019-02-18 16:52:51 -05:00