8c262f0edf
[DOCS] Updates transforms upgrade API docs ( #79608 )
2021-10-21 19:03:01 +02:00
f13912c1b3
[DOCS] Drafts docs for Upgrade Transforms API ( #79139 )
2021-10-19 16:03:54 +02:00
1595d3a20f
[Transform] Add _meta field to TransformConfig ( #79003 )
2021-10-15 08:12:03 +02:00
939f81e557
[Transform] add transform upgrade endpoint ( #77566 )
...
Add an _upgrade endpoint to bulk upgrade transforms. _upgrade rewrites all transforms and its
artifacts into the latest format to the latest storage(index). If all transforms are upgraded old
indices and outdated documents get deleted. Using the dry_run option it is possible to check if
upgrades are necessary without applying changes.
2021-10-13 08:49:45 +02:00
df32157a99
[Transform][DOCS] remove 7.x related limitations ( #78975 )
...
remove 7.x related limitations from limitations documentation for 8.x
2021-10-12 14:01:25 +02:00
1971bd4591
[DOCS] Adds Transform alerts docs ( #78185 )
2021-10-05 14:06:48 +02:00
1575d34822
[DOCS] Fix formatting ( #77567 )
...
This PR fixes a missing backtick.
2021-09-10 09:33:32 -07:00
676d4de3de
[Transform] Implement the ability to preview the existing transform ( #76697 )
2021-08-24 14:41:49 +02:00
ec07e4213e
[Transform] Rename interim_results to align_checkpoints ( #76609 )
2021-08-18 13:58:50 +02:00
86df1b3aec
[DOCS] enhance transform example with range filter ( #74284 )
...
enhance transform example using range instead of terms for 5xx error codes
2021-06-21 10:37:11 +02:00
e197577003
[DOCS] Fixes typo in transforms at scale page. ( #73726 )
2021-06-03 18:27:36 +02:00
5273011f98
[DOCS] Update transforms tutorial with index mapping details ( #73395 )
2021-06-02 13:45:01 -07:00
0bb41ba4f8
[DOCS] Adds screenshots to Transform examples ( #72939 )
...
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2021-05-26 12:06:54 +02:00
a5e39ce086
Add missing word in data streams checkpoints docs ( #73005 )
2021-05-13 08:34:34 +02:00
bbfe962cae
[DOCS] Adds top_metrics aggs examples to Transform docs ( #72738 )
...
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2021-05-10 14:41:51 +02:00
090690d17a
[DOCS] Revises required privileges info in Transforms API docs ( #72803 )
2021-05-06 15:19:28 +02:00
0074ba6d5a
[DOCS] Clarify update transform API ( #72427 )
2021-04-29 07:57:58 -07:00
51fe73081d
[DOCS] Adds further details and an example to how transform checkpointing works ( #71615 )
2021-04-19 11:29:17 +02:00
693807a6d3
[DOCS] Fix double spaces ( #71082 )
2021-03-31 09:57:47 -04:00
178563c224
[DOCS] Reorganizes Transforms limitations ( #70638 )
2021-03-24 11:22:59 +01:00
c4a33f2413
[DOCS] Adds latest transform example to transform docs ( #70562 )
...
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2021-03-23 15:34:10 +01:00
5eca57e9dd
[DOCS] Remove beta qualifier from transform tutorial ( #70469 )
2021-03-16 12:13:06 -07:00
5c75d004fa
[DOCS] Replace `put` with `create or update` in API names ( #70330 )
...
Co-authored-by: debadair <debadair@elastic.co>
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-03-15 14:49:44 -04:00
010a973018
[DOCS] Refactor ingest pipeline docs ( #70253 )
2021-03-15 12:22:57 -04:00
a3fdaceeb1
[DOCS] Expands transforms docs with CCS info ( #70156 )
...
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2021-03-10 15:54:31 +01:00
300031b247
[DOCS] Removes beta from latest Transform docs. ( #69964 )
2021-03-04 16:36:47 +01:00
b4057d7c22
[DOCS] Adds new screenshot to Transform tutorial ( #69194 )
...
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2021-02-23 15:23:51 +01:00
742facdfe6
[DOCS] Adds runtime filed related item to Transforms limitations ( #68895 )
2021-02-11 16:09:26 +01:00
4443cb2f0e
[DOCS] Adds retention_policy to PUT Transform API docs ( #68656 )
...
Co-authored-by: lcawl <lcawley@elastic.co>
2021-02-09 08:00:47 +01:00
54ed2e37d9
[Transform] implement retention policy to delete data from a transform ( #67832 )
...
add a retention policy to transform to delete data that is considered outdated as part of a
transform checkpoint.
fixes #67916
2021-02-08 15:06:15 +01:00
05e16428fe
[DOCS] Expands transforms docs with persistent tasks and related links. ( #68582 )
2021-02-08 09:44:06 +01:00
cf08c0e6ab
[Transform] refactor cat transform to show more useful information ( #68232 )
...
Refactoring of cat transform to show more relevant information. The current cat transform shows a
lot of configuration details, however cat should show operationally useful information. This PR
changes the defaults and also adds when transform did a search last.
2021-02-02 07:29:20 +01:00
d78f39c2ad
[Transform] Add support for search-time runtime fields. ( #67643 )
2021-01-21 13:27:42 +01:00
2e8ff40901
[DOCS] Add latest method to transform overview ( #66767 )
2021-01-15 15:07:08 -08:00
1bf5f8df04
[DOCS] Add latest method to transform tutorial ( #66766 )
...
Co-authored-by: Przemysław Witek <przemyslaw.witek@elastic.co>
2021-01-15 13:46:06 -08:00
11640bc4ce
[DOCS] Add space limitations for transforms ( #66810 )
2021-01-13 08:58:06 -08:00
f1f41e4e36
[DOCS] Comments out group by example and link. ( #67241 )
2021-01-11 12:38:38 +01:00
97dedbd192
[DOCS] Add beta qualifier to transform latest APIs ( #67036 )
2021-01-05 12:28:19 -08:00
d5892c50cd
[DOCS] Drafts API changes for transform latest function ( #66481 )
2020-12-18 09:50:09 -08:00
55d2f86b5b
[DOCS] Adds Working with transforms at scale to docs ( #65726 )
2020-12-07 18:00:42 +01:00
9b47889153
[Transform] use ISO dates in output instead of epoch millis ( #65584 )
...
Transform writes dates as epoch millis, this does not work for historic data in some cases or is
unsupported. Dates should be written as such. With this PR transform starts writing dates in ISO
format, but as existing transform might rely on the format it provides backwards compatibility for
old jobs as well as a setting to write dates as epoch millis.
fixes #63787
2020-12-07 15:34:28 +01:00
f6b0216958
[DOCS] Fixes 'the the' typo in transforms docs. ( #64393 )
2020-10-30 10:52:35 +01:00
46df9dd75e
[DOCS] Adds note box about mappings to Transforms Painless examples ( #64285 )
2020-10-29 17:02:37 +01:00
7c4c098f76
[DOCS] Fixes typos in Transform Painless examples. ( #64352 )
2020-10-29 16:06:14 +01:00
1ea83359bb
[DOCS] Fix case for 'Boolean' ( #64299 )
2020-10-29 09:04:43 -04:00
ebcac2d864
[Transform] add new exclude_generated flag to GET transform ( #63093 )
...
This adds a new flag `exclude_generated` for GET transform API.
This flag is useful for when a transform needs to be cloned within a cluster or exported/imported between clusters.
It removes certain fields that are not able to be set via the PUT api (e.g. version, create_time).
relates https://github.com/elastic/elasticsearch/issues/63055
2020-10-20 11:38:40 -04:00
ccc820a972
[DOCS] Clarifies destination index mappings for Transforms. ( #63794 )
2020-10-16 15:24:33 +02:00
7f24c4df24
[DOCS] Adds limitation item about using scripts in transforms ( #63021 )
...
* [DOCS] Adds limitation item about using scripts in transforms.
* [DOCS] Adds scripts related limitation item to transforms docs.
* [DOCS] Merges two bullets, adds a new one, and removes last sentences.
* [DOCS] Refines last bullet.
* [DOCS] Addresses feedback.
* [DOCS] Removes low info content.
2020-09-30 15:16:10 +02:00
f0bfefe917
[DOCS] Adds data stream and ILM related limitation items to transforms ( #63016 )
2020-09-30 10:10:57 +02:00
60cc30522c
[DOCS] Removes init_script line from example Painless aggregation. ( #62367 )
2020-09-15 14:50:26 +02:00
15001bef0e
[DOCS] Makes example preface more accurate. ( #61912 )
2020-09-03 16:31:40 +02:00
ff95360433
[DOCS] Adds filter aggregation example link to painless examples ( #61890 )
2020-09-03 14:19:03 +02:00
1781d4a7b9
[DOCS] Fix security links in machine learning APIs ( #60098 )
2020-07-23 12:14:56 -07:00
8ad8421262
[DOCS] Refresh transform screenshots with histograms ( #59264 )
2020-07-23 08:48:06 -07:00
3f4da04c3e
[DOCS] Changes level offset of transform pages ( #60066 )
2020-07-22 10:55:48 -07:00
f8002a7204
[DOCS] Fixes getting time features example in Painless in Transforms ( #59379 )
2020-07-13 10:57:03 +02:00
fca1ece693
[DOCS] Clarifies transform node settings ( #59023 )
2020-07-07 13:31:04 -07:00
bea47ecf94
[DOCS] Adds web session details example to painless transform examples ( #57942 )
2020-06-15 14:15:34 +02:00
0f52cab495
[DOCS] Replaces docdir attributes in ML APIs ( #57390 )
2020-06-01 11:46:10 -07:00
d7735d9ef2
[DOCS] Add throttling based on configuration parameter ( #56653 )
2020-05-14 08:38:57 -07:00
a73511e4c7
[DOC] document transform settings and docs_per_second ( #56178 )
...
add documentation for throttling, added in #56007
2020-05-11 09:21:36 +02:00
51052f9e5d
[DOCS] Updated screenshots in transform ecommerce example. ( #56359 )
2020-05-08 07:44:44 +02:00
33f134f556
[Transform] add throttling ( #56007 )
...
add throttling to transform, throttling will slow down search requests by delaying the execution based on a documents per second metric.
fixes #54862
2020-05-05 11:34:54 +02:00
f36ab092ed
Deprecated xpack "enable" settings should be no-ops ( #55416 )
...
The following settings are now no-ops:
* xpack.flattened.enabled
* xpack.logstash.enabled
* xpack.rollup.enabled
* xpack.slm.enabled
* xpack.sql.enabled
* xpack.transform.enabled
* xpack.vectors.enabled
Since these settings no longer need to be checked, we can remove settings
parameters from a number of constructors and methods, and do so in this
commit.
We also update documentation to remove references to these settings.
2020-05-04 16:49:11 -04:00
079a14ea4c
[DOCS] Removes transform performance note ( #55177 )
2020-04-15 10:40:04 -07:00
a65eb43f6c
[DOCS] Updates transform prerequisites ( #54804 )
2020-04-06 17:06:22 +02:00
8f152b317b
[DOCS] Adds snippet comparing two indices to the painless examples ( #54563 )
2020-04-02 08:44:35 +02:00
5d590b5be6
[DOCS] Add processing details to get transforms stats API ( #54368 )
2020-04-01 09:50:57 -07:00
b7d6ebc21b
[DOCS] Adds HTTP response count example to Painless examples ( #54412 )
2020-03-31 15:11:40 +02:00
fdcd19483d
[DOCS] Collapses content in machine learning APIs ( #54234 )
2020-03-30 10:08:38 -07:00
3c81082fdf
[Transform] fixing naming in HLRC and _cat to match API content ( #54300 )
...
Fixing the naming of the HLRC values to match the ToXContent field names (i.e. the field names returned from an API call).
Also fixes the names in the _cat API as well.
closes #53946
2020-03-30 08:10:15 -04:00
6f846520ac
[DOCS] Changes scripted metric to filter aggs in transforms example ( #54167 )
2020-03-30 09:49:40 +02:00
6fceef73e4
[DOCS] Augments cat transforms API ( #53776 )
...
Co-Authored-By: Benjamin Trent <ben.w.trent@gmail.com>
2020-03-25 12:35:01 -07:00
51c103033b
[DOCS] Adds transform security privileges ( #53908 )
2020-03-24 09:33:29 -07:00
ea33795d98
[DOCS] Fixes formatting in transform overview ( #53900 )
2020-03-23 10:20:41 -07:00
0ea4324e22
[DOCS] Adds data nanos transform limitation ( #53826 )
2020-03-23 09:48:00 -07:00
bad7580f87
[DOCS] Add generated_dest_index to preview transform API ( #53905 )
2020-03-23 09:40:25 -07:00
108f9ca73f
[DOCS] Adds painless transform examples ( #53274 )
...
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2020-03-23 10:38:36 +01:00
f2929fe2cd
[DOCS] Adds performance considerations section to transforms overview ( #53791 )
...
Co-Authored-By: Lisa Cawley <lcawley@elastic.co>
2020-03-19 17:49:19 +01:00
0edfbd7179
[DOCS] Adds example links to transform tutorial ( #53640 )
2020-03-19 09:40:29 -07:00
35ad63036e
[DOCS] Add transform nodes ( #53698 )
2020-03-18 15:23:41 -07:00
7aa661c2eb
[DOCS] Adds operations_behind to transform stats ( #53518 )
2020-03-13 09:32:15 -07:00
1a099fa075
[DOCS] Correct important note for xpack.transform.enabled ( #52194 )
...
Because transforms get assigned to an arbitrary data node it
is important that the transforms plugin is enabled on every
data node.
2020-02-11 12:54:09 +00:00
14900c23fd
[DOCS] Defines data frame transform stats API objects ( #44197 )
2020-02-05 12:23:30 -08:00
0e38bd8294
[DOCS] Minor fixes in transform documentation ( #51633 )
2020-01-29 16:52:40 -08:00
f9ba80a7c5
[DOCS] Removes beta qualifiers from transform documentation ( #51553 )
2020-01-29 08:40:38 -08:00
fd97b772ad
[DOCS] Removes CCS limitation item from Transforms limitations. ( #51151 )
2020-01-20 09:42:04 +01:00
207525bb70
[Transform] fail to start/put on missing pipeline ( #50701 )
...
If a pipeline referenced by a transform does not exist, we should not allow the transform to be created.
We do allow the pipeline existence check to be skipped with defer_validations, but if the pipeline still does not exist on `_start`, the pipeline will fail to start.
relates: #50135
2020-01-09 09:31:44 -05:00
6d608e6a0d
[DOCS] Move transform resource definitions into APIs ( #50108 )
2019-12-17 09:01:31 -08:00
d442ff9223
[DOCS] Updates transform screenshots and text ( #50059 )
2019-12-12 08:20:39 -08:00
37cc0b6c9e
[DOCS] Fixes attribute in transforms overview. ( #49898 )
2019-12-06 10:23:01 +01:00
25474c62f1
[Transform][DOCS]rewrite client ip example to use continuous transform ( #49822 )
...
adapt the transform example for suspicious client ips to use continuous transform
2019-12-06 08:19:21 +01:00
6dad2662ae
[DOCS] Removes data frame leftovers from transforms overview ( #49434 )
2019-11-22 09:13:55 +01:00
65023eaf67
update the name of the audit index ( #49432 )
...
small update to the name of the audit index changed in 7.5
2019-11-21 16:14:41 +01:00
451a5c0621
[ML][Transforms] add wait_for_checkpoint flag to stop ( #47935 )
...
Adds `wait_for_checkpoint` for `_stop` API.
2019-10-28 11:21:21 -04:00
5e8eb1b3a4
update warning about index names after transform rename ( #48457 )
...
update warning about index names after transform rename
2019-10-24 15:16:20 +02:00
c1c4efcfd3
[DOCS][Transform] document limitation regarding rolling upgrade with 7.2, 7.3 ( #48118 )
...
adds a limitation about rolling upgrade from 7.2 or 7.3. and fixes a problem with renamed preferences
2019-10-22 09:00:08 +02:00
a20f71ad8d
update internal index name in documentation warning ( #48125 )
2019-10-17 14:22:36 +02:00
e5af8bb3f8
[DOCS] Applies rename of transform related roles and privileges ( #48123 )
2019-10-17 10:22:38 +02:00
e9e121c9ce
[Transform] move root endpoint to _transform with BWC layer ( #47127 )
...
move the main endpoint to /_transform/ from /_data_frame/transforms/ with providing backwards compatibility and deprecation warnings
2019-10-07 16:21:51 +02:00
István Zoltán Szabó
Przemysław Witek
Hendrik Muhs
Lisa Cawley
Felix Barnsteiner
James Rodewig
Benjamin Trent
William Brafford
David Roberts