Commit Graph

58 Commits

Author SHA1 Message Date
Przemysław Witek 7be74a8046
Introduce `deduce_mappings` transform setting (#82256) 2022-01-18 09:01:23 +01:00
Lisa Cawley 4ed6e8ad3c
[DOCS] Adds missing timeout parameter to transform APIs (#81129) 2021-12-02 13:28:28 -08:00
Lisa Cawley 8ab03d021c
[DOCS] Edits reset transforms API (#81027) 2021-11-25 08:40:50 -08:00
Przemysław Witek 9b058da548
[Transform] Transform Reset API (#79828) 2021-11-09 10:21:57 +01:00
James Rodewig f56a0f4b66
[DOCS] Remove `testenv` annotations from doc snippet tests (#80023)
Removes `testenv` annotations and related code. These annotations originally let you skip x-pack snippet tests in the docs. However, that's no longer possible.

Relates to #79309, #31619
2021-11-05 18:38:50 -04:00
Lisa Cawley c10bf9be84
[DOCS] Add transform breaking changes (#79531) 2021-10-25 08:08:18 -07:00
István Zoltán Szabó 8c262f0edf
[DOCS] Updates transforms upgrade API docs (#79608) 2021-10-21 19:03:01 +02:00
István Zoltán Szabó f13912c1b3
[DOCS] Drafts docs for Upgrade Transforms API (#79139) 2021-10-19 16:03:54 +02:00
Przemysław Witek 1595d3a20f
[Transform] Add _meta field to TransformConfig (#79003) 2021-10-15 08:12:03 +02:00
Hendrik Muhs 939f81e557
[Transform] add transform upgrade endpoint (#77566)
Add an _upgrade endpoint to bulk upgrade transforms. _upgrade rewrites all transforms and its
artifacts into the latest format to the latest storage(index). If all transforms are upgraded old
indices and outdated documents get deleted. Using the dry_run option it is possible to check if
upgrades are necessary without applying changes.
2021-10-13 08:49:45 +02:00
Lisa Cawley 1575d34822
[DOCS] Fix formatting (#77567)
This PR fixes a missing backtick.
2021-09-10 09:33:32 -07:00
Przemysław Witek 676d4de3de
[Transform] Implement the ability to preview the existing transform (#76697) 2021-08-24 14:41:49 +02:00
Przemysław Witek ec07e4213e
[Transform] Rename interim_results to align_checkpoints (#76609) 2021-08-18 13:58:50 +02:00
Lisa Cawley 5273011f98
[DOCS] Update transforms tutorial with index mapping details (#73395) 2021-06-02 13:45:01 -07:00
István Zoltán Szabó 090690d17a
[DOCS] Revises required privileges info in Transforms API docs (#72803) 2021-05-06 15:19:28 +02:00
Lisa Cawley 0074ba6d5a
[DOCS] Clarify update transform API (#72427) 2021-04-29 07:57:58 -07:00
James Rodewig 693807a6d3
[DOCS] Fix double spaces (#71082) 2021-03-31 09:57:47 -04:00
James Rodewig 5c75d004fa
[DOCS] Replace `put` with `create or update` in API names (#70330)
Co-authored-by: debadair <debadair@elastic.co>
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
2021-03-15 14:49:44 -04:00
James Rodewig 010a973018
[DOCS] Refactor ingest pipeline docs (#70253) 2021-03-15 12:22:57 -04:00
István Zoltán Szabó a3fdaceeb1
[DOCS] Expands transforms docs with CCS info (#70156)
Co-authored-by: Lisa Cawley <lcawley@elastic.co>
2021-03-10 15:54:31 +01:00
István Zoltán Szabó 300031b247
[DOCS] Removes beta from latest Transform docs. (#69964) 2021-03-04 16:36:47 +01:00
István Zoltán Szabó 4443cb2f0e
[DOCS] Adds retention_policy to PUT Transform API docs (#68656)
Co-authored-by: lcawl <lcawley@elastic.co>
2021-02-09 08:00:47 +01:00
Hendrik Muhs 54ed2e37d9
[Transform] implement retention policy to delete data from a transform (#67832)
add a retention policy to transform to delete data that is considered outdated as part of a
transform checkpoint.

fixes #67916
2021-02-08 15:06:15 +01:00
Hendrik Muhs cf08c0e6ab
[Transform] refactor cat transform to show more useful information (#68232)
Refactoring of cat transform to show more relevant information. The current cat transform shows a
lot of configuration details, however cat should show operationally useful information. This PR
changes the defaults and also adds when transform did a search last.
2021-02-02 07:29:20 +01:00
Przemysław Witek d78f39c2ad
[Transform] Add support for search-time runtime fields. (#67643) 2021-01-21 13:27:42 +01:00
Lisa Cawley 97dedbd192
[DOCS] Add beta qualifier to transform latest APIs (#67036) 2021-01-05 12:28:19 -08:00
Lisa Cawley d5892c50cd
[DOCS] Drafts API changes for transform latest function (#66481) 2020-12-18 09:50:09 -08:00
Hendrik Muhs 9b47889153
[Transform] use ISO dates in output instead of epoch millis (#65584)
Transform writes dates as epoch millis, this does not work for historic data in some cases or is
unsupported. Dates should be written as such. With this PR transform starts writing dates in ISO
format, but as existing transform might rely on the format it provides backwards compatibility for
old jobs as well as a setting to write dates as epoch millis.

fixes #63787
2020-12-07 15:34:28 +01:00
James Rodewig 1ea83359bb
[DOCS] Fix case for 'Boolean' (#64299) 2020-10-29 09:04:43 -04:00
Benjamin Trent ebcac2d864
[Transform] add new exclude_generated flag to GET transform (#63093)
This adds a new flag `exclude_generated` for GET transform API.

This flag is useful for when a transform needs to be cloned within a cluster or exported/imported between clusters.

It removes certain fields that are not able to be set via the PUT api (e.g. version, create_time).

relates https://github.com/elastic/elasticsearch/issues/63055
2020-10-20 11:38:40 -04:00
Lisa Cawley 1781d4a7b9
[DOCS] Fix security links in machine learning APIs (#60098) 2020-07-23 12:14:56 -07:00
Lisa Cawley 3f4da04c3e
[DOCS] Changes level offset of transform pages (#60066) 2020-07-22 10:55:48 -07:00
Lisa Cawley 0f52cab495
[DOCS] Replaces docdir attributes in ML APIs (#57390) 2020-06-01 11:46:10 -07:00
Lisa Cawley d7735d9ef2
[DOCS] Add throttling based on configuration parameter (#56653) 2020-05-14 08:38:57 -07:00
Hendrik Muhs a73511e4c7
[DOC] document transform settings and docs_per_second (#56178)
add documentation for throttling, added in #56007
2020-05-11 09:21:36 +02:00
Hendrik Muhs 33f134f556
[Transform] add throttling (#56007)
add throttling to transform, throttling will slow down search requests by delaying the execution based on a documents per second metric. 

fixes #54862
2020-05-05 11:34:54 +02:00
István Zoltán Szabó a65eb43f6c
[DOCS] Updates transform prerequisites (#54804) 2020-04-06 17:06:22 +02:00
Lisa Cawley 5d590b5be6
[DOCS] Add processing details to get transforms stats API (#54368) 2020-04-01 09:50:57 -07:00
Lisa Cawley fdcd19483d
[DOCS] Collapses content in machine learning APIs (#54234) 2020-03-30 10:08:38 -07:00
Benjamin Trent 3c81082fdf
[Transform] fixing naming in HLRC and _cat to match API content (#54300)
Fixing the naming of the HLRC values to match the ToXContent field names (i.e. the field names returned from an API call).

Also fixes the names in the _cat API as well.

closes #53946
2020-03-30 08:10:15 -04:00
Lisa Cawley 6fceef73e4
[DOCS] Augments cat transforms API (#53776)
Co-Authored-By: Benjamin Trent <ben.w.trent@gmail.com>
2020-03-25 12:35:01 -07:00
Lisa Cawley bad7580f87
[DOCS] Add generated_dest_index to preview transform API (#53905) 2020-03-23 09:40:25 -07:00
Lisa Cawley 7aa661c2eb
[DOCS] Adds operations_behind to transform stats (#53518) 2020-03-13 09:32:15 -07:00
Lisa Cawley 14900c23fd
[DOCS] Defines data frame transform stats API objects (#44197) 2020-02-05 12:23:30 -08:00
Lisa Cawley f9ba80a7c5
[DOCS] Removes beta qualifiers from transform documentation (#51553) 2020-01-29 08:40:38 -08:00
Benjamin Trent 207525bb70
[Transform] fail to start/put on missing pipeline (#50701)
If a pipeline referenced by a transform does not exist, we should not allow the transform to be created. 

We do allow the pipeline existence check to be skipped with defer_validations, but if the pipeline still does not exist on `_start`, the pipeline will fail to start.

relates:  #50135
2020-01-09 09:31:44 -05:00
Lisa Cawley 6d608e6a0d
[DOCS] Move transform resource definitions into APIs (#50108) 2019-12-17 09:01:31 -08:00
Benjamin Trent 451a5c0621
[ML][Transforms] add wait_for_checkpoint flag to stop (#47935)
Adds `wait_for_checkpoint` for `_stop` API.
2019-10-28 11:21:21 -04:00
Hendrik Muhs 5e8eb1b3a4
update warning about index names after transform rename (#48457)
update warning about index names after transform rename
2019-10-24 15:16:20 +02:00
Hendrik Muhs a20f71ad8d
update internal index name in documentation warning (#48125) 2019-10-17 14:22:36 +02:00