elasticsearch/docs/reference/ml/df-analytics/apis
Benjamin Trent f72b2db29a
[ML] partitions model definitions into chunks (#55260)
This paves the data layer way so that exceptionally large models are partitioned across multiple documents.

This change means that nodes before 7.8.0 will not be able to use trained inference models created on nodes on or after 7.8.0.

I chose the definition document limit to be 100. This *SHOULD* be plenty for any large model. One of the largest models that I have created so far had the following stats:
~314MB of inflated JSON, ~66MB when compressed, ~177MB of heap. 
With the chunking sizes of `16 * 1024 * 1024` its compressed string could be partitioned to 5 documents. 
Supporting models 20 times this size (compressed) seems adequate for now.
2020-04-20 15:13:23 -04:00
..
delete-dfanalytics.asciidoc [DOCS] Changes kibana_user to kibana_admin in DFA API prerequisites. (#54806) 2020-04-06 15:45:08 +02:00
delete-inference-trained-model.asciidoc [DOCS] Changes kibana_user to kibana_admin in DFA API prerequisites. (#54806) 2020-04-06 15:45:08 +02:00
evaluate-dfanalytics.asciidoc Add missing docs for new evaluation metrics (#50967) 2020-01-15 14:23:37 +01:00
explain-dfanalytics.asciidoc [DOCS] Removes unshared sections from ml-shared.asciidoc (#55129) 2020-04-14 15:19:31 -07:00
get-dfanalytics-stats.asciidoc [DOCS] Adds description of analysis_stats object and its properties to GET DFA stats API docs (#53881) 2020-03-31 13:27:54 +02:00
get-dfanalytics.asciidoc [DOCS] Removes unshared sections from ml-shared.asciidoc (#55129) 2020-04-14 15:19:31 -07:00
get-inference-trained-model-stats.asciidoc [DOCS] Fine-tunes data frame analytics API docs formatting. (#50799) 2020-01-09 16:21:01 +01:00
get-inference-trained-model.asciidoc [DOCS] Removes unshared sections from ml-shared.asciidoc (#55129) 2020-04-14 15:19:31 -07:00
index.asciidoc [DOCS] Adds PUT inference API docs (#51231) 2020-01-31 13:12:24 +01:00
put-dfanalytics.asciidoc [DOCS] Removes unshared sections from ml-shared.asciidoc (#55129) 2020-04-14 15:19:31 -07:00
put-inference.asciidoc [ML] partitions model definitions into chunks (#55260) 2020-04-20 15:13:23 -04:00
start-dfanalytics.asciidoc [DOCS] Removes unshared sections from ml-shared.asciidoc (#55129) 2020-04-14 15:19:31 -07:00
stop-dfanalytics.asciidoc [DOCS] Changes kibana_user to kibana_admin in DFA API prerequisites. (#54806) 2020-04-06 15:45:08 +02:00