Nik Everett 9022cccba7 ESQL: CATEGORIZE as a BlockHash (#114317) ... Re-implement `CATEGORIZE` in a way that works for multi-node clusters. This requires that data is first categorized on each data node in a first pass, then the categorizers from each data node are merged on the coordinator node and previously categorized rows are re-categorized. BlockHashes, used in HashAggregations, already work in a very similar way. E.g. for queries like `... | STATS ... BY field1, field2` they map values for `field1` and `field2` to unique integer ids that are then passed to the actual aggregate functions to identify which "bucket" a row belongs to. When passed from the data nodes to the coordinator, the BlockHashes are also merged to obtain unique ids for every value in `field1, field2` that is seen on the coordinator (not only on the local data nodes). Therefore, we re-implement `CATEGORIZE` as a special BlockHash. To choose the correct BlockHash when a query plan is mapped to physical operations, the `AggregateExec` query plan node needs to know that we will be categorizing the field `message` in a query containing `... | STATS ... BY c = CATEGORIZE(message)`. For this reason, _we do not extract the expression_ `c = CATEGORIZE(message)` into an `EVAL` node, in contrast to e.g. `STATS ... BY b = BUCKET(field, 10)`. The expression `c = CATEGORIZE(message)` simply remains inside the `AggregateExec`'s groupings. **Important limitation:** For now, to use `CATEGORIZE` in a `STATS` command, there can be only 1 grouping (the `CATEGORIZE`) overall.		2024-11-27 17:44:55 +01:00
..
aggregations	DOCS: Correct explanation of percentiles_bucket (#116499)	2024-11-08 12:40:53 -05:00
analysis	Provide access to new settings for HyphenationCompoundWordTokenFilter (#115585)	2024-11-18 17:38:49 +01:00
autoscaling	(Doc+) Link API doc to parent object - part1 (#111951)	2024-08-20 14:58:18 -06:00
behavioral-analytics/apis	(Doc+) Link API doc to parent object - part1 (#111951)	2024-08-20 14:58:18 -06:00
cat	Remove checking of sync commit ids (#114246)	2024-11-01 16:18:12 +01:00
ccr	(Doc+) Link API doc to parent object - part1 (#111951)	2024-08-20 14:58:18 -06:00
cluster	[DOCS] Remove broken migration guide link (#117293)	2024-11-21 14:02:18 -08:00
commands	Remove cluster state from `/_cluster/reroute` response (#114231)	2024-10-08 07:59:57 +01:00
connector	[Docs] Update incremental sync note (#117545)	2024-11-26 11:06:52 +00:00
data-management	…
data-streams	Include a link to downsampling a TSDS using DSL document (#117510)	2024-11-26 08:09:30 -08:00
docs	(+Doc) Link setting reference for action.auto_create_index (#110558)	2024-07-11 07:57:18 -06:00
eql	(Doc+) Link API doc to parent object - part1 (#111951)	2024-08-20 14:58:18 -06:00
esql	ESQL: CATEGORIZE as a BlockHash (#114317)	2024-11-27 17:44:55 +01:00
features/apis	Simplify reset-features API (#110866)	2024-07-15 13:23:21 +01:00
fleet	…
graph	…
health	[DOCS] Fixes the description of 'affected_resources' in health API documentation (#111833)	2024-08-13 18:51:49 +02:00
high-availability	Round up shard allocation / recovery / relocation concepts (#109943)	2024-07-25 14:44:57 -04:00
how-to	[DOCS] Rename how-to subsection, move recipes to search relevance (#117044)	2024-11-19 18:27:05 +01:00
ilm	(Doc+) link videos for allocation and ilm (#116880)	2024-11-19 14:43:50 -07:00
images	Docs for starred esql queries in Kibana (#117468)	2024-11-25 15:13:23 +01:00
index-modules	Clarify the vector files utilized for preloading (#116488)	2024-11-12 08:30:48 +11:00
indices	Remove deprecated local parameter from alias APIs (#115393)	2024-10-24 15:58:24 +01:00
inference	[DOCS] : swap allocation sections (#116518)	2024-11-27 11:39:07 +01:00
ingest	Document new ip_location processor (#116623)	2024-11-11 19:55:57 -05:00
licensing	…
mapping	Mention `bbq_hnsw` for `m` and `ef_construction` options in docs (#117022)	2024-11-25 14:50:09 +01:00
migration	Bump 8.x to 8.18.0	2024-11-21 14:37:05 -05:00
ml	Remove duplicate 'the the' (#116023)	2024-10-31 19:14:58 +01:00
modules	Output a consistent format when generating error json (#90529)	2024-11-19 13:35:04 +00:00
monitoring	[Docs] Update Monitoring docs with integration assets info (#112164)	2024-09-04 16:07:45 -04:00
query-dsl	Add documentation for query rules retriever (#115696)	2024-11-06 14:42:06 -05:00
query-rules/apis	Add tracking for query rule types (#116357)	2024-11-13 17:05:05 +01:00
quickstart	Update quickstart overview, add local install instructions (#115746)	2024-10-28 14:13:14 +01:00
release-notes	Bump 8.x to 8.18.0	2024-11-21 14:37:05 -05:00
repositories-metering-api	…
reranking	Remove duplicate 'the the' (#116023)	2024-10-31 19:14:58 +01:00
rest-api	Docs for monitor_stats privilege (#116533)	2024-11-12 09:13:37 -06:00
rollup	Revert "Emit deprecation warning when executing one of the rollup APIs (#112807)" (#113047)	2024-09-18 05:30:35 +10:00
scripting	Term Stats documentation (#115933)	2024-10-30 15:31:26 +01:00
search	[DOCS] Documents that ELSER is the default service for `semantic_text` (#115769)	2024-11-25 08:07:30 -05:00
search-application/apis	Remove duplicate 'the the' (#116023)	2024-10-31 19:14:58 +01:00
searchable-snapshots	Add warning about restart migration (#116769)	2024-11-14 18:07:09 +01:00
security	Upgrade Bouncy Castle FIPS dependencies (#112989)	2024-11-22 21:39:25 +11:00
settings	Introduce Email Address Allow Lists For Watcher (#116672)	2024-11-14 12:38:14 +01:00
setup	Document using xpack.ml.use_auto_machine_memory_percent setting in docker getting started (#114009)	2024-11-08 13:46:13 +01:00
shutdown/apis	[DOCS] Align docs to implementation for timeout parameters (#108593)	2024-05-16 13:05:39 +10:00
slm/apis	Add interval based SLM scheduling (#110847)	2024-08-22 21:15:29 -05:00
snapshot-restore	(Doc+) link videos for allocation and ilm (#116880)	2024-11-19 14:43:50 -07:00
sql	Removing server from the version compatibility table (#109168)	2024-05-29 11:57:46 -06:00
synonyms/apis	Clarify synonyms docs (#110822)	2024-07-18 10:20:26 +02:00
tab-widgets	[DOCS] Create Elasticsearch basics section, refactor quickstarts section (#112436)	2024-09-25 17:30:01 +02:00
text-structure/apis	…
transform	[DOCS] Adds an admonition to the transform painless examples. (#113706)	2024-09-30 09:28:28 +02:00
troubleshooting	(Doc+) link videos for allocation and ilm (#116880)	2024-11-19 14:43:50 -07:00
upgrade	(Doc+) Link Gateway Settings to Full Restart (#110902)	2024-07-25 09:10:19 -06:00
vectors	Correct bit * byte and bit * float script comparisons (#117404)	2024-11-26 03:38:06 +11:00
watcher	(#34659) - Add Timezone Configuration to Watcher (#117033)	2024-11-25 09:51:11 +00:00
aggregations.asciidoc	…
alias.asciidoc	Mention alias filters don't apply for get-by-id in docs (#108433)	2024-05-08 15:28:25 -06:00
analysis.asciidoc	…
api-conventions.asciidoc	Add known issue docs for #111854 (#111978)	2024-08-20 07:25:55 +01:00
cat.asciidoc	…
cluster.asciidoc	…
data-management.asciidoc	…
data-rollup-transform.asciidoc	…
datatiers.asciidoc	Clarify docs around disk capacity expectation. (#115745)	2024-11-11 15:59:11 +01:00
dependencies-versions.asciidoc	…
docs.asciidoc	…
geospatial-analysis.asciidoc	Make spatial search functions not preview (#117489)	2024-11-25 17:04:48 +01:00
gs-index.asciidoc	…
high-availability.asciidoc	…
how-to.asciidoc	[DOCS] Rename how-to subsection, move recipes to search relevance (#117044)	2024-11-19 18:27:05 +01:00
index-modules.asciidoc	Avoid throw exception in SyntheticSourceIndexSettingsProvider (#114479)	2024-10-14 09:45:46 +11:00
index.asciidoc	Reorder docs sidebar (#115360)	2024-10-23 12:57:59 -04:00
index.x.asciidoc	…
indices.asciidoc	…
ingest.asciidoc	[DOCS] Port connector docs from Enterprise Search guide (#112953)	2024-09-30 10:22:37 +02:00
intro.asciidoc	[DOCS] Trivial: remove tech preview badge (#117461)	2024-11-26 10:48:35 +01:00
landing-page.asciidoc	Adds hands-on learning for Search link to the landing page (#116007)	2024-10-31 14:49:11 +01:00
links.asciidoc	…
mapping.asciidoc	[DOCS][101] Update first quick start with mappings examples (#113558)	2024-10-02 20:00:09 +02:00
query-dsl.asciidoc	Group vector queries into new section (#110722)	2024-07-11 14:45:35 +02:00
redirects.asciidoc	Document new ip_location APIs (#116611)	2024-11-11 13:52:47 -05:00
release-notes.asciidoc	Prep docs for v9 (#115375)	2024-10-31 09:46:19 -05:00
run-elasticsearch-locally.asciidoc	Update quickstart overview, add local install instructions (#115746)	2024-10-28 14:13:14 +01:00
scripting.asciidoc	…
search.asciidoc	…
setup.asciidoc	[DOCS] Create Elasticsearch basics section, refactor quickstarts section (#112436)	2024-09-25 17:30:01 +02:00
troubleshooting.asciidoc	(Doc+) Capture Elasticsearch diagnostic (#108259)	2024-05-09 10:27:19 -06:00
upgrade.asciidoc	…