Commit Graph

1118 Commits

Author SHA1 Message Date
Costin Leau ec57fbec6f
SQL: Remove JDBC dependency on ES lib geo (#82166)
As part of the effort of making JDBC driver self sufficient, remove the
ES lib geo dependencies without any replacement.
Currently the JDBC driver takes the WKT text and instantiates a geo
object based on the ES lib geo.
Moving forward the driver will return the WKT string representation
without any conversion letting the user pick the geo library desired.
That can be ES lib geo, jts, spatial4j or others.

Note this is a breaking change.

Relates #80277
2022-01-04 07:55:41 +02:00
James Rodewig efeb1983ae
[DOCS] Combine 8.0 breaking changes for mapping type endpoints (#81730)
Combines several 8.0 breaking changes for the removal of API endpoints that contain mapping types. These items were separate because we previously organized breaking changes by area.

This is a follow-on to #79162.
2021-12-17 16:03:51 -05:00
Alan Woodward f0bf6f5ee3
Configure IndexSearcher.maxClauseCount() based on Node characteristics (#81525)
This commit deprecates the indices.query.bool.max_clause_count node setting,
and instead configures the maximum clause count for lucene based on the available
heap and the size of the thread pool.

Closes #46433
2021-12-17 11:37:32 +00:00
James Rodewig cec4a79a8e [DOCS] Fix formatting typo 2021-12-09 15:46:44 -05:00
James Rodewig 1519bb6ecb
[DOCS] Update snapshot defaults for system indices (#81226)
Updates the snapshot and restore docs for https://github.com/elastic/elasticsearch/pull/79670.

Closes https://github.com/elastic/elasticsearch/issues/81183
2021-12-08 10:15:14 -05:00
Keith Massey 68a9eaa4dc
Adding discovery.zen.bwc_ping_timeout to the list of removed zen settings (#81310)
This commit adds the discovery.zen.bwc_ping_timeout setting our documentation about the
settings that have been removed in 8.0.
2021-12-03 16:16:48 -06:00
James Rodewig e999ad0061
[DOCS] Relocate 8.0 `repositories.fs.compress` breaking change (#81216)
The change removes a node-level setting. It was accidentally placed with REST API changes as part of https://github.com/elastic/elasticsearch/issues/79162. This moves the breaking change to the cluster and node setting changes section.
2021-12-01 09:53:10 -05:00
Ignacio Vera 00aa197399
Fields API should return normalize geometries (#80649)
Fields API deliver now the normalize geometries instead of the plain geometries from source

Co-authored-by: James Rodewig <james.rodewig@elastic.co
2021-12-01 08:10:54 +01:00
James Rodewig 58f32b361f
[DOCS] Update 8.0 breaking change for searchable snapshot shared cache (#80793)
You can no longer configure `xpack.searchable.snapshot.shared_cache.size` as a user setting in ESS on 7.13+ deployments. This PR removes the ESS icon from the related 8.0 breaking change for the setting.

It also clarifies the breaking change text to indicate that configuring the setting on non-frozen nodes will result in an error on startup.

Relates to https://github.com/elastic/elasticsearch/pull/80795
2021-11-19 11:25:55 -05:00
James Rodewig 2f4143267e
[DOCS] Un-deprecate transient cluster settings (#80766) (#80780)
#80556 reverted the deprecation of transient cluster settings. This replaces deprecation language in the docs with a warning/recommendation to avoid transient settings.

Closes #80557
# Conflicts:
#	docs/reference/migration/migrate_7_16.asciidoc
2021-11-16 16:00:13 -05:00
James Rodewig 5061c460e6
[DOCS] Remove unneeded breaking changes files (#80729)
Removes some unneeded files related to the previous organization of breaking changes.

Relates to #79162 and https://github.com/elastic/stack-docs/pull/1877
2021-11-15 17:24:58 -05:00
James Rodewig 987010db47
[DOCS] Fix 8.0 breaking change tags (#80725)
Includes command line tool deprecations in the notable changes tag.
2021-11-15 12:00:35 -05:00
James Rodewig 767a23727e
[DOCS] Organize breaking changes by component (#79162)
* Reorganizes the 8.0.0 and 8.1.0 breaking changes and deprecations into component-based categories.
* Adds an ESS icon to cluster settings on the ESS user settings allowlist.
* Adds tips for sections that aren't relevant to Cloud users.
* Updates the labels for some items to provide better context.

Co-authored-by: debadair <debadair@elastic.co>
2021-11-15 10:42:12 -05:00
David Turner f9afa8750f
Fix up docs for #78876 (#80580)
Follow-up to #78876 to rework the deprecation docs slightly.
2021-11-10 10:23:01 +00:00
Nikola Grcevski 3308dd5c00
Undo transient settings deprecation (#80558)
This change removes the deprecation warning when calling
the cluster settings APIs with transient settings.

Relates to #80556
2021-11-09 17:07:55 -05:00
Artem Prigoda 27fd66d084
Deprecate lenient parsing of bulk actions (#78876)
Make sure there are no arbitrary fields after an action declaration and that it gets properly closed by a curly bracket.

Resolves #43774
2021-11-09 13:09:19 +01:00
David Turner 8cf4c7b6fb
Remove last few mentions of Zen discovery (#80410)
We have a few leftover mentions of `zen` discovery, mostly for
historical/BwC reasons, which this commit removes.

Prior to this commit the default value for `discovery.type` was `zen`
but this was not written down anywhere or officially supported: the two
options were to set it to `single-node` or to omit it entirely. This
commit changes the default to `multi-node` and documents this.

Co-authored-by: Adam Locke <adam.locke@elastic.co>
2021-11-09 09:52:06 +01:00
Jake Landis 375481e615
Add a note about support for deprecation.skip_deprecated_settings (#80035)
This commit adds a warning that this setting should only
be used indirectly by ESS/ECE/ECK. Wording is borrowed from
[cloud-only](54335b0790/shared/attributes.asciidoc (L145))
2021-11-08 07:57:30 -06:00
Artem Prigoda a2c3daead1
Return 200 OK response code for a cluster health timeout (#78968)
Returning 408 for a cluster health timeout was deprecated in #78180 and backported to 7.x in #78940

Now we can do a breaking change in 8.0 respecting the user choice to run ES in 7.x compatible mode via the REST Compatibility layer.

Fixes #70849
2021-11-06 19:46:27 +01:00
James Rodewig f56a0f4b66
[DOCS] Remove `testenv` annotations from doc snippet tests (#80023)
Removes `testenv` annotations and related code. These annotations originally let you skip x-pack snippet tests in the docs. However, that's no longer possible.

Relates to #79309, #31619
2021-11-05 18:38:50 -04:00
James Rodewig cb6347b3da
[DOCS] Add transient settings migration guide (#80091) (#80272)
Changes:

* Adds a transient settings migration guide to the 7.16 docs.
* Updates the related deprecation docs to link to the guide.

Closes #80055

Relates to #79167.
2021-11-03 09:23:25 -04:00
Lisa Cawley a80be4d7ac
[DOCS] Fixes version in ML breaking change (#80240) 2021-11-02 18:47:53 -07:00
Lisa Cawley 18320c0757
[DOCS] Adds breaking change for allow_no_datafeeds and allow_no_jobs (#80155) 2021-11-01 12:08:29 -07:00
James Rodewig 51e65b4dcb
[DOCS] Fix whitespace in tier filtering 8.0 breaking change (#79913)
Adds some whitespace so these display as unordered lists.
2021-10-27 09:30:30 -04:00
Dan Hermann 9e93765ee1
Document removal of freeze index API in migration guide (#79801) 2021-10-27 08:01:21 -05:00
Adam Locke 4d8dd1ff3f
[DOCS] Fix typos in 8.0 security migration (#79802)
* [DOCS] Fix typo

* Fix other typos

* Fix line break in deprecation notice
2021-10-26 08:51:51 -04:00
Ioannis Kakavas 0eb2baa07d
CLI tool to (re)set users password (#79709)
This change introduces a new CLI tool that can be used to set and
reset the password of all the built-in users and users in the native
realm in Elasticsearch. It depends on the file realm being enabled
(which it is, by default) and can (re)set one built-in user password at a time.
It removes the previously introduced elasticsearch-reset-elastic-password
and elasticsearch-reset-kibana-system-password as their functionality is
covered by this new tool.
2021-10-26 07:57:18 +03:00
Lisa Cawley c10bf9be84
[DOCS] Add transform breaking changes (#79531) 2021-10-25 08:08:18 -07:00
bellengao fd68b04049
Throw a RepositoryConflictException when trying to put or delete a repository in use (#56070) 2021-10-21 13:16:36 +02:00
Przemyslaw Gomulka 6aa0db817c
[DOCS] Migration information about ES logging breaking changes (#79146)
Adds breaking change docs for #47105. (ECS layout and plaintext log files removal)

Relates to #46119
2021-10-20 17:02:29 +02:00
Gordon Brown 1a906897e6
Implement framework for migrating system indices (#78951)
This PR adds a framework for migrating system indices as necessary prior
to Elasticsearch upgrades. This framework uses REST APIs added in
another commit:
- GET _migration/system_features

This API, which gets the status of "features" (plugins which own system
indices) with regards to whether they need to be upgraded or not. As of
this PR, this API also reports errors encountered while migrating system
indices alongside the index that was being processed when this occurred.

As an example of this error reporting:

```json
{
    "feature_name": "logstash_management",
    "minimum_index_version": "8.0.0",
    "upgrade_status": "ERROR",
    "indices": [
        {
            "index": ".logstash",
            "version": "8.0.0",
            "failure_cause": {
                "error": {
                    "root_cause": [
                        {
                            "type": "runtime_exception",
                            "reason": "whoopsie",
                            "stack_trace": "<omitted for brevity>"
                        }
                    ],
                    "type": "runtime_exception",
                    "reason": "whoopsie",
                    "stack_trace": "<omitted for brevity>"
                }
            }
        }
    ]
}
```

- POST _migration/system_features

This API starts the migration process. The API for this has no changes,
but when called, any system indices which need to be migrated will be
migrated, with status information stored in the cluster state for later
use by the GET _migration/system_features API.
2021-10-19 18:52:22 -06:00
James Baiera ceaf53cf9e
Add deprecation info API entries for deprecated monitoring settings (#78799)
Recently we have deprecated a number of settings in monitoring. These settings should be represented in the deprecation info API. This PR will be backported with some minor changes to the 7.x branch so that we can start the deprecation process in that release cycle.
2021-10-19 12:45:38 -04:00
Ioannis Kakavas d6ef299975
Add note in breaking changes for nameid_format (#77785)
* Add note in breaking changes for nameid_format

We changed the default for `nameid_format` in 8.0 in #44090 but
did not add anything to the breaking changes in the release notes.
This change amends that.

* remove reference to settings

* Fix docs build

* Accepting most of James' suggested changes

Thanks James!

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

* Incorporating changes from Ioannis

* Apply suggestions from code review

Co-authored-by: Tim Vernum <tim@adjective.org>

* Apply suggestions from code review

Co-authored-by: Ioannis Kakavas <ikakavas@protonmail.com>

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
Co-authored-by: Adam Locke <adam.locke@elastic.co>
Co-authored-by: Tim Vernum <tim@adjective.org>
2021-10-19 12:38:52 -04:00
William Brafford 5c6a481cb7
Use 'migration' instead of 'upgrade' in GET system feature migration status responses (#79302)
* Change 'upgrade' to 'migration' in System Index Migration responses

* Mute rest compatibility test
2021-10-19 12:15:26 -04:00
Jack Conradson 55e5daf470
Add deprecated methods for JodaCompatibleZonedDateTime to docs (#79202)
This change adds all the JodaCompatibleZonedDateTime methods that no longer exist to the 
migration docs with their ZonedDateTime equivalents.

Fixes: #78739
2021-10-18 08:00:47 -07:00
Adam Locke 8510766e7d
[DOCS] Add deprecation notice for reset password tool (#78793)
* [DOCS] Add deprecation notice for elastic-reset-password

* Change links to be external

* Update wording

Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com>
2021-10-18 07:59:01 -04:00
Keith Massey 87fa61cc3f
Filtering setting deprecation info API messages based on a setting (#78725) (#79184)
This commit adds the ability to configure a list of settings that will be ignored by the deprecation info
API. Any deprecation messages for any of the settings given will be suppressed. This can be used to hide
settings that users do not have the ability to change.
Relates #78725
2021-10-14 16:31:13 -05:00
Martijn van Groningen 04e5823a69
Remove default maxmind geoip databases from distribution (#78362)
* Adjusted integration tests to use geoip test fixture or to use test databases provided via config dirs (for qa module / docs).
* Kept the geolite2-databases dependency for most of the unit tests only.
* Made fallback_to_default_databases parameter on geoip processor a noop and emit deprecation warning upon using it.
* If no geoip databases are available yet to a node then the geoip processor factory returns a processor implementation that flags documents that databases are unavailable. This allows these documents to be reindex later with a pipeline. These documents will have a tag string array field, which contains a string _geoip_database_unavailable_{database_name} for each missing database in a pipeline.
* Added reload pipeline capabilities is IngestService, so that when databases are available again on a node then pipelines with geoip processor definition can be reloaded.

Relates to #68920
2021-10-13 14:52:18 +02:00
James Rodewig ae50acdbf8
[DOCS] Add 8.0 breaking change for adjacency matrix setting (#79023)
Adds an 8.0 breaking change for the removal of the
`index.max_adjacency_matrix_filters` index setting.

Relates to #77803.
2021-10-13 08:33:39 -04:00
James Rodewig a023febd20
[DOCS] Update the 8.0 Java breaking change for consistency (#79018)
Portions of the change reference Java 11 while other portions reference
Java 17. This updates the docs to consistently use Java 17.
2021-10-13 07:27:31 -04:00
William Brafford 0a28c7cb91
Implement GET API for System Feature Upgrades (#78642)
* Implement and test get feature upgrade status API
* Add integration test for feature upgrade endpoint
* Use constant enum for statuses
* Add unit tests for transport class methods
2021-10-07 15:18:47 -04:00
debadair 248b2293f9
[DOCS] Add info about FIPS and Java 17 (#78580)
* [DOCS] Updated breaking changes entry for Java 11.
2021-10-06 11:54:48 -07:00
James Baiera aa3d5109b1
Automatically install monitoring templates at plugin initialization (#78350)
This PR adds a MonitoringIndexTemplateRegistry to the monitoring plugin which automatically 
installs all monitoring templates locally when the plugin is initialized. Exporters have been 
updated to no longer attempt installation of the monitoring templates, and instead will wait for 
the templates to become available before setting themselves as started. Some older 
functionality related to templates has been removed as well, such as the expectation that 
version 6 monitoring templates are installed, as well as the setting that controls their installation
(xpack.monitoring.exporters.<EXPORTER>.index.template.create_legacy_templates).
2021-10-05 14:05:20 -04:00
Jack Conradson 2cf160f2c0
Remove deprecated code from stored scripts (#78643)
This change removes several pieces of deprecated code from stored scripts.

Stored scripts/templates are no longer allowed to be an empty and will throw an exception when used 
with PutStoredScript.

ScriptMetadata will now drop any existing stored scripts that are empty with a deprecation warning in 
the case they have not been previously removed.

The code field is now only allowed as source as part of a PutStoredScript JSON blob.
2021-10-05 10:41:39 -07:00
James Rodewig 2893ea911b
[DOCS] Remove duplicate line from migration guide (#78688) 2021-10-05 08:52:11 -04:00
Joe Gallo 4a14f2f6f9
Validate that snapshot repository exists for ILM policies at creation/update time (#78468) 2021-10-04 15:19:10 -04:00
debadair 7431a9656e
[DOCS] Fix erroneous page break. (#78487) 2021-09-29 15:12:13 -07:00
William Brafford 8c2fe902f3
Feature upgrade rest stubs (#77827)
* Add stubs for get API
* Add stub for post API
* Register new actions in ActionModule
* HLRC stubs
* Unit tests
* Add rest api spec and tests
* Add new action to non-operator actions list
2021-09-29 16:25:15 -04:00
Jack Conradson 086ba1aefb
Remove JodaCompatibleZonedDateTime (#78417)
This change removes JodaCompatibleZonedDateTime and replaces it with ZonedDateTime for use in 
scripting.

Breaking changes:
* JodaCompatibleDateTime no longer exists and cannot be cast to in Painless. Use ZonedDateTime 
instead.
* The dayOfWeek method on ZonedDateTime returns the DayOfWeek enum instead of an int from 
JodaCompatibleDateTime. dayOfWeekEnum still exists on ZonedDateTime as an augmentation to 
support the transition to ZonedDateTime, but is now deprecated in favor of dayOfWeek on 
ZonedDateTime.
2021-09-29 13:01:40 -07:00
James Rodewig 4544ab2dbb
[DOCS] Always enable file and native realms unless explicitly disabled (#78405)
* [DOCS] Always enable file and native realms by default

Adds an 8.0 breaking change for PR #69096.

The copy is based on the 7.13 deprecation notice added with PR #69320.

* reword

* Update docs/reference/migration/migrate_8_0/security.asciidoc

Co-authored-by: Yang Wang <ywangd@gmail.com>

* Update docs/reference/migration/migrate_8_0/security.asciidoc

Co-authored-by: Yang Wang <ywangd@gmail.com>

Co-authored-by: Yang Wang <ywangd@gmail.com>
2021-09-29 09:10:30 -04:00