Commit Graph

813 Commits

Author SHA1 Message Date
A. Sophie Blee-Goldman 5c22e03e9e
MINOR: add missing docs for record-e2e-latency metrics (#10251)
Need to add missing docs for the record-e2e-latency metrics, and new TRACE recording level

Reviewers: Walker Carlson <wcarlson@confluent.io>
2021-03-04 14:42:56 -08:00
Ismael Juma 7a3ebbebbc
KAFKA-12415 Prepare for Gradle 7.0 and restrict transitive scope for non api dependencies (#10203)
Gradle 7.0 is required for Java 16 compatibility and it removes a number of
deprecated APIs. Fix most issues preventing the upgrade to Gradle 7.0.
The remaining ones are more complicated and should be handled
in a separate PR. Details of the changes:

* Release tarball no longer includes includes test, sources, javadoc and test sources jars (these
are still published to the Maven Central repository).
* Replace `compile` with `api` or `implementation` - note that `implementation`
dependencies appear with `runtime` scope in the pom file so this is a (positive)
change in behavior
* Add missing dependencies that were uncovered by the usage of `implementation`
* Replace `testCompile` with `testImplementation`
* Replace `runtime` with `runtimeOnly` and `testRuntime` with `testRuntimeOnly`
* Replace `configurations.runtime` with `configurations.runtimeClasspath`
* Replace `configurations.testRuntime` with `configurations.testRuntimeClasspath` (except for
the usage in the `streams` project as that causes a cyclic dependency error)
* Use `java-library` plugin instead of `java`
* Use `maven-publish` plugin instead of deprecated `maven` plugin - this changes the
commands used to publish and to install locally, but task aliases for `install` and
`uploadArchives` were added for backwards compatibility
* Removed `-x signArchives` line from the readme since it was wrong (it was a
no-op before and it fails now, however)
* Replaces `artifacts` block with an approach that works with the `maven-publish` plugin
* Don't publish `jmh-benchmark` module - the shadow jar is pretty large and not
particularly useful (before this PR, we would publish the non shadow jars)
* Replace `version` with `archiveVersion`, `baseName` with `archiveBaseName` and
`classifier` with `archiveClassifier`
* Update Gradle and plugins to the latest stable version (7.0 is not stable yet)
* Use `plugin` DSL to configure plugins
* Updated notable changes for 3.0

Reviewers: Chia-Ping Tsai <chia7712@gmail.com>, Randall Hauch <rhauch@gmail.com>
2021-03-04 11:22:22 -08:00
Michael G. Noll 1fd75bf1ed
KAFKA-12393: Document multi-tenancy considerations (#334) (#10263)
KAFKA-12393: Document multi-tenancy considerations
Addressed review feedback by @dajac and @rajinisivaram
Ported from apache/kafka-site#334

Reviewers: Bill Bejeck <bbejeck@apache.org>
2021-03-04 10:47:48 -05:00
Lee Dongjin ea005cc700
KAFKA-12407: Document Controller Health Metrics (#10257)
Reviewers: Luke Chen <showuon@gmail.com>, Dong Lin <lindong28@gmail.com>
2021-03-04 22:24:50 +08:00
Matthias J. Sax e2a0d0c90e
MINOR: bump release version to 3.0.0-SNAPSHOT (#10186)
Reviewers: Konstantine Karantasis <konstantine@confluent.io>, Chia-Ping Tsai <chia7712@gmail.com>
2021-02-24 17:49:18 -08:00
vamossagar12 8bd0e218d8
MINOR: Add release documentation for KIP-614 (#10051)
Reviewers: Bruno Cadonna <bruno@confluent.io>, John Roesler <vvcephei@apache.org>
2021-02-24 13:34:38 -06:00
Luke Chen 5a9435afd1
KAFKA-12350: Correct the default value in doc (#10165)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2021-02-25 01:52:34 +08:00
A. Sophie Blee-Goldman 0605b690e9
MINOR: document restriction against running multiple Streams apps on same state.dir (#10187)
Reviewers: Leah Thomas <lthomas@confluent.io>, Almog Gavra <almog@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
2021-02-23 08:39:19 -08:00
Jim Galasyn 9728b4ff92
KAFKA-12160: Remove max.poll.interval.ms from config docs (#10182)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2021-02-22 17:06:25 -08:00
Matthias J. Sax b35ca4349d
KAFKA-9274: Throw TaskCorruptedException instead of TimeoutException when TX commit times out (#10072)
Part of KIP-572: follow up work to PR #9800. It's not save to retry a TX commit after a timeout, because it's unclear if the commit was successful or not, and thus on retry we might get an IllegalStateException. Instead, we will throw a TaskCorruptedException to retry the TX if the commit failed.

Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>
2021-02-19 13:36:07 -08:00
Luke Chen b17f70ed66
MINOR: Fix broken link in quickstart.html (#10161)
Update the old anchor #intro_topic to #intro_concepts_and_terms

Reviewers: Mickael Maison <mickael.maison@gmail.com>
2021-02-19 11:36:12 +00:00
Justine Olshan 16a8f2c3c4 MINOR: Add note about topic IDs to upgrade doc (#10125)
Reviewers: Jun Rao <junrao@gmail.com>
2021-02-17 09:48:08 -08:00
Jim Galasyn da58ce4065
MINOR: Clarify config names for EOS versions 1 and 2 (#9670)
Reviewers: Boyang Chen <boyang@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2021-02-16 17:11:24 -08:00
Cheng Tan 19506b6c01
Fill in the 2.8 release note for Authorizer (#9865)
Reviewers: Ismael Juma <ismael@juma.me.uk>, Rajini Sivaram <rajinisivaram@googlemail.com>
2021-02-10 11:24:13 +00:00
Luke Chen 8bd5ceb3d2
MINOR: Update security doc
Author: Luke Chen <showuon@gmail.com>

    Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
2021-02-08 18:16:47 +05:30
John Roesler 1f240ce179 bump to 2.9 development version 2021-02-07 09:25:36 -06:00
Luke Chen 3a766bd30d MINOR: remove the indent in security doc
Reading the security doc recently, and one thing annoys me: the long indent in front of each command, ex:

![image](https://user-images.githubusercontent.com/43372967/106253151-155a1e80-6252-11eb-97f7-e8f4f60c6047.png)

![image](https://user-images.githubusercontent.com/43372967/106253176-1be89600-6252-11eb-845b-b8e478534fd7.png)

![image](https://user-images.githubusercontent.com/43372967/106253249-3589dd80-6252-11eb-82e1-45fe188b26d6.png)

https://kafka.apache.org/documentation/#security_ssl_key

Removing all the prefix indent in the commands. I'll create another PR to kafka-site if this change accepts. Thanks.

Author: Luke Chen <showuon@gmail.com>

Reviewers: Tom Bentley <tbentley@redhat.com>, Manikumar Reddy <manikumar.reddy@gmail.com>

Closes #10002 from showuon/doc_code_indent
2021-02-06 19:50:54 +05:30
Matthias J. Sax d01d97ed66
MINOR: add docs for KIP-680 (#10048)
Reviewers: Bill Bejeck <bill@confluent.io>, Jim Galasyn <jim.galasyn@confluent.io>
2021-02-04 20:18:20 -08:00
Matthias J. Sax 016128c920
MINOR: Extends RocksDB docs (#10046)
We recommend users to switch to jemalloc for RocksDB.

Co-authored-by: Jim Galasyn <jim.galasyn@confluent.io>

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Rohan Desai <rohan@confluent.io>, A. Sophie Blee-Goldman <sophie@confluent.io>
2021-02-04 18:50:19 -08:00
Ivan Ponomarev 5552da3a20
KAFKA-5488: Add type-safe split() operator (#9107)
Implements KIP-418, that deprecated the `branch()` operator in favor of the newly added and type-safe `split()` operator.

Reviewers: Matthias J. Sax <matthias@confluent.io>, John Roesler <john@confluent.io>
2021-02-04 16:23:35 -08:00
leah 8bdfc5770d
MINOR: adding docs for failed stream thread metric (#9974)
Add docs for KIP-663.

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Walker Carlson <wcarlson@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2021-02-02 10:12:22 -08:00
leah f5a2fbac6d
KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size (#9253)
See KIP details and discussions here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size

Deprecates methods that allow users to skip setting a window size when one is needed. Adds a window size streams config to allow the timeWindowedDeserializer to calculate window end time.

Reviewers: Walker Carlson <wcarlson@confluent.io>, John Roesler <vvcephei@apache.org>, Guozhang Wang <wangguoz@gmail.com>
2021-02-01 16:20:35 -08:00
Walker Carlson eff51a82f2
MINOR: update docs for KIP-663, KIP-696, and KIP-671 (#9969)
Co-authored-by: Bruno Cadonna <bruno@confluent.io>

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <guozhang@confluent.io>, Bruno Cadonna <bruno@confluent.io>
2021-01-29 09:00:56 -08:00
Michael G. Noll f4983f4172
KAFKA-8930: MirrorMaker v2 documentation (#324) (#9983)
This adds a new user-facing documentation "Geo-replication (Cross-Cluster Data Mirroring)" section to the Kafka Operations documentation that covers MirrorMaker v2.

Was already merged to kafka-site via apache/kafka-site#324.
Reviewers: Bill Bejeck <bbejeck@apache.org>
2021-01-27 11:51:34 -05:00
leah 6c8033abf3
MINOR: Add docs for StreamJoined changes (#9951)
Add docs for KIP-689.

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2021-01-26 11:38:13 -08:00
Bruno Cadonna add160d522
KAFKA-9924: Add docs for RocksDB properties-based metrics (#9895)
Document the new properties-based metrics for RocksDB

Reviewers: Leah Thomas <lthomas@confluent.io>, Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-01-19 13:30:23 -08:00
Matthias J. Sax 2e0c686ec1
MINOR: improve KafkaStreams replication factor documentation (#9829)
Reviewers: Jason Gustafson <jason@confluent.io>, Jim Galasyn <jim.galasyn@confluent.io>
2021-01-06 11:31:05 -08:00
Matthias J. Sax e3b0ea81ca
MINOR: add missing quickstart.html file (#9722)
Reviewers: Guozhang Wang <guozhang@confluent.io>, Bill Bejeck <bill@confluent.io>
2020-12-22 16:45:50 -08:00
Matthias J. Sax bb813310c7
MINOR: remove dangling quickstart-*.html (#9721)
Reviewers: Guozhang Wang <guozhang@confluent.io>
2020-12-22 16:19:43 -08:00
Luke Chen 3717ab0ff2
KAFKA-10776: Add version attribute in RequestsPerSec metrics documentation (#9661)
See https://cwiki.apache.org/confluence/display/KAFKA/KIP-272%3A+Add+API+version+tag+to+broker%27s+RequestsPerSec+metric

Reviewers: Ismael Juma <ismael@juma.me.uk>
2020-12-15 06:39:07 -08:00
high.lee 88c8180957
KAFKA-8147: Update upgrade notes for KIP-446 (#8965)
Reviewer: Matthias J. Sax <matthias@confluent.io>, John Roesler <john@confluent.io>
2020-12-04 12:56:59 -07:00
Jim Galasyn 03cff6cb59
MINOR: Fix KTable-KTable foreign-key join example (#9683)
Reviewer: Matthias J. Sax <matthias@confluent.io>
2020-12-03 13:17:01 -07:00
James Cheng 16eb1f5cd1
KAFKA-10473: Add docs on partition size-on-disk, and other log-related metrics (#9276)
kafka.log,type=Log,name=Size
kafka.log,type=Log,name=NumLogSegments
kafka.log,type=Log,name=LogStartOffset
kafka.log,type=Log,name=LogEndOffset

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2020-12-03 11:18:12 -08:00
fml2 90bc7e9777
KAFKA-10722: Described the types of the used state stores (#9607)
Reviewer: Matthias J. Sax <matthias@confluent.io>
2020-11-30 17:25:47 -07:00
Tom Bentley 6add0594a7
MINOR: Remove erroneous extra <code> in design doc (#9657)
Reviewers: Bill Bejeck <bbejeck@apache.org>
2020-11-30 15:41:14 -05:00
Tom Bentley 91679f247a
KAFKA-10692: Add delegation.token.secret.key, deprecate ...master.key (#9623)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2020-11-19 15:26:25 +00:00
zhangyue19921010 156584915a
MINOR: Remove the extra brackets in the demo code (#9586)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2020-11-11 19:57:40 +08:00
Bill Bejeck 27153e2268
MINOR: Add back section taken out by mistake (#9544)
Reviewers: Matthias J. Sax <mjsax@apache.org>
2020-11-04 14:44:29 -05:00
bill b5a1c2649b update version in quickstart to current 2020-11-04 09:16:30 -05:00
Bill Bejeck e847f057e3
KAFKA-10679: [Streams] migrate kafka-site updated docs to kafka/docs (#9554)
During the AK website upgrade, changes made to kafka-site weren't migrated back to kafka-docs.

This PR is an attempt at porting the streams changes to kafka/docs

For the most part, the bulk of the changes in the PR are cosmetic.

For testing:

I reviewed the PR diffs
Rendered the changes locally

Reviewers: John Roesler <john@confluent.io>
2020-11-04 08:30:10 -05:00
Igor Soarez b3e77dfad9
KAFKA-10036: Improve handling and documentation of Suppliers (#9000)
Reviewer: Matthias J. Sax <matthias@confluent.io>
2020-11-03 17:30:15 -08:00
Bill Bejeck b4f00d7ef6
KAFKA-10679: Migrate upgrade changes from site to kafka/docs (#9551)
During the AK website upgrade, changes made to kafka-site weren't migrated back to kafka-docs.

This PR is an initial attempt at porting the changes to kafka/docs, but it does not include the streams changes. Those will come in a separate PR.

For the most part, the bulk of the changes in the PR are cosmetic. Only the introduction.html has substantial changes, but it's a direct port from the live documentation.

For testing:

I reviewed the PR diffs
Rendered the changes locally

Reviewers: Matthias J. Sax <mjsax@apache.org>
2020-11-03 13:40:44 -05:00
Kengo Seki fb3d26d5b7
MINOR: Fix an example in the Kafka Streams tutorial to be compilable (#6647)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2020-11-03 10:49:49 +08:00
Bill Bejeck d39382d3e2
MINOR: Move upgraded docs from site to kafak docs (#9532)
Reviewers: Matthias J. Sax <mjsax@apache.org>
2020-10-31 07:52:14 -04:00
Alexander Iskuskov 51c8c69e3a
MINOR: Fix documentation for KIP-585 (#9524)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2020-10-29 10:08:00 +08:00
Bill Bejeck d5c77695a2
MINOR: Add KIP-431 to upgrade.html file (#9514)
Reviewers: Matthias J. Sax <mjsax@apache.org>
2020-10-27 19:35:33 -04:00
Bill Bejeck 81465a1951
MINOR: Add KIP-584 to upgrade.html file (#9511)
Reviewers: Kowshik Prakasam <kprakasam@confluent.io>, Manikumar Reddy <manikumar.reddy@gmail.com>, Boyang Chen <boyang@confluent.io>
2020-10-27 14:35:02 -04:00
Bill Bejeck 714d125772
MINOR: Update docs to point to next release add notable features for 2.7 (#9483)
Reviewers: Matthias J. Sax <mjsax@apache.org>
2020-10-22 17:57:41 -04:00
Okada Haruki 94ccd4d25e
MINOR: Fix timestampDelta type in doc (#8870)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2020-10-22 16:42:53 +08:00
Emre Hasegeli 850e9922c1
MINOR: Fix upgrade.mode references (#5645)
Reviewers: John Roesler <john@confluent.io>, Andrew Choi <andrew.choi@uwaterloo.ca>, Chia-Ping Tsai <chia7712@gmail.com>
2020-10-20 22:17:56 +08:00