Commit Graph

690 Commits

Author SHA1 Message Date
Konstantine Karantasis bbfecaef72 MINOR: Document endpoints for connector topic tracking (KIP-558)
Update the site documentation to include the endpoints introduced with KIP-558 and a short paragraph on how this feature is used in Connect.

Author: Konstantine Karantasis <konstantine@confluent.io>

Reviewers: Toby Drake <tobydrake7@gmail.com>, Ewen Cheslack-Postava <ewen@confluent.io>

Closes #8148 from kkonstantine/kip-558-docs
2020-02-21 12:25:35 -08:00
Lee Dongjin b28aa4ece6 KAFKA-9586: Fix errored json filename in ops documentation
This PR is the counterpart of apache/kafka-site#253.

cc/ omkreddy

Author: Lee Dongjin <dongjin@apache.org>

Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>

Closes #8149 from dongjinleekr/feature/KAFKA-9586
2020-02-21 18:49:11 +05:30
Ron Dagostino d9b8b86bdd KAFKA-9575: Mention ZooKeeper 3.5.7 upgrade
*More detailed description of your change,
if necessary. The PR title and PR message become
the squashed commit message, so use a separate
comment to ping reviewers.*

*Summary of testing strategy (including rationale)
for the feature or bug fix. Unit and/or integration
tests are expected for any behaviour change and
system tests should be considered for larger changes.*

Author: Ron Dagostino <rdagostino@confluent.io>

Reviewers: Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>

Closes #8139 from rondagostino/KAFKA-9575
2020-02-21 18:45:14 +05:30
Gunnar Morling 04b6641c14
MINOR: Wording fix in Streams DSL docs (#5692)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2020-02-20 11:35:27 +00:00
Lee Dongjin 9942e20a58
MINOR: fix omitted 'next.' in interactive queries documentation (#7883)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2020-02-19 10:23:59 -08:00
Rajini Sivaram b1449f683c
MINOR: Add upgrade note about TLSv1 and TLSv1.1 being disabled in 2.5.0 (#8128)
Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
2020-02-17 11:37:15 +00:00
Mitch 96c69da8c1
KAFKA-8507; Unify connection name flag for command line tool [KIP-499] (#8023)
This change updates ConsoleProducer, ConsumerPerformance, VerifiableProducer, and VerifiableConsumer classes to add and prefer the --bootstrap-server flag for defining the connection point of the Kafka cluster. This change is part of KIP-499: https://cwiki.apache.org/confluence/display/KAFKA/KIP-499+-+Unify+connection+name+flag+for+command+line+tool.

Reviewers: Ron Dagostino <rdagostino@confluent.io>, Stanislav Kozlovski <stanislav_kozlovski@outlook.com>,  Chia-Ping Tsai <chia7712@gmail.com>, Jason Gustafson <jason@confluent.io>
2020-02-13 13:44:51 -08:00
Ron Dagostino 342f13a838 KAFKA-8843: KIP-515: Zookeeper TLS support
Signed-off-by: Ron Dagostino <rdagostinoconfluent.io>

Author: Ron Dagostino <rdagostino@confluent.io>

Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>, Rajini Sivaram <rajinisivaram@googlemail.com>

Closes #8003 from rondagostino/KAFKA-8843
2020-02-08 21:16:48 +05:30
David Arthur 7e776b0462
Bump trunk to 2.6.0-SNAPSHOT (#8026) 2020-02-03 13:04:56 -05:00
commandini 9d96964792 MINOR: Update introduction page in Kafka documentation
Although APIs section in Kafka documentation lists 5 core APIs (https://kafka.apache.org/documentation/#api), introduction page in Kafka documentation lists 4 of them. I've added the missing list element to fix this incoherence.

Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
2020-01-20 22:19:41 +05:30
Rajini Sivaram dbeaba5d9e
KAFKA-8847; Deprecate and remove usage of supporting classes in kafka.security.auth (#7966)
Removes references to the old scala Acl classes from kafka.security.auth (Acl, Operation, ResourceType, Resource etc.) and replaces these with the Java API. Only the old SimpleAclAuthorizer, AuthorizerWrapper used to wrap legacy authorizer instances and tests using SimpleAclAuthorizer continue to use the old API. Deprecates the old scala API.

Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
2020-01-17 13:20:34 +00:00
Guozhang Wang 8c21fa837d
MINOR: Add upgrade guide for KAFKA-8421 (#7925)
Co-Authored-By: A. Sophie Blee-Goldman <ableegoldman@gmail.com>

Reviewers: A. Sophie Blee-Goldman <ableegoldman@gmail.com>
2020-01-13 12:40:06 -08:00
Bill Bejeck 03f763df8a
MINOR: Fixes for adding new DSL naming page (#7899)
Added re-direct for new page and added link to Developer Guide page
Reviewers:  Matthias J. Sax <mjsax@apache.org>, Sophie Blee-Goldman <sophie@confluent.io>,
2020-01-06 18:42:06 -05:00
Ismael Juma 6dc6f6a60d
KAFKA-9324: Drop support for Scala 2.11 (KIP-531) (#7859)
* Adjust build and documentation.
* Use lambda syntax for SAM types in `core`, `streams-scala` and
`connect-runtime` modules.
* Remove `runnable` and `newThread` from `CoreUtils` as lambda
syntax for SAM types make them unnecessary.
* Remove stale comment in `FunctionsCompatConversions`,
`KGroupedStream`, `KGroupedTable' and `KStream` about Scala 2.11,
the conversions are needed for Scala 2.12 too.
* Deprecate `org.apache.kafka.streams.scala.kstream.Suppressed`
and use `org.apache.kafka.streams.kstream.Suppressed` instead.
* Use `Admin.create` instead of `AdminClient.create`. Static methods
in Java interfaces can be invoked since Scala 2.12. I noticed that
MirrorMaker 2 uses `AdminClient.create`, but I did not change them
as Connectors have restrictions on newer client APIs.
* Improve efficiency in a few `Gauge` implementations by avoiding
unnecessary intermediate collections.
* Remove pointless `Option.apply` in `ZookeeperClient`
`SessionState` metric.
* Fix unused import/variable and other compiler warnings.
* Reduce visibility of some vals/defs.

Reviewers: Manikumar Reddy <manikumar@confluent.io>, Guozhang Wang <wangguoz@gmail.com>, Gwen Shapira <gwen@confluent.io>
2020-01-06 19:51:01 +01:00
Mickael Maison 46980d632c
MINOR: Update authorization primitives in security.html (#7509)
Since 2.3, there are 5 new APIs: ElectPreferredLeaders, IncrementalAlterConfigs, AlterPartitionReassignments, DescribePartitionReassignments and OffsetDelete

Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
2020-01-06 17:52:50 +00:00
A. Sophie Blee-Goldman e812784e74 fix rows (#7837)
Minor followup to #7825, should be cherry-picked to 2.4

Reviewers: Bill Bejeck <bbejeck@gmail.com>
2019-12-23 12:05:57 -05:00
Manikumar Reddy 96edabb6b8 MINOR: Update ZooKeeper upgrade notes
Author: Manikumar Reddy <manikumar.reddy@gmail.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>, Magnus Edenhill <magnus@edenhill.se>, Colin Patrick McCabe <cmccabe@apache.org>

Closes #7818 from omkreddy/zk-note
2019-12-20 00:47:12 +05:30
Harsha Laxman 6e56ba4b7d Update introduction.html (#7853)
Fixing small grammar issue with plural versions

Reviewers: Mickael Maison <mickael.maison@gmail.com>
2019-12-19 13:04:38 +00:00
Mickael Maison c6e25bb362 MINOR: Fix static membership link in Streams upgrade notes (#7439)
Fix broken link

Reviewers: John Roesler <vvcephei@apache.org>
2019-12-18 11:21:57 -06:00
Guozhang Wang 763cb9683f HOTFIX: remove non-os streams example repo reference from web docs 2019-12-16 14:08:30 -08:00
wcarlson5 8b57f6cb3a KAFKA-6049: Add auto-repartitioning for cogroup (#7792)
Follow up to PR #7538 (KIP-150)

Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-12-13 14:07:21 -08:00
A. Sophie Blee-Goldman 9567921fd4 MINOR: add UPGRADE_FROM to config docs (#7825)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2019-12-12 18:43:37 -08:00
A. Sophie Blee-Goldman 48da0c6c95 port paragrpah from CP docs (#7808)
The AK Streams architecture docs should explain how the maximum parallelism is determined
Reviewers: Bill Bejeck <bbejeck@gmail.com>
2019-12-09 16:35:17 -05:00
ravowlga123 deafc56fed KAFKA-8953: Rename UsePreviousTimeOnInvalidTimestamp to UsePartitionTimeOnInvalidTimestamp (#7633)
Implements KIP-530

Reviewer: Matthias J. Sax <matthias@confluent.io>
2019-12-08 19:23:19 -08:00
A. Sophie Blee-Goldman cd5618f866 MINOR: clarify node grouping of input topics using pattern subscription (#7793)
Updates the HTML docs and the javadoc.

Reviewers: John Roesler <vvcephei@apache.org>
2019-12-06 16:03:42 -06:00
Fábio Silva a2aa0a458b KAFKA-9255: Add 'timestamp' field to 'message' entry (#7764)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2019-12-02 14:39:28 +00:00
Sönke Liebau d7513693a3 KAFKA-9226: Updated documentation section on log deletion policies. (#7738)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2019-11-27 12:08:06 +00:00
Simon Clark af17468fa6 MINOR: Standardise "variable-length" vs "variable length" (#7720)
Both were used in the same sentence, which isn't necessarily clear.

Reviewers: Mickael Maison <mickael.maison@gmail.com>
2019-11-21 13:36:56 +00:00
Xin Wang 0ee9bf326d MINOR: Add missing parentheses in docs/streams/tutorial.html (#7696)
Reviewers: Jason Gustafson <jason@confluent.io>
2019-11-18 08:41:40 -08:00
Michael Gyarmathy f44272e392 fix typo in processor-api developer guide docs (#7689)
Fixed a small typo on the Processor API page of the Kafka Streams developer guide docs. ("buildeer" changed to "builder")

Reviewers: Bill Bejeck <bbejeck@gmail.com>
2019-11-14 10:32:35 -05:00
Bill Bejeck ed8810127f
KAFKA-9072: Add Topology naming to the dev guide (#7629)
Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Matthias J. Sax <mjsax@apache.org>, Sophie Blee-Goldman <sophie@confluent.io>
2019-11-13 10:54:47 -05:00
Alice ff50f28794 MINOR: fix docs around leader rebalancing to reflect default of true (#7614)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2019-11-10 18:15:44 +00:00
Mathias Kub 42284fbbee MINOR: Fix JAAS configuration numbering (#7601)
7.3.1.1 JAAS configuration for Kafka brokers was followed by
7.3.1.4 JAAS configuration for Kafka clients instead of 7.3.1.2.

Reviewers: Mickael Maison <mickael.maison@gmail.com>
2019-11-10 17:37:02 +00:00
Manikumar Reddy dbce4c12ba MINOR: Update docs about ZooKeeper upgrade issue from 3.4.X to 3.5.6
ZK upgrade from 3.4.X to 3.5.6 fails with "java.io.IOException: No snapshot found" if there are no snapshot files. This was discussed in https://issues.apache.org/jira/browse/ZOOKEEPER-3056

Author: Manikumar Reddy <manikumar.reddy@gmail.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #7625 from omkreddy/zk-upgrade
2019-11-09 14:30:37 +05:30
Colin P. Mccabe 67fd88050f KAFKA-8984: Improve tagged fields documentation
Author: Colin P. Mccabe <cmccabe@confluent.io>

Reviewers: Vikas Singh <vikas@confluent.io>, Jason Gustafson <jason@confluent.io>

Closes #7477 from cmccabe/KAFKA-8984
2019-11-09 10:37:48 +05:30
Mickael Maison e4262471c9 MINOR: Fix command examples in kafka-reassign-partitions.sh docs (#7583)
Reviewers: Jason Gustafson <jason@confluent.io>
2019-10-26 13:16:26 -07:00
Jason Gustafson 4bde9bb3cc
KAFKA-9102; Increase default zk session timeout and replica max lag [KIP-537] (#7596)
This patch increases the default value of `zookeeper.session.timeout` from 6s to 18s and `replica.lag.time.max.ms` from 10s to 30s. This change was documented in KIP-537: https://cwiki.apache.org/confluence/display/KAFKA/KIP-537%3A+Increase+default+zookeeper+session+timeout.

Reviewers: Ismael Juma <ismael@juma.me.uk>
2019-10-25 22:10:01 -07:00
Guozhang Wang 4f682b3c0a
KAFKA-8729: Add upgrade docs for KIP-467 on augmented produce response (#7522)
Add a paragraph explaining the producer caller's expected behavior change on record validation failure scenarios that are improved by KIP-467.

Reviewers: Tu V. Tran <tu@confluent.io>, Jason Gustafson <jason@confluent.io>
2019-10-24 19:45:09 -07:00
Adam Bellemare aab14fb843 MINOR: Add documentation for foreign-key joins (KIP-213) (#7535)
Reviewers: John Roesler <john@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-10-24 11:35:55 -07:00
Manikumar Reddy f46eb292f5 MINOR: Add upgrade docs for 2.4.0 release
Author: Manikumar Reddy <manikumar.reddy@gmail.com>

Reviewers: Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>

Closes #7530 from omkreddy/2.4-upgrade-docs
2019-10-22 20:51:10 +05:30
Bill Bejeck c7a3d1b52d MINOR:Upgrade guide updates for KIP-479 (#7550)
Reviewers: A. Sophie Blee-Goldmann <sophie@confluent.io>, John Roesler <john@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-10-21 17:27:23 -07:00
Bill Bejeck 7bef73d724 MINOR: KIP-307 upgrade guide docs (#7547)
Reviewers: John Roesler <john@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-10-21 15:42:08 -07:00
Guozhang Wang eac367c76a
MINOR: Add metrics in operations doc for KIP-429 / KIP-467 (#7527)
Reviewers: Tu V. Tran <tu@confluent.io>, A. Sophie Blee-Goldman <sophie@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-10-18 17:32:03 -07:00
Kevin Lu ed078bd702 KAFKA-8874: Add consumer metrics to observe user poll behavior (KIP-517)
https://cwiki.apache.org/confluence/display/KAFKA/KIP-517%3A+Add+consumer+metrics+to+observe+user+poll+behavior

Author: Kevin Lu <kelu@paypal.com>

Reviewers: Sriharsha Chintalapani <sriharsha@apache.org>, Jason Gustafson <jason@confluent.io>

Closes #7395 from KevinLiLu/KIP517-KAFKA8874
2019-10-17 14:46:42 +05:30
A. Sophie Blee-Goldman 3e30bf5439 Explain the separate upgrade paths for consumer groups and Streams (#7516)
Document the upgrade path for the consumer and for Streams (note that they differ significantly).

Needs to be cherry-picked to 2.4

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2019-10-16 16:09:09 -07:00
Matthias J. Sax 1d6d3709d6
MINOR: Update Kafka Streams upgrade docs for KIP-444, KIP-470, KIP-471, KIP-474, KIP-528 (#7515)
Reviewers: Jukka Karvanen <jukka.karvanen@jukinimi.com>, Guozhang Wang <guozhang@confluent.io>, A. Sophie Blee-Goldman <sophie@confluent.io>
2019-10-16 11:53:36 -07:00
Bruno Cadonna e58401b2f0 KAFKA-9030: Document client-level (a.k.a. instance-level) metrics (#7501)
Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-10-15 14:30:16 -07:00
Bruno Cadonna 9c80a06466 KAFKA-8942: Document RocksDB metrics
Author: Bruno Cadonna <bruno@confluent.io>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #7490 from cadonna/AK8942-docs-rocksdb_metrics

Minor comments
2019-10-15 11:13:43 -07:00
Chris Stromberger 13c2e150e5 MINOR: clarify wording around fault-tolerant state stores (#7510)
Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2019-10-14 14:41:57 -07:00
Manikumar Reddy 4c2bd567b1
MINOR: Bump version to 2.5.0-SNAPSHOT (#7455) 2019-10-07 20:04:57 +05:30