Commit Graph

1232 Commits

Author SHA1 Message Date
TengYao Chi e1dcd383bc
KAFKA-17927 Disallow users to configure `max.in.flight.requests.per.connection` bigger than 5 (#17717)
Reviewers: PoAn Yang <payang@apache.org>, Chia-Ping Tsai <chia7712@gmail.com>
2024-11-18 14:01:16 +08:00
Kamal Chandraprakash 6dddabb359
KAFKA-16780: Document the new RemoteLogMetadataManager#nextSegmentWithTxnIndex API in upgrade notes. (#17735)
Reviewers: Divij Vaidya <diviv@amazon.com>
2024-11-12 23:15:12 +05:30
xijiu 7413a5a9e4
KAFKA-17913 Fix KRaft controller count recommendations (#17657)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-11-08 04:18:30 +08:00
kevin-wu24 aa4782aea3
KAFKA-17576 Fix all references to kraft/server.properties to use reconfig-server.properties (#17567)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-11-08 03:58:21 +08:00
wperlichek 688c2c0913
MINOR: Fix broken hyperlink for producer API in documentation (#17701)
Reviewers: Divij Vaidya <diviv@amazon.com>
2024-11-06 10:26:36 +01:00
Yung b7e69ebf5c
KAFKA-17924: Remove `bufferpool-wait-time-total`, `io-waittime-total`, and `iotime-total` (#17697)
These metrics were deprecated in KIP-773 and are being removed in Kafka 4.0.

Reviewers:  Chia-Ping Tsai <chia7712@gmail.com>, Divij Vaidya <diviv@amazon.com>
2024-11-06 08:46:28 +01:00
Luke Chen 67e2a0ae6f
MINOR: Improve the KIP-853 documentation (#17598)
In docs/ops.html, add a section discussion the difference between static and dynamic quorums. This section also discusses how to find out which quorum type you have. Also discuss the current limitations, such as the inability to transition from static quorums to dynamic.

Add a brief section to docs/upgrade.html discussing controller membership change.

Co-authored-by: Federico Valeri <fedevaleri@gmail.com>, Colin P. McCabe <cmccabe@apache.org>
Reviewers: Justine Olshan <jolshan@confluent.io>
2024-10-30 09:41:19 -07:00
Josep Prat c55d4f08c4
MINOR: Update the upgrade docs to include 3.8.1 version (#17628)
Signed-off-by: Josep Prat <josep.prat@aiven.io>

Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-10-30 11:41:00 +01:00
Yung 984777f0b9
KAFKA-17875: Align KRaft controller count recommendations (#17600)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
Co-authored-by: yungh <yungh@nvidia.com>
2024-10-29 11:37:49 +01:00
xijiu 71f4001a21
KAFKA-17874: Fix the KRaft metric names in the documentation (#17599)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-10-28 11:12:18 +01:00
TengYao Chi 553e6b4c6d
KAFKA-17860 Remove log4j-appender module (#17588)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-24 18:13:30 +08:00
PoAn Yang 2d896d9130
KAFKA-17614: Remove AclAuthorizer (#17424)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-10-23 17:07:48 +02:00
Federico Valeri d705be05d9
MINOR: Fix other tools' formatting in documentation (#17572)
Reviewers: Luke Chen <showuon@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-10-23 02:24:55 +08:00
Colin Patrick McCabe e3751a838c
KAFKA-17794: Add some formatting safeguards for KIP-853 (#17504)
KIP-853 adds support for dynamic KRaft quorums. This means that the quorum topology is
no longer statically determined by the controller.quorum.voters configuration. Instead, it
is contained in the storage directories of each controller and broker.

Users of dynamic quorums must format at least one controller storage directory with either
the --initial-controllers or --standalone flags.  If they fail to do this, no quorum can be
established. This PR changes the storage tool to warn about the case where a KIP-853 flag has
not been supplied to format a KIP-853 controller. (Note that broker storage directories
can continue to be formatted without a KIP-853 flag.)

There are cases where we don't want to specify initial voters when formatting a controller. One
example is where we format a single controller with --standalone, and then dynamically add 4
more controllers with no initial topology. In this case, we want the 4 later controllers to grab
the quorum topology from the initial one. To support this case, this PR adds the
--no-initial-controllers flag.

Reviewers: José Armando García Sancio <jsancio@apache.org>, Federico Valeri <fvaleri@redhat.com>
2024-10-21 10:06:41 -07:00
Federico Valeri 7aaffed372
MINOR: Add missing extention to tools commands (#17548)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-19 22:01:36 +08:00
Ken Huang e01f6a5c1e
KAFKA-17740 Update Readme and documentation (#17435)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-18 10:54:02 +08:00
David Jacot 52017a83db
KAFKA-17383; Update upgrade notes about removal of `offsets.commit.required.acks` (#17446)
This patch updates the upgrades note about the removal of `offsets.commit.required.acks` configuration in 4.0.

Reviewers: Lianet Magrans <lmagrans@confluent.io>
2024-10-10 05:26:14 -07:00
Josep Prat 17f0e56e9a
MINOR: Fix upgrade instructions for 3.8 and 3.9 (#17445)
Signed-off-by: Josep Prat <josep.prat@aiven.io>
Reviewers:  Chia-Ping Tsai <chia7712@gmail.com>
2024-10-10 11:36:01 +02:00
PoAn Yang 9bbf0950f9
KAFKA-17387 Remove broker-list in VerifiableConsumer (#17406)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-10 11:41:53 +08:00
Mickael Maison 2836f7aaae
KAFKA-14705 Remove deprecated classes and options in tools (#17420)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-09 10:33:34 +08:00
Andrew Schofield 284a3db28a
KAFKA-15908: Remove deprecated Consumer.poll(long timeout) (#17368)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>, David Jacot <djacot@confluent.io>, Lianet Magrans <lmagrans@confluent.io>
2024-10-08 10:49:10 -04:00
Mickael Maison 3815339e05
KAFKA-14158: Remove auto.include.jmx.reporter configuration (#17360)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-08 16:17:07 +02:00
PoAn Yang 8db86c60a6
KAFKA-17385 Remove authorizer, authorizer-properties, zk-tls-config-file in AclCommand (#17224)
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-10-08 08:48:43 +08:00
tall15421542-lab 46b6147ab6
MINRO: fix stream-stream-join semantic example from 10s window to 15s (#17379)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2024-10-07 10:17:12 -07:00
Federico Valeri 3f2cb55a75
KAFKA-14705: Remove redirections and unused tools (#17386)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-10-07 17:24:43 +02:00
Chia-Chuan Yu 9e809be4ce
KAFKA-17529 Remove blacklist from MM2 (#17202)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-07 13:21:31 +08:00
TengYao Chi 0e4eebe9c0
KAFKA-12895 Drop support for Scala 2.12 in Kafka 4.0 (#17313)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-07 01:34:38 +08:00
Chung, Ming-Yen 696e33ee6d
KAFKA-17451 Remove deprecated consumer#committed (#17320)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-03 13:53:32 +08:00
Mickael Maison 7fb25a2b06
KAFKA-16769 Remove add.source.alias.to.metrics configuration (#17323)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-02 02:03:02 +08:00
GangHuo 6ee46ea865
MINOR: Fix DefaultRecordBatch and DefaultRecord protocol documentation (#17196)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-30 10:15:28 +08:00
Arnav Dadarya 05696037d3
KAFKA-12823 Remove Deprecated method KStream#through (#16761)
Implements KIP-1087

Reviewers: Matthias J. Sax <matthias@confluent.io>, Lucas Brutschy <lbrutschy@confluent.io>, Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2024-09-28 15:21:26 -07:00
devanshikhatsuriya 235cafa805
KAFKA-6197: Update Streams API and Javadoc references in documentation (#17215)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2024-09-28 12:42:59 -07:00
TengYao Chi 84fee3399e
KAFKA-17087 Deprecate `delete-config` of TopicCommand (#17222)
Reviewers: Apoorv Mittal <apoorvmittal10@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-09-26 03:37:10 +08:00
TaiJuWu db56553fd3
KAFKA-17530 Remove blacklist/whitelist from ReplaceField (#17237)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-25 01:02:28 +08:00
José Armando García Sancio 34c158f67f
MINOR: Replace gt and lt char with html encoding (#17235)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-24 19:29:11 +08:00
Chia-Chuan Yu 8c2a0619e2
KAFKA-17528 Remove whitelist/blacklist from JMXReporter (#17179)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-23 11:17:01 +08:00
Colin P. McCabe 3636afb737 HOTFIX: add file that was missed from KAFKA-17048 commit 2024-09-18 11:33:14 -07:00
José Armando García Sancio aee44efd40
KAFKA-17048; Update docs for KIP-853 (#17076)
Change the configurations under config/kraft to use controller.quorum.bootstrap.servers instead of controller.quorum.voters. Add comments explaining how to use the older static quorum configuration where appropriate.

In docs/ops.html, remove the reference to "tentative timelines for ZooKeeper removal" and "Tiered storage is considered as an early access feature" since they are no longer up-to-date. Add KIP-853 information.

In docs/quickstart.html, move the ZK instructions to be after the KRaft instructions. Update the KRaft instructions to use KIP-853.

In docs/security.html, add an explanation of --bootstrap-controller and document controller.quorum.bootstrap.servers instead of controller.quorum.voters.

Reviewers: Mickael Maison <mickael.maison@gmail.com>, Alyssa Huang <ahuang@confluent.io>, Colin P. McCabe <cmccabe@apache.org>
2024-09-18 11:23:58 -07:00
Colin Patrick McCabe f1e7954ad1 MINOR: update documentation link to 3.9 (#17216)
Reviewers: David Arthur <mumrah@gmail.com>
2024-09-17 07:36:48 -07:00
Ivan Yurchenko d0f4d691b5
KAFKA-17322: Document required header versions in Protocol Guide (#16867)
Reviewers: Josep Prat <josep.prat@aiven.io>
2024-09-16 14:19:47 +02:00
Ivan Yurchenko ab1eb8d561
KAFKA-17494: Document message structure in Protocol Guide (#17122)
Reviewers: Josep Prat <josep.prat@aiven.io>
2024-09-16 12:03:59 +02:00
tkuramoto33 5a01945cb7
MINOR: Fix javadoc url for KafkaProducer (#17200)
Fix javadoc url for KafkaProducer

Reviewers: Luke Chen <showuon@gmail.com>
2024-09-15 20:00:29 +08:00
PoAn Yang 4692aeb671
KAFKA-17036 KIP-919 supports for createAcls, deleteAcls, describeAcls (#16493)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-14 03:40:32 +08:00
Xuan-Zhang Gong 02e3f7cc28
KAFKA-12601 Remove deprecated `delegation.token.master.key` (#17082)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-13 17:21:46 +08:00
Chung, Ming-Yen 60707a5fe9
KAFKA-17392 Remove whitelist option in ConsoleConsumerOptions (#17138)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-12 01:46:16 +08:00
Xuan-Zhang Gong 9242723e4c
KAFKA-17435 remove use.incremental.alter.configs (#17027)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-11 14:34:05 +08:00
Kuan-Po Tseng 089cbefac9
KAFKA-16830 Remove the scala version formatters support (#17127)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-10 16:04:58 +08:00
Murali Basani 72e16cb9e1
KAFKA-16863 : Deprecate default exception handlers (#17005)
Implements KIP-1056:
 - deprecates default.deserialization.exception.handler in favor of deserialization.exception.handler
 - deprecates default.production.exception.handler in favor of production.exception.handler

Reviewers: Matthias J. Sax <matthias@confluent.io>
2024-09-07 20:14:46 -07:00
Luke Chen 887b947d8a
MINOR: Update doc for tiered storage GA (#17088)
Reviewers: Satish Duggana <satishd@apache.org>
2024-09-05 15:56:23 +05:30
Mickael Maison af0604e6ef
KAFKA-16188: Delete kafka.common.MessageReader (#17090)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-05 09:41:59 +02:00