Lianet Magrans
c465cf6b4b
KAFKA-17298: Update upgrade notes for 4.0 KIP-848 ( #18756 )
...
Reviewers: David Jacot <djacot@confluent.io>
2025-02-13 11:51:56 -05:00
Ismael Juma
da21b536c4
MINOR: Java version and TLS documentation improvements ( #18822 )
...
Most of the changes are obvious clean-ups/fixes. A couple of noteworthy items:
1. Support for non LTS versions is clarified (we were incorrectly stating full support
for Java 23).
2. TLS version negotiation details are clarified.
Reviewers: Matthias J. Sax <matthias@confluent.io>, Chia-Ping Tsai <chia7712@gmail.com>
2025-02-10 12:24:28 -08:00
Jhen-Yung Hsu
4e36368d08
KAFKA-18743 Remove leader.imbalance.per.broker.percentage as it is not supported by Kraft ( #18821 )
...
Remove `leader.imbalance.per.broker.percentage` from config.
Add `leader.imbalance.per.broker.percentage` to release note
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-02-11 04:01:57 +08:00
PoAn Yang
c1a813b740
MINOR: add missing <li> to upgrade.html ( #18817 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-02-07 00:11:07 +08:00
Nick Guo
e2e302b7e6
KAFKA-18741 document the removal of `inter.broker.protocol.version` ( #18818 )
...
Reviewers: Ken Huang <s7133700@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2025-02-07 00:07:31 +08:00
Albert
f6d9ce2bcd
MINOR: Add missing MirrorMaker2 metrics to docs ( #18691 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>
Co-authored-by: u0184996 <alozano@caixabanktech.com>
2025-02-04 14:22:54 +01:00
Jhen-Yung Hsu
9ba2621620
MINOR: Remove the test for ZooKeeper metrics used by ZooKeeperClient ( #18775 )
...
Reviewers: Ismael Juma <ismael@juma.me.uk>, Ken Huang <s7133700@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2025-02-03 20:06:01 +08:00
Ming-Yen Chung
9d6faf0283
KAFKA-18674 Document the incompatible changes in parsing --bootstrap-server ( #18751 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-02-03 13:57:32 +08:00
Almog Gavra
95abd174c7
MINOR: fix typo in HTML docs ( #18742 )
...
Reviewers: Divij Vaidya <diviv@amazon.com>
2025-01-30 11:58:13 +01:00
Mehari Beyene
cc259d76e9
KAFKA-18570: Update documentation to add remainingLogsToRecover, remainingSegmentsToRecover and LogDirectoryOffline metrics ( #18731 )
...
Reviewers: Divij Vaidya <diviv@amazon.com>
2025-01-30 11:52:35 +01:00
Joao Pedro Fonseca Dantas
85109a5111
KAFKA-16339: Add Kafka Streams migrating guide from transform to process ( #18314 )
...
Reviewers: Matthias J. Sax <matthias@confluent.io>
2025-01-29 11:07:16 -08:00
PoAn Yang
4dd0bcbde8
KAFKA-18383 Remove reserved.broker.max.id and broker.id.generation.enable ( #18478 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-01-30 02:55:09 +08:00
PoAn Yang
c774352c35
MINOR: add removed controller metrics to zk2kraft ( #18654 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-01-25 22:54:27 +08:00
TengYao Chi
40890faa1b
KAFKA-18592 Cleanup ReplicaManager ( #18621 )
...
Reviewers: Ismael Juma <ismael@juma.me.uk>, Christo Lolov <lolovc@amazon.com>, Chia-Ping Tsai <chia7712@gmail.com>
2025-01-24 01:34:36 +08:00
Ken Huang
32767599c0
MINOR: add the removed topic metrics to zk2kraft ( #18658 )
...
Reviewers: Christo Lolov <lolovc@amazon.com>, Chia-Ping Tsai <chia7712@gmail.com>
2025-01-23 15:05:06 +08:00
TengYao Chi
7e86bd8281
KAFKA-18229: Move configs out of "kraft" directory ( #18389 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Ismael Juma <ismael@juma.me.uk>, José Armando García Sancio <jsancio@apache.org>
2025-01-22 15:47:57 +01:00
Matthias J. Sax
faff2de6a5
KAFKA-17561: add processId tag to thread-state metric ( #18581 )
...
Part of KIP-1091.
Reviewers: Bill Bejeck <bill@confluent.io>
2025-01-21 08:09:43 -08:00
Ken Huang
3d49159c84
KAFKA-18598: Remove ControllerMetadataMetrics ZK-related Metrics ( #18629 )
...
Reviewers: Christo Lolov <lolovc@amazon.com>
2025-01-21 15:23:39 +00:00
PoAn Yang
ff2b4546f1
MINOR: mention advertised.listeners is not supported in zk2kraft.html ( #18575 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-01-18 09:31:50 +08:00
Jason Taylor
54fe0f0135
KAFKA-16368: Add a new constraint for segment.bytes to min 1MB for KIP-1030 ( #18140 )
...
Reviewers: Divij Vaidya <diviv@amazon.com>
2025-01-16 16:07:00 +01:00
Jason Taylor
23c459286b
KAFKA-16368: Update defaults for LOG_MESSAGE_TIMESTAMP_AFTER_MAX_MS_DEFAULT and NUM_RECOVERY_THREADS_PER_DATA_DIR_CONFIG ( #18106 )
...
Reviewers: Divij Vaidya <diviv@amazon.com>
2025-01-16 15:30:00 +01:00
Jason Taylor
11c10fe4da
KAFKA-16368: Update default linger.ms to 5ms for KIP-1030 ( #18080 )
...
Reviewers: Ismael Juma <ismael@juma.me.uk>, Divij Vaidya <diviv@amazon.com>
2025-01-16 10:50:06 +01:00
Ken Huang
d82f03e98b
KAFKA-18364 add document to show the changes of metrics and configs after removing zookeeper ( #18365 )
...
This patch introduces a new page to document the configs and metrics that have been removed in the transition to 4.0. While these removed items lack a formal deprecation cycle as they are part of KIP-500, KIP-500 itself does not provide an exhaustive list of all impacted configs and metrics. Therefore, this new page aims to assist Kafka users in understanding the specific configs and metrics that have been removed in the 4.0 release.
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-01-16 05:02:01 +08:00
Matthias J. Sax
3f3bc90509
MINOR: Kafka Streams doc updates for 4.0 release ( #18488 )
...
Reviewers: Bill Bejeck <bill@confluent.io>
2025-01-15 11:58:53 -08:00
Matthias J. Sax
65daa1db2f
MINOR: improve KS docs about recommended configs ( #18516 )
...
Reviewers: Bill Bejeck <bill@confluent.io>
2025-01-15 10:02:02 -08:00
Matthias J. Sax
e6d47ff959
MINOR: add KafkaStreams 4.0 information to top-level upgrade section ( #18543 )
...
Reviewers: Bruno Cadonna <bruno@confluent.io>, Alieh Saeedi <asaeedi@confluent.io>
2025-01-15 09:55:17 -08:00
TengYao Chi
c0b3e12dcf
KAFKA-18330: Update documentation to remove controller deployment limitations ( #18281 )
...
Reviewers: José Armando García Sancio <jsancio@apache.org>
2025-01-14 16:31:16 -05:00
Alieh Saeedi
2d22f523ee
MINOR: Update 4.0.0 documentation for Kafka Streams ( #18124 )
...
Reviewers: Matthias J. Sax <matthias@confluent.io>
2025-01-14 13:14:22 -08:00
Sanskar Jhajharia
e3e4c17959
Add DescribeShareGroupOffsets API [KIP-932] ( #18500 )
...
Reviewers: Apoorv Mittal <apoorvmittal10@gmail.com>, Andrew Schofield <aschofield@confluent.io>
2025-01-14 14:33:39 +00:00
Matthias J. Sax
d8c98f2e82
MINOR: fix KafkaStreams archtype docs ( #18469 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2025-01-13 11:19:32 -08:00
TengYao Chi
cbbeccad63
MINOR: Remove unnecessary < from Errant Record Reporter section ( #18498 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2025-01-13 12:13:10 +01:00
Kirk True
403fe71c5f
KAFKA-18400: Don't use YYYY when formatting/parsing dates in Java client ( #18404 )
...
Reviewers: Andrew Schofield <aschofield@confluent.io>
2025-01-11 18:29:01 +00:00
Matthias J. Sax
3b38b016c8
KAFKA-17825: Update docs for ByteBufferDeserializer changes in 3.6 release ( #18466 )
...
KIP-863 introduced a change to ByteBufferDeserializer which is not
properly documented, but should be called out because it could surface
bugs in application code which using ByteBufferDeserializer.
Reviewers: Lianet Magrans <lmagrans@confluent.io>, Kirk True <ktrue@confluent.io>, Chia-Ping Tsai <chia7712@gmail.com>
2025-01-10 15:32:51 -08:00
Andrew Schofield
c6f2276e32
KAFKA-17671: Create better documentation for transactions ( #17454 )
...
Co-authored-by: Matthias J. Sax <mjsax@apache.org>
Reviewers: Matthias Sax <mjsax@apache.org>, Justine Olshan <jolshan@confluent.io>
2025-01-10 09:53:51 +00:00
Swikar Patel
8b72204bfd
KAFKA-15443: Upgrade RocksDB to 9.7.3 ( #18275 )
...
This PR upgrades RocksDB from 7.9.2 to 9.7.3 and addresses the following compatibility issues introduced by the RocksDB upgrade:
- Removal of AccessHint: The AccessHint class was completely removed in RocksDB 9.7.3. This required removing all import statements, variable declarations, method parameters, method return types, and static method calls related to AccessHint in RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapter.java RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapterTest.java Unused methods are removed in RocksDBGenericOptionsToDbOptionsColumnFamilyOptionsAdapter.java
- Removal of NO_FILE_CLOSES: The NO_FILE_CLOSES metric was also removed in RocksDB 9.7.3. The calculation for numberOfOpenFiles in RocksDBMetricsRecorder.java has been adjusted to now track the total number of file opens since the last reset. The previous calculation, which subtracted NO_FILE_CLOSES from NO_FILE_OPENS, is no longer possible. The reason RocksDB removed NO_FILE_CLOSES seems to be that it did not properly work: https://github.com/search?q=repo%3Afacebook%2Frocksdb+NO_FILE_CLOSES&type=issues
- Removal of methods related to compressed block cache configuration in BlockBasedTableConfig
- Change of the signature of org.rocksdb.Options.setLogger()
Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Matthias J. Sax <matthias@confluent.io>, Bruno Cadonna <cadonna@apache.org>
2025-01-09 11:55:56 +01:00
Swikar Patel
d1b1d9d47d
KAFKA-18111: Add Kafka Logo to README ( #18452 )
...
Reviewers: Matthias J. Sax <matthias@confluent.io>
2025-01-08 17:17:31 -08:00
TengYao Chi
abeed20168
KAFKA-10790: Add deadlock detection to producer#flush ( #17946 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>, Andrew Schofield <aschofield@confluent.io>, TaiJuWu <tjwu1217@gmail.com>
2025-01-07 16:32:43 +00:00
Matthias J. Sax
ca511cd1cf
MINOR: update Kafka Streams docs for 4.0 KIP changes ( #18307 )
...
Reviewers: Lucas Brutschy <lbrutschy@confluent.io>
2025-01-03 12:47:15 -08:00
Matthias J. Sax
40e05435a2
MINOR: add broadcast/multicast to Kafka Streams docs ( #18341 )
...
Reviewer: Lucas Brutschy <lbrutschy@confluent.io>
2025-01-03 10:38:27 -08:00
Ken Huang
4896d02ca7
MINOR: fix sh command and properties file ( #18369 )
...
In document the shell command base dir is in Kafka, so we should make all command is bin/<tools>.sh
In kafka repo doesn't have controller_static.properties this file, this would misunderstanding user, I change to use controller.properties
Reviewers: Luke Chen <showuon@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2025-01-02 09:35:58 +08:00
TengYao Chi
ab4f4a5515
MINOR: Remove PaswwordEncoderConfig related entries from upgrade.html ( #18362 )
...
Reviewers: Ken Huang <s7133700@gmail.com>, TaiJuWu <tjwu1217@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2025-01-01 00:06:12 +08:00
TengYao Chi
3161115ada
KAFKA-18361 Remove PasswordEncoderConfigs ( #18347 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-31 00:18:23 +08:00
TengYao Chi
585b7db482
MINOR: log4j2 upgrade follow-up ( #18290 )
...
Reviewers: PoAn Yang <payang@apache.org>, Chia-Ping Tsai <chia7712@gmail.com>
2024-12-30 20:38:58 +08:00
PoAn Yang
e6d2421136
KAFKA-18295 Remove deprecated function Partitioner#onNewBatch ( #18282 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-27 18:40:19 +08:00
xijiu
6139840e98
KAFKA-18348 Remove the deprecated MockConsumer#setException ( #18317 )
...
Reviewers: TengYao Chi <kitingiao@gmail.com>, TaiJuWu <tjwu1217@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-12-27 12:31:23 +08:00
Chung, Ming-Yen
88adb94c81
KAFKA-18093 Remove deprecated DeleteTopicsResult#values ( #18250 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-25 14:46:14 +08:00
Logan Zhu
4d6535e60d
KAFKA-18290 Remove deprecated methods of FeatureUpdate ( #18246 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-24 14:53:32 +08:00
Nick Guo
1a3dce72fa
KAFKA-18289 Remove deprecated methods of DescribeTopicsResult ( #18255 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-24 01:48:15 +08:00
Nick Guo
1cf514313e
KAFKA-18291 Remove deprecated methods of ListConsumerGroupOffsetsOptions ( #18265 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-24 01:37:10 +08:00
Ismael Juma
2e1134284c
MINOR: Add release note for Java 17 requirement ( #18302 )
...
Also remove confusing comment related to connect & Java 17 from build.gradle.
I also updated KIP-1013 to note the implications of KIP-1032.
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-12-22 19:36:03 -08:00