Commit Graph

1136 Commits

Author SHA1 Message Date
Kuan-Po (Cooper) Tseng 028e7a06dc
MINOR: fix incorrect formatter package in streams quickstart (#15991)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-05-22 22:24:50 +08:00
Igor Soarez a0ca025f9d
MINOR: Update upgrade documentation for 3.7.1 (#15866)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-05-20 09:45:07 +01:00
Sid Yagnik ef7b48e66a
Allowing WriteTxnMarkers API to run with AlterCluster permissions (#15837)
https://issues.apache.org/jira/browse/KAFKA-16513

https://cwiki.apache.org/confluence/display/KAFKA/KIP-1037%3A+Allow+WriteTxnMarkers+API+with+Alter+Cluster+Permission

Reviewers: Christo Lolov <christo_lolov@yahoo.com>,  Luke Chen <showuon@gmail.com>, Justine Olshan <jolshan@confluent.io>
2024-05-10 15:30:57 -07:00
Lucia Cerchie 31528f581d
KAFKA-15307: update/note deprecated configs (#14360)
Configs default.windowed.value.serde.inner and default.windowed.key.serde.inner
were replace with windowed.inner.class.serde. This PR updates the docs accordingly,
plus a few more side cleanups.

Reviewers: Matthias J. Sax <matthias@confluent.io>
2024-05-09 19:46:00 -07:00
Ivan Yurchenko 5a9ccb6b77
KAFKA-16445: Add PATCH method for connector config (#6934)
Reviewers: Chris Egerton <chrise@aiven.io>
2024-05-09 21:59:09 +02:00
Andrew Schofield f4fdaa702a
MINOR: Add missing RPCs to security.html (#15878)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-05-09 20:51:00 +08:00
PoAn Yang 9387c7a626
KAFKA-16467: add docs README (#15664)
Add how to run local website to docs folder.

Signed-off-by: PoAn Yang <payang@apache.org>

Reviewers: Luke Chen <showuon@gmail.com>
2024-04-30 10:26:35 +08:00
Igor Soarez 269b457d30
MINOR: Add missing docs for migration metrics (#15718)
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-04-16 16:20:52 +02:00
Igor Soarez 31171d0791
MINOR: Document JBOD limitation during migration (#15692)
Document JBOD limitation during migration when log dir failure.

Reviewers: Luke Chen <showuon@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-04-12 14:50:09 +08:00
Greg Harris 7317159f0c
KAFKA-16303: Add upgrade notes to 3.5.0, 3.5.2, and 3.7.0 about MM2 offset translation (#15423)
Signed-off-by: Greg Harris <greg.harris@aiven.io>
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-03-29 08:51:42 -07:00
John Yu cfa7d39360
MINOR : Removed the depreciated information about Zk to Kraft migration. (#15552)
Reviewers: Luke Chen <showuon@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-03-21 10:57:59 +08:00
Manikumar Reddy 8c0fafba58 MINOR: Update upgrade docs to refer 3.6.2 version 2024-03-20 12:06:43 +05:30
Hector Geraldino 7b9f31e35c
KAFKA-16358: Sort transformations by name in documentation; add missing transformations to documentation; add hyperlinks (#15499)
Reviewers: Yash Mayya <yash.mayya@gmail.com>
2024-03-15 16:26:36 +05:30
Matthias J. Sax 612a1fe1bb
MINOR: Kafka Streams docs fixes (#15517)
- add missing section to TOC
- add default value for client.id

Reviewers: Lucas Brutschy <lbrutschy@confluent.io>, Bruno Cadonna <bruno@confluent.io>
2024-03-13 21:54:06 -07:00
PoAn Yang 1bb36c2bc1
MINOR: change "inter.broker.protocol version" to inter.broker.protocol.version (#15504)
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-03-10 03:28:06 +08:00
Daan Gerits b9a5b4a805
KAFKA-10892: Shared Readonly State Stores ( revisited ) (#12742)
Implements KIP-813.

Reviewers: Matthias J. Sax <matthias@confluent.io>, Walker Carlson <wcarlson@confluent.io>
2024-03-08 10:57:56 -08:00
Owen Leung 3f3cee1b21
KAFKA-16325 Add missing producer metrics to documentatio (#15466)
Add `buffer-exhausted-rate`, `buffer-exhausted-total`, `bufferpool-wait-ratio` and `metadata-wait-time-ns-total`

Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-03-08 07:07:21 +08:00
Stanislav Kozlovski a512ef1478
MINOR: Add 3.7 JBOD KRaft Early Acces disclaimer (#15418)
This patch adds a small disclaimer to the ops documentation page to mention that JBOD is in early access with 3.7
2024-02-22 23:55:19 +01:00
Stanislav Kozlovski ea94507679
MINOR: Add 3.7 upgrade notes (#15407)
This patch adds the 3.7 upgrade notes.
2024-02-22 10:44:24 +01:00
Stanislav Kozlovski 9402d525ab
MINOR: Reconcile upgrade.html with kafka-site/36's version (#15406)
The usual flow of updating the upgrade.html docs is to first do it in apache/kafka/trunk, then cherry-pick to the relative release branch and then copy into the kafka-site repo.

It seems like this was not done with a few commits updating the 3.6.1, 3.5.2 and 3.5.1, resulting in kafka-site's latest upgrade.html containing content that isn't here. This was caught while we were adding the 3.7 upgrade docs.

This patch reconciles both files by taking the extra changes from kafka-site and placing them here. This was done by simply comparing a diff of both changes and taking the ones that apply
2024-02-22 10:39:58 +01:00
Paolo Patierno 9118ad653f
Additional fix on the rollback migration documentation (#15317)
This is an additional PR to fix rollback migration documentation related to #15287

Reviewers: Luke Chen <showuon@gmail.com>
2024-02-21 17:43:05 +08:00
Matthias J. Sax 0789952b68
MINOR: add note about Kafka Streams feature for 3.7 release (#15380)
Reviewers: Walker Carlson <wcarlson@confluent.io>
2024-02-16 08:59:48 -08:00
Paolo Patierno ddc5d1dc34
MINOR: Added ACLs authorizer change during migration (#15333)
This trivial PR makes clear when it's the right time to switch from AclAuthorizer to StandardAuthorizer during the migration process.

Reviewers: Luke Chen <showuon@gmail.com>
2024-02-16 18:57:22 +08:00
Luke Chen 501f82b91c
KAFKA-15670: add "inter.broker.listener.name" config in KRaft controller config (#14631)
During ZK migrating to KRaft, before entering dual-write mode, the KRaft controller will send RPCs (i.e. UpdateMetadataRequest, LeaderAndIsrRequest, and StopReplicaRequest) to the brokers. Currently, we use the inter broker listener to send the RPC to brokers from the controller. But in the doc, we didn't provide this info to users because the normal KRaft controller won't use inter.broker.listener.names.

This PR adds the missing config in the ZK migrating to KRaft doc.

Reviewers: Mickael Maison <mickael.maison@gmail.com>, Paolo Patierno <ppatierno@live.com>
2024-02-16 18:56:06 +08:00
Jim Galasyn 54ef99f42f
Update Streams API broker compat table for AK 3.7 (#15051)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2024-02-05 12:03:15 -08:00
Josep Prat f54975c331
MINOR: Fix code listings in quickstart.html (#10767)
* MINOR: Fix code listings in quickstart

Uses the right syntax highlighting

Reviewers: Mickael Maison <mickael.maison@gmail.com>, Luke Chen <showuon@gmail.com>
2024-02-05 16:43:53 +01:00
Josep Prat 829d5d45c4
MINOR: fix code listings connect.html (#10769)
* MINOR: fix code listings connect

Uses the right tool to show code listings, so it is consistent with the
rest of the examples

Signed-off-by: Josep Prat <josep.prat@aiven.io>

Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-02-05 15:39:19 +01:00
Colin P. McCabe b8ad609541 Revert "KAFKA-16101: Additional fixes on KRaft migration documentation (#15287)"
This reverts commit 46d76269fa.
2024-02-01 16:17:18 -08:00
Paolo Patierno 46d76269fa
KAFKA-16101: Additional fixes on KRaft migration documentation (#15287)
This PR fixes a couple of things related to the #15193 PR.

When you complete "Enter Migration Mode on the brokers", we are actually in "Enabling the migration on the brokers" referring to the migration guide and the broker doesn't really have node.id yet but still broker.id, so the PR removes a statement saying to replace the one with the other.

Also, during rollback it's not enough just deleting the /controller znode quickly after shutting down controllers because the controller election doesn't start yet until at least one broker is rolled back with the right configuration. Until the rolling and when controllers are down, the brokers just log something like this even if you deleted the znode "quickly":

[2024-01-30 09:27:52,394] DEBUG [zk-broker-0-to-controller-quorum-channel-manager]: Controller isn't cached, looking for local metadata changes (kafka.server.BrokerToControllerRequestThread)
[2024-01-30 09:27:52,394] INFO [zk-broker-0-to-controller-quorum-channel-manager]: Recorded new controller, from now on will use node localhost:9093 (id: 1 rack: null) (kafka.server.BrokerToControllerRequestThread)

You have to reduce the amount of time between deleting the znode and rolling at least one broker, so that an election can start.

Reviewers: Luke Chen <showuon@gmail.com>
2024-01-31 15:24:47 +08:00
Colin Patrick McCabe 5b422613a6
KAFKA-16101: Fix KRaft migration documentation (#15193)
This PR fixes some bugs in the KRaft migration documentation and reorganizes it to be easier to read. (Specifically, there were some steps that were previously out of order.)

In order to keep it all straight, the revert documentation is now in the form of a table which maps the latest migration state to the actions which the system administrator should perform.

Reviewers: Luke Chen <showuon@gmail.com>, David Arthur <mumrah@gmail.com>, Liu Zeyu <zeyu.luke@gmail.com>, Paolo Patierno <ppatierno@live.com>
2024-01-29 14:34:07 -08:00
Ayoub Omari 65596d0a23
KAFKA-14404: fix overlap of streams-config sections & describe additional parameters (#15162)
There is an overlap between two sections in the current version of streams-config.html as described in KAFKA-14404.
The goal of this fix is to remove the overlap as well as describing some other parameters and their default values

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Matthias Sax <mjsax@apache.org>
2024-01-24 14:04:43 -08:00
Justine Olshan 0ef89a7cc0
MINOR: Update KIP-890 note (#15244)
We've released the fix so I updated the note. We can backport to 3.6 and 3.7 branches as well.

Reviewers: Ismael Juma <ismael@juma.me.uk>, Divij Vaidya <diviv@amazon.com>
2024-01-23 09:18:28 -08:00
Ismael Juma 92a67e8571
Note that Java 11 support for broker and tools is deprecated for removal in 4.0 (#15236)
Reviewers: Divij Vaidya <diviv@amazon.com>
2024-01-19 14:08:07 -08:00
Christo Lolov 71b2cd6173
MINOR: Add public documentation for metrics introduced in KIP-963 (#15138)
Reviewers: Satish Duggana <satishd@apache.org>, Kamal Chandraprakash<kamal.chandraprakash@gmail.com>
2024-01-09 08:47:31 +05:30
Walker Carlson d54c9e3500
Minor: Add KIP-923 to upgrade-guide.html and dsl-api.html (#14725)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2024-01-05 05:19:18 -08:00
Almog Gavra ecf5550aa8
KAFKA-15215: docs for KIP-954 (#14949)
Upgrade guide and config docs for KIP-954, adding the new dsl.store.suppliers config for default store configuration

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Matthias Sax <mjsax@apache.org>
2024-01-02 10:44:24 -08:00
Stanislav Kozlovski d582d5aff5
MINOR: Update documentation.html with the 3.7 release (#15010)
This patch updates the docs/documentation.html to mention the 3.7 release, as per the step in the Release Process:

> Make sure docs/documentation.html is referring to the next release and links and update docs/upgrade.html with upgrade instructions for next release. For a bugfix release, make sure to at least bump the version number in the "Upgrading to ..." header in docs/upgrade.html. If this is a major or minor release #, it's a good idea to make this change now. If you end up doing it after cutting branches, be sure the commit lands on both trunk and your release branch. Note that this must be done before generating any artifacts because these docs are part of the content that gets voted on.
2023-12-26 14:50:45 +01:00
Eduwer Camacaro 0b086ca4ce
KAFKA-15448: Update upgrade guide for KIP-988 (#15039)
Reviewers: Colt McNealy <colt@littlehorse.io>, A. Sophie Blee-Goldman <ableegoldman@apache.org>, Matthias J. Sax <matthias@confluent.io>
2023-12-19 07:09:58 -08:00
Iblis Lin 55be0b3d4e
MINOR: doc/streams/dsl-api, fix href of "KTable-KTable Foreign-Key Joins" (#13919)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-19 01:26:17 -08:00
Jim Galasyn a8dac3e6af
MINOR: Update Streams API broker compat table (#14803)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-19 01:18:29 -08:00
Hao Li 4d7a7740f1
MINOR: docs for rack aware assignment (#14999)
Part of KIP-925.

Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-19 01:12:02 -08:00
Lokesh Kumar 72aa099b22
MINOR: Fixed typo in quickstart documentation (#15037)
Reviewers: Divij Vaidya <diviv@amazon.com>
2023-12-18 13:51:36 +01:00
Paolo Patierno 137fc18713
KAFKA-16005: Add details about rollback during ZK->KRaft migration in docs (#15012)
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Luke Chen <showuon@gmail.com>
2023-12-14 14:59:29 +01:00
Stanislav Kozlovski b352cc6b4e
MINOR: Bump trunk to 3.8.0-SNAPSHOT (#14993)
This patch bumps the next release version to 3.8.0-SNAPSHOT.

Following the Release Process, I created the 3.7 branch and am following the steps to bump these versions:

Modify the version in trunk to bump to the next one (eg. "0.10.1.0-SNAPSHOT") in the following files:

docs/js/templateData.js
gradle.properties
kafka-merge-pr.py
streams/quickstart/java/pom.xml
streams/quickstart/java/src/main/resources/archetype-resources/pom.xml
streams/quickstart/pom.xml
tests/kafkatest/__init__.py
2023-12-14 09:07:18 +01:00
Vedarth Sharma 0cd2be8718
KAFKA-15879: Add documentation and examples for docker image (#14938)
Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
2023-12-12 10:29:05 +05:30
Alieh Saeedi d6fc5bcf07
MINOR: Update upgrade-guide.html for KIP-960 and KIP-968 (#14958)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-11 01:42:43 -08:00
Hanyu Zheng 5ba7bfaa57
KAFKA-15629: Support ResultOrder to TimestampedRangeQuery. (#14907)
Update to KIP-992.

Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-07 15:29:29 -08:00
Hanyu Zheng 9d2297ad2d
KAFKA-15527: Support ResultOrder to reverseRange and reverseAll query over kv-store in IQv2 (#14906)
Update to KIP-985.

Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-07 08:32:16 -08:00
Hanyu Zheng efaae48897
KAKFA-15629: Update upgrade-guide.html for TimestampedKeyQuery and TimestampedRangeQuery (#14898)
Update upgrade-guide.html for TimestampedKeyQuery and TimestampedRangeQuery

Reviewers: Matthias J. Sax <matthias@confluent.io>
2023-12-06 17:51:26 -08:00
Florin Akermann 4a958c6cb1
Kafka-14748: Relax non-null FK left-join requirement (#14107)
Relax non-null FK left-join requirement.

Testing Strategy: Inject extractor which returns null on first or second element.

Reviewers: Walker Carlson <wcarlson@apace.org>
2023-12-05 18:04:32 -06:00