Commit Graph

313 Commits

Author SHA1 Message Date
Matthias J. Sax a21c4a46e3 MINOR: update Kafka Streams state.dir doc (#14155)
Default state directory was changes in 2.8.0 release (cf KAFKA-10604)

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2023-08-07 10:40:47 -07:00
Matthias J. Sax 6d5d3d5163 MINOR: remove note on future multi-cluster support of Kafka Streams (#11363)
Reviewer: Bill Bejeck <bill@confluent.io>
2021-09-28 23:10:09 -07:00
Luke Chen 26f6ed0658
MINOR: (doc) Disable spurious left/outer stream-stream join fix (#11247)
This is the doc rollback for #11233
2021-08-23 11:59:55 -07:00
Guozhang Wang 3f2c833cda KAFKA-13172: Add downgrade guidance note for 3.0 (#11184)
Reviewers: Luke Chen <showuon@gmail.com>, Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Bruno Cadonna <cadonna@confluent.io>
2021-08-17 17:03:44 -07:00
Luke Chen 85359ee57b MINOR: update the branch(split) doc and java doc and tests (#11195)
Reviewers: Ivan Ponomarev <iponomarev@mail.ru>, Matthias J. Sax <matthias@confluent.io>
2021-08-10 13:38:39 -07:00
Matthias J. Sax 98f1ab94fb MINOR: update stream-stream join docs (#11172)
Reviewers: Guozhang Wang <guozhang@confluent.io>
2021-08-05 11:34:13 -07:00
A. Sophie Blee-Goldman ace3bbbc73 KAFKA-13021: clarify KIP-633 javadocs and address remaining feedback (#11114)
There were a few followup things to address from #10926, most importantly a number of updates to the javadocs. Also includes a few missing verification checks.

Reviewers: Guozhang Wang <guozhang@confluent.io>, Matthias J. Sax <mjsax@apache.org>, Israel Ekpo
2021-07-23 16:15:31 -07:00
Luke Chen 64014e8ac3 MINOR: update doc to reflect the grace period change (#11100)
We removed default 24 hours grace period in KIP-633, and deprecate some grace methods, but we forgot to update the stream docs.

Reviewer: Bruno Cadonna <cadonna@apache.org>
2021-07-21 13:27:38 +02:00
Guozhang Wang 718408261b KAFKA-10847: Remove internal config for enabling the fix (#10941)
Also update the upgrade guide indicating about the grace period KIP and its indication on the fix with throughput impact.

Reviewers: Luke Chen <showuon@gmail.com>, Matthias J. Sax <mjsax@apache.org>
2021-07-15 10:59:10 -07:00
John Roesler 06f306a8a8 KAFKA-8410: Update the docs to reference the new PAPI (#10994)
Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Luke Chen <showuon@gmail.com>, Matthias J. Sax <mjsax@apache.org>
2021-07-13 10:25:31 -05:00
John Roesler f69be68c58 KAFKA-12360: Document new time semantics (#11003)
Update the docs for task idling, since the semantics have
changed in 3.0.

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Luke Chen <showuon@gmail.com>, Boyang Chen <boyang@apache.org>
2021-07-12 16:18:33 -05:00
A. Sophie Blee-Goldman fca37e410c MINOR: fix typo in config for eos-v2 docs of the upgrade guide (#11001)
One of the configs has a typo and should have been exactly_once _v2 rather than just exactly_once

Reviewers: John Roesler <vvcephei@apache.org>
2021-07-08 12:35:37 -07:00
leah 3f432af02b KAFKA-9559 add docs for changing default serde to null (#10988)
#10813 changed the default serde from ByteArraySerde as discussed in KIP-741. This adds proper documentation so users know to set a serde through the configs or explicitly pass one in.

Reviewers: Walker Carlson <wcarlson@confluent.io>, Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-07-08 11:34:01 -07:00
Josep Prat 6655a09e99
KAFKA-12849: KIP-744 TaskMetadata ThreadMetadata StreamsMetadata as API (#10840)
Implementation of KIP-744.

Creates new Interfaces for TaskMetadata, ThreadMetadata, and
StreamsMetadata, providing internal implementations for each of them.

Deprecates current TaskMetadata, ThreadMetadata under o.a.k.s.processor,
and SreamsMetadata under a.o.k.s.state.

Updates references on internal classes from deprecated classes to new interfaces.

Deprecates methods on KafkaStreams returning deprecated ThreadMeatada and
StreamsMetadata, and provides new ones returning the new interfaces.

Update Javadocs referencing to deprecated classes and methods to point
to the right ones.

Co-authored-by: Bruno Cadonna <cadonna@apache.org>

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Bruno Cadonna <cadonna@apache.org>
2021-06-25 18:31:49 +02:00
A. Sophie Blee-Goldman bbe170af70
MINOR: deprecate TaskMetadata constructor and add KIP-740 notes to upgrade guide (#10755)
Quick followup to KIP-740 to actually deprecate this constructor, and update the upgrade guide with what we changed in KIP-740. I also noticed the TaskId#parse method had been modified previously, and should be re-added to the public TaskId class. It had no tests, so now it does

Reviewers: Matthias J. Sax <mjsax@confluent.io>, Luke Chen <showuon@gmail.com>
2021-05-26 10:35:12 -07:00
Josep Prat aa25176e77
MINOR: Kafka Streams code samples formating unification (#10651)
Code samples are now unified and correctly formatted.
Samples under Streams use consistently the prism library.

Reviewers: Bruno Cadonna <cadonna@apache.org>
2021-05-21 17:27:42 +02:00
Daniyar Yeralin 6d1ae8bc00
KAFKA-8326: Introduce List Serde (#6592)
Introduce List serde for primitive types or custom serdes with a serializer and a deserializer according to KIP-466

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Matthias J. Sax <mjsax@conflunet.io>, John Roesler <roesler@confluent.io>, Michael Noll <michael@confluent.io>
2021-05-13 15:54:00 -07:00
Vito Jeng fae0784ce3
KAFKA-5876: KIP-216 Part 4, Apply InvalidStateStorePartitionException for Interactive Queries (#10657)
KIP-216, part 4 - apply InvalidStateStorePartitionException

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-05-10 17:29:58 -07:00
Matthias J. Sax 6a5992a814
KAFKA-8531: Change default replication factor config (#10532)
Implements KIP-733

Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>
2021-05-05 16:16:06 -07:00
Vito Jeng 816f5c3b86
KAFKA-5876: KIP-216 Part 3, Apply StreamsNotStartedException for Interactive Queries (#10597)
KIP-216 Part 3: Throw StreamsNotStartedException if KafkaStreams state is CREATED

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-05-03 13:53:35 -07:00
Guozhang Wang 3ec6317ee6
KAFKA-12683: Remove deprecated UsePreviousTimeOnInvalidTimestamp (#10557)
Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-05-01 08:31:41 -07:00
A. Sophie Blee-Goldman 3805f3706f
KAFKA-12574: KIP-732, Deprecate eos-alpha and replace eos-beta with eos-v2 (#10573)
Deprecates the following 

1. StreamsConfig.EXACTLY_ONCE
2. StreamsConfig.EXACTLY_ONCE_BETA
3. Producer#sendOffsetsToTransaction(Map offsets, String consumerGroupId)

And introduces a new StreamsConfig.EXACTLY_ONCE_V2 config. Additionally, this PR replaces usages of the term "eos-beta" throughout the code with the term "eos-v2"

Reviewers: Matthias J. Sax <mjsax@confluent.io>
2021-04-28 13:22:15 -07:00
JoelWee 0ea440b2af
KAFKA-6435: KIP-623 Add internal topics option to streamResetter (#8923)
Allow user to specify subset of internal topics to clean up with application reset tool

Reviewers: Boyang Chen <boyang@confluent.io>, Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Walker Carlson <wcarlson@confluent.io>
2021-04-27 15:44:53 -07:00
Vito Jeng c972ac929e
KAFKA-5876: Apply UnknownStateStoreException for Interactive Queries (#9821)
KIP-216: IQ should throw different exceptions for different errors, Part 2

Reviewers: Matthias J. Sax <mjsax@confluent.io>, Anna Sophie Blee-Goldman <ableegoldman@apache.org>, Bruno Cadonna <cadonna@confluent.io>
2021-04-23 12:09:32 -07:00
Guozhang Wang 87b24025ce HOTFIX: typo in Streams DSL docs 2021-04-21 10:25:54 -07:00
Guozhang Wang 035449eb55
KAFKA-12633: Remove deprecated APIs in TopologyTestDriver (#10508)
As well as related test classes.

Reviewers: John Roesler <vvcephei@apache.org>
2021-04-18 10:46:01 -07:00
A. Sophie Blee-Goldman c608d8480e
KAFKA-7606: Remove deprecated options from StreamsResetter (#10411)
Remove deprecated --zookeeper and --execute flags

Reviewers: Matthias J. Sax <mjsax@confluent.io>
2021-04-12 18:24:18 -07:00
Jorge Esteban Quilcate Otoya db0323e9ba
KAFKA-12449: Remove deprecated WindowStore#put (#10293)
Removes `WindowStore#put(K,V)` that was deprecated via KIP-474.

Reviewers: Matthias J. Sax <matthias@confluent.io>
2021-04-09 11:49:37 -07:00
Jim Galasyn e4b6ffae5d
MINOR: Fix left/outer join descriptions in Streams DSL reference topic (#10453)
Reviewer: Matthias J. Sax <matthias@confluent.io>
2021-04-09 11:41:52 -07:00
cyc 8d356b034b
KAFKA-12492: Fix the formatting of example RocksDBConfigSetter (#10486)
Fix the formatting of example RocksDBConfigSetter due to the un-arranged spaces within <pre> tag.

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-04-08 20:55:52 -07:00
Guozhang Wang d44e01be48 HOTFIX: add missing upgrade docs 2021-04-08 08:49:33 -07:00
Guozhang Wang 3ca5a3bb78
KAFKA-12568: Remove deprecated APIs in KStream, KTable and Joined (#10421)
This is related to KIP-307 / KIP-372 / KIP-479.

Reviewers: John Roesler <vvcephei@apache.org>
2021-04-07 17:38:43 -07:00
Marco Aurelio Lotz 33d0445b84
KAFKA-5146: remove Connect dependency from Streams module (#10131)
Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Ismael Juma <ismael@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2021-04-06 17:47:52 -07:00
Matthias J. Sax 57723f0c97
MINOR: remove KTable.to from the docs (#10464)
Reviewers: Bill Bejeck <bill@confluent.io>
2021-04-02 09:36:35 -07:00
Walker Carlson e971d94eb3
KAFKA-8784: remove default close for RocksDBConfigSetter (#10416)
Remove the default close implementation for RocksDBConfigSetter to avoid accidental memory leaks via C++ backed objects which are constructed but not closed by the user

Reviewers: Anna Sophie Blee-Goldman <ableegoldman@apache.org>
2021-03-29 14:26:39 -07:00
Guozhang Wang d5fd491bf7
KAFKA-7106: remove deprecated Windows APIs (#10378)
1. Remove all deprecated APIs in KIP-328.
2. Remove deprecated APIs in Windows in KIP-358.

Reviewers: John Roesler <vvcephei@apache.org>
2021-03-28 12:33:40 -07:00
Guozhang Wang b8058829bb
KAFKA-12562: Remove deprecated APIs in KafkaStreams and returned state classes (#10412)
Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>
2021-03-28 12:20:31 -07:00
Luke Chen 69baa03404
MINOR: fix the wrong/missing anchor in docs caused link error (#10413)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2021-03-28 11:39:53 -07:00
Matthias J. Sax bd9a5da9d1
MINOR: update Streams upgrade notes with removed APIs (#10420)
Reviewer: Guozhang Wang <guozhang@confluent.io>
2021-03-28 11:36:42 -07:00
Guozhang Wang 7071ded2a6
KAFKA-12524: Remove deprecated segments() (#10379)
Reviewers: Boyang Chen <boyang@confluent.io>
2021-03-23 21:05:42 -07:00
vamossagar12 8bd0e218d8
MINOR: Add release documentation for KIP-614 (#10051)
Reviewers: Bruno Cadonna <bruno@confluent.io>, John Roesler <vvcephei@apache.org>
2021-02-24 13:34:38 -06:00
A. Sophie Blee-Goldman 0605b690e9
MINOR: document restriction against running multiple Streams apps on same state.dir (#10187)
Reviewers: Leah Thomas <lthomas@confluent.io>, Almog Gavra <almog@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
2021-02-23 08:39:19 -08:00
Jim Galasyn 9728b4ff92
KAFKA-12160: Remove max.poll.interval.ms from config docs (#10182)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2021-02-22 17:06:25 -08:00
Matthias J. Sax b35ca4349d
KAFKA-9274: Throw TaskCorruptedException instead of TimeoutException when TX commit times out (#10072)
Part of KIP-572: follow up work to PR #9800. It's not save to retry a TX commit after a timeout, because it's unclear if the commit was successful or not, and thus on retry we might get an IllegalStateException. Instead, we will throw a TaskCorruptedException to retry the TX if the commit failed.

Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>
2021-02-19 13:36:07 -08:00
Jim Galasyn da58ce4065
MINOR: Clarify config names for EOS versions 1 and 2 (#9670)
Reviewers: Boyang Chen <boyang@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2021-02-16 17:11:24 -08:00
Matthias J. Sax d01d97ed66
MINOR: add docs for KIP-680 (#10048)
Reviewers: Bill Bejeck <bill@confluent.io>, Jim Galasyn <jim.galasyn@confluent.io>
2021-02-04 20:18:20 -08:00
Matthias J. Sax 016128c920
MINOR: Extends RocksDB docs (#10046)
We recommend users to switch to jemalloc for RocksDB.

Co-authored-by: Jim Galasyn <jim.galasyn@confluent.io>

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Rohan Desai <rohan@confluent.io>, A. Sophie Blee-Goldman <sophie@confluent.io>
2021-02-04 18:50:19 -08:00
Ivan Ponomarev 5552da3a20
KAFKA-5488: Add type-safe split() operator (#9107)
Implements KIP-418, that deprecated the `branch()` operator in favor of the newly added and type-safe `split()` operator.

Reviewers: Matthias J. Sax <matthias@confluent.io>, John Roesler <john@confluent.io>
2021-02-04 16:23:35 -08:00
leah f5a2fbac6d
KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size (#9253)
See KIP details and discussions here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size

Deprecates methods that allow users to skip setting a window size when one is needed. Adds a window size streams config to allow the timeWindowedDeserializer to calculate window end time.

Reviewers: Walker Carlson <wcarlson@confluent.io>, John Roesler <vvcephei@apache.org>, Guozhang Wang <wangguoz@gmail.com>
2021-02-01 16:20:35 -08:00
Walker Carlson eff51a82f2
MINOR: update docs for KIP-663, KIP-696, and KIP-671 (#9969)
Co-authored-by: Bruno Cadonna <bruno@confluent.io>

Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <guozhang@confluent.io>, Bruno Cadonna <bruno@confluent.io>
2021-01-29 09:00:56 -08:00