Commit Graph

55 Commits

Author SHA1 Message Date
A. Sophie Blee-Goldman 9482bfe2ce MINOR: add UPGRADE_FROM to 2.0-2.3 config docs (#7831)
Reviewers: Guozhang Wang <guozhang@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2020-01-01 15:27:27 -08:00
A. Sophie Blee-Goldman 6c8ad27060 MINOR: clarify node grouping of input topics using pattern subscription (#7793)
Updates the HTML docs and the javadoc.

Reviewers: John Roesler <vvcephei@apache.org>
2019-12-06 23:17:10 -06:00
vinoth chandar 440956a55c KAFKA-8913: Document topic based configs & ISR settings for Streams apps (#7346)
Reviewer: Matthias J. Sax <matthias@confluent.io>
2019-09-17 17:39:13 -07:00
slim 8cc43fa313 Fixes #8198 KStreams testing docs use non-existent method pipe (#6678)
Minor fix of #8198 apache/kafka-site#210

Reviewers: John Roesler <john@confluent.io>, Bill Bejeck <bbejeck@gmail.com>
2019-07-12 11:14:03 -04:00
Victoria Bialas dd332b10ff KAFKA-7315 DOCS update TOC internal links serdes all versions (#6875)
Reviewers: Joel Hamill <joel@confluent.io>, Jim Galasyn <jim.galasyn@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-06-10 10:11:25 -07:00
Bill Bejeck 839541e4b9 KAFKA-8210: Fix link for streams table duality (#6573)
Reviewers: Victoria Bialas <vicky@confluent.io>
2019-04-16 11:16:54 -04:00
Victoria Bialas 35813009c6 KAFKA-8212 DOCS (kafka) - Fix Maven artifacts table from cutting off text (#6576)
Reviewer: Matthias J. Sax <matthias@confluent.io>
2019-04-13 15:46:55 -07:00
Victoria Bialas 612219ad8d KAFKA-8213 - Fix typo in Streams Dev Guide (#6574)
Reviewers: Jim Galasyn <jim.galasyn@confluent.io>, Joel Hamill <joel@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-04-13 15:38:18 -07:00
cwildman 5b23eb64ea MINOR: state.cleanup.delay.ms default is 600,000 ms (10 minutes). (#6345)
Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2019-02-28 09:26:27 -08:00
John Roesler a3ce7daf40 KAFKA-7741: Reword Streams dependency workaround docs (#6207)
Avoid mentioning unreleased versions in the docs.

Reviewers: Matthias J. Sax <matthias@confluent.io>, Bill Bejeck <bill@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2019-02-11 10:26:07 -08:00
John Roesler c5ed908476 KAFKA-7741: streams-scala - document dependency workaround (#6125)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2019-01-11 17:16:43 -08:00
Bill Bejeck 1d239a0fd8 HOTFIX: Fix broken links (#5676)
Reviewers: Joel Hamill <11722533+joel-hamill@users.noreply.github.com>, Guozhang Wang <wangguoz@gmail.com>
2018-10-10 17:49:41 -07:00
Matthias J. Sax 9e50cb23dd MINOR: fix Streams docs state.dir (#5465)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-08-06 13:54:21 -07:00
Simon Clark c7bdc3a1f5 MINOR: Fixed default streams state dir location. (#5441)
Co-authored-by: Mickael Maison <mickael.maison@gmail.com>
Co-authored-by: Simon Clark <simonc6r@gmail.com>

Reviewers: Sriharsha Chintalapani <sriharsha@apache.org>
2018-08-06 11:57:43 -07:00
Guozhang Wang 67a0560812 MINOR: web docs fixes on message header (#5381)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2018-07-17 17:32:05 -07:00
Guozhang Wang 35d8383ec8 HOTFIX: update Streams security docs 2018-06-26 18:53:53 -07:00
Guozhang Wang 82ba5c0ad6 MINOR: update web docs and examples of Streams with Java8 syntax (#5249)
Reviewers: John Roesler <john@confluent.io>, Bill Bejeck <bill@confluent.io>, Damian Guy <damian@confluent.io>
2018-06-21 10:03:47 -07:00
Guozhang Wang bc2badb248 MINOR: provide an example for deserialization exception handler (#5231)
Also added a paragraph from data types to link to the example code.

Reviewers: Matthias J. Sax <mjsax@apache.org>
2018-06-17 17:31:57 -07:00
Guozhang Wang 86410e14d7 MINOR: Add missing configs for resilience settings
Reviewers: Matthias J. Sax <matthias@confluent.io>, Bill Bejeck <bill@confluent.io>
2018-06-05 11:41:03 -07:00
Jorge Quilcate Otoya e8ddb76573 KAFKA-6938: Add documentation for accessing Headers on Kafka Streams Processor API (#5128)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-06-04 15:39:20 -07:00
Guozhang Wang 718d6f2475
MINOR: Remove deprecated KafkaStreams constructors in docs (#5118)
Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2018-06-04 13:43:20 -07:00
Guozhang Wang f33e9a346e KAFKA-4936: Add dynamic routing in Streams (#5018)
implements KIP-303

Reviewers: Bill Bejeck <bill@confluent.io>, John Roesler <john@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2018-05-30 11:54:53 -07:00
Joan Goyeau 1e0793c4ce Update doc of curried joins and aggregates (#5053)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-05-30 11:03:58 -07:00
Andy Coates 4e1c8ffd0d KAFKA-6849: add transformValues methods to KTable. (#4959)
See the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-292%3A+Add+transformValues%28%29+method+to+KTable

This PR adds the transformValues method to the KTable interface. The semantics of the call are the same as the methods of the same name on the KStream interface.

Fixes KAFKA-6849

Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
2018-05-18 16:06:50 -07:00
Matthias J. Sax 0b3712d8a5
MINOR: add missing parameter `processing.guaratees` to Streams docs (#5023)
Reviewers: Guozhang Wang <guozhang@confluent.io>, Bill Bejeck <bill@confluent.io>
2018-05-16 13:58:25 -07:00
Guozhang Wang d4204e8b14
MINOR: fix broken links in streams doc (#5025)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-05-16 13:23:20 -07:00
David Glasser e9154b7960 KAFKA-6905: Document that Processors may be re-used by Streams (#5022)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-05-16 13:10:21 -07:00
Joel Hamill c14b0ad9ee MINOR - Fix typo in Streams Dev Guide (#4972)
Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2018-05-11 10:27:07 -07:00
Joan Goyeau b88d70b532 MINOR: Make Serdes less confusing in Scala (#4963)
Serdes are confusing in the Scala wrapper:

* We have wrappers around Serializer, Deserializer and Serde which are not very useful.
* We have Serdes in 2 places org.apache.kafka.common.serialization.Serde and in DefaultSerdes, instead we should be having only one place where to find all the Serdes.

I wanted to do this PR before the release as this is a breaking change.
This shouldn't add more so the current tests should be enough.

Reviewers: Debasish Ghosh <dghosh@acm.org>, Guozhang Wang <guozhang@confluent.io>
2018-05-08 09:15:31 -07:00
Sean Glover 893e044515 MINOR: Build and code sample updates for Kafka Streams DSL for Scala (#4949)
Several build and documentation updates were required after the merge of KAFKA-6670: Implement a Scala wrapper library for Kafka Streams.

Encode Scala major version into streams-scala artifacts.
To differentiate versions of the kafka-streams-scala artifact across Scala major versions it's required to encode the version into the artifact name before its published to a maven repository. This is accomplished by following a similar release process as kafka core, which encodes the Scala major version and then runs the build for each major version of Scala supported. This is considered standard practice when releasing Scala libraries, but is not handled for us automatically with the basic Scala for Gradle support.

After this change you can generate and install the kafka-streams-scala artifact into the local maven repository:

$ ./gradlew -PscalaVersion=2.11 install
$ ./gradlew -PscalaVersion=2.12 install

Reviewers: Ismael Juma <ismael@juma.me.uk>, Guozhang Wang <wangguoz@gmail.com>
2018-05-06 20:55:12 -07:00
Boyang Chen 1b170df31c KAFKA-6657: Add StreamsConfig prefix for different consumers (#4805)
This pull request is for JIRA 6657, for KIP-276.

Added unit tests for new getGlobalConsumerConfigs API and make sure existing restore consumer tests are passing.

Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
2018-05-02 13:24:15 -07:00
manjuapu 0143a65091 Fix streams web doc configs tables (#4943)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-04-27 16:15:55 -07:00
manjuapu 3ce14a84a8 MINOR: Streams web doc table fix (#4942) 2018-04-27 14:20:29 -07:00
Debasish Ghosh b2e4db01b6 KAFKA-6670: Implement a Scala wrapper library for Kafka Streams
This PR implements a Scala wrapper library for Kafka Streams. The library is implemented as a project under streams, namely `:streams:streams-scala`. The PR contains the following:

* the library implementation of the wrapper abstractions
* the test suite
* the changes in `build.gradle` to build the library jar

The library has been tested running the tests as follows:

```
$ ./gradlew -Dtest.single=StreamToTableJoinScalaIntegrationTestImplicitSerdes streams:streams-scala:test
$ ./gradlew -Dtest.single=StreamToTableJoinScalaIntegrationTestImplicitSerdesWithAvro streams:streams-scala:test
$ ./gradlew -Dtest.single=WordCountTest streams:streams-scala:test
```

Author: Debasish Ghosh <ghosh.debasish@gmail.com>
Author: Sean Glover <seglo@randonom.com>

Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Ismael Juma <ismael@juma.me.uk>, John Roesler <john@confluent.io>, Damian Guy <damian@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #4756 from debasishg/scala-streams
2018-04-23 13:33:35 -07:00
taekyung 51db468bf3 MINOR: Fixed deserialization.exception.handler default value of config-streams (#4914)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-04-23 09:49:53 -07:00
ro7m 8434d494e6 KAFKA-6790: Fix Streams processor node broken link (#4874)
The page here https://kafka.apache.org/11/documentation/streams/developer-guide/memory-mgmt.html talks about processor nodes and refers to non existing links.

Broken link (appears twice in the same document):

https://kafka.apache.org/11/documentation/streams/concepts.html#streams-concepts-processor

To find this search for the word "processor node" on the page memory-management , the ones which are links are broken.

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-04-15 09:56:12 -07:00
ro7m ac4374dc24 KAFKA-6732: Fix Streams doc ref link (#4806)
Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-04-01 18:05:15 -07:00
John Roesler adbf31ab1d KAFKA-6473: Add MockProcessorContext to public test-utils (#4736)
Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <guozhang@confluent.io>, Bill Bejeck <bill@confluent.io>
2018-03-27 14:03:24 -07:00
Matthias J. Sax 394aa74261
KAFKA-6454: Allow timestamp manipulation in Processor API (#4519)
Reviewers: Bill Bejeck <bill@confluent.io>, Damian Guy <damian@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2018-03-16 16:02:11 -07:00
huxi a9c16a8110 KAFKA-6663: Doc for `GlobalKTable` should be corrected. (#4723)
Reviewers: John Roesler <john@confluent.io>, Bill Bejeck <bill@confluent.io>, Guozhang Wang <guozhang@confluent.io>, Damian Guy <damian@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2018-03-16 13:24:14 -07:00
huxi d2aca95aeb MINOR: Fix incorrect expression for KTable in stream doc. (#4718)
In dsi-api.html, when reading from Kafka to a KTable, the doc says "In the case of a KStream.." where `Kstream` here is not correct. They should be `KTable`.

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-03-15 11:34:33 -07:00
Matthias J. Sax 0c00aa0983
MINOR: Streams doc example should not close store (#4667)
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Bill Bejeck <bill@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2018-03-13 00:42:40 -07:00
Matthias J. Sax 77a6104f54
KAFKA-3625: add docs for Kafka Streams test-utils (follow up) (#4493)
Adds web page docs for KIP-247

Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Guozhang Wang <guozhang@confluent.io>, Bill Bejeck <bill@confluent.io>, Joel Hamill <joel@confluent.io>, Damian Guy <damian@confluent.io>
2018-02-08 13:35:57 -08:00
Matthias J. Sax a0fb4db40a
MINOR: improve security docs for Kafka Streams (#4532)
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Bill Bejeck <bill@confluent.io>, Joel Hamill <joel@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2018-02-08 11:49:09 -08:00
Guozhang Wang 077fd9ced3
HOTFIX: Fix broken javadoc links on web docs(#4543)
Reviewers: Matthias J. Sax <matthias@confluent.io>
2018-02-08 09:31:58 -08:00
Matthias J. Sax 164fea30ea
MINOR: update upgrade notes for Streams API; message format 0.10 requiered (#4500)
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Bill Bejeck <bill@confluent.io>, Guozhang Wang <guozhang@confluent.io.>
2018-02-07 11:43:57 -08:00
Yu f6bbec4af2 KAFKA-6354: Update KStream JavaDoc using new State Store API (#4456)
Updates KStream JavaDoc and web page documentations using new State Store API

Author: Yu Liu <yu.liu003@gmail.com>

Reviewers: Guozhang Wang <guozhang@confluent.io>, Matthias J. Sax <matthias@confluent.io>
2018-02-02 11:24:20 -08:00
Joel Hamill 6ea53d22e2 MINOR: Fix some streams web doc nits (#4411)
Reviewers: Derrick Or <derrickor@gmail.com>, Guozhang Wang <wangguoz@gmail.com>
2018-01-29 10:09:32 -08:00
Matthias J. Sax 9ef883e62f MINOR: update docs with regard to improved resilience of Kafka Streams (#4380)
Reviewers: Guozhang Wang <wangguoz@gmail.com>, Joel Hamill, Damian Guy <damian.guy@gmail.com>, Bill Bejeck <bill@confluent.io>
2018-01-22 14:37:19 -08:00
Joel Hamill 06597ba26b MINOR: Menu updates and navigation (#4405)
* Menu updates and navigation

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-01-09 16:28:49 -08:00