Commit Graph

181 Commits

Author SHA1 Message Date
Boyang Chen 964693e40d KAFKA-6386: Use Properties instead of StreamsConfig in KafkaStreams constructor
This pull request targets https://issues.apache.org/jira/browse/KAFKA-6386
The minor fix to deprecate usage of `StreamsConfig` in favor of `java.util.Properties`.
I created separate public constructors using `Properties` in order to replace the old ones,
and prioritize new functions in the `KafkaStreams.java` file.

Since this is my first time doing open source contribution, I'm very happy to get
any comment or pointer to be more professional and get better next time, thank you Guozhang guozhangwang and Liquan Ishiihara!

testing strategy: existing unit test should be suffice to cover this change.

Author: cs427fa16staff <bchen11@outlook.com>

Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <guozhang@confluent.io>, Bill Bejeck <bill@confluent.io>

Closes #4354 from abbccdda/starter

github comments
2018-03-27 16:09:34 -07:00
Matthias J. Sax 394aa74261
KAFKA-6454: Allow timestamp manipulation in Processor API (#4519)
Reviewers: Bill Bejeck <bill@confluent.io>, Damian Guy <damian@confluent.io>, Guozhang Wang <guozhang@confluent.io>
2018-03-16 16:02:11 -07:00
Guozhang Wang 925acc9f47
KAFKA-4831: add documentation for KIP-265 (#4686)
Reviewers: Damian Guy <damian.guy@gmail.com>, Bill Bejeck <bill@confluent.io>
2018-03-14 17:33:54 -07:00
Guozhang Wang 8e84961661
KAFKA-6560: Add docs for KIP-261 (#4685)
Reviewers: Matthias J. Sax <mjsax@apache.org>, Bill Bejeck <bill@confluent.io>
2018-03-12 13:11:29 -07:00
Matthias J. Sax a78f66a5ae KAFKA-3625: Add public test utils for Kafka Streams (#4402)
* KAFKA-3625: Add public test utils for Kafka Streams
 - add new artifact test-utils
 - add TopologyTestDriver
 - add MockTime, TestRecord, add TestRecordFactory

Reviewers: Guozhang Wang <wangguoz@gmail.com>, Damian Guy <damian.guy@gmail.com>, Bill Bejeck <bill@confluent.io>
2018-01-29 17:21:48 -08:00
Matthias J. Sax d673c8cf94 MINOR: update upgrade notes with regard to KIP-149 (#4439)
Reviewers: Guozhang Wang <wangguoz@gmail.com>, Damian Guy <damian.guy@gmail.com>
2018-01-26 09:18:22 -08:00
RichardYuSTUG 1d1c857596 4385
Author: RichardYuSTUG <yohan.richard.yu2@gmail.com>
Author: Prasanna Gautam <prasannagautam@gmail.com>
Author: Dong Lin <lindong28@gmail.com>
Author: Vahid Hashemian <vahidhashemian@us.ibm.com>
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #4385 from ConcurrencyPractitioner/doc-kafka-4499
2018-01-12 17:27:52 -08:00
Richard Yu b8aa1761c3 KAFKA-6265: Add #queryableStoreName() to GlobalKTable
A spinoff of original pull request #4340 for resolving conflicts.

Author: RichardYuSTUG <yohan.richard.yu2@gmail.com>

Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #4413 from ConcurrencyPractitioner/kafka-6265-2
2018-01-11 09:54:02 -08:00
Joel Hamill 06597ba26b MINOR: Menu updates and navigation (#4405)
* Menu updates and navigation

Reviewers: Guozhang Wang <wangguoz@gmail.com>
2018-01-09 16:28:49 -08:00
Jorge Quilcate Otoya 2900af6b33 Updating docs for streams app reset tool (#4401)
Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
2018-01-08 12:02:29 -08:00
Joel Hamill 26270983cd MINOR: Fix menu ordering in streams docs
https://issues.apache.org/jira/browse/KAFKA-6419

Related: https://github.com/apache/kafka-site/pull/115

Author: Joel Hamill <joel-hamill@users.noreply.github.com>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #4390 from joel-hamill/fix-streams-menu-order
2018-01-08 11:43:38 -08:00
Matt Farmer e1c5d0c119 MINOR: Add documentation for KAFKA-6086 (ProductionExceptionHandler) (#4395)
* Update streams documentation to describe production exception handler

* Add a mention of the ProductionExceptionHandler in the upgrade guide
2018-01-08 11:33:23 +00:00
Guozhang Wang 5995453f4c MINOR: Web docs for KIP-220
1. added functions for KafkaStreams and KafkaClientSupplier.
2. added prefix for admin client in StreamsConfig.

Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Jason Gustafson <jason@confluent.io>, Matthias J. Sax <matthias@confluent.io>

Closes #4338 from guozhangwang/K6150-doc-changes
2017-12-22 11:53:04 -08:00
Joel Hamill 3e2fe17c08 MINOR: Improve Streams Dev Guide content on web docs
This PR migrates content from CP Streams Dev Guide.

Here is the top-level page:
![image](https://user-images.githubusercontent.com/11722533/33904945-df9cf804-df31-11e7-93aa-52385961522c.png)

Here is a child page:
![image](https://user-images.githubusercontent.com/11722533/33904976-f2eafabe-df31-11e7-918c-fbf95db0f76b.png)

See related: https://github.com/apache/kafka-site/pull/112

Author: Joel Hamill <joel-hamill@users.noreply.github.com>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #4252 from joel-hamill/20171122-migrate-cp-dev-guide
2017-12-21 11:15:54 -08:00
Guozhang Wang ef49145200 MINOR: a few web doc and javadoc fixes
1. Added missing Javadocs in public interfaces.
2. Added missing upgrade web docs.
3. Minor improvements on exception messages.

Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Bill Bejeck <bill@confluent.io>, Damian Guy <damian.guy@gmail.com>, Matthias J. Sax <matthias@confluent.io>, Antony Stubbs <antony.stubbs@gmail.com>

Closes #4071 from guozhangwang/KMinor-javadoc-gaps
2017-10-16 16:50:59 -07:00
Guozhang Wang e2e8d4a57a MINOR: KIP-161 upgrade docs change
Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Damian Guy <damian.guy@gmail.com>

Closes #4036 from guozhangwang/KMinor-kip-161-docs
2017-10-06 17:57:32 -07:00
Joel Hamill d985513b22 MINOR: streams dev guide fixup
Author: Joel Hamill <joel@Joel-Hamill-Confluent.local>
Author: Joel Hamill <11722533+joel-hamill@users.noreply.github.com>

Reviewers: Derrick Or <derrickor@gmail.com>, Michael G. Noll <michael@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #3862 from joel-hamill/joel-hamill/streams-dev-guide
2017-10-04 11:28:59 -07:00
Richard Yu b8be86b805 KAFKA-5765; Move merge() from StreamsBuilder to KStream
This is the polished version.
1. The old merge() method in StreamsBuilder has been removed,
2. The merge() method in KStreamBuilder was changed so that it would use the single variable argument
rather than several variable arguments in the KStreamImpl implementation
3. The merge() method in KStream has been declared as final and tests have been added to test correctness.

Author: Richard Yu <richardyu@Richards-Air.attlocal.net>

Reviewers: Matthias J. Sax <matthias@confluent.io>, Bill Bejeck <bill@confluent.io>, Guozhang Wang <wangguoz@gmail.com>, Damian Guy <damian.guy@gmail.com>

Closes #3916 from ConcurrencyPractitioner/trunk
2017-09-26 09:42:53 +01:00
Damian Guy f29391c490 MINOR: add upgrade note for KIP-173 topic configs
Author: Damian Guy <damian.guy@gmail.com>

Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #3921 from dguy/minor-kip-173-docs
2017-09-21 18:19:24 +08:00
Florian Hussonnois 398714b758 KAFKA-5839: Upgrade Guide doc changes for KIP-130
Author: Florian Hussonnois <florian.hussonnois@gmail.com>

Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #3811 from fhussonnois/KAFKA-5839

minor fixes
2017-09-20 16:50:08 +08:00
Damian Guy 4769e3d92a KAFKA-5815; add Printed class and KStream#print(printed)
Part of KIP-182
- Add `Printed` class and `KStream#print(Printed)`
- deprecate all other `print` and `writeAsText` methods

Author: Damian Guy <damian.guy@gmail.com>

Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #3768 from dguy/kafka-5652-printed
2017-09-08 18:22:04 +01:00
Damian Guy e16b9143df KAFKA-5853; implement WindowedKStream
Add the `WindowedKStream` interface and implementation of methods that don't require `Materialized`

Author: Damian Guy <damian.guy@gmail.com>

Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #3809 from dguy/kgrouped-stream-windowed-by
2017-09-08 16:49:18 +01:00
Guozhang Wang 9b85cf9ed0 MINOR: KIP-138 renaming of string names
Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Bill Bejeck <bill@confluent.io>, Matthias J. Sax <matthias@confluent.io>, Damian Guy <damian.guy@gmail.com>

Closes #3796 from guozhangwang/kip-138-minor-renames
2017-09-06 18:39:40 -07:00
Matthias J. Sax 212bce6e3f MINOR: fix typos on web doc's upgrade guide
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #3804 from mjsax/hotfix
2017-09-06 15:42:52 -07:00
Matthias J. Sax cd59976eea KAFKA-5823: Extend upgrade section for KIP-120
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Sharon Liu <sharonliu.cup@gmail.com>, Damian Guy <damian.guy@gmail.com>, Guozhang Wang <wangguoz@gmail.com>

Closes #3787 from mjsax/kafka-5823-kip120-docs
2017-09-05 16:54:00 -07:00
Guozhang Wang ce04b14358 MINOR: KIP-160 docs
Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Damian Guy <damian.guy@gmail.com>

Closes #3733 from guozhangwang/KMinor-kip160-docs
2017-08-30 11:17:55 -07:00
Guozhang Wang f5310d645c MINOR: doc changes for KIP-138
1. Core concepts (added the stream time definition), upgrade guide and developer guide.
2. Related Java docs changes.

Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Bill Bejeck <bill@confluent.io>, Damian Guy <damian.guy@gmail.com>

Closes #3732 from guozhangwang/KMinor-kip138-docs
2017-08-30 09:45:16 -07:00
Guozhang Wang 21fea170d8 MINOR: add upgrade section for 1.0.0
1. Add upgrade section for 1.0.0, including Streams API changes section.
2. Add metrics name changes section.

Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Eno Thereska <eno.thereska@gmail.com>, Damian Guy <damian.guy@gmail.com>

Closes #3687 from guozhangwang/KMinor-metrics-upgrade-guide
2017-08-24 09:12:12 -07:00
Derrick Or 300f48018c MINOR: Add Streams landing page
Content and assets for the updated Streams API landing page

Author: Derrick Or <derrickor@gmail.com>

Reviewers: Michael G. Noll <michael@confluent.io>, Guozhang Wang <wangguoz@gmail.com>

Closes #3540 from derrickdoo/streams-landing-page
2017-07-21 19:16:14 -07:00
Eno Thereska 7bfe008ae1 MINOR: Move quickstart under streams
Author: Eno Thereska <eno.thereska@gmail.com>

Reviewers: Michael G. Noll <michael@confluent.io>, Damian Guy <damian.guy@gmail.com>, Guozhang Wang <wangguoz@gmail.com>

Closes #3494 from enothereska/minor-quickstart-docs

rename section name and bold font for section names
2017-07-09 17:35:14 -07:00
Guozhang Wang 2c6e9a9653 MINOR: Follow-up Streams doc changes to break into sub-pages
Also fixed a bunch of broken links (details can be found in 34f8ecea0d)

Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Eno Thereska <eno.thereska@gmail.com>, Bill Bejeck <bbejeck@gmail.com>, Damian Guy <damian.guy@gmail.com>

Closes #3473 from guozhangwang/KMinor-streams-doc-breakdown
2017-07-03 15:35:47 +01:00