Commit Graph

39 Commits

Author SHA1 Message Date
huxi 895c83f88d KAFKA-7412: clarify the doc for producer callback (#5798)
The metadata in the callback is not null with non-null exception.

Reviewers: Jun Rao <junrao@gmail.com>
2018-11-08 16:58:14 -08:00
Viktor Somogyi 8a78d76466 KAFKA-7140; Remove deprecated poll usages (#5319)
Reviewers: Matthias J. Sax <mjsax@apache.org>, Jason Gustafson <jason@confluent.io>
2018-08-10 22:51:17 -07:00
Ismael Juma cc4dce94af
KAFKA-2983: Remove Scala consumers and related code (#5230)
- Removed Scala consumers (`SimpleConsumer` and `ZooKeeperConsumerConnector`)
and their tests.
- Removed Scala request/response/message classes.
- Removed any mention of new consumer or new producer in the code
with the exception of MirrorMaker where the new.consumer option was
never deprecated so we have to keep it for now. The non-code
documentation has not been updated either, that will be done
separately.
- Removed a number of tools that only made sense in the context
of the Scala consumers (see upgrade notes).
- Updated some tools that worked with both Scala and Java consumers
so that they only support the latter (see upgrade notes).
- Removed `BaseConsumer` and related classes apart from `BaseRecord`
which is used in `MirrorMakerMessageHandler`. The latter is a pluggable
interface so effectively public API.
- Removed `ZkUtils` methods that were only used by the old consumers.
- Removed `ZkUtils.registerBroker` and `ZKCheckedEphemeral` since
the broker now uses the methods in `KafkaZkClient` and no-one else
should be using that method.
- Updated system tests so that they don't use the Scala consumers except
for multi-version tests.
- Updated LogDirFailureTest so that the consumer offsets topic would
continue to be available after all the failures. This was necessary for it
to work with the Java consumer.
- Some multi-version system tests had not been updated to include
recently released Kafka versions, fixed it.
- Updated findBugs and checkstyle configs not to refer to deleted
classes and packages.

Reviewers: Dong Lin <lindong28@gmail.com>, Manikumar Reddy <manikumar.reddy@gmail.com>
2018-06-19 07:32:54 -07:00
UVN 1667c16be1 MINOR: Read configuration fields from ProducerConfig in example (#4601)
Reading the configuration field names from ProducerConfig class and taking the key and value serializer names from class name directly instead of hardcoding.
2018-02-21 08:58:35 -08:00
Vahid Hashemian f85c18032b KAFKA-3264; Deprecate the old Scala consumer (KIP-109)
Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>

This patch had conflicts when merged, resolved by
Committer: Ismael Juma <ismael@juma.me.uk>

Closes #2328 from vahidhashemian/KAFKA-3264
2017-06-02 12:27:47 +01:00
Matthias J. Sax d0e436c471 MINOR: improve license header check by providing head file instead of (prefix) header regex
Author: Matthias J. Sax <matthias@confluent.io>

Reviewers: Jason Gustafson <jason@confluent.io>, Ewen Cheslack-Postava <ewen@confluent.io>

Closes #2303 from mjsax/licenseHeader
2017-02-28 12:35:04 -08:00
Qian Zheng 39a1c42dfc MINOR: add a space to separate two words
I think we should add a space here, otherwise the two words will join together.
And replace the host string with a constant, otherwise when I need to modify the host, I need to modify several files.

Author: 郑谦00117553 <00117553@zte.intra>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #2132 from ZhengQian1/trunk
2016-11-16 11:36:05 -08:00
Rajini Sivaram 9d71489ff0 KAFKA-3548: Use root locale for case transformation of constant strings
For enums and other constant strings, use locale independent case conversions to enable comparisons to work regardless of the default locale.

Author: Rajini Sivaram <rajinisivaram@googlemail.com>

Reviewers: Manikumar Reddy, Ismael Juma, Guozhang Wang, Gwen Shapira

Closes #1220 from rajinisivaram/KAFKA-3548
2016-04-20 18:54:30 -07:00
Ismael Juma e3ab96b2f0 MINOR: Example style improvements
These are minor, but no reason to make our example code look worse than it has to.

Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Grant Henke

Closes #940 from ijuma/example-style-improvements
2016-02-22 11:40:33 -08:00
Grant Henke 64b746bd8b KAFKA-3020; Ensure CheckStyle runs on all Java code
- Adds CheckStyle to core and examples modules
- Fixes any existing CheckStyle issues

Author: Grant Henke <granthenke@gmail.com>

Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>

Closes #703 from granthenke/checkstyle-core
2015-12-21 22:48:03 -08:00
Ashish Singh 5338f8432f KAFKA-2487: change kafka.examples.Consumer to use the new java consumer
Author: Ashish Singh <asingh@cloudera.com>

Reviewers: Guozhang Wang

Closes #297 from SinghAsDev/KAFKA-2487
2015-10-15 17:28:23 -07:00
Ismael Juma ed1a548c50 KAFKA-2140 Improve code readability; reviewed by Neha Narkhede 2015-04-26 08:40:58 -07:00
Ashish Singh 5408931a29 kafka-1982; change kafka.examples.Producer to use the new java producer; patched by Ashish Singh; reviewed by Gwen Shapira, Mayuresh Gharat and Jun Rao 2015-04-19 07:46:58 -07:00
Jay Kreps 1c6d5bbac6 KAFKA-1915: Add checkstyle for java code. 2015-02-03 09:16:55 -08:00
Geoffrey Anderson b77099626e kafka-1700; examples directory - README and shell scripts are out of date; patched by Geoffrey Anderson; reviewed by Jun Rao 2014-10-23 16:12:54 -07:00
Joe Stein a8297cc6ca KAFKA-1254 remove vestigial sbt patch by Joe Stein; reviewed by Jun Rao 2014-02-20 00:11:31 -05:00
Ailing Zhang e1f7bea157 kafka-1205; README in examples not update; patched by Ailing Zhang; reviewed by Jun Rao 2014-01-17 08:29:28 -08:00
Jun Rao c98bdd3e4f kafka-896; merge 0.8 (988d4d8e65) to trunk; patched by Jun Rao; reviewed by Jay Kreps 2013-07-08 15:42:24 -07:00
Swapnil Ghike 2d7403174f kafka-871; Rename ZkConfig properties; patched by Swapnil Ghike; reviewed by Jun Rao 2013-04-25 18:57:31 -07:00
Jun Rao 92f177b309 merge 0.8 to trunk and resolve conflicts 2013-01-25 22:03:39 -08:00
Joe Stein e6aa600813 KAFKA-139 cross-compile multiple Scala versions and upgrade to SBT 0.12.1 patch by Derek Chen-Becker reviewed by Joe Stein 2013-01-21 14:41:47 -05:00
Jun Rao 9249b76d1d merge from 0.8 and resolve conflicts 2013-01-11 18:25:56 -08:00
Jun Rao a40953196e Use uniform convention for naming properties keys; kafka-648; patched by Sriram Subramanian; reviewed by Jun Rao 2013-01-11 16:12:57 -08:00
Jay Kreps 32dae955d5 Merge branch '0.8' into trunk
Conflicts:
	core/src/main/scala/kafka/log/Log.scala
	core/src/test/scala/unit/kafka/admin/AdminTest.scala
	core/src/test/scala/unit/kafka/log/LogTest.scala
	core/src/test/scala/unit/kafka/server/LogOffsetTest.scala
2012-12-18 09:43:41 -08:00
Derek Chen-Becker 45cb03d456 Re-applied old patch from KAFKA-139
Had to make some additional changes based on further mainline work. Leaving
KafkaProject.scala in place as a reference for now.
2012-12-14 17:12:38 -07:00
Edward Jay Kreps 4be0b1be29 KAFKA-521 Refactor the log subsystem. Patch reviewed by Neha.
git-svn-id: https://svn.apache.org/repos/asf/kafka/trunk@1416253 13f79535-47bb-0310-9956-ffa450edef68
2012-12-02 20:50:01 +00:00
Neha Narkhede d7c71c0949 KAFKA-622 Create mbeans per client; patched by Swapnil; reviewed by Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/kafka/branches/0.8@1415021 13f79535-47bb-0310-9956-ffa450edef68
2012-11-29 01:31:18 +00:00
Edward Jay Kreps 60d0587e8f KAFKA-545 Add some log performance tests.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410088 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 22:54:45 +00:00
Edward Jay Kreps f4ccf21d5d KAFKA-544 Store the key given to the producer in the message. Expose this key in the consumer. Patch reviewed by Jun.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1410055 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 22:15:14 +00:00
Neha Narkhede 98f6407089 KAFKA-537 Expose clientId in ConsumerConfig and fix correlation id; patched by Yang Ye; reviewed by Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1398893 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 17:30:46 +00:00
Jun Rao ee855fe1aa remove ZK dependency on producer; patched by Yang Ye; reviewed by Jun Rao; KAFKA-369
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1372724 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 04:17:27 +00:00
Joe Stein 822963bb9d KAFKA-348 merge trunk to branch 1239902:1310937 patch by Joe Stein reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344526 13f79535-47bb-0310-9956-ffa450edef68
2012-05-31 01:51:23 +00:00
Jun Rao a5fb217293 new consumer request format; patched by Prashanth Menon; reviewed by Jun Rao and Jay Kreps; KAFKA-240
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1243407 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 03:58:37 +00:00
Neha Narkhede fa09aacdbd KAFKA-141 Check and make sure that the files that have been donated have been updated to reflect the new ASF copyright;patched by nehanarkhede; reviewd by jjkoshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180185 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 19:51:28 +00:00
Neha Narkhede f34dfc002d Reverting accidental commit 1180110, which is pending review for KAFKA-141
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180117 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 17:33:43 +00:00
Neha Narkhede a99becbe49 Minor patch, removing the .gitigore file
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180110 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 17:18:56 +00:00
Jun Rao 4092ceeb5a Consumer needs a pluggable decoder; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-3
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1176671 13f79535-47bb-0310-9956-ffa450edef68
2011-09-28 00:42:30 +00:00
Henry Saputra 462dfda513 KAFKA-93 | Change and add ASF source header to follow standard ASF source header (http://www.apache.org/legal/src-headers.html).
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156232 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 15:33:21 +00:00
Edward Jay Kreps 642da2f28c Initial checkin of Kafka to Apache SVN. This corresponds to 709afe4ec7 except that git specific files have been removed and code has been put into trunk/branches/site/etc. This is just a copy of master, branches and history are not being converted since we can't find a good tool for it.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1152970 13f79535-47bb-0310-9956-ffa450edef68
2011-08-01 23:41:24 +00:00