Commit Graph

14175 Commits

Author SHA1 Message Date
Jun Rao 7bd3e169f1 trivial fix to make output of ConsumerOffsetChecker sorted
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229876 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 02:53:04 +00:00
Neha Narkhede a3c742ef23 KAFKA-245 Pull zkclient jar from Maven; patched by pyritschard; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229794 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:17:45 +00:00
Neha Narkhede 7821f5b20f KAFKA 218 Upgrade to zookeeper 3.3.4; patched by pyritschard; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229784 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 22:53:04 +00:00
Neha Narkhede b0484eccf3 KAFKA-228 Reduce duplicate messages served by the kafka consumer for uncompressed topics; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1228504 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 00:01:25 +00:00
Jun Rao 66be5eedf3 Support configurable send / receive socket buffer size in server; patched by John Fung; reviewed by Jun Rao; KAFKA-200
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1228480 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 22:50:29 +00:00
Neha Narkhede 336410a777 KAFKA-227 Broker failure system test; patched by johnfung; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1227916 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 00:43:46 +00:00
Jun Rao aac7668195 Make backoff time during consumer rebalance configurable; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-234
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1227417 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:12:43 +00:00
Jun Rao a7d4c2cf23 avoid logging stacktrace directly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-231
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1226599 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 01:55:23 +00:00
Edward Jay Kreps 5eb4badfc9 KAFKA-229 Patch from Joe Stein. Log full exception stack trace instead of just message.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1226549 13f79535-47bb-0310-9956-ffa450edef68
2012-01-02 20:51:36 +00:00
Jun Rao e5a4ec1806 SyncProducer connect may return failed connection on reconnect; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-226
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1215027 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 02:21:02 +00:00
Neha Narkhede 77da5f54d7 KAFKA-221 LICENSE and NOTICE problems in Kafka 0.7; patched by jakobhoman; reviewed by junrao and nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1214904 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:30:05 +00:00
Jun Rao 31f6f02aa2 Bug in mirroring code causes mirroring to halt; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-225
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1213990 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:55:52 +00:00
Jun Rao bbba103d76 Embedded consumer doesn't shut down if the server can't start; patched by Jun Rao; reviewed by Neha Narkhede and Jay Kreps; KAFKA-197
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1213546 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 03:03:38 +00:00
Jun Rao 9a3e2104b5 trivial change to catch all throwables in ProducerSendThread
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1211747 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:38:46 +00:00
Neha Narkhede f53eb16f87 KAFKA 222 Mavenize contrib;patched by nehanarkhede; reviewed jakobhoman and junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1211616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 20:14:15 +00:00
Neha Narkhede c36cba4f6c Minor fix to add description of usage of MIT license in the LICENSE file
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208924 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 01:03:35 +00:00
Neha Narkhede 07611f3174 KAFKA:212 IllegalThreadStateException in kafka mirroring;patched by nehanarkhede; reviewed by junrao and jaykreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208919 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 00:46:25 +00:00
Jakob Glen Homan 8aecab2253 KAFKA-216: Add nunit license to the NOTICE file.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208878 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 23:30:28 +00:00
Jun Rao 078bd591e1 make # of consumer rebalance retries configurable; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-213
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1207645 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 21:56:14 +00:00
Jun Rao cb2564c45e SyncProducer should log host and port if can't connect; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-214
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1207642 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 21:53:13 +00:00
Jun Rao c65e771d47 BoundedByteBufferReceive hides OutOfMemoryError; patched by Chris Burroughs; reviewed by Neha Narkhede; KAFKA-204
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205663 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:41:23 +00:00
Jun Rao eefd133656 revert previous commit r1205659 because of wrong commit message
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205662 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:40:23 +00:00
Jun Rao 285acbec41 AsyncProducerStats is not a singleton; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-207
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205659 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 23:25:14 +00:00
Jun Rao e98bf881a5 javaapi ZookeeperConsumerConnectorTest duplicates many tests in the scala version; patched by Jun Rao; reviewed by Kay Kreps; KAFKA-210
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205535 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:43:48 +00:00
Neha Narkhede 56b48d3fb6 KAFKA-176 Fix existing perf tools; patched by nehanarkhede; reviewed by junrao and jaykreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205525 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:19:06 +00:00
Edward Jay Kreps cb4486656e KAFKA-171 Do a single write for request sends.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205313 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 07:29:37 +00:00
Edward Jay Kreps 1280b71a35 KAFKA-193 Add a logging helper trait and use it where logging is used. Patch from Joe Stein.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205311 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 07:21:16 +00:00
Neha Narkhede 41db543d31 KAFKA-211 Fix LICENSE file to include MIT and SCALA license; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205116 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 18:03:09 +00:00
Jun Rao 09f5ce21b3 AsyncProducerStats is not a singleton; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-207
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1204768 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 00:58:39 +00:00
Jun Rao af923c3018 Avoid creating a new topic by the consumer; patched by Taylor Gautier; reviewed by Jun Rao; KAFKA-101
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1204764 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 00:35:09 +00:00
Neha Narkhede 7d856dce92 KAFKA-206 add DISCLAIMER, cleanup NOTICE file; patched by chrisburroughs;reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1203439 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:23:44 +00:00
Jun Rao c51b940179 Add Snappy Compression as a Codec; patched by Joe Stein; reviewed by Neha Narkhede and Jun Rao; KAFKA-187
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1202045 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 05:02:08 +00:00
Jun Rao 0153d4bb59 change ProducerShell to use high level producer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-195
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1198849 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 18:11:10 +00:00
Neha Narkhede 4f9000c412 KAFKA-192 CompressionUtilTest does not run and fails when it does;patched by joestein;reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1198536 13f79535-47bb-0310-9956-ffa450edef68
2011-11-06 19:07:20 +00:00
Edward Jay Kreps 5497e8d156 Leave the default port alone (it was accidentally changed to 9093).
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1198047 13f79535-47bb-0310-9956-ffa450edef68
2011-11-05 20:25:33 +00:00
Neha Narkhede 5c3d5d815c KAFKA-177 Remove the clojure clients until correctly implemented and refactored; patched by nehanarkhede; reviewd by jefferydamick
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1195281 13f79535-47bb-0310-9956-ffa450edef68
2011-10-30 23:46:41 +00:00
Neha Narkhede 65c25ae6b9 KAFKA-91 zkclient does not show up in pom;patched by cburroughs;reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1195253 13f79535-47bb-0310-9956-ffa450edef68
2011-10-30 21:39:44 +00:00
Neha Narkhede 12572102c6 KAFKA-177 Remove the clojure clients until correctly implemented and refactored; patched by nehanarkhede; reviewd by jefferydamick
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1195249 13f79535-47bb-0310-9956-ffa450edef68
2011-10-30 21:17:13 +00:00
Neha Narkhede 14a1f0dcd6 KAFKA 158 Support for compression in go clients; patched by jeffregydamick; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1189773 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 14:24:27 +00:00
Neha Narkhede d9a8af7782 KAFKA-161 Producer using broker list does not load balance requests across multiple partitions on a broker; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188333 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 19:41:35 +00:00
Edward Jay Kreps 41f14a3e96 KAFKA-166 Add JMX perf tool.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188288 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 18:52:12 +00:00
Edward Jay Kreps 76957e5e3a KAFKA-150 Make the error message for duplicate node ids in zk more self-explanatory.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188255 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 17:47:20 +00:00
Edward Jay Kreps 46b6144a8f KAFKA-164 Fix up configuration with more docs.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188024 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 05:01:40 +00:00
Edward Jay Kreps ce070548e4 KAFKA-165 Add a cli script to use zkCli without having to download ZK.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1187983 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 22:03:49 +00:00
Jun Rao 81f8d0dd83 ZK consumer gets into infinite loop if a message is larger than fetch size; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-160
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1186570 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 23:52:58 +00:00
Edward Jay Kreps a0b2aa8847 KAFKA-162 Upgrade the python client to use the new message format.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1186535 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:14:50 +00:00
Jun Rao c2dc9c0841 Php Client support for compression attribute; patched by AaronR; KAFKA-159
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1185774 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 17:57:29 +00:00
Jun Rao e39c11abbc Add compression to C# client; patched by Eric Hauser; KAFKA-153
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1185772 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 17:52:13 +00:00
Neha Narkhede 3f0046be1b KAFKA-143 Fixing source code files to have the Apache license header ;patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1183191 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:32:41 +00:00
Neha Narkhede 4ad98872ad KAFKA-151 Standard .rat-excludes file and rat script;patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1183190 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:30:12 +00:00