Commit Graph

16405 Commits

Author SHA1 Message Date
Jun Rao 95ee38728c make time-based reconnect starting at a random time; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291490 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 22:24:52 +00:00
Jun Rao a23d396a5a trivial fix for kafka-producer-perf-test.sh
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245779 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:54:29 +00:00
Joe Stein ff562472dd test access, fixed space
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245316 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 04:14:47 +00:00
Neha Narkhede c28b3a61cc KAFKA-274 Handle corrupted messages cleanly; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245299 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:33:07 +00:00
Jun Rao 6e1b2ebe32 shutdown watch executor thread properly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245295 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:14:25 +00:00
Jun Rao 2ead8a49ea trivial fix to add trace logging in FetcherRunnable
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244792 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 23:51:27 +00:00
Jun Rao 3e79116e7a fix condition to use await instead of wait; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244765 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:22:11 +00:00
Jun Rao 5c4ce61699 add JMX on broker to track bytes/messages per topic; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-272
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244755 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:04:00 +00:00
Jun Rao 6e36047fae disable dup topic in consumer request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-240
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1244650 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:08:08 +00:00
Jun Rao 0bd3b9c3f6 time-based reconnect in producer; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243786 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 06:19:34 +00:00
Jun Rao 732c27ff3e Add a queue of zookeeper notifications in the zookeeper consumer to reduce the number of rebalancing attempts; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243721 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 22:31:02 +00:00
Jun Rao a5fb217293 new consumer request format; patched by Prashanth Menon; reviewed by Jun Rao and Jay Kreps; KAFKA-240
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1243407 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 03:58:37 +00:00
Jun Rao 6a3c2f2032 trivial change to reduce default fetcher queue size
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242696 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 06:52:37 +00:00
Neha Narkhede a888a9d09e KAFKA-262 Bug in the consumer rebalancing logic causes one consumer to release partitions that it does not own; patched by Neha Narkhede; reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242552 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:04:32 +00:00
Jun Rao 21da30456f refactor the async producer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-253
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1241754 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 02:59:54 +00:00
Neha Narkhede 345bc7bad5 KAFKA-263 Enhance single host broker failure test to have 2 topics with uneven distribution on the source brokers; patched by John Fung; reviewed by Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241528 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 17:38:15 +00:00
Neha Narkhede 2552a2488f KAFKA-257 Hadoop producer should use software load balancer; patched by Sam Shah; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241249 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 23:10:54 +00:00
Neha Narkhede e3b529df80 Merging commits 1230840:1239902 from trunk
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1239937 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 23:40:39 +00:00
Neha Narkhede afd4b0d772 KAFKA 256 Bug in the consumer rebalancing logic leads to the consumer not pulling data from some partitions; patched by nehanarkhede; reviewed by joelkoshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239766 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 19:07:48 +00:00
Jun Rao fcc82dce6a Corrupted request shuts down the broker; patched by Jun Rao; reviewed by Jay Kreps and Neha Narkhede; KAFKA-261
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239740 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 17:33:46 +00:00
Neha Narkhede af0ceff79b KAFKA-238 getTopicMetadata API; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1235492 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 20:54:11 +00:00
Jun Rao fe2f055713 ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-241
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1233501 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 17:53:32 +00:00
Jun Rao d3c58b6428 max.message.size and fetch.size defaults should be consistent; patched by Pierre-Yves Ritschard; reviewed by Jun Rao; KAFKA-247
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1232500 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:30:38 +00:00
Jun Rao e913a06533 trivial fix to make create topic script executable
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1231403 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 23:52:21 +00:00
Jun Rao ff668f4fc9 create/delete ZK path for a topic in an admin tool; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-237
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1231400 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 23:48:27 +00:00
Neha Narkhede cd91e6770b Checking in some files left from the last checkin for KAFKA-202
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1231298 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 21:15:29 +00:00
Neha Narkhede 1021ea9002 KAFKA 244 Improve log4j appender to use kafka.producer.Producer; patched by vtkstef; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1231276 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 19:53:32 +00:00
Neha Narkhede 60d88a3ac9 KAFKA-202 Make request processing in kafka asynchronous; patched by jaykreps; reviewed by junrao and nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1230845 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 00:03:02 +00:00
Neha Narkhede 5706727937 Creating branch for kafka-0.8.0-incubating that will include all replication related changes
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1230840 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 23:54:57 +00:00
Neha Narkhede 6c43b4634e Minor fix in the broker failure test for clean shutdown of servers
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1230759 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 20:26:25 +00:00
Jun Rao 7bd3e169f1 trivial fix to make output of ConsumerOffsetChecker sorted
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229876 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 02:53:04 +00:00
Neha Narkhede a3c742ef23 KAFKA-245 Pull zkclient jar from Maven; patched by pyritschard; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229794 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 23:17:45 +00:00
Neha Narkhede 7821f5b20f KAFKA 218 Upgrade to zookeeper 3.3.4; patched by pyritschard; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229784 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 22:53:04 +00:00
Neha Narkhede b0484eccf3 KAFKA-228 Reduce duplicate messages served by the kafka consumer for uncompressed topics; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1228504 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 00:01:25 +00:00
Jun Rao 66be5eedf3 Support configurable send / receive socket buffer size in server; patched by John Fung; reviewed by Jun Rao; KAFKA-200
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1228480 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 22:50:29 +00:00
Neha Narkhede 336410a777 KAFKA-227 Broker failure system test; patched by johnfung; reviewed by nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1227916 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 00:43:46 +00:00
Jun Rao aac7668195 Make backoff time during consumer rebalance configurable; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-234
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1227417 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 01:12:43 +00:00
Jun Rao a7d4c2cf23 avoid logging stacktrace directly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-231
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1226599 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 01:55:23 +00:00
Edward Jay Kreps 5eb4badfc9 KAFKA-229 Patch from Joe Stein. Log full exception stack trace instead of just message.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1226549 13f79535-47bb-0310-9956-ffa450edef68
2012-01-02 20:51:36 +00:00
Jun Rao e5a4ec1806 SyncProducer connect may return failed connection on reconnect; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-226
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1215027 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 02:21:02 +00:00
Neha Narkhede 77da5f54d7 KAFKA-221 LICENSE and NOTICE problems in Kafka 0.7; patched by jakobhoman; reviewed by junrao and nehanarkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1214904 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 18:30:05 +00:00
Jun Rao 31f6f02aa2 Bug in mirroring code causes mirroring to halt; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-225
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1213990 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:55:52 +00:00
Jun Rao bbba103d76 Embedded consumer doesn't shut down if the server can't start; patched by Jun Rao; reviewed by Neha Narkhede and Jay Kreps; KAFKA-197
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1213546 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 03:03:38 +00:00
Jun Rao 9a3e2104b5 trivial change to catch all throwables in ProducerSendThread
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1211747 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:38:46 +00:00
Neha Narkhede f53eb16f87 KAFKA 222 Mavenize contrib;patched by nehanarkhede; reviewed jakobhoman and junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1211616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 20:14:15 +00:00
Neha Narkhede c36cba4f6c Minor fix to add description of usage of MIT license in the LICENSE file
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208924 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 01:03:35 +00:00
Neha Narkhede 07611f3174 KAFKA:212 IllegalThreadStateException in kafka mirroring;patched by nehanarkhede; reviewed by junrao and jaykreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208919 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 00:46:25 +00:00
Jakob Glen Homan 8aecab2253 KAFKA-216: Add nunit license to the NOTICE file.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208878 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 23:30:28 +00:00
Jun Rao 078bd591e1 make # of consumer rebalance retries configurable; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-213
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1207645 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 21:56:14 +00:00
Jun Rao cb2564c45e SyncProducer should log host and port if can't connect; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-214
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1207642 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 21:53:13 +00:00