root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 2 Packages Projects Releases Wiki Activity
16,083 Commits 84 Branches 277 Tags 600 MiB
Commit Graph

16083 Commits

Author SHA1 Message Date
Neha Narkhede 79a3b31f26 KAFKA-320 testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException; patched by nehanarkhede; reviewed by junrao and prashanth menon 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1310661 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 02:12:26 +00:00
Jun Rao c0e190cdef Separate out Kafka mirroring into a stand-alone app; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede; KAFKA-249 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310645 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 00:04:51 +00:00
Jun Rao d9441f0066 enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-315 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310595 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 21:18:56 +00:00
Jun Rao f8346239d4 CallbackHandler.afterDequeuingExistingData is not called during event queue timeout; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-326 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310482 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 16:59:44 +00:00
Jun Rao a260bfacae SyncProducer does not correctly timeout; patched by Prashanth Menon; reviewed by Jun Rao, Neha Narkhede; KAFKA-305 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1305454 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 17:12:30 +00:00
Neha Narkhede fedb9d6c19 KAFKA-307 Refactor server code to reduce interdependencies; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1304473 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 16:46:03 +00:00
Neha Narkhede ba8fd9f1ee KAFKA-309 Bug in FileMessageSet's append API can corrupt on disk log; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303890 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 16:59:11 +00:00
Neha Narkhede 2bcc911343 KAFKA-310 Incomplete message set validation checks in Log's append API can corrupt on disk log segment; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303861 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 16:03:49 +00:00
Neha Narkhede 854fb29c26 KAFKA-300 Leader election; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1303473 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 17:29:32 +00:00
Jun Rao e180e68f94 Dead code in the Log4j appender; patched by Jose Quinteiro; reviewed by Jun Rao; KAFKA-303 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303239 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 00:38:14 +00:00
Jun Rao 7b39d7eed1 kafka-console-producer does not take in customized values of --batch-size or --timeout; patched by Jun Rao; reviewed by Edward Smith; KAFKA-279 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303232 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-21 00:25:09 +00:00
Jun Rao 5e0e0b17fb reverting previous commit for KAFKA-296 because patch didn't apply cleanly 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300801 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 00:39:42 +00:00
Jun Rao 66d8073156 Update Go Client to new version of Go; patched by AaronR; KAFKA-296 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300777 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 22:58:57 +00:00
Jun Rao 4dd7f95569 Add acknowledgement to the produce request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-49 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1300435 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 01:35:46 +00:00
Jun Rao 74af0deef1 LogManager test fails on linux; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-220 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298426 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-08 15:18:30 +00:00
Jun Rao 624a361e01 trivial fix to include violated payload size in MessageSizeTooLargeException; patched by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298030 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-07 17:51:21 +00:00
Joe Stein 88660999a8 KAFKA-240 missing producer response 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1297593 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 17:45:17 +00:00
Jun Rao 0443e2dd73 broker deletes all file segments when cleaning up an empty log segment; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-292 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1297324 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-06 02:21:54 +00:00
Joe Stein f8042d5b39 KAFKA-240 ProducerRequest wire format protocol update and related changes 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1296577 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-03 05:46:43 +00:00
Neha Narkhede 9fd2d4ffdb KAFKA-239 Refactoring code to wire new ZK data structures and making partitions logical; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1295861 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 21:15:26 +00:00
Joe Stein ccc464c19a Niek Sanders - KAFKA-284 fixed compilation issue for cpp client 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1295388 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 02:47:03 +00:00
Jun Rao 6c34cf2dcc use propertyExists to test if both broker.list and zk.connect are present; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-290 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294959 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 03:22:14 +00:00
Jun Rao d8286aad10 Increase maximum value of log.retention.size; patched by Elben Shira; reviewed by Jun Rao; KAFKA-285 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294441 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 01:50:38 +00:00
Jun Rao caf310c228 consumer sometimes don't release partition ownership properly in ZK during rebalance; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-286 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294302 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-27 19:46:36 +00:00
Jun Rao 7e91c16743 add jmx beans in broker to track # of failed requests; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-283 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293720 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 23:08:02 +00:00
Jun Rao 333966f50e Add a shallow iterator to the ByteBufferMessageSet; patched by Yang Ye; reviewed by Jun Rao; KAFKA-277 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293010 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 22:57:40 +00:00
Jun Rao 22d80462b1 A tool to UPDATE Zookeeper partition-offset with input from a file; patched by John Fung; reviewed by Jun Rao; KAFKA-255 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291536 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 00:26:42 +00:00
Jun Rao 7066d1c38b A tool to GET Zookeeper partition-offset and output to files; patched by John Fung; reviewed by Jun Rao; KAFKA-254 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291535 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 00:25:55 +00:00
Jun Rao 95ee38728c make time-based reconnect starting at a random time; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291490 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 22:24:52 +00:00
Jun Rao a23d396a5a trivial fix for kafka-producer-perf-test.sh 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245779 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:54:29 +00:00
Joe Stein ff562472dd test access, fixed space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245316 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 04:14:47 +00:00
Neha Narkhede c28b3a61cc KAFKA-274 Handle corrupted messages cleanly; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245299 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 02:33:07 +00:00
Jun Rao 6e1b2ebe32 shutdown watch executor thread properly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245295 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 02:14:25 +00:00
Jun Rao 2ead8a49ea trivial fix to add trace logging in FetcherRunnable 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244792 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 23:51:27 +00:00
Jun Rao 3e79116e7a fix condition to use await instead of wait; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244765 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:22:11 +00:00
Jun Rao 5c4ce61699 add JMX on broker to track bytes/messages per topic; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-272 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244755 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:04:00 +00:00
Jun Rao 6e36047fae disable dup topic in consumer request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-240 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1244650 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:08:08 +00:00
Jun Rao 0bd3b9c3f6 time-based reconnect in producer; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243786 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 06:19:34 +00:00
Jun Rao 732c27ff3e Add a queue of zookeeper notifications in the zookeeper consumer to reduce the number of rebalancing attempts; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243721 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 22:31:02 +00:00
Jun Rao a5fb217293 new consumer request format; patched by Prashanth Menon; reviewed by Jun Rao and Jay Kreps; KAFKA-240 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1243407 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 03:58:37 +00:00
Jun Rao 6a3c2f2032 trivial change to reduce default fetcher queue size 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242696 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 06:52:37 +00:00
Neha Narkhede a888a9d09e KAFKA-262 Bug in the consumer rebalancing logic causes one consumer to release partitions that it does not own; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242552 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:04:32 +00:00
Jun Rao 21da30456f refactor the async producer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-253 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1241754 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 02:59:54 +00:00
Neha Narkhede 345bc7bad5 KAFKA-263 Enhance single host broker failure test to have 2 topics with uneven distribution on the source brokers; patched by John Fung; reviewed by Neha Narkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241528 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 17:38:15 +00:00
Neha Narkhede 2552a2488f KAFKA-257 Hadoop producer should use software load balancer; patched by Sam Shah; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241249 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 23:10:54 +00:00
Neha Narkhede e3b529df80 Merging commits 1230840:1239902 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1239937 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 23:40:39 +00:00
Neha Narkhede afd4b0d772 KAFKA 256 Bug in the consumer rebalancing logic leads to the consumer not pulling data from some partitions; patched by nehanarkhede; reviewed by joelkoshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239766 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:07:48 +00:00
Jun Rao fcc82dce6a Corrupted request shuts down the broker; patched by Jun Rao; reviewed by Jay Kreps and Neha Narkhede; KAFKA-261 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239740 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 17:33:46 +00:00
Neha Narkhede af0ceff79b KAFKA-238 getTopicMetadata API; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1235492 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 20:54:11 +00:00
Jun Rao fe2f055713 ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-241 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1233501 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 17:53:32 +00:00