root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 2 Packages Projects Releases Wiki Activity
16,414 Commits 84 Branches 277 Tags 600 MiB
Commit Graph

16414 Commits

Author SHA1 Message Date
Neha Narkhede 9fd2d4ffdb KAFKA-239 Refactoring code to wire new ZK data structures and making partitions logical; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1295861 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 21:15:26 +00:00
Joe Stein ccc464c19a Niek Sanders - KAFKA-284 fixed compilation issue for cpp client 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1295388 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 02:47:03 +00:00
Jun Rao 6c34cf2dcc use propertyExists to test if both broker.list and zk.connect are present; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-290 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294959 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-29 03:22:14 +00:00
Jun Rao d8286aad10 Increase maximum value of log.retention.size; patched by Elben Shira; reviewed by Jun Rao; KAFKA-285 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294441 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-28 01:50:38 +00:00
Jun Rao caf310c228 consumer sometimes don't release partition ownership properly in ZK during rebalance; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-286 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294302 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-27 19:46:36 +00:00
Jun Rao 7e91c16743 add jmx beans in broker to track # of failed requests; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-283 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293720 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-25 23:08:02 +00:00
Jun Rao 333966f50e Add a shallow iterator to the ByteBufferMessageSet; patched by Yang Ye; reviewed by Jun Rao; KAFKA-277 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293010 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-23 22:57:40 +00:00
Jun Rao 22d80462b1 A tool to UPDATE Zookeeper partition-offset with input from a file; patched by John Fung; reviewed by Jun Rao; KAFKA-255 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291536 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 00:26:42 +00:00
Jun Rao 7066d1c38b A tool to GET Zookeeper partition-offset and output to files; patched by John Fung; reviewed by Jun Rao; KAFKA-254 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291535 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-21 00:25:55 +00:00
Jun Rao 95ee38728c make time-based reconnect starting at a random time; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291490 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-20 22:24:52 +00:00
Jun Rao a23d396a5a trivial fix for kafka-producer-perf-test.sh 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245779 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 21:54:29 +00:00
Joe Stein ff562472dd test access, fixed space 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245316 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 04:14:47 +00:00
Neha Narkhede c28b3a61cc KAFKA-274 Handle corrupted messages cleanly; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245299 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 02:33:07 +00:00
Jun Rao 6e1b2ebe32 shutdown watch executor thread properly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245295 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-17 02:14:25 +00:00
Jun Rao 2ead8a49ea trivial fix to add trace logging in FetcherRunnable 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244792 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 23:51:27 +00:00
Jun Rao 3e79116e7a fix condition to use await instead of wait; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244765 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:22:11 +00:00
Jun Rao 5c4ce61699 add JMX on broker to track bytes/messages per topic; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-272 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244755 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 22:04:00 +00:00
Jun Rao 6e36047fae disable dup topic in consumer request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-240 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1244650 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-15 19:08:08 +00:00
Jun Rao 0bd3b9c3f6 time-based reconnect in producer; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243786 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-14 06:19:34 +00:00
Jun Rao 732c27ff3e Add a queue of zookeeper notifications in the zookeeper consumer to reduce the number of rebalancing attempts; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1243721 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 22:31:02 +00:00
Jun Rao a5fb217293 new consumer request format; patched by Prashanth Menon; reviewed by Jun Rao and Jay Kreps; KAFKA-240 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1243407 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-13 03:58:37 +00:00
Jun Rao 6a3c2f2032 trivial change to reduce default fetcher queue size 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242696 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-10 06:52:37 +00:00
Neha Narkhede a888a9d09e KAFKA-262 Bug in the consumer rebalancing logic causes one consumer to release partitions that it does not own; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1242552 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-09 22:04:32 +00:00
Jun Rao 21da30456f refactor the async producer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-253 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1241754 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-08 02:59:54 +00:00
Neha Narkhede 345bc7bad5 KAFKA-263 Enhance single host broker failure test to have 2 topics with uneven distribution on the source brokers; patched by John Fung; reviewed by Neha Narkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241528 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-07 17:38:15 +00:00
Neha Narkhede 2552a2488f KAFKA-257 Hadoop producer should use software load balancer; patched by Sam Shah; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1241249 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-06 23:10:54 +00:00
Neha Narkhede e3b529df80 Merging commits 1230840:1239902 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1239937 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 23:40:39 +00:00
Neha Narkhede afd4b0d772 KAFKA 256 Bug in the consumer rebalancing logic leads to the consumer not pulling data from some partitions; patched by nehanarkhede; reviewed by joelkoshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239766 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 19:07:48 +00:00
Jun Rao fcc82dce6a Corrupted request shuts down the broker; patched by Jun Rao; reviewed by Jay Kreps and Neha Narkhede; KAFKA-261 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1239740 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 17:33:46 +00:00
Neha Narkhede af0ceff79b KAFKA-238 getTopicMetadata API; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1235492 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 20:54:11 +00:00
Jun Rao fe2f055713 ConsumerIterator throws a IllegalStateException after a ConsumerTimeout occurs; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-241 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1233501 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-19 17:53:32 +00:00
Jun Rao d3c58b6428 max.message.size and fetch.size defaults should be consistent; patched by Pierre-Yves Ritschard; reviewed by Jun Rao; KAFKA-247 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1232500 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 17:30:38 +00:00
Jun Rao e913a06533 trivial fix to make create topic script executable 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1231403 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 23:52:21 +00:00
Jun Rao ff668f4fc9 create/delete ZK path for a topic in an admin tool; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-237 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1231400 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 23:48:27 +00:00
Neha Narkhede cd91e6770b Checking in some files left from the last checkin for KAFKA-202 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1231298 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 21:15:29 +00:00
Neha Narkhede 1021ea9002 KAFKA 244 Improve log4j appender to use kafka.producer.Producer; patched by vtkstef; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1231276 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 19:53:32 +00:00
Neha Narkhede 60d88a3ac9 KAFKA-202 Make request processing in kafka asynchronous; patched by jaykreps; reviewed by junrao and nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1230845 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 00:03:02 +00:00
Neha Narkhede 5706727937 Creating branch for kafka-0.8.0-incubating that will include all replication related changes 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1230840 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 23:54:57 +00:00
Neha Narkhede 6c43b4634e Minor fix in the broker failure test for clean shutdown of servers 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1230759 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 20:26:25 +00:00
Jun Rao 7bd3e169f1 trivial fix to make output of ConsumerOffsetChecker sorted 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229876 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-11 02:53:04 +00:00
Neha Narkhede a3c742ef23 KAFKA-245 Pull zkclient jar from Maven; patched by pyritschard; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229794 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 23:17:45 +00:00
Neha Narkhede 7821f5b20f KAFKA 218 Upgrade to zookeeper 3.3.4; patched by pyritschard; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1229784 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 22:53:04 +00:00
Neha Narkhede b0484eccf3 KAFKA-228 Reduce duplicate messages served by the kafka consumer for uncompressed topics; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1228504 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 00:01:25 +00:00
Jun Rao 66be5eedf3 Support configurable send / receive socket buffer size in server; patched by John Fung; reviewed by Jun Rao; KAFKA-200 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1228480 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 22:50:29 +00:00
Neha Narkhede 336410a777 KAFKA-227 Broker failure system test; patched by johnfung; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1227916 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-06 00:43:46 +00:00
Jun Rao aac7668195 Make backoff time during consumer rebalance configurable; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-234 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1227417 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-05 01:12:43 +00:00
Jun Rao a7d4c2cf23 avoid logging stacktrace directly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-231 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1226599 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-03 01:55:23 +00:00
Edward Jay Kreps 5eb4badfc9 KAFKA-229 Patch from Joe Stein. Log full exception stack trace instead of just message. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1226549 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-02 20:51:36 +00:00
Jun Rao e5a4ec1806 SyncProducer connect may return failed connection on reconnect; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-226 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1215027 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 02:21:02 +00:00
Neha Narkhede 77da5f54d7 KAFKA-221 LICENSE and NOTICE problems in Kafka 0.7; patched by jakobhoman; reviewed by junrao and nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1214904 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 18:30:05 +00:00