root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 2 Packages Projects Releases Wiki Activity
16,148 Commits 84 Branches 277 Tags 600 MiB
Commit Graph

16148 Commits

Author SHA1 Message Date
Jun Rao 596c8d1af7 JMX bean that reports #message/sec in consumer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-136 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1178298 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 04:57:06 +00:00
Jun Rao efc7a8a0cd Expose total metrics through MBeansp; patched by Pierre-Yves Ritschard; reviewed by Jun Rao; KAFKA-140 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1177798 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 19:36:07 +00:00
Jun Rao da35513245 trival fix to make hash code positive; patched by Joel Koshy; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1177516 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 05:44:13 +00:00
Jun Rao 1b0feb6345 Bug in the queue timeout logic of the async producer; patched by Neha Narkhede; reviewed by Jun Rao; KAFKA-138 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1176672 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 00:51:51 +00:00
Jun Rao 4092ceeb5a Consumer needs a pluggable decoder; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-3 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1176671 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 00:42:30 +00:00
Jun Rao 61433bf0a2 ruby kafka gem is not functional; patched by Pierre-Yves Ritschard; KAFKA-135 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1175972 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-26 17:41:02 +00:00
Jun Rao 5fbac30f86 Log flush should complete upon broker shutdown; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-126 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1175966 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-26 17:34:48 +00:00
Jun Rao d772600c7b Fix ASF license headers for C# client; patched by Eric Hauser; #KAFKA-137 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1174493 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-23 01:44:40 +00:00
Jun Rao dc66fd9a4b enhancements to .Net; patched by Eric Hauser; KAFKA-85 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1173797 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 19:17:19 +00:00
Edward Jay Kreps 8efb536aff KAFKA-132 Patch from Scott Andreas to avoid flush when there is nothing to flush. Looks like due to atime attribute in the filesystem this can lead to flushing file metadata. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1171889 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-17 03:31:15 +00:00
Edward Jay Kreps 54f49314af KAFKA-70 Patch from Prashanth Menon to add space-based retention setting. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1171886 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-17 03:21:06 +00:00
Jun Rao 6af334d69a Tool to watch consumer offsets and lag; patched by Joel Joshy; reviewed by Jun Rao; KAFKA-127 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1167405 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 23:49:45 +00:00
Jun Rao d42450715c Hadoop Consumer goes into an infinite loop; patched by Sam William; reviewed by Richard Park; KAFKA-131 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1166424 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 21:47:26 +00:00
Jun Rao c8e507aba4 fix string formatting; write data to stdout in ConsumerShell 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1164353 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 05:19:15 +00:00
Jun Rao ec21a5e841 DumpLogSegments outputs wrong offsets; kafka-128 patched by junrao; reviewed by Joel 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163929 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 07:49:31 +00:00
Edward Jay Kreps c247dfa884 KAFKA-124 Console consumer does not stop consuming if the program reading from standard out dies. Check for errors on the output stream and exit if no one is listening. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163911 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 05:47:21 +00:00
Chris Burroughs 92b1dd9252 Enable logging for tests, at a reasonable verbosity 
patch by cburroughs; reviewed by junrao for KAFKA-113

git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163693 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 16:53:38 +00:00
Jun Rao d72b388236 more info in DumpLogSegments; KAFKA-122 ; patched by Jun; reviewed by Neha 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1161664 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 17:47:03 +00:00
Neha Narkhede b5ea7c9055 A new file part of KAFKA-116 was accidentally not checked in. This commit fixes it; patched by nehanarkhede; reviewed by chrisburroughs 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1161276 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 21:10:03 +00:00
Neha Narkhede 72544aa51e Code clean up in FetcherRunnable and ZookeeperConsumerConnector; KAFKA-120; patched by junrao; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160953 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 01:33:59 +00:00
Neha Narkhede bf30ae996f The FetcherRunnable busy waits on empty fetch requests; KAFKA-117; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160952 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 01:27:42 +00:00
Neha Narkhede 4cdc982e22 Producer performance tool should use the new blocking async producer instead of the sleep timeout hack; KAFKA-118; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160947 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 00:50:28 +00:00
Neha Narkhede c79c4f6f94 AsyncProducer shutdown logic causes data loss; KAFKA-116; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160946 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 00:44:22 +00:00
Chris Burroughs e311cbb6bb Explicitly list ZooKeeper as a dependency instead of including jar in-tree 
patch by cburroughs; reviewed by nehanarkhede and hsaputra for KAFKA-90


git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160905 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-23 22:22:13 +00:00
Neha Narkhede 2e05fbfa22 Improve the command line tools in the bin directory to use the compression feature correctly; KAFKA-112; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160529 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-23 02:36:24 +00:00
Neha Narkhede a484c1bcd1 Kafka server access log does not log request details coming from a MultiProduceRequest; KAFKA-115; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160527 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-23 02:31:56 +00:00
Edward Jay Kreps 4a688c5d6c KAFKA-99 Enforce a max request size in socket server to avoid running out of memory with very large requests. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159837 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-20 04:08:06 +00:00
Neha Narkhede 4f56e44100 ByteBufferMessageSet iterator bug returning incorrect offsets after reading a compressed empty message set KAFKA-111; patched by Jun; reviewed by Neha 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159466 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 01:09:26 +00:00
Neha Narkhede 76ccf2211d Bug in the collate logic of the DefaultEventHandler dispatches empty list of messages using the producer KAFKA-110; patched by Neha; reviewed by Jun 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159465 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 01:00:07 +00:00
Neha Narkhede 28984e6c18 Some new unit tests for ByteBufferMessageSet iterator KAFKA-108; patched by Jun; reviewed by Neha 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159461 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 00:51:20 +00:00
Neha Narkhede 900496eeda CompressionUtils introduces a GZIP header while compressing empty message sets KAFKA-109; patched by Neha; reviewed by Jun 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159459 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 00:47:34 +00:00
Neha Narkhede 8a07bdb71e Bug in serialize and collate logic in the DefaultEventHandler KAFKA-107; patched by Neha; reviewed by Jun 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1159452 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-19 00:29:09 +00:00
Jun Rao 82b42163a5 change whitelist config for mirroring; patched by Joel; KAFKA-103 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1158969 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 23:34:08 +00:00
Jun Rao 4cf1f16746 fix log4j to avoid duplicating log entries in kafka 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1158447 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-16 21:07:54 +00:00
Edward Jay Kreps 6d1b6f2827 KAFKA-98 Fix hardcoded ports in unit tests so you can run them while running kafka. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1157922 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 17:34:24 +00:00
Edward Jay Kreps 7976993f9e KAFKA-102 Patch from Blake Matheny. Clean up logging. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1157920 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 17:31:35 +00:00
Jun Rao d7e0b11d87 fix kafka-server-start.sh to take an optional producer property 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1157560 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-14 16:42:35 +00:00
Jun Rao 944da579ba KafkaServer can throw a NullPointerException during startup if zookeeper is down; KAFKA-94 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156940 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 02:09:56 +00:00
Jun Rao 49f3b40179 auto-discovery of topics for mirroring; patched by Joel; reviewed by Jun; KAFKA-74 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156393 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 22:32:23 +00:00
Henry Saputra d0c980dab2 KAFKA-93 | add license to missed files and remove LinkedIn copyright line per ASF guideline. Thanks to Joel Koshy for pointing it out 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156299 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 18:32:09 +00:00
Henry Saputra 462dfda513 KAFKA-93 | Change and add ASF source header to follow standard ASF source header (http://www.apache.org/legal/src-headers.html). 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156232 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 15:33:21 +00:00
Chris Burroughs e96cf1facf Update readme links. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156166 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 13:14:28 +00:00
Jun Rao ed34f0cb35 change default zk connection limit to infinite; KAFKA-88 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1155041 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 18:27:54 +00:00
Jun Rao f7046c247d Options in SyncProducerConfig and AsyncProducerConfig can leak, KAFKA-83 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1154804 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-07 23:56:05 +00:00
Jun Rao 96b8e03dd1 commit offset before consumer shutdown KAFKA-84; rename util.StringSerializer to ZKStringSerializer to avoid confusion with producer.StringSerializer 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1154719 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-07 16:29:55 +00:00
Jun Rao 665f1d0527 upgrade zkclient jar; #KAFKA-82 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1154064 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-05 01:36:43 +00:00
Chris Burroughs cbbfbaf331 gitignore for git-svn users. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1153592 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-03 17:34:03 +00:00
Edward Jay Kreps 642da2f28c Initial checkin of Kafka to Apache SVN. This corresponds to 709afe4ec7 except that git specific files have been removed and code has been put into trunk/branches/site/etc. This is just a copy of master, branches and history are not being converted since we can't find a good tool for it. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1152970 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 23:41:24 +00:00