root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 2 Packages Projects Releases Wiki Activity
110 Commits 84 Branches 277 Tags 600 MiB
Commit Graph

73 Commits

Author SHA1 Message Date
Neha Narkhede 07611f3174 KAFKA:212 IllegalThreadStateException in kafka mirroring;patched by nehanarkhede; reviewed by junrao and jaykreps 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1208919 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 00:46:25 +00:00
Jun Rao 078bd591e1 make # of consumer rebalance retries configurable; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-213 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1207645 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 21:56:14 +00:00
Jun Rao cb2564c45e SyncProducer should log host and port if can't connect; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-214 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1207642 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-28 21:53:13 +00:00
Jun Rao c65e771d47 BoundedByteBufferReceive hides OutOfMemoryError; patched by Chris Burroughs; reviewed by Neha Narkhede; KAFKA-204 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205663 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 23:41:23 +00:00
Jun Rao eefd133656 revert previous commit r1205659 because of wrong commit message 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205662 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 23:40:23 +00:00
Jun Rao 285acbec41 AsyncProducerStats is not a singleton; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-207 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205659 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 23:25:14 +00:00
Jun Rao e98bf881a5 javaapi ZookeeperConsumerConnectorTest duplicates many tests in the scala version; patched by Jun Rao; reviewed by Kay Kreps; KAFKA-210 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205535 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 18:43:48 +00:00
Neha Narkhede 56b48d3fb6 KAFKA-176 Fix existing perf tools; patched by nehanarkhede; reviewed by junrao and jaykreps 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205525 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 18:19:06 +00:00
Edward Jay Kreps cb4486656e KAFKA-171 Do a single write for request sends. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205313 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 07:29:37 +00:00
Edward Jay Kreps 1280b71a35 KAFKA-193 Add a logging helper trait and use it where logging is used. Patch from Joe Stein. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1205311 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 07:21:16 +00:00
Jun Rao 09f5ce21b3 AsyncProducerStats is not a singleton; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-207 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1204768 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 00:58:39 +00:00
Jun Rao af923c3018 Avoid creating a new topic by the consumer; patched by Taylor Gautier; reviewed by Jun Rao; KAFKA-101 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1204764 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 00:35:09 +00:00
Jun Rao c51b940179 Add Snappy Compression as a Codec; patched by Joe Stein; reviewed by Neha Narkhede and Jun Rao; KAFKA-187 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1202045 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 05:02:08 +00:00
Jun Rao 0153d4bb59 change ProducerShell to use high level producer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-195 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1198849 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 18:11:10 +00:00
Neha Narkhede 4f9000c412 KAFKA-192 CompressionUtilTest does not run and fails when it does;patched by joestein;reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1198536 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-06 19:07:20 +00:00
Neha Narkhede d9a8af7782 KAFKA-161 Producer using broker list does not load balance requests across multiple partitions on a broker; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188333 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 19:41:35 +00:00
Edward Jay Kreps 41f14a3e96 KAFKA-166 Add JMX perf tool. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188288 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 18:52:12 +00:00
Edward Jay Kreps 76957e5e3a KAFKA-150 Make the error message for duplicate node ids in zk more self-explanatory. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1188255 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 17:47:20 +00:00
Jun Rao 81f8d0dd83 ZK consumer gets into infinite loop if a message is larger than fetch size; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-160 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1186570 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 23:52:58 +00:00
Jun Rao c0fc483d9f ZK consumer may lose a chunk worth of message during rebalance; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-154 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1182028 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 19:11:38 +00:00
Jun Rao 84c06d4285 Include payload size in DumpLogSegments; patched by Chris Burroughs; reviewed by Jun Rao; KAFKA-152 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1181329 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 01:10:37 +00:00
Neha Narkhede fa09aacdbd KAFKA-141 Check and make sure that the files that have been donated have been updated to reflect the new ASF copyright;patched by nehanarkhede; reviewd by jjkoshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180185 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 19:51:28 +00:00
Neha Narkhede f34dfc002d Reverting accidental commit 1180110, which is pending review for KAFKA-141 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180117 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 17:33:43 +00:00
Neha Narkhede a99becbe49 Minor patch, removing the .gitigore file 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180110 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 17:18:56 +00:00
Neha Narkhede 4de899c24d KAFKA-89 consumer should initialize to a valid offset;patched by junrao; reviewed by jjkoshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1179796 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 19:57:38 +00:00
Neha Narkhede 101af58f6c KAFKA-141; Added the ASF header to the kafka source and test files where it was missing, deleted the CONTRIBUTORS file to match the convention of other Apache projects; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1179788 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 19:45:38 +00:00
Jun Rao 0a9aea7160 add optional mx4j support; patched by Chris Burroughs; reviewed by Jun Rao; KAFKA-78 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1179501 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 05:10:09 +00:00
Jun Rao 881eaf14e5 trivial change to print out last offset in DumpLogSegments 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1179500 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 05:04:40 +00:00
Neha Narkhede 4f28442864 KAFKA-145 Kafka server mirror shutdown bug; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1179466 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 22:48:10 +00:00
Neha Narkhede bac6d9c3fa KAFKA-146 testUnreachableServer sporadically fails; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1179043 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 02:49:56 +00:00
Neha Narkhede dd62e77f90 KAFKA-129 ZK-based producer can throw an unexpceted exception when sending a message; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1178997 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 22:43:00 +00:00
Chris Burroughs a7b4731947 obsessive compulsive tag team: Replace tabs with spaces 
patch by jkreps; reviewed by cburroughs for KAFKA-114

git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1178670 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 01:41:25 +00:00
Edward Jay Kreps 59a5c3215a KAFKA-130 Add a "console producer" that sends messages from standard input 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1178659 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:54:14 +00:00
Edward Jay Kreps 031a559e89 KAFKA-125 On Linux, the test can throw SocketException instead of EOFException, that is cool too. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1178553 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 20:11:36 +00:00
Jun Rao 596c8d1af7 JMX bean that reports #message/sec in consumer; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-136 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1178298 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 04:57:06 +00:00
Jun Rao efc7a8a0cd Expose total metrics through MBeansp; patched by Pierre-Yves Ritschard; reviewed by Jun Rao; KAFKA-140 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1177798 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 19:36:07 +00:00
Jun Rao da35513245 trival fix to make hash code positive; patched by Joel Koshy; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1177516 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 05:44:13 +00:00
Jun Rao 1b0feb6345 Bug in the queue timeout logic of the async producer; patched by Neha Narkhede; reviewed by Jun Rao; KAFKA-138 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1176672 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 00:51:51 +00:00
Jun Rao 4092ceeb5a Consumer needs a pluggable decoder; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-3 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1176671 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-28 00:42:30 +00:00
Jun Rao 5fbac30f86 Log flush should complete upon broker shutdown; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-126 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1175966 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-26 17:34:48 +00:00
Edward Jay Kreps 8efb536aff KAFKA-132 Patch from Scott Andreas to avoid flush when there is nothing to flush. Looks like due to atime attribute in the filesystem this can lead to flushing file metadata. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1171889 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-17 03:31:15 +00:00
Edward Jay Kreps 54f49314af KAFKA-70 Patch from Prashanth Menon to add space-based retention setting. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1171886 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-17 03:21:06 +00:00
Jun Rao 6af334d69a Tool to watch consumer offsets and lag; patched by Joel Joshy; reviewed by Jun Rao; KAFKA-127 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1167405 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 23:49:45 +00:00
Jun Rao c8e507aba4 fix string formatting; write data to stdout in ConsumerShell 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1164353 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 05:19:15 +00:00
Jun Rao ec21a5e841 DumpLogSegments outputs wrong offsets; kafka-128 patched by junrao; reviewed by Joel 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163929 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 07:49:31 +00:00
Edward Jay Kreps c247dfa884 KAFKA-124 Console consumer does not stop consuming if the program reading from standard out dies. Check for errors on the output stream and exit if no one is listening. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163911 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 05:47:21 +00:00
Chris Burroughs 92b1dd9252 Enable logging for tests, at a reasonable verbosity 
patch by cburroughs; reviewed by junrao for KAFKA-113

git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1163693 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 16:53:38 +00:00
Jun Rao d72b388236 more info in DumpLogSegments; KAFKA-122 ; patched by Jun; reviewed by Neha 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1161664 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 17:47:03 +00:00
Neha Narkhede b5ea7c9055 A new file part of KAFKA-116 was accidentally not checked in. This commit fixes it; patched by nehanarkhede; reviewed by chrisburroughs 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1161276 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 21:10:03 +00:00
Neha Narkhede 72544aa51e Code clean up in FetcherRunnable and ZookeeperConsumerConnector; KAFKA-120; patched by junrao; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1160953 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-24 01:33:59 +00:00