root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 2 Packages Projects Releases Wiki Activity
16,414 Commits 84 Branches 277 Tags 600 MiB
Commit Graph

16414 Commits

Author SHA1 Message Date
Neha Narkhede 23d7620442 KAFKA-42 Cluster expansion feature; patched by Neha; reviewed by Jun 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396808 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:27:11 +00:00
Neha Narkhede a1698e2b70 Reverting KAFKA-42 since it accidentally contained changes to metrics package. Didn't catch it due to a stale sbt cache. It is better to redo the patch and then commit 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396726 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:57 +00:00
Neha Narkhede 6d0042b4f4 KAFKA-42 Cluster expansion feature; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396713 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:03:07 +00:00
Neha Narkhede 01a8b8d123 Reverting KAFKA-510, to be reapplied after addressing review comments and after KAFKA-42 is checked in 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:32:10 +00:00
Jun Rao cdc6ca2c7b trival fix to make run_sanity.sh executable 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396693 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:03:11 +00:00
Neha Narkhede 1b4d3c3061 KAFKA-502 Adding 30 more system tests, reviewed by Jun and Neha; patched by John Fung 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396687 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 16:56:57 +00:00
Jun Rao 3c335bfbdc trival fix to kafka-563: KafkaScheduler shutdown in ZookeeperConsumerConnector should check for config.autocommit 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396678 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 16:33:42 +00:00
Jun Rao 6ccdc40ae8 broker needs to know the replication factor per partition; patched by Yang Ye; reviewed by Jun Rao; kafka-510 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396673 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 16:25:42 +00:00
Jun Rao a975113c0e confusing reference to zk.connect in config/producer.properties; patched by yazgoo; reviewed by Jun Rao; kafka-553 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396652 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 15:46:42 +00:00
Edward Jay Kreps 5a33bfa9d4 KAFKA-543 Avoid sending duplicate topic names in TopicMetadataRequest. Reviewed by Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396465 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 04:24:27 +00:00
Joel Jacob Koshy dd21b35120 Fix wildcard consumption to work with greater than one stream; KAFKA-550; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1396425 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 00:06:28 +00:00
Joel Jacob Koshy 2f41be0916 Fix wildcard consumption to work with greater than one stream; KAFKA-550; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396425 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 00:06:28 +00:00
Joel Jacob Koshy 542ac86313 Upgrade to metrics jar to 3.x to pick up csv reporter fixes; KAFKA-542; patched by Joel Koshy; reviewed by Neha Narkhede. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396336 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 21:28:20 +00:00
Edward Jay Kreps 3a525e0bfa KAFKA-504 Catching the wrong exception in the test for snappy compression, added check for SnappyException too. Trivial fix, no review. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396178 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 18:37:51 +00:00
Jun Rao d5df29b84f support changing host/port of a broker; patched by David Arthur; reviewed by Jun Rao; kafka-474 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396116 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 17:08:42 +00:00
Edward Jay Kreps 452be9080e KAFKA-551 Remove the concept of immutable log segments--now all indexes and message sets are mutable. This allows truncating old segments. Review by Jun and Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396102 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 16:40:56 +00:00
Jun Rao 3819adc486 The ConsumerStats MBean name should include the groupid; patched by Michael Tamm; reviewed by Jun Rao; kafka-547 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1396085 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 15:56:52 +00:00
Jun Rao eed5983596 Replica.hw should be initialized to the smaller of checkedpointed HW and log end offset; patched by Yang Ye; reviewed by Jun Rao; KAFKA-539 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1395861 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 05:16:26 +00:00
Joel Jacob Koshy 7294dd3333 ConsumerOffsetChecker now works with hostnames (in addition to IP) in the brokers/ids zk path; KAFKA-549; patched by Bob Cotton; reviewed by Joel Koshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1395809 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 23:18:48 +00:00
Joel Jacob Koshy c85c01b6e4 ConsumerOffsetChecker now works with hostnames (in addition to IP) in the brokers/ids zk path; KAFKA-549; patched by Bob Cotton; reviewed by Joel Koshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1395809 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 23:18:48 +00:00
Edward Jay Kreps f64fd3dcba KAFKA-506 Move to logical offsets. Reviewed by Jun and Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1395729 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:13:24 +00:00
Joe Stein 3f1fbb1d07 KAFKA-508 split out partiondata from fetchresponse and producerrequest 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1394587 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 15:27:05 +00:00
Jun Rao c42726cdaf ProducerSendThread calls ListBuffer.size a whole bunch. That is a O(n) operation; patched by David Arthur; reviewed by Jun Rao; kafka-456 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1394164 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 17:29:33 +00:00
Jun Rao 3bb1c16691 log.append() should halt on IOException; patched by Jun Rao; reviewed by Jay Kreps; KAFKA-540 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1393906 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 03:46:44 +00:00
Joel Jacob Koshy db4e02f263 Replace numerical compression codes in config with something human readable; KAFKA-363; patched by David Arthur; reviewed by Joel Koshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1393731 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 19:50:13 +00:00
Jun Rao db78c35fc0 server should shut down on encountering invalid highwatermark file; patched by Yang Ye; reviewed by Jun Rao; kafka-509 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1392988 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 15:47:10 +00:00
Jun Rao 9623ae4de3 IndexOutOfBoundsException thrown by kafka.consumer.ConsumerFetcherThread; patched by Jun Rao; reviewed by Jay Kreps and Neha Narkhede; kafka-528 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1391854 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 18:17:39 +00:00
Joe Stein 77b511f696 KAFKA-538 missing apache license header in sbt and util.h 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1391715 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 01:11:36 +00:00
Joe Stein 80d571049f KAFKA-538 missing apache license header in sbt and util.h 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1391714 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 01:11:07 +00:00
Joel Jacob Koshy 14b42f7956 getOffset Api should return different latest offset to non-follower and follower consumers. Also, implement a batched version of the getOffset Api. patched by Joel Koshy; reviewed by Jun Rao; KAFKA-501 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1391168 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 19:20:08 +00:00
Jun Rao 3310531d87 restrict topic names (reopened); patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-495 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1390800 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 01:33:54 +00:00
Jun Rao 1cf88bc6c5 Use getMetadata Api in ZookeeperConsumerConnector; patched by Yang Ye; reviewed by Jun Rao; KAFKA-473 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1390798 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 01:19:29 +00:00
Joe Stein 85d5edfa9c KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing client libraries from repo 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1390790 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 00:25:23 +00:00
Joe Stein 2a62bdb040 KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing client libraries from repo 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1390788 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 00:24:56 +00:00
Joe Stein 9a4ef48ef1 KAFKA-534 remove client library directory 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1390786 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 00:22:12 +00:00
Joe Stein e9d07d72fa KAFKA-534 remove client library directory 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1390784 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 00:21:45 +00:00
Jun Rao b5dc73219e System Test should remove the top level data log directory; patched by John Fung; reviewed by Jun Rao; KAFKA-526 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1390052 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-25 19:02:30 +00:00
Jun Rao 081f0d2353 migration tool from 0.7 to 0.8; patched by Yang Ye; reviewed by Jun Rao; kafka-327 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1389460 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-24 16:08:44 +00:00
Jun Rao 0f06136aa8 javaapi support for getTopoicMetaData; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-500 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1387796 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-19 22:15:52 +00:00
Neha Narkhede 3889a3b34f KAFKA-499 Refactor controller; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1387270 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:21:15 +00:00
Jun Rao 13e606924f trivial fix to log topics in fetching metadata properly 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1387269 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 17:18:09 +00:00
Jun Rao d37eb7fdd8 TopicCount.constructTopicCount isn't thread-safe; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-379 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1386987 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-18 05:04:00 +00:00
Joel Jacob Koshy b688c3ba04 KAFKA-391 Refactor fetch/producer requests to use maps instead of several arrays; patched by Joel Koshy; reviewed by Jun Rao. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1386806 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 20:15:59 +00:00
Jun Rao c8f7587072 log.truncateTo needs to handle targetOffset smaller than the lowest offset in the log ; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-463 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1386641 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-17 14:52:18 +00:00
Neha Narkhede fb0f176131 KAFKA-449: Leader election test 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1384854 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 17:20:04 +00:00
Jun Rao e42c8d5f4e revisit broker config in 0.8; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-325 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1384624 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-14 01:29:07 +00:00
Jun Rao 2bc65dab67 Improve Kafka internal metrics; patched by Jun Rao; reviewed by Joel Koshy and Neha Narkhede; KAFKA-203 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1384202 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-13 04:27:13 +00:00
Jun Rao de927e2948 Handle topic names with / on Kafka server (0.8 branch); patched by Swapnil Ghike; reviewed by Jay Kreps, Joel Koshy and Jun Rao; KAFKA-495 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383739 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 02:14:37 +00:00
Jun Rao ea14ae8b7f Check max message size on server; patched by Swapnil Ghike; reviewed by Joel Koshy and Jun Rao; KAFKA-490 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383730 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-12 01:30:09 +00:00
Jun Rao 082d9d3b5a trival fix to remove a 0 byte file 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383464 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-11 16:07:35 +00:00