root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 3 Packages Projects Releases Wiki Activity
12,596 Commits 84 Branches 278 Tags 628 MiB
Commit Graph

12596 Commits

Author SHA1 Message Date
Jun Rao 3adf92151a KafkaRequestHandler needs to handle exceptions; patched by Yang Ye; reviewed by Jun Rao; KAFKA-491 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1404857 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 02:07:03 +00:00
Jun Rao 1828b1852c system test configs are broken; patched by John Fung; reviewed by Jun Rao; kafka-586 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1404203 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 15:25:43 +00:00
Jun Rao 6d86e43f0a Update System Test due to new argument --sync in ProducerPerformance; patched by Jun Rao; reviewed by Neha Narkhede and Jun Rao; kafka-594 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1404197 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 15:21:11 +00:00
Edward Jay Kreps 414e9faf9b KAFKA-588 Fix bug in OffsetIndex.truncateTo. Reviewed by Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403859 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 20:18:45 +00:00
Jun Rao 4d7c0b7a51 Register metrics beans at kafka server startup; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-592 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403601 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 01:36:44 +00:00
Jun Rao ddabfa7da5 Partition.makeFollower() reads broker info from ZK; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-575 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403598 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 01:28:01 +00:00
Jun Rao 743ac37382 extend DumpLogSegments to verify consistency btw data and index; patched by Yang Ye; reviewed by Neha Narkhede and Jun Rao; KAFKA-577 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1403553 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 22:09:43 +00:00
Jun Rao 4f529c7444 trivial fix to use foreach instead of map 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1402731 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 01:18:27 +00:00
Joel Jacob Koshy 947ad072af Implement clean shutdown in replication; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede; KAFKA-340 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1402395 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 05:23:55 +00:00
Jun Rao 9eb9e51011 produce/fetch remote time metric not set correctly when num.acks = 1; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-584 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1402250 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:15:41 +00:00
Jun Rao 4ef9166769 trivial fix to add the missing Logging class 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401909 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 23:00:25 +00:00
Jun Rao adebb7d78a Add more test cases to System Test ; patched by John Fung; reviewed by Jun Rao; KAFKA-571 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401875 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:56:16 +00:00
Jun Rao 0d9f7ffe4d provides windows batch script for starting Kafka/Zookeeper; patched by Antoine Vianey; reviewed by Jun Rao; kafka-581 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401782 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 16:57:56 +00:00
Jun Rao 68d8f59045 remove connection timeout in SyncProducer; patched by Swapnil Ghike; reviewed by Jun Rao; kafka-579 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401775 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 16:46:32 +00:00
Jun Rao 23bce10e77 Change MessageSet.sizeInBytes to Int; patched by Swapnil Ghike; reviewed by Jun Rao; kafka-556 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401760 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 16:19:26 +00:00
Jun Rao 3deb6cd420 SimpleConsumer throws UnsupportedOperationException: empty.head; patched by Yang Ye; reviewed by Jun Rao; kafka-576 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 14:19:18 +00:00
Jun Rao 2c66f5b701 system test testcase_0122 under replication fails due to large # of data loss; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-580 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401356 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 17:25:02 +00:00
Neha Narkhede 1b7b43c6e1 KAFKA-541 Move to metrics csv reporter for system tests; patched by Yang Ye; reviewed by Neha, Jun and Joel 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1401138 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 01:26:08 +00:00
Jun Rao e35854062f System Test : Leader Failure Log Segment Checksum Mismatched When request-num-acks is 1; patched by Jun Rao; reviewed by John Fung, Joel Koshy and Neha Narkhede; KAFKA-573 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1399934 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 00:09:32 +00:00
Neha Narkhede 98f6407089 KAFKA-537 Expose clientId in ConsumerConfig and fix correlation id; patched by Yang Ye; reviewed by Neha Narkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1398893 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 17:30:46 +00:00
Edward Jay Kreps d1a22b2e3b KAFKA-569 Split up utils package and do some cleanup. Patch reviewed by Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397765 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-13 03:35:02 +00:00
Neha Narkhede 3015d0a447 KAFKA-43 Move leader to preferred replica; patched by Neha Narkhede; reviewed by Joel Koshy and Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397747 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-13 00:39:41 +00:00
Neha Narkhede 669ae397f8 KAFKA-548 remove partition from ProducerRequestPartitionData and FetchResponsePartitionData; patched by Yang Ye; reviewed by Neha and Joel 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397744 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-13 00:21:45 +00:00
Jun Rao c0fdcd305c Replication Data Loss in Mirror Maker Bouncing testcase; patched by Jun Rao; reviewed by Joel Koshy, John Fung and Neha Narkhede; kafka-567 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397717 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 20:28:14 +00:00
Jun Rao 2b13581711 trival fix to remove 2 empty files 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397623 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 15:50:10 +00:00
Neha Narkhede 3629f6f882 Changing kafka-server-stop.sh to use SIGTERM for Kafka server process termination. No review 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397434 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:48:33 +00:00
Neha Narkhede dd44ec672a KAFKA-432 allow consumer to read from followers; patched by Yang Ye; reviewed by Neha and Jun 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397422 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 02:56:28 +00:00
Edward Jay Kreps 97d434513f KAFKA-506 Hadoop consumer not advancing to next offset. No review. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397388 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 00:15:26 +00:00
Neha Narkhede eb06b93f97 KAFKA-510 Broker needs to know replication factor per partition; patched by Yang Ye; reviewed by Neha Narkhede, Jun Rao and Joel Koshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397372 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 23:30:23 +00:00
Edward Jay Kreps 4324235183 KAFKA-557 Patch to avoid assigning offsets to Log.appends as part of replication. Reviewed by Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397190 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 17:40:00 +00:00
Edward Jay Kreps aaa5d14e39 KAFKA-506 Misc. follow-up cleanups from Neha's review. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1397134 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 16:06:50 +00:00
Neha Narkhede 93fdcfa0e2 KAFKA-42 part 2: new files 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396814 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:43:44 +00:00
Neha Narkhede 23d7620442 KAFKA-42 Cluster expansion feature; patched by Neha; reviewed by Jun 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396808 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:27:11 +00:00
Neha Narkhede a1698e2b70 Reverting KAFKA-42 since it accidentally contained changes to metrics package. Didn't catch it due to a stale sbt cache. It is better to redo the patch and then commit 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396726 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:57 +00:00
Neha Narkhede 6d0042b4f4 KAFKA-42 Cluster expansion feature; patched by Neha Narkhede; reviewed by Jun Rao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396713 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:03:07 +00:00
Neha Narkhede 01a8b8d123 Reverting KAFKA-510, to be reapplied after addressing review comments and after KAFKA-42 is checked in 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:32:10 +00:00
Jun Rao cdc6ca2c7b trival fix to make run_sanity.sh executable 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396693 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:03:11 +00:00
Neha Narkhede 1b4d3c3061 KAFKA-502 Adding 30 more system tests, reviewed by Jun and Neha; patched by John Fung 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396687 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 16:56:57 +00:00
Jun Rao 3c335bfbdc trival fix to kafka-563: KafkaScheduler shutdown in ZookeeperConsumerConnector should check for config.autocommit 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396678 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 16:33:42 +00:00
Jun Rao 6ccdc40ae8 broker needs to know the replication factor per partition; patched by Yang Ye; reviewed by Jun Rao; kafka-510 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396673 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 16:25:42 +00:00
Jun Rao a975113c0e confusing reference to zk.connect in config/producer.properties; patched by yazgoo; reviewed by Jun Rao; kafka-553 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396652 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 15:46:42 +00:00
Edward Jay Kreps 5a33bfa9d4 KAFKA-543 Avoid sending duplicate topic names in TopicMetadataRequest. Reviewed by Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396465 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 04:24:27 +00:00
Joel Jacob Koshy dd21b35120 Fix wildcard consumption to work with greater than one stream; KAFKA-550; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1396425 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 00:06:28 +00:00
Joel Jacob Koshy 2f41be0916 Fix wildcard consumption to work with greater than one stream; KAFKA-550; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396425 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 00:06:28 +00:00
Joel Jacob Koshy 542ac86313 Upgrade to metrics jar to 3.x to pick up csv reporter fixes; KAFKA-542; patched by Joel Koshy; reviewed by Neha Narkhede. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396336 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 21:28:20 +00:00
Edward Jay Kreps 3a525e0bfa KAFKA-504 Catching the wrong exception in the test for snappy compression, added check for SnappyException too. Trivial fix, no review. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396178 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 18:37:51 +00:00
Jun Rao d5df29b84f support changing host/port of a broker; patched by David Arthur; reviewed by Jun Rao; kafka-474 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396116 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 17:08:42 +00:00
Edward Jay Kreps 452be9080e KAFKA-551 Remove the concept of immutable log segments--now all indexes and message sets are mutable. This allows truncating old segments. Review by Jun and Neha. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1396102 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 16:40:56 +00:00
Jun Rao 3819adc486 The ConsumerStats MBean name should include the groupid; patched by Michael Tamm; reviewed by Jun Rao; kafka-547 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1396085 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 15:56:52 +00:00
Jun Rao eed5983596 Replica.hw should be initialized to the smaller of checkedpointed HW and log end offset; patched by Yang Ye; reviewed by Jun Rao; KAFKA-539 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1395861 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 05:16:26 +00:00