Commit Graph

16414 Commits

Author SHA1 Message Date
Edward Jay Kreps 0d0f1fcfb3 KAFKA-371 Patch from Jonathan Creasy reviewed by me. Correctly handle the case of an empty string as topic name or invalid partition number.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1363022 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 17:16:28 +00:00
Jun Rao 89661d3b67 ZookeeperConsumerConnector needs to connect to new leader after leadership change; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-362
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1360261 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 16:16:26 +00:00
Jun Rao 3bade0b5c8 broker failure system test broken on replication branch; patched by John Fung; reviewed by Joel Koshy and Jun Rao; KAFKA-306
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1359813 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 18:08:07 +00:00
Jun Rao d79919d827 broker failure system test broken on replication branch; patched by John Fung; reviewed by Joel Koshy and Jun Rao; KAFKA-306
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1359812 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 18:05:54 +00:00
Joel Jacob Koshy 489b09c120 KAFKA-373 Fix trunk broker failure test to work with mirror maker; patched by John Fung; reviewed by Joel Koshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1358407 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 20:44:51 +00:00
Joel Jacob Koshy e7efee02c1 KAFKA-353 Tie producer-side ack with high watermark and progress of replicas; patched by Joel Koshy; reviewed by Jun Rao, Jay Kreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1355578 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:05:57 +00:00
Jun Rao cb5be0aff1 Consumer doesn't receive all data; patched by Jun Rao; reviewed by John Fung; KAFKA-372
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1354094 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 16:23:14 +00:00
Jun Rao 505cf9d618 using MultiFetch in the follower; patched by Jun Rao; reviewed by Joel Koshy and Neha Narkhede; KAFKA-339
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1353086 13f79535-47bb-0310-9956-ffa450edef68
2012-06-23 07:14:24 +00:00
Jun Rao 0efd609fe7 Exception java.util.NoSuchElementException: None.get appears inconsistently; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-370
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1352980 13f79535-47bb-0310-9956-ffa450edef68
2012-06-22 17:31:38 +00:00
Joe Stein a16448b71e KAFKA-368 use the pig core jar from maven instead of distributing it patch by Joe Stein reviewed by Jun Rao and Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1352146 13f79535-47bb-0310-9956-ffa450edef68
2012-06-20 15:04:53 +00:00
Joe Stein 1af23bb263 KAFKA-368 use the pig core jar from maven instead of distributing it patch by Joe Stein reviewed by Jun Rao and Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1352145 13f79535-47bb-0310-9956-ffa450edef68
2012-06-20 15:04:04 +00:00
Jun Rao 1a8511684c upgrade ZKClient to allow conditional updates in ZK; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-337
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1351546 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 00:32:18 +00:00
Jun Rao 16b600d4fd add jmx beans in broker to track # bytes in consumer; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-336
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1351544 13f79535-47bb-0310-9956-ffa450edef68
2012-06-19 00:27:00 +00:00
Prashanth Menon eff68ce1d0 Create topic support (revisit based on v3 design); patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-329
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1351188 13f79535-47bb-0310-9956-ffa450edef68
2012-06-18 01:17:44 +00:00
Joe Stein efdc57bc58 KAFKA-348 rebase branch from trunk patch by Jun Rao reviewed by Joe Stein
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1351112 13f79535-47bb-0310-9956-ffa450edef68
2012-06-17 15:32:29 +00:00
Joe Stein f8ce071f3f KAFKA-365 change copyright in NOTICE to current year, reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1350349 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 17:47:20 +00:00
Joe Stein ebcf7fc10d KAFKA-365 change copyright in NOTICE to current year, reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1350349 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 17:47:20 +00:00
Jun Rao 965edbbcd8 system test to validate consistency of replicas; patched by John Fung; reviewed by Jun Rao; KAFKA-341
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1350316 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 16:23:30 +00:00
Jun Rao 83c82a3ecc embedded controller; patched by Yang Ye; reviewed by Jun Rao; KAFKA-335
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1350291 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 15:17:35 +00:00
Jun Rao 7d3a782e50 trivial change to add some logging info in DefaultEventHandler
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1350046 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 22:36:20 +00:00
Jun Rao f99177766a Add admin RPC requests; clean up Response objects; patched by Yang Ye; reviewed by Jun Rao; KAFKA-349; KAFKA-336
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1346697 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 01:28:46 +00:00
Neha Narkhede c4a913e3c4 Minor checkin to remove an empty package
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344965 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 01:54:41 +00:00
Neha Narkhede 045f4fdca4 KAFKA-46: Message replication feature without failures; patched by Neha Narkhede; reviewed by Jun Rao, Jay Kreps, Prashanth Menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344964 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 01:53:19 +00:00
Joe Stein 822963bb9d KAFKA-348 merge trunk to branch 1239902:1310937 patch by Joe Stein reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344526 13f79535-47bb-0310-9956-ffa450edef68
2012-05-31 01:51:23 +00:00
Prashanth Menon 904708fae8 Fix retry logic for producers; patched by Prashanth Menon; reviewed by Jun Rao, Neha Narkhede; KAFKA-49
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1343255 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 13:45:51 +00:00
Jun Rao 23b422bc44 upgrade ZKClient to allow conditional updates in ZK; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-337
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1342487 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 01:49:22 +00:00
Neha Narkhede 2a59ad76c6 Minor fix: Turning on TCP NODELAY in the Simple Consumer. This fix has a significant impact on single fetch request performance from a latency standpoint
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1339944 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 01:22:11 +00:00
Edward Jay Kreps 1bedde76c2 KAFKA-48 Patch to add "long poll" support to fetch requests.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1332413 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 21:34:49 +00:00
Jun Rao d6b1de35f6 Mirroring should use multiple producers; add producer retries to DefaultEventHandler; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-332
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1330083 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 02:24:47 +00:00
Neha Narkhede d73355017a KAFKA-301 Implement broker startup procedure; patched by Neha Narkhede; reviewed by Jun Rao and Jay Kreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1329509 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 23:32:59 +00:00
Neha Narkhede d97c557202 KAFKA-320 testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException; patched by nehanarkhede; reviewed by junrao and prashanth menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310937 13f79535-47bb-0310-9956-ffa450edef68
2012-04-08 02:00:19 +00:00
Neha Narkhede 79a3b31f26 KAFKA-320 testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException; patched by nehanarkhede; reviewed by junrao and prashanth menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1310661 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 02:12:26 +00:00
Jun Rao c0e190cdef Separate out Kafka mirroring into a stand-alone app; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede; KAFKA-249
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310645 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 00:04:51 +00:00
Jun Rao d9441f0066 enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-315
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310595 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 21:18:56 +00:00
Jun Rao f8346239d4 CallbackHandler.afterDequeuingExistingData is not called during event queue timeout; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-326
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310482 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:59:44 +00:00
Jun Rao a260bfacae SyncProducer does not correctly timeout; patched by Prashanth Menon; reviewed by Jun Rao, Neha Narkhede; KAFKA-305
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1305454 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:12:30 +00:00
Neha Narkhede fedb9d6c19 KAFKA-307 Refactor server code to reduce interdependencies; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1304473 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 16:46:03 +00:00
Neha Narkhede ba8fd9f1ee KAFKA-309 Bug in FileMessageSet's append API can corrupt on disk log; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303890 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 16:59:11 +00:00
Neha Narkhede 2bcc911343 KAFKA-310 Incomplete message set validation checks in Log's append API can corrupt on disk log segment; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303861 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 16:03:49 +00:00
Neha Narkhede 854fb29c26 KAFKA-300 Leader election; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1303473 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 17:29:32 +00:00
Jun Rao e180e68f94 Dead code in the Log4j appender; patched by Jose Quinteiro; reviewed by Jun Rao; KAFKA-303
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303239 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 00:38:14 +00:00
Jun Rao 7b39d7eed1 kafka-console-producer does not take in customized values of --batch-size or --timeout; patched by Jun Rao; reviewed by Edward Smith; KAFKA-279
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303232 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 00:25:09 +00:00
Jun Rao 5e0e0b17fb reverting previous commit for KAFKA-296 because patch didn't apply cleanly
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300801 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 00:39:42 +00:00
Jun Rao 66d8073156 Update Go Client to new version of Go; patched by AaronR; KAFKA-296
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300777 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 22:58:57 +00:00
Jun Rao 4dd7f95569 Add acknowledgement to the produce request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-49
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1300435 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 01:35:46 +00:00
Jun Rao 74af0deef1 LogManager test fails on linux; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-220
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298426 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 15:18:30 +00:00
Jun Rao 624a361e01 trivial fix to include violated payload size in MessageSizeTooLargeException; patched by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298030 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 17:51:21 +00:00
Joe Stein 88660999a8 KAFKA-240 missing producer response
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1297593 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 17:45:17 +00:00
Jun Rao 0443e2dd73 broker deletes all file segments when cleaning up an empty log segment; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-292
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1297324 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 02:21:54 +00:00
Joe Stein f8042d5b39 KAFKA-240 ProducerRequest wire format protocol update and related changes
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1296577 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 05:46:43 +00:00