Commit Graph

12596 Commits

Author SHA1 Message Date
Jun Rao 83c82a3ecc embedded controller; patched by Yang Ye; reviewed by Jun Rao; KAFKA-335
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1350291 13f79535-47bb-0310-9956-ffa450edef68
2012-06-14 15:17:35 +00:00
Jun Rao 7d3a782e50 trivial change to add some logging info in DefaultEventHandler
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1350046 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 22:36:20 +00:00
Jun Rao f99177766a Add admin RPC requests; clean up Response objects; patched by Yang Ye; reviewed by Jun Rao; KAFKA-349; KAFKA-336
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1346697 13f79535-47bb-0310-9956-ffa450edef68
2012-06-06 01:28:46 +00:00
Neha Narkhede c4a913e3c4 Minor checkin to remove an empty package
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344965 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 01:54:41 +00:00
Neha Narkhede 045f4fdca4 KAFKA-46: Message replication feature without failures; patched by Neha Narkhede; reviewed by Jun Rao, Jay Kreps, Prashanth Menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344964 13f79535-47bb-0310-9956-ffa450edef68
2012-06-01 01:53:19 +00:00
Joe Stein 822963bb9d KAFKA-348 merge trunk to branch 1239902:1310937 patch by Joe Stein reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1344526 13f79535-47bb-0310-9956-ffa450edef68
2012-05-31 01:51:23 +00:00
Prashanth Menon 904708fae8 Fix retry logic for producers; patched by Prashanth Menon; reviewed by Jun Rao, Neha Narkhede; KAFKA-49
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1343255 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 13:45:51 +00:00
Jun Rao 23b422bc44 upgrade ZKClient to allow conditional updates in ZK; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-337
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1342487 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 01:49:22 +00:00
Neha Narkhede 2a59ad76c6 Minor fix: Turning on TCP NODELAY in the Simple Consumer. This fix has a significant impact on single fetch request performance from a latency standpoint
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1339944 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 01:22:11 +00:00
Edward Jay Kreps 1bedde76c2 KAFKA-48 Patch to add "long poll" support to fetch requests.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1332413 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 21:34:49 +00:00
Jun Rao d6b1de35f6 Mirroring should use multiple producers; add producer retries to DefaultEventHandler; patched by Joel Koshy; reviewed by Jun Rao; KAFKA-332
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1330083 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 02:24:47 +00:00
Neha Narkhede d73355017a KAFKA-301 Implement broker startup procedure; patched by Neha Narkhede; reviewed by Jun Rao and Jay Kreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1329509 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 23:32:59 +00:00
Neha Narkhede d97c557202 KAFKA-320 testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException; patched by nehanarkhede; reviewed by junrao and prashanth menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310937 13f79535-47bb-0310-9956-ffa450edef68
2012-04-08 02:00:19 +00:00
Neha Narkhede 79a3b31f26 KAFKA-320 testZKSendWithDeadBroker fails intermittently due to ZKNodeExistsException; patched by nehanarkhede; reviewed by junrao and prashanth menon
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1310661 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 02:12:26 +00:00
Jun Rao c0e190cdef Separate out Kafka mirroring into a stand-alone app; patched by Joel Koshy; reviewed by Jun Rao and Neha Narkhede; KAFKA-249
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310645 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 00:04:51 +00:00
Jun Rao d9441f0066 enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression; patched by Jun Rao; reviewed by Joel Koshy; KAFKA-315
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310595 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 21:18:56 +00:00
Jun Rao f8346239d4 CallbackHandler.afterDequeuingExistingData is not called during event queue timeout; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-326
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1310482 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 16:59:44 +00:00
Jun Rao a260bfacae SyncProducer does not correctly timeout; patched by Prashanth Menon; reviewed by Jun Rao, Neha Narkhede; KAFKA-305
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1305454 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:12:30 +00:00
Neha Narkhede fedb9d6c19 KAFKA-307 Refactor server code to reduce interdependencies; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1304473 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 16:46:03 +00:00
Neha Narkhede ba8fd9f1ee KAFKA-309 Bug in FileMessageSet's append API can corrupt on disk log; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303890 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 16:59:11 +00:00
Neha Narkhede 2bcc911343 KAFKA-310 Incomplete message set validation checks in Log's append API can corrupt on disk log segment; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303861 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 16:03:49 +00:00
Neha Narkhede 854fb29c26 KAFKA-300 Leader election; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1303473 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 17:29:32 +00:00
Jun Rao e180e68f94 Dead code in the Log4j appender; patched by Jose Quinteiro; reviewed by Jun Rao; KAFKA-303
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303239 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 00:38:14 +00:00
Jun Rao 7b39d7eed1 kafka-console-producer does not take in customized values of --batch-size or --timeout; patched by Jun Rao; reviewed by Edward Smith; KAFKA-279
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1303232 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 00:25:09 +00:00
Jun Rao 5e0e0b17fb reverting previous commit for KAFKA-296 because patch didn't apply cleanly
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300801 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 00:39:42 +00:00
Jun Rao 66d8073156 Update Go Client to new version of Go; patched by AaronR; KAFKA-296
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300777 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 22:58:57 +00:00
Jun Rao 4dd7f95569 Add acknowledgement to the produce request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-49
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1300435 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 01:35:46 +00:00
Jun Rao 74af0deef1 LogManager test fails on linux; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-220
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298426 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 15:18:30 +00:00
Jun Rao 624a361e01 trivial fix to include violated payload size in MessageSizeTooLargeException; patched by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1298030 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 17:51:21 +00:00
Joe Stein 88660999a8 KAFKA-240 missing producer response
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1297593 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 17:45:17 +00:00
Jun Rao 0443e2dd73 broker deletes all file segments when cleaning up an empty log segment; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-292
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1297324 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 02:21:54 +00:00
Joe Stein f8042d5b39 KAFKA-240 ProducerRequest wire format protocol update and related changes
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1296577 13f79535-47bb-0310-9956-ffa450edef68
2012-03-03 05:46:43 +00:00
Neha Narkhede 9fd2d4ffdb KAFKA-239 Refactoring code to wire new ZK data structures and making partitions logical; patched by Neha Narkhede; reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1295861 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 21:15:26 +00:00
Joe Stein ccc464c19a Niek Sanders - KAFKA-284 fixed compilation issue for cpp client
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1295388 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 02:47:03 +00:00
Jun Rao 6c34cf2dcc use propertyExists to test if both broker.list and zk.connect are present; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-290
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294959 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 03:22:14 +00:00
Jun Rao d8286aad10 Increase maximum value of log.retention.size; patched by Elben Shira; reviewed by Jun Rao; KAFKA-285
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294441 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 01:50:38 +00:00
Jun Rao caf310c228 consumer sometimes don't release partition ownership properly in ZK during rebalance; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-286
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1294302 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 19:46:36 +00:00
Jun Rao 7e91c16743 add jmx beans in broker to track # of failed requests; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-283
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293720 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 23:08:02 +00:00
Jun Rao 333966f50e Add a shallow iterator to the ByteBufferMessageSet; patched by Yang Ye; reviewed by Jun Rao; KAFKA-277
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1293010 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 22:57:40 +00:00
Jun Rao 22d80462b1 A tool to UPDATE Zookeeper partition-offset with input from a file; patched by John Fung; reviewed by Jun Rao; KAFKA-255
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291536 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 00:26:42 +00:00
Jun Rao 7066d1c38b A tool to GET Zookeeper partition-offset and output to files; patched by John Fung; reviewed by Jun Rao; KAFKA-254
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291535 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 00:25:55 +00:00
Jun Rao 95ee38728c make time-based reconnect starting at a random time; patched by Yang Ye; reviewed by Jun Rao; KAFKA-268
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1291490 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 22:24:52 +00:00
Jun Rao a23d396a5a trivial fix for kafka-producer-perf-test.sh
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245779 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:54:29 +00:00
Joe Stein ff562472dd test access, fixed space
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245316 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 04:14:47 +00:00
Neha Narkhede c28b3a61cc KAFKA-274 Handle corrupted messages cleanly; patched by nehanarkhede; reviewed by junrao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245299 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:33:07 +00:00
Jun Rao 6e1b2ebe32 shutdown watch executor thread properly; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1245295 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 02:14:25 +00:00
Jun Rao 2ead8a49ea trivial fix to add trace logging in FetcherRunnable
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244792 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 23:51:27 +00:00
Jun Rao 3e79116e7a fix condition to use await instead of wait; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-265
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244765 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:22:11 +00:00
Jun Rao 5c4ce61699 add JMX on broker to track bytes/messages per topic; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-272
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1244755 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:04:00 +00:00
Jun Rao 6e36047fae disable dup topic in consumer request; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-240
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1244650 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:08:08 +00:00