Commit Graph

7322 Commits

Author SHA1 Message Date
Joel Jacob Koshy b688c3ba04 KAFKA-391 Refactor fetch/producer requests to use maps instead of several arrays; patched by Joel Koshy; reviewed by Jun Rao.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1386806 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 20:15:59 +00:00
Jun Rao c8f7587072 log.truncateTo needs to handle targetOffset smaller than the lowest offset in the log ; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-463
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1386641 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 14:52:18 +00:00
Neha Narkhede fb0f176131 KAFKA-449: Leader election test
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1384854 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 17:20:04 +00:00
Jun Rao e42c8d5f4e revisit broker config in 0.8; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-325
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1384624 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:29:07 +00:00
Jun Rao 2bc65dab67 Improve Kafka internal metrics; patched by Jun Rao; reviewed by Joel Koshy and Neha Narkhede; KAFKA-203
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1384202 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 04:27:13 +00:00
Jun Rao de927e2948 Handle topic names with / on Kafka server (0.8 branch); patched by Swapnil Ghike; reviewed by Jay Kreps, Joel Koshy and Jun Rao; KAFKA-495
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383739 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 02:14:37 +00:00
Jun Rao ea14ae8b7f Check max message size on server; patched by Swapnil Ghike; reviewed by Joel Koshy and Jun Rao; KAFKA-490
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383730 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 01:30:09 +00:00
Jun Rao 082d9d3b5a trival fix to remove a 0 byte file
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383464 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 16:07:35 +00:00
Jun Rao ba58c9a704 remove errorcode from ByteBufferMessageSet; patched by Swapnil Ghike; reviewed by Jay Kreps and Jun Rao; KAFKA-458
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1383105 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 20:47:23 +00:00
Neha Narkhede 22e4341ba9 KAFKA-498: Controller has race conditions and synchronization bugs; patched by Neha Narkhede; reviewed by Jun Rao
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1382988 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 17:09:52 +00:00
Prashanth Menon 87fa96e291 Expose different data to fetch requests from the follower replicas and consumer clients; patched by Prashanth Menon; reviewed by Jun Rao; KAFKA-376
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1382828 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 13:28:44 +00:00
Jun Rao 50792c8765 Transient failure in ProducerTest; patched by Jun Rao; reviewed by Neha Narkhede; kafka-471
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1381858 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 03:57:32 +00:00
Jun Rao 259b710694 Handle topic names with / on Kafka server; patched by Jun Rao; reviewed by Neha Narkhede; kafka-470
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1381856 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 03:54:10 +00:00
Jun Rao 9e54dadf4b Handle topic names with / on Kafka server; patched by Swapnil Ghike; reviewed by Jay Kreps and Jun Rao; kafka-495
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1381853 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 03:48:50 +00:00
Neha Narkhede 4cea1de21a KAFKA-483 Improvements to the system testing framework; patched by John Fung; reviewed by Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1379232 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 23:47:55 +00:00
Neha Narkhede d4f3eff171 KAFKA-489 Add metrics collection and graphs to the system test framework; patched by Neha Narkhede; reviewed by Jun Rao and John Fung
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1378666 13f79535-47bb-0310-9956-ffa450edef68
2012-08-29 18:07:58 +00:00
Jun Rao 695a8d43eb Message size not checked at the server (patch v3); patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-469
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1378590 13f79535-47bb-0310-9956-ffa450edef68
2012-08-29 14:52:39 +00:00
Jun Rao e72ff0ee2a Add constructor for message which takes both byte array offset and length; patched by Graham Sanderson; reviewed by Jun Rao; KAFKA-393
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1378264 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 18:42:00 +00:00
Jun Rao a32d37f6d1 Log errors for unrecognized config options; patched by Jun Rao; reviewed by Jay Kreps; KAFKA-181
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377220 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 06:23:18 +00:00
Jun Rao a74cdb61b1 Require values in Utils.getTopic* methods to be positive (0.8 branch); patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-481
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377214 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 05:28:33 +00:00
Jun Rao f2c901bcd4 Require values in Utils.getTopic* methods to be positive; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-481
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1377213 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 05:16:27 +00:00
Jun Rao 2f34eda87e Expose JMX operation to set logger level dynamically (0.8 branch); patched by Jun Rao; reviewed by Jay Kreps; KAFKA-429
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377175 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:14:41 +00:00
Jun Rao 749665e336 Expose JMX operation to set logger level dynamically; patched by Jun Rao; reviewed by Jay Kreps; KAFKA-429
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1377172 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:04:59 +00:00
Jun Rao 31b9d124d6 maintain HW correctly with only 1 replica in ISR; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-420
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377166 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 00:46:08 +00:00
Jun Rao 2756b424a7 Time based log segment rollout (0.8 branch); patched by Swapnil Ghike; reviewed by Jun Rao, Neha Narkhede; KAFKA-475
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377165 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 00:34:27 +00:00
Jun Rao 17283a377d Controller tests throw several zookeeper errors; patched by Yang Ye; reviewed by Jun Rao; KAFKA-416
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377161 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 00:24:49 +00:00
Jun Rao 93e9dbd026 update leaderAndISR in ZK conditionally; patched by Yang Ye; reviewed by Jun Rao; KAFKA-428
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1377157 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 00:06:33 +00:00
Jun Rao 21326cb9f2 Time based log segment rollout; patched by Swapnil Ghike; reviewed by Jun Rao, Neha Narkhede; KAFKA-475
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1377093 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 20:38:27 +00:00
Jun Rao 9a84e408c1 message size not checked at the server; patched by Swapnil Ghike; reviewed by Jun Rao, Neha Narkhede; KAFKA-469
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1376943 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 14:32:10 +00:00
Jun Rao 0d6a4dff09 TopicCount.constructTopicCount isn't thread-safe; patched by Jun Rao; reviewed by Joel Koshy and Neha Narkhede; kafka-379
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1376598 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 17:15:17 +00:00
Neha Narkhede 5861046d09 KAFKA-440 Regression/system test framework; patched by John Fung; reviewed by Neha Narkhede
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1376147 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 17:16:26 +00:00
Jun Rao 663d254433 refactor ReplicaManager; patched by Jun Rao; reviewed by Neha Narkhede; KAFKA-351
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1375670 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 17:17:29 +00:00
Jun Rao 7baccc6c33 remove support for format for magic byte 0 in 0.8; patched by Swapnil Ghike; reviewed by Jun Rao; KAFKA-461
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1375367 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 01:52:50 +00:00
Jun Rao 27aaebc874 Create a generic Kafka thread; patched by Yang Ye; reviewed by Jun Rao, Jay Kreps; KAFKA-56
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1375360 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 01:10:00 +00:00
Jun Rao be521175dc failed ERROR messages in LazyInitProducerTest; patched by Yang Ye; reviewed by Jun Rao; kafka-467
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1374514 13f79535-47bb-0310-9956-ffa450edef68
2012-08-18 05:26:59 +00:00
Jun Rao 12a3ccafa1 KafkaController NPE in SessionExpireListener; patched by Yang Ye; reviewed by Jun Rao, Neha Narkhede; KAFKA-464
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1374467 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:09:05 +00:00
Jun Rao 60735b7ad6 enforce broker.id to be a non-negative integer; patched by Swapnil Ghike; reviewed by Jun Rao, Neha Narkhede; KAFKA-424
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1374440 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 21:09:15 +00:00
Joel Jacob Koshy 190bd3ff71 KAFKA-385 Fix race condition between checkSatisfied and expire in RequestPurgatory; fixed constant expiration of follower fetch requests as checkSatisfied was not getting called; add metrics to the RequestPurgatory; add a KafkaTimer convenience class; patched by Joel Koshy; reviewed by Jun Rao and Jay Kreps.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1374069 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 21:26:40 +00:00
Jun Rao 0fe89f7a49 KafkaController.RequestSendThread can throw exception on broker socket; patched by Yang Ye; reviewed by Jun Rao; KAFKA-459, KAFKA-460
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1373448 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 15:07:41 +00:00
Edward Jay Kreps 9eb99fde9a KAFKA-323 Add more parameters to the log4j appender. Patch by Jose Quinteiro.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1373067 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:35:48 +00:00
Edward Jay Kreps 623e2b7e53 KAFKA-424. Fix command line usage description. Patch from Tommie.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1373056 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 19:59:11 +00:00
Edward Jay Kreps d482531810 KAFKA-425 Wrong class name in scripts. Patch from Akira Kitada reviewed by Jay Kreps.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1373054 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 19:56:36 +00:00
Edward Jay Kreps a8790784df KAFKA-439 Fix bad javadoc. Patch from Jim Plush. Reviewed and modified by Jay Kreps.
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1373052 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 19:47:54 +00:00
Jun Rao ee855fe1aa remove ZK dependency on producer; patched by Yang Ye; reviewed by Jun Rao; KAFKA-369
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1372724 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 04:17:27 +00:00
Neha Narkhede b995133387 Minor checkin to fix replication system test and jmx tool
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1370941 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:17:31 +00:00
Neha Narkhede 8ceec6eff0 KAFKA-380 Enhance single_host_multi_brokers test with failure to trigger leader re-election in replication; patched by John Fung; reviewed by Neha Narkhede, Jun Rao and Joel Koshy
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1369888 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 17:27:05 +00:00
Jun Rao 0223fd8270 recommit: revisit the become leader and become follower state change operations using V3 design; patched by Yang Ye; reviewed by Neha Narkhede and Jun Rao; kafka-343
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1368092 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 16:13:59 +00:00
Neha Narkhede 96ed9af620 KAFKA-384 Fix intermittent unit test failures and remove Thread.sleep statements; patched by Neha Narkhede; reviewed by Joel Koshy, Jun Rao and Jay Kreps
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1367821 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 23:27:11 +00:00
Jun Rao c21a7979c1 revert commit to KAFKA-343 due to unit test failures
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1367811 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 22:50:59 +00:00
Jun Rao 2a9d42c243 revisit the become leader and become follower state change operations using V3 design; patched by Yang Ye; reviewed by Neha Narkhede and Jun Rao; kafka-343
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/branches/0.8@1367619 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 15:33:29 +00:00