root
/
kafka
mirror of https://github.com/apache/kafka.git
1
0
Fork 0
Code Issues Actions 2 Packages Projects Releases Wiki Activity
16,414 Commits 84 Branches 277 Tags 600 MiB
Commit Graph

3978 Commits

Author SHA1 Message Date
Geoff Anderson e43c9aff92 KAFKA-2276; KIP-25 initial patch 
Initial patch for KIP-25

Note that to install ducktape, do *not* use pip to install ducktape. Instead:

```
$ git clone gitgithub.com:confluentinc/ducktape.git
$ cd ducktape
$ python setup.py install
```

Author: Geoff Anderson <geoff@confluent.io>
Author: Geoff <granders@gmail.com>
Author: Liquan Pei <liquanpei@gmail.com>

Reviewers: Ewen, Gwen, Jun, Guozhang

Closes #70 from granders/KAFKA-2276 and squashes the following commits:

a62fb6c [Geoff Anderson] fixed checkstyle errors
a70f0f8 [Geoff Anderson] Merged in upstream trunk.
8b62019 [Geoff Anderson] Merged in upstream trunk.
47b7b64 [Geoff Anderson] Created separate tools jar so that the clients package does not pull in dependencies on the Jackson JSON tools or argparse4j.
a9e6a14 [Geoff Anderson] Merged in upstream changes
d18db7b [Geoff Anderson] fixed :rat errors (needed to add licenses)
321fdf8 [Geoff Anderson] Ignore tests/ and vagrant/ directories when running rat build task
795fc75 [Geoff Anderson] Merged in changes from upstream trunk.
1d93f06 [Geoff Anderson] Updated provisioning to use java 7 in light of KAFKA-2316
2ea4e29 [Geoff Anderson] Tweaked README, changed default log collection behavior on VerifiableProducer
0eb6fdc [Geoff Anderson] Merged in system-tests
69dd7be [Geoff Anderson] Merged in trunk
4034dd6 [Geoff Anderson] Merged in upstream trunk
ede6450 [Geoff] Merge pull request #4 from confluentinc/move_muckrake
7751545 [Geoff Anderson] Corrected license headers
e6d532f [Geoff Anderson] java 7 -> java 6
8c61e2d [Geoff Anderson] Reverted jdk back to 6
f14c507 [Geoff Anderson] Removed mode = "test" from Vagrantfile and Vagrantfile.local examples. Updated testing README to clarify aws setup.
98b7253 [Geoff Anderson] Updated consumer tests to pre-populate kafka logs
e6a41f1 [Geoff Anderson] removed stray println
b15b24f [Geoff Anderson] leftover KafkaBenchmark in super call
0f75187 [Geoff Anderson] Rmoved stray allow_fail. kafka_benchmark_test -> benchmark_test
f469f84 [Geoff Anderson] Tweaked readme, added example Vagrantfile.local
3d73857 [Geoff Anderson] Merged downstream changes
42dcdb1 [Geoff Anderson] Tweaked behavior of stop_node, clean_node to generally fail fast
7f7c3e0 [Geoff Anderson] Updated setup.py for kafkatest
c60125c [Geoff Anderson] TestEndToEndLatency -> EndToEndLatency
4f476fe [Geoff Anderson] Moved aws scripts to vagrant directory
5af88fc [Geoff Anderson] Updated README to include aws quickstart
e5edf03 [Geoff Anderson] Updated example aws Vagrantfile.local
96533c3 [Geoff] Update aws-access-keys-commands
25a413d [Geoff] Update aws-example-Vagrantfile.local
884b20e [Geoff Anderson] Moved a bunch of files to kafkatest directory
fc7c81c [Geoff Anderson] added setup.py
632be12 [Geoff] Merge pull request #3 from confluentinc/verbose-client
51a94fd [Geoff Anderson] Use argparse4j instead of joptsimple. ThroughputThrottler now has more intuitive behavior when targetThroughput is 0.
a80a428 [Geoff Anderson] Added shell program for VerifiableProducer.
d586fb0 [Geoff Anderson] Updated comments to reflect that throttler is not message-specific
6842ed1 [Geoff Anderson] left out a file from last commit
1228eef [Geoff Anderson] Renamed throttler
9100417 [Geoff Anderson] Updated command-line options for VerifiableProducer. Extracted throughput logic to make it reusable.
0a5de8e [Geoff Anderson] Fixed checkstyle errors. Changed name to VerifiableProducer. Added synchronization for thread safety on println statements.
475423b [Geoff Anderson] Convert class to string before adding to json object.
bc009f2 [Geoff Anderson] Got rid of VerboseProducer in core (moved to clients)
c0526fe [Geoff Anderson] Updates per review comments.
8b4b1f2 [Geoff Anderson] Minor updates to VerboseProducer
2777712 [Geoff Anderson] Added some metadata to producer output.
da94b8c [Geoff Anderson] Added number of messages option.
07cd1c6 [Geoff Anderson] Added simple producer which prints status of produced messages to stdout.
a278988 [Geoff Anderson] fixed typos
f1914c3 [Liquan Pei] Merge pull request #2 from confluentinc/system_tests
81e4156 [Liquan Pei] Bootstrap Kafka system tests
 2015-07-28 17:22:14 -07:00
Rajini Sivaram f4101ab3fc KAFKA-2089: Fix transient MetadataTest failure; reviewed by Jiangjie Qin and Guozhang Wang 2015-07-28 16:31:33 -07:00
Ashish Singh 594b963930 KAFKA-2275: Add ListTopics() API to the Java consumer; reviewed by Jason Gustafson, Edward Ribeiro and Guozhang Wang 2015-07-28 15:49:22 -07:00
Ashish Singh 269c2407d4 KAFKA-2381: Fix concurrent modification on assigned partition while looping over it; reviewed by Jason Gustafson, Aditya Auradkar, Ewen Cheslack-Postava, Ismael Juma and Guozhang Wang 2015-07-28 14:23:44 -07:00
Jason Gustafson fd3b4cc41e KAFKA-2342; KafkaConsumer rebalance with in-flight fetch can cause invalid position 
Author: Jason Gustafson <jason@confluent.io>

Closes #88 from hachikuji/KAFKA-2342 and squashes the following commits:

cabb017 [Jason Gustafson] KAFKA-2342; KafkaConsumer rebalance with in-flight fetch can cause invalid position
 2015-07-22 13:00:03 -07:00
Parth Brahmbhatt fa03a7c6c4 KAFKA-2032: validate consumer's partition-assignment config; reviewed by Jason Rosenberg, Sriharsha Chintalapani and Guozhang Wang 2015-07-16 12:59:27 -07:00
Jason Gustafson 83d17e5b24 [MINOR] fix new consumer heartbeat reschedule bug 
This commit fixes a minor issue introduced in the patch for KAFKA-2123. The schedule method requires the time the task should be executed, not a delay.

Author: Jason Gustafson <jason@confluent.io>

Closes #79 from hachikuji/KAFKA-2123-fix and squashes the following commits:

6eb7ec6 [Jason Gustafson] [Minor] fix new consumer heartbeat reschedule bug
 2015-07-15 19:00:37 -07:00
Jason Gustafson 4fcb7acafe KAFKA-2335; fix comment about thread safety 
Author: Jason Gustafson <jason@confluent.io>

Closes #78 from hachikuji/KAFKA-2335 and squashes the following commits:

c697998 [Jason Gustafson] KAFKA-2335; fix comment about consumer thread safety
 2015-07-15 15:46:19 -07:00
Jason Gustafson 99c0686be2 KAFKA-2123: add callback in commit api and use a delayed queue for async requests; reviewed by Ewen Cheslack-Postava and Guozhang Wang 2015-07-15 12:38:45 -07:00
Tim Brooks 69b451e289 KAFKA-2312: use atomic long for thread id reference; reviewed by Ewen Cheslack-Postava, Jason Gustafson, Ismael Juma and Guozhang Wang 2015-07-13 13:13:02 -07:00
Gwen Shapira 67b6b9a45b KAFKA-2308: make MemoryRecords idempotent; reviewed by Guozhang Wang 2015-07-08 09:57:16 -07:00
Dong Lin 23d72bccbe KAFKA-2298; Client Selector can drop connections on InvalidReceiveException without notifying NetworkClient; reviewed by Jason Gustafson and Joel Koshy 2015-07-07 18:09:00 -07:00
Onur Karaman f13dd8024d KAFKA-2313: javadoc fix for KafkaConsumer deserialization; reviewed by Guozhang Wang 2015-07-07 13:36:55 -07:00
Dong Lin a99f70feb2 KAFKA-2306: add another metric for buffer exhausted; reviewed by Guozhang Wang 2015-07-07 12:42:49 -07:00
Guozhang Wang 3f8480ccfb KAFKA-1740: merge offset manager into consumer coordinator; reviewed by Onur Karaman and Jason Gustafson 2015-07-02 11:41:51 -07:00
Jason Gustafson 14e0ce0a47 KAFKA-2168: minor follow-up patch; reviewed by Guozhang Wang 2015-07-01 15:28:11 -07:00
Tao Xiao 9ff5b27bc5 KAFKA-2281: avoid unnecessary value copying if logAsString is false; reviewed by Guozhang Wang 2015-06-29 18:48:05 -07:00
Jeff Maxwell 6d4991e312 KAFKA-2294; javadoc compile error due to illegal <p/> , build failing (jdk 8); patched by Jeff Maxwell; reviewed by Jakob Homan 2015-06-23 10:52:21 -07:00
Jason Gustafson b6d326b089 kafka-2168; New consumer poll() can block other calls like position(), commit(), and close() indefinitely; patched by Jason Gustafson; reviewed by Jay Kreps, Ewen Cheslack-Postava, Guozhang Wang and Jun Rao 2015-06-23 00:09:06 -04:00
Gwen Shapira 5c90407454 kafka-2249; KafkaConfig does not preserve original Properties; patched by Gwen Shapira; reviewed by Jun Rao 2015-06-18 14:07:33 -07:00
Jun Rao ba86f0a25d trivial fix for stylecheck error on Jenkins 2015-06-16 16:41:20 -07:00
Gwen Shapira 478505632e kafka-2252; Socket connection closing is logged, but not corresponding opening of socket; patched by Gwen Shapira; reviewed by Jun Rao 2015-06-16 15:37:58 -07:00
Manikumar Reddy 7009f1d6ff kafka-2264; SESSION_TIMEOUT_MS_CONFIG in ConsumerConfig should be int; patched by Manikumar Reddy; reviewed by Jun Rao 2015-06-16 15:30:52 -07:00
Andrii Biletskyi 54e54f0807 kafka-2195; Add versionId to AbstractRequest.getErrorResponse and AbstractRequest.getRequest; patched by Andrii Biletskyi; reviewed by Jun Rao 2015-06-16 14:46:48 -07:00
Tim Brooks 20a31a29f7 kafka-2101; Metric metadata-age is reset on a failed update; patched by Tim Brooks; reviewed by Jun Rao 2015-06-15 17:43:56 -07:00
Alexander Pakulov d31a2c2381 kafka-2232; make MockProducer generic; patched by Alexander Pakulov; reviewed by Jun Rao 2015-06-12 14:16:03 -07:00
Jason Gustafson 017c00caf4 kafka-2266; Client Selector can drop idle connections without notifying NetworkClient; patched by Jason Gustafson; reviewed by Jun Rao 2015-06-12 10:24:54 -07:00
Jiangjie Qin ca6d01bc69 KAFKA-2246; UnknownTopicOrPartitionException should be an instance of InvalidMetadataException; reviewed by Ewen Cheslack-Postava and Joel Koshy 2015-06-05 11:20:25 -07:00
Gwen Shapira 78ba492e3e kafka-1928; Move kafka.network over to using the network classes in org.apache.kafka.common.network; patched by Gwen Shapira; reviewed by Joel Koshy, Jay Kreps, Jiangjie Qin, Guozhang Wang and Jun Rao 2015-06-03 21:40:35 -07:00
Guozhang Wang d22987f01d KAFKA-2208; add consumer side error handling upon coordinator failure; reviewed by Onur Karaman 2015-06-03 13:47:08 -07:00
Sriharsha Chintalapani d6c45c70fb KAFKA-2091; Expose a partitioner interface in the new producer 
(https://cwiki.apache.org/confluence/display/KAFKA/KIP-+22+-+Expose+a+Partitioner+interface+in+the+new+producer);
reviewed by Joel Koshy and Jay Kreps
 2015-05-28 13:27:12 -07:00
Onur Karaman 49026f1178 KAFKA-1334; Add the heartbeat logic to consumer coordinator; reviewed by Guozhang Wang 2015-05-14 14:54:59 -07:00
Jiangjie Qin 33af0cba3b KAFKA-1660; Add API to the producer to support close with a timeout; reviewed by Joel Koshy and Jay Kreps. 2015-05-12 15:31:07 -07:00
Guozhang Wang 4328aa02c0 KAFKA-2121; add missing file 2015-05-07 21:52:07 -07:00
Steven Wu 5a47ef8ecb KAFKA-2121; Fix Closeable backward-compatibility; reviewed by Guozhang Wang 2015-05-07 17:04:51 -07:00
Manikumar Reddy 31dadf0242 KAFKA-1884; Add logging upon metadata response errors; reviewed by Guozhang Wang 2015-05-07 15:48:40 -07:00
Guozhang Wang 161b1aa16e KAFKA-2068 Phase 1; Merge in KAFKA-1841; reviewed by Jun Rao 2015-05-03 17:26:20 -07:00
Guozhang Wang 97358411af KAFKA-2121 Follow-up: minor bug fix as pointed out by Sean Lydon 2015-04-27 17:41:43 -07:00
Ismael Juma ed1a548c50 KAFKA-2140 Improve code readability; reviewed by Neha Narkhede 2015-04-26 08:40:58 -07:00
Jiangjie Qin 2166104aff KAFKA-2138; Fix producer to honor retry backoff; reviewed by Joel Koshy and Guozhang Wang 2015-04-24 12:41:32 -07:00
Steven Wu 01e94e2b4a KAFKA-2121; Close internnal modules upon client shutdown; reviewed by Ewen Cheslack-Postava and Guozhang Wang 2015-04-22 10:14:44 -07:00
Manikumar Reddy 761711ecaf kafka-2131; Update new producer javadocs with correct documentation links; patched by Manikumar Reddy; reviewed by Jun Rao 2015-04-19 07:56:53 -07:00
Ashish Singh 7c5b2405d8 kafka-1982; (add missing files) change kafka.examples.Producer to use the new java producer; patched by Ashish Singh; reviewed by Gwen Shapira, Mayuresh Gharat and Jun Rao 2015-04-19 07:53:46 -07:00
Ashish Singh 5408931a29 kafka-1982; change kafka.examples.Producer to use the new java producer; patched by Ashish Singh; reviewed by Gwen Shapira, Mayuresh Gharat and Jun Rao 2015-04-19 07:46:58 -07:00
Ewen Cheslack-Postava 813c4230d4 kafka-2119; ConsumerRecord key() and value() methods should not have throws Exception; patched by Ewen Cheslack-Postava; reviewed by Jun Rao 2015-04-17 18:02:23 -07:00
Gwen Shapira aa365639b2 kafka-2115; Error updating metrics in RequestChannel; patched by Gwen Shapira; reviewed by Jun Rao 2015-04-13 09:21:53 -05:00
Tim Brooks 2490b1c499 kafka-2090; Remove duplicate check to metadataFetchInProgress; patched by Tim Brook; reviewed by Ewen Cheslack-PostavaJun Rao 2015-04-08 19:06:05 -07:00
Guozhang Wang 013cda2d79 KAFKA-1910 Follow-up; Revert the no-offset-committed error code; reviewed by Joel Koshy 2015-04-07 15:38:36 -07:00
Pierre-Yves Ritschard b1cc725107 kafka-2033; Small typo in documentation; patched by Pierre-Yves Ritschard; reviewed by Jun Rao 2015-04-07 14:40:06 -07:00
Grant Henke 75e1cc8bc4 kafka-2043; CompressionType is passed in each RecordAccumulator append; patched by Grant Henke; reviewed by Jun Rao 2015-04-06 13:34:31 -07:00
Tong Li 9c23d93553 kafka-1926; Replace kafka.utils.Utils with o.a.k.common.utils.Utils; patched by Tong Li; reviewed by Jun Rao 2015-04-05 21:46:11 -07:00
Gwen Shapira 53f31432a0 kafka-1809; Refactor brokers to allow listening on multiple ports and IPs; patched by Gwen Shapira; reviewed by Joel Koshy and Jun Rao 2015-04-05 17:21:37 -07:00
Ewen Cheslack-Postava 6adaffd8ea KAFKA-1501 Let the OS choose the port in unit tests to avoid collisions. Patch by Ewen CP, reviewed by Guozhang and me. 2015-04-04 14:26:38 -07:00
Gwen Shapira d8fe98efee kafka-2044; Support requests and responses from o.a.k.common in KafkaApis; patched by Gwen Shapira; reviewed by Jun Rao 2015-03-28 08:39:48 -07:00
Guozhang Wang c5df2a8e3a KAFKA-1634; Bump up Offset Commit Request to v2 to add global retention and remove per-partition commit timestamp; reviewed by Joel Koshy and Jun Rao 2015-03-26 17:16:33 -07:00
Jiangjie Qin 991195416e KAFKA-2042; Update topic list of the metadata regardless of cluster information; reviewed by Guozhang Wang 2015-03-24 15:48:46 -07:00
Guozhang Wang c62cff3559 trivial fix on coding style 2015-03-19 16:10:23 -07:00
Guozhang Wang b2c833aa41 KAFKA-1910; Fix two bugs on MemoryRecords and KafkaConsumer; reviewed by Onur Karaman 2015-03-19 15:52:54 -07:00
Guozhang Wang 1caaf6db40 KAFKA-1863; Add docs for possible thrown exception in Callback; reviewed by Jiangjie Qin 2015-03-13 15:17:08 -07:00
Jiangjie Qin c41c7b40b6 KAFKA-1997; Refactor MirrorMaker based on KIP-3; reviewed by Joel Koshy and Guozhang Wang 2015-03-13 15:07:48 -07:00
Guozhang Wang 01f20e029f KAFKA-1910 Follow-up again; fix ListOffsetResponse handling for the expected error codes 2015-03-11 16:25:21 -07:00
Guozhang Wang 1eb5f53aa4 KAFKA-1910; missed follow-up changes 2015-03-10 17:31:17 -07:00
Guozhang Wang 01d2a25235 KAFKA-1910; follow-up on fixing buffer.flip on produce requests 2015-03-10 16:18:00 -07:00
Guozhang Wang 0b92cec1e0 KAFKA-1910; Refactor new consumer and fixed a bunch of corner cases / unit tests; reviewed by Onur Karaman and Jay Kreps 2015-03-10 11:19:48 -07:00
Joe Stein 8f0003f9b6 KAFKA-1845 KafkaConfig should use ConfigDef patch by Andrii Biletskyi reviewed by Gwen Shapira 2015-03-05 09:53:27 -05:00
Tong Li 3a9f4b833b KAFKA-1988; Fix org.apache.kafka.common.utils.Utils.abs and add Partitioner.toPositive; reviewed by Jun Rao and Guozhang Wang 2015-03-03 17:15:30 -08:00
Jay Kreps 0636928d96 KAFKA-1865 Add a flush() method to the producer. 2015-02-28 14:11:59 -08:00
Jun Rao 10311c1389 kafka-1984; java producer may miss an available partition; patched by Jun Rao; reviewed by Ewen Cheslack-Postava, Jay Kreps, and Guozhang Wang 2015-02-24 14:07:27 -08:00
Jay Kreps 19031823c1 KAFKA-1919: Always update the metadata, when a metadata response is received to ensure we back off. 2015-02-21 15:39:23 -08:00
Parth Brahmbhatt 5b949c7b1a KAFKA-1805; ProducerRecord should implement equals and hashCode; reviewed by Guozhang Wang 2015-02-17 16:18:35 -08:00
Gwen Shapira eab4f4c9f4 KAFKA-1697; Remove support for producer ack > 1 on the broker; reviewed by Joel Koshy 2015-02-13 13:08:10 -08:00
Guozhang Wang 0839def4bd KAFKA-1925; Fix coordinator broker id stuck with INT_MIN; reviewed by Jay Kreps 2015-02-09 09:33:16 -08:00
Jay Kreps 1c6d5bbac6 KAFKA-1915: Add checkstyle for java code. 2015-02-03 09:16:55 -08:00
Jay Kreps 0699ff2ce6 KAFKA-1760: New consumer. 2015-01-29 02:55:35 -08:00
Manikumar Reddy a611178408 KAFKA-1723 (delta patch to fix javadoc); make the metrics name in new producer more standard; patched by Manikumar Reddy; reviewed by Jun Rao 2015-01-14 12:02:50 -08:00
Jun Rao bfb2da3c82 trivial change to add byte serializer to ProducerPerformance; patched by Jun Rao 2015-01-13 09:54:54 -08:00
Manikumar Reddy 688e38ce45 KAFKA-1723; make the metrics name in new producer more standard; patched by Manikumar Reddy; reviewed by Jay Kreps and Jun Rao 2015-01-12 22:02:02 -08:00
Jun Rao 6f4dea9dbc kafka-1797; (missed parametric in a few files) add the serializer/deserializer api to the new java client; patched by Jun Rao 2015-01-12 21:29:40 -08:00
Jaikiran Pai ad4883a0cd KAFKA-1836 metadata.fetch.timeout.ms set to zero blocks forever; reviewed by Neha Narkhede and Ewen Cheslack-Postava 2015-01-12 15:59:16 -08:00
Jun Rao a93ef199b2 kafka-1797; (addressing Manikumar Reddy's comment) add the serializer/deserializer api to the new java client; patched by Jun Rao; reviewed by Manikumar Reddy and Neha Narkhede 2015-01-09 11:27:00 -08:00
Jun Rao 517503db26 kafka-1797; (delta follow-up patch) add the serializer/deserializer api to the new java client; patched by Jun Rao; reviewed by Neha Narkhede 2015-01-06 12:10:04 -08:00
Jun Rao 50b734690a kafka-1797; (follow-up patch) add the serializer/deserializer api to the new java client; patched by Jun Rao; reviewed by Jay Kreps 2015-01-06 11:40:26 -08:00
Ewen Cheslack-Postava 4471dc08b6 kafka-1642; (followup patch) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost; patched by Ewen Cheslack-Postava; patched by Ewen Cheslack-Postava; reviewed by Jun Rao 2015-01-06 10:56:32 -08:00
Jun Rao 92d1d4cd31 kafka-1797; add the serializer/deserializer api to the new java client; patched by Jun Rao; reviewed by Neha Narkhede 2014-12-17 16:29:09 -08:00
Ewen Cheslack-Postava 4fc74958e3 KAFKA-1807 Improve accuracy of ProducerPerformance target throughput; reviewed by Neha Narkhede 2014-12-05 09:18:34 -08:00
dokovan b24f9c0890 kafka-1798; ConfigDef.parseType() should throw exception on invalid boolean value; patched by dokovan; reviewed by Jun Rao 2014-12-01 16:24:31 -08:00
Manikumar Reddy 74bc8860c3 kafka-1799; (add missing test file) ProducerConfig.METRIC_REPORTER_CLASSES_CONFIG doesn't work; patched by Manikumar Reddy; reviewed by Jun Rao 2014-12-01 16:04:01 -08:00
Manikumar Reddy 8a719e0372 kafka-1799; ProducerConfig.METRIC_REPORTER_CLASSES_CONFIG doesn't work; patched by Manikumar Reddy; reviewed by Jun Rao 2014-12-01 16:02:47 -08:00
Dmytro Kostiuchenko 834b641980 kafka-1667; topic-level configuration not validated; patched by Dmytro Kostiuchenko; reviewed by Jun Rao 2014-11-25 14:36:31 -08:00
Ewen Cheslack-Postava 7d89867c05 kafka-1642; [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost; patched by Ewen Cheslack-Postava; reviewed by Guozhang Wang and Jun Rao 2014-11-14 14:30:04 -08:00
Guozhang Wang 2cd9ae7454 KAFKA-1762; Update max-inflight-requests doc-string in producer config to note risk of reordering in the presence of retries 2014-11-12 15:55:03 -08:00
Ewen Cheslack-Postava 4b095760cb kafka-1698; Validator.ensureValid() only validates default config value; patched by Ewen Cheslack-Postava; reviewed by Jun Rao 2014-10-20 18:02:00 -07:00
James Oliver 37356bfee0 kafka-1493; Use a well-documented LZ4 compression format and remove redundant LZ4HC option; patched by James Oliver; reviewed by Jun Rao 2014-10-17 10:07:34 -07:00
Ewen Cheslack-Postava 0d65f043fe KAFKA-1471 Add producer unit tests for LZ4 and LZ4HC compression codecs; patched by James Oliver; reviewed by Neha Narkhede 2014-10-12 16:15:54 -07:00
Ewen Cheslack-Postava 7062ed7db3 KAFKA-1692 Include client ID in new producer IO thread name; reviewed by Neha Narkhede 2014-10-12 15:50:48 -07:00
Gwen Shapira 043190c601 kafka-1555; provide strong consistency with reasonable availability; patched by Gwen Shapira; reviewed by Joel Koshy and Jun Rao 2014-10-09 18:26:03 -07:00
Sriharsha Chintalapani c940470e32 kafka-1670; Corrupt log files for segment.bytes values close to Int.MaxInt; patched by Sriharsha Chintalapani; reviewed by Jay Kreps and Jun Rao 2014-10-09 08:05:32 -07:00
Jun Rao f452c426bb kafka-1673; potential java.lang.IllegalStateException in BufferPool.allocate(); patched by Jun Rao; reviewed by Jay Kreps 2014-10-06 07:45:23 -07:00
Krzysztof Szafrański be5edd2f8d kafka-1123; Broker IPv6 addresses parsed incorrectly; patched by Krzysztof Szafrański; reviewed by Jun Rao 2014-09-18 15:53:48 -07:00
Dong Lin aa775a199e kafka-1609; New producer metadata response handling should only exclude a PartitionInfo when its error is LEADER_NOT_AVAILABLE; patched by Dong Lin; reviewed by Jun Rao 2014-08-22 17:05:33 -07:00
Jonathan Natkins c6f08b6094 KAFKA-1580; Reject producer requests to internal topics; reviewed by Joel Koshy and Neha Narkhede 2014-08-15 15:49:54 -07:00
Jun Rao 0386790e75 trivial change to remove a compilation warning; patched by Jun Rao 2014-08-04 21:24:05 -07:00
Jun Rao 1d2e776d8c kafka-1571; MetadataTest hangs; patched by Jun Rao; reviewed by Guozhang Wang 2014-08-04 21:19:49 -07:00
Jun Rao 50f2b245c1 kafka-1542 (trivail followup patch to fix NullPointerException); normal IOException in the new producer is logged as ERROR; patched by Jun Rao 2014-07-28 10:58:58 -07:00
David Corley fa34841d98 kafka-1542; normal IOException in the new producer is logged as ERROR; patched by David Corley; reviewed by Jun Rao 2014-07-27 10:55:30 -07:00
Guozhang Wang ff05e9b361 kafka-1533; transient unit test failure in ProducerFailureHandlingTest; reviewed by Guozhang Wang; reviewed by Jun Rao 2014-07-22 14:14:19 -07:00
Jun Rao fc0e03f791 kafka-1462; Add new request and response formats for the new consumer and coordinator communication; patched by Jun Rao; reviewed by Guozhang Wang and Jay Kreps 2014-07-17 18:20:01 -07:00
Jay Kreps 83a9aa55d3 KAFKA-1515 Producer can hang during metadata updates. Patch by Guozhang. 2014-07-11 13:08:24 -07:00
Alan Lee 8034390ef0 kafka-1406; Fix scaladoc/javadoc warnings; patched by Alan Lee; reviewed by Jun Rao 2014-07-10 09:45:05 -07:00
Jay Kreps cd3ce27d4b KAFKA-1515 Fix a bug that could result in blocking for a long period of time in the producer. Patch from Guozhang Wang. 2014-07-08 13:16:56 -07:00
Jay Kreps e3dfad304e KAFKA-1498 Follow-up: add metric on avg record size. 2014-07-01 14:47:57 -07:00
Jay Kreps f1c6e97d71 KAFKA-1498 Misc. producer performance enhancements. Patch from Guozhang. 2014-07-01 13:21:36 -07:00
Jay Kreps d0c019a07e KAFKA-1316 Follow-up patch for concurrent modification exception. 2014-06-19 13:52:56 -07:00
Jay Kreps 548d1ba093 KAFKA-1326 Refactor Sender to support consumer. 2014-06-10 17:41:29 -07:00
Jun Rao dcc88408c9 KAFKA-1488; new metrics for measuring the ratio when the new producer is block for space allocation; patched by Jun Rao; reviewed by Guozhang Wang and Joel Koshy 2014-06-10 17:14:45 -07:00
Dong Lin bb01847579 KAFKA-1472; Add the compression ratio metrics in the new producer; patched by Dong Lin; reviewed by Guozhang Wang and Jun Rao 2014-06-10 16:51:10 -07:00
Jay Kreps 02311c0642 KAFKA-1468 Misc. improvements from benchmarking. 2014-05-31 15:05:45 -07:00
Joe Stein 547ccedcfa KAFKA-1456 Add LZ4 and LZ4C as a compression codec patch by James Oliver reviewed by Joe Stein 2014-05-26 11:34:50 -04:00
Neha Narkhede bf83131dff KAFKA-1328 follow up: Updated javadoc 2014-05-20 22:11:19 -07:00
Neha Narkhede c24740c7b0 KAFKA-1328 New consumer APIs; reviewed by Jun Rao and Guozhang Wang 2014-05-20 16:49:31 -07:00
Jay Kreps 99f10739b5 KAFKA-1445 Send all partitions, regardless of how full, whenever we are sending a request to a broker. Patch from Guozhang. 2014-05-15 16:56:45 -07:00
Guozhang Wang 93af67cd4f kafka-1359; Followup on K1359: change nanoTime to currentTimeMillis in metrics; patched by Guozhang Wang; reviewed by Neha Narkhede, Jun Rao 2014-04-22 17:47:55 -07:00
Jay Kreps ec075c5a85 KAFKA-1359: Ensure all topic/server metrics registered at once. 2014-04-16 10:19:18 -07:00
Guozhang Wang 8f94bc3315 KAFKA-1366 Multiple Unit Test failures with new producer; reviewed by Neha Narkhede 2014-04-08 10:15:08 -07:00
Jay Kreps 640f3b05ef KAFKA-1337 Rationalize the producer configs. 2014-04-04 13:55:47 -07:00
Jay Kreps 98952b3cc7 KAFKA-1251 Further metric naming standardization. 2014-04-01 12:48:44 -07:00
Timothy Chen 083b6265c9 KAFKA-1341 Client Selector doesn't check connection id properly; reviewed by Jay Kreps and Neha Narkhede 2014-03-31 22:36:42 -07:00
Jay Kreps e287e02b12 KAFKA-1251 Missed one per-node metric. 2014-03-27 21:00:33 -07:00
Jay Kreps 23d7fc4706 KAFKA-1251: Add metrics to the producer. 2014-03-27 20:52:42 -07:00
Neha Narkhede 9bc47bc136 KAFKA-1253 Compression in the new producer: follow up patch to push new files 2014-03-26 21:50:30 -07:00
Guozhang Wang 466a83b78c KAFKA-1253 Compression in the new producer; reviewed by Jay Kreps and Jun Rao 2014-03-26 21:49:06 -07:00
Jun Rao 74e2209251 kafka-1304; unregistered mbean exception in new producer; reviewed by Jay Kreps 2014-03-18 10:55:19 -07:00
Jun Rao cc859dcca7 kafka-1307; potential socket leak in new producer and clean up; reviewed by Jay Kreps, Guozhang Wang and Neha Narkhede 2014-03-18 10:52:34 -07:00
Jun Rao 84a3a9a3d9 kafka-1302; cleanup logging in new producer; reviewed by Jay Kreps, Guozhang Wang and Neha Narkhede 2014-03-13 14:25:37 -07:00
Jun Rao c124bbbb6c kafka-1301; system testcase_0206 fails using the new producer; patched by Jun Rao; reviewed by Jay Kreps 2014-03-11 20:56:32 -07:00
Neha Narkhede 74c54c7eeb KAFKA-1281 add the new producer to existing tools; reviewed by Jun Rao and Guozhang Wang 2014-03-06 18:08:55 -08:00
Jay Kreps 4524f384dc KAFKA-1286: Trivial fix up: Use || instead of |. 2014-03-05 14:35:07 -08:00
Jay Kreps 2404191be9 KAFKA-1286 Follow-up comment from Jun: Change the backoff default time configuration. 2014-03-05 13:32:08 -08:00
Jay Kreps 5ba48348b3 KAFKA-1286 Retry can block. Patch from Guozhang, reviewed by jay. 2014-03-04 20:07:00 -08:00
Jun Rao 220cc842a6 kafka-1285; enable log4j in unit test; patched by Jun Rao; reviewed by Neha Narkhede 2014-02-28 13:53:37 -08:00
Jay Kreps f1a53b972e KAFKA-1250 Add logging to new producer. 2014-02-27 18:04:50 -08:00
Guozhang Wang 5e2a9a560d KAFKA-1260 Integration Test for New Producer Part II: Broker Failure Handling; reviewed by Jay Kreps, Neha Narkhede and Jun Rao 2014-02-27 10:50:26 -08:00
Joe Stein a8297cc6ca KAFKA-1254 remove vestigial sbt patch by Joe Stein; reviewed by Jun Rao 2014-02-20 00:11:31 -05:00
Jay Kreps 3f0b67b6ac KAFKA-1252 Implement retries in new producer. 2014-02-18 17:18:13 -08:00
Jay Kreps 7e154a36f7 KAFKA-1261 Make it possible to configure the metadata refresh. 2014-02-13 10:54:07 -08:00
Guozhang Wang 84a5803a7e KAFKA-1233 Follow up changes to new producer integration test; reviewed by Jay Kreps 2014-02-12 12:50:33 -08:00
Jay Kreps ef1e30bf5b KAFKA-1259 Close blocked only until all messages had been sent not until all acknowledgements had been received. 2014-02-11 19:52:49 -08:00
Jay Kreps e1845ba1d8 KAFKA-1257 Only send metadata requests to nodes with no in-flight requests. 2014-02-11 19:51:43 -08:00
Jay Kreps 6b80dbb97b KAFKA-1236 Fix various breakages in the perf tests. Make the producer test use either the old or the new producer. 2014-02-10 20:49:08 -08:00
Jay Kreps 02bb382621 Fix bug in ByteBufferSend that lead to incorrect complete() method. 2014-02-09 15:20:33 -08:00
Jay Kreps d2ec321a03 KAFKA-1238 Move metadata req/resp parsing into its own classes and avoid updating cluster metadata if there are no available nodes. 2014-02-09 15:20:33 -08:00
Jay Kreps 962b5475cb KAFKA-1241 Better error message for underflow on read of struct. 2014-02-09 15:20:32 -08:00
Jun Rao 36eae8f63c trivial fix to add missing license header using .gradlew licenseFormatMain and ./gradlew licenseFormatTest; patched by Jun Rao 2014-02-07 14:19:06 -08:00
Jay Kreps fa6339c19c Rename client package from kafka.* to org.apache.kafka.* 2014-02-06 16:25:11 -08:00
Jay Kreps 3220af1fe2 TRIVIAL: Fix misc. numerical issues in histogram. 2014-02-06 10:49:37 -08:00
Jay Kreps 253f86e310 Implement a few of the API suggestions from the mailing list. 2014-02-04 08:39:56 -08:00
Jay Kreps 269d16d3c9 KAFKA-1227 New producer! 2014-01-28 11:15:05 -08:00
Joe Stein e9d07d72fa KAFKA-534 remove client library directory 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1390784 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-27 00:21:45 +00:00
Jun Rao 5e0e0b17fb reverting previous commit for KAFKA-296 because patch didn't apply cleanly 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300801 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-15 00:39:42 +00:00
Jun Rao 66d8073156 Update Go Client to new version of Go; patched by AaronR; KAFKA-296 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1300777 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-14 22:58:57 +00:00
Joe Stein ccc464c19a Niek Sanders - KAFKA-284 fixed compilation issue for cpp client 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1295388 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-01 02:47:03 +00:00
Neha Narkhede 5c3d5d815c KAFKA-177 Remove the clojure clients until correctly implemented and refactored; patched by nehanarkhede; reviewd by jefferydamick 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1195281 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-30 23:46:41 +00:00
Neha Narkhede 12572102c6 KAFKA-177 Remove the clojure clients until correctly implemented and refactored; patched by nehanarkhede; reviewd by jefferydamick 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1195249 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-30 21:17:13 +00:00
Neha Narkhede 14a1f0dcd6 KAFKA 158 Support for compression in go clients; patched by jeffregydamick; reviewed by nehanarkhede 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1189773 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 14:24:27 +00:00
Edward Jay Kreps a0b2aa8847 KAFKA-162 Upgrade the python client to use the new message format. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1186535 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:14:50 +00:00
Jun Rao c2dc9c0841 Php Client support for compression attribute; patched by AaronR; KAFKA-159 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1185774 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 17:57:29 +00:00
Jun Rao e39c11abbc Add compression to C# client; patched by Eric Hauser; KAFKA-153 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1185772 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 17:52:13 +00:00
Neha Narkhede 3f0046be1b KAFKA-143 Fixing source code files to have the Apache license header ;patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1183191 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:32:41 +00:00
Neha Narkhede e27136d81a KAFKA-141 Follow up patch to fix the cpp files; patched by Lorenzo, nehanarkhede; reviewed by junrao, jjkoshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1182158 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 01:05:28 +00:00
Neha Narkhede c7fb464938 KAFKA-143 Check and make sure that all source code distributed by the project is covered by one or more approved licenses; patched by nehanarkhede; reviewed by junrao 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1182023 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-11 19:00:28 +00:00
Neha Narkhede fa09aacdbd KAFKA-141 Check and make sure that the files that have been donated have been updated to reflect the new ASF copyright;patched by nehanarkhede; reviewd by jjkoshy 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180185 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 19:51:28 +00:00
Neha Narkhede f34dfc002d Reverting accidental commit 1180110, which is pending review for KAFKA-141 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180117 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 17:33:43 +00:00
Neha Narkhede a99becbe49 Minor patch, removing the .gitigore file 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1180110 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-07 17:18:56 +00:00
Jun Rao 61433bf0a2 ruby kafka gem is not functional; patched by Pierre-Yves Ritschard; KAFKA-135 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1175972 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-26 17:41:02 +00:00
Jun Rao d772600c7b Fix ASF license headers for C# client; patched by Eric Hauser; #KAFKA-137 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1174493 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-23 01:44:40 +00:00
Jun Rao dc66fd9a4b enhancements to .Net; patched by Eric Hauser; KAFKA-85 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1173797 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-21 19:17:19 +00:00
Henry Saputra d0c980dab2 KAFKA-93 | add license to missed files and remove LinkedIn copyright line per ASF guideline. Thanks to Joel Koshy for pointing it out 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1156299 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 18:32:09 +00:00
Edward Jay Kreps 642da2f28c Initial checkin of Kafka to Apache SVN. This corresponds to 709afe4ec7 except that git specific files have been removed and code has been put into trunk/branches/site/etc. This is just a copy of master, branches and history are not being converted since we can't find a good tool for it. 
git-svn-id: https://svn.apache.org/repos/asf/incubator/kafka/trunk@1152970 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-01 23:41:24 +00:00