Go to file
Jay Kreps 3f0b67b6ac KAFKA-1252 Implement retries in new producer. 2014-02-18 17:18:13 -08:00
bin KAFKA-1236 Fix various breakages in the perf tests. Make the producer test use either the old or the new producer. 2014-02-10 20:49:08 -08:00
clients KAFKA-1252 Implement retries in new producer. 2014-02-18 17:18:13 -08:00
config Update description of num.partitions config in sample server properties - issue reported by Vaibhav Puranik 2013-11-25 19:46:42 -08:00
contrib trivial typo fix; patched by Moritz Schwörer; reviewed by Jun Rao 2014-02-04 08:04:35 -08:00
core Liars in PrimitiveApiTest that promise to test api in compression mode, but don't do this actually; patched by Kostya Golikov; reviewed by Guozhang Wang and Jun Rao 2014-02-17 11:43:45 -08:00
examples kafka-1205; README in examples not update; patched by Ailing Zhang; reviewed by Jun Rao 2014-01-17 08:29:28 -08:00
gradle kafka-1171; Gradle build for Kafka; patched by David Arthur, Joe Stein, Chris Freeman and Jun Rao; reviewed by Guozhang Wang, Joel Koshy and Neha Narkhede 2014-02-07 13:48:04 -08:00
lib Updated SBT JAR to 0.12.1 2013-01-07 10:42:01 -07:00
perf KAFKA-1236 Fix various breakages in the perf tests. Make the producer test use either the old or the new producer. 2014-02-10 20:49:08 -08:00
project KAFKA-1236 Fix various breakages in the perf tests. Make the producer test use either the old or the new producer. 2014-02-10 20:49:08 -08:00
system_test KAFKA-1164 kafka should depend on snappy 1.0.5 (instead of 1.0.4.1); reviewed by Neha Narkhede 2014-02-03 21:16:55 -08:00
.gitignore Re-applied old patch from KAFKA-139 2012-12-14 17:12:38 -07:00
.rat-excludes KAFKA-151 Standard .rat-excludes file and rat script;patched by nehanarkhede; reviewed by junrao 2011-10-14 01:30:12 +00:00
.reviewboardrc KAFKA-1053 Kafka patch review tool that integrates JIRA and reviewboard; reviewed by Joel Koshy, Swapnil Ghike and Guozhang Wang 2013-09-17 20:48:15 -07:00
HEADER trivial fix to add missing license header using .gradlew licenseFormatMain and ./gradlew licenseFormatTest; patched by Jun Rao 2014-02-07 14:19:06 -08:00
LICENSE KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing client libraries from repo 2012-09-27 00:25:23 +00:00
NOTICE KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing client libraries from repo 2012-09-27 00:25:23 +00:00
README-sbt.md kafka-1171; Gradle build for Kafka; patched by David Arthur, Joe Stein, Chris Freeman and Jun Rao; reviewed by Guozhang Wang, Joel Koshy and Neha Narkhede 2014-02-07 13:48:04 -08:00
README.md KAFKA-1263 Snazzy up the README markdown for better visibility on github; patched by Joe Stein; reviewed by Neha Narkhede 2014-02-13 22:45:53 -05:00
build.gradle KAFKA-1245 the jar files and pom are not being signed so nexus is failing to publish them patch by Joe Stein; Reviewed by Jun Rao 2014-02-14 14:15:32 -05:00
gradle.properties KAFKA-1245 the jar files and pom are not being signed so nexus is failing to publish them patch by Joe Stein; Reviewed by Jun Rao 2014-02-14 14:15:32 -05:00
gradlew kafka-1171; Gradle build for Kafka; patched by David Arthur, Joe Stein, Chris Freeman and Jun Rao; reviewed by Guozhang Wang, Joel Koshy and Neha Narkhede 2014-02-07 13:48:04 -08:00
kafka-patch-review.py KAFKA-1142 Patch review tool should take diff with origin from last divergent point; reviewed by Neha Narkhede 2013-12-11 16:20:38 -08:00
sbt kafka-843; Re-add the release-zip sbt target; patched by Cosmin Lehene; reviewed by Jun Rao 2013-04-11 11:01:11 -07:00
sbt.bat provides windows batch script for starting Kafka/Zookeeper; patched by Antoine Vianey; reviewed by Jun Rao; kafka-581 2012-10-24 16:57:56 +00:00
scala.gradle kafka-1244,kafka-1246,kafka-1249; various gradle issues for release; patched by Jun Rao; reviewed by Neha Narkhede 2014-02-12 08:22:51 -08:00
settings.gradle kafka-1244,kafka-1246,kafka-1249; various gradle issues for release; patched by Jun Rao; reviewed by Neha Narkhede 2014-02-12 08:22:51 -08:00

README.md

Apache Kafka

See our web site for details on the project.

Building a jar and running it

./gradlew jar  

Follow instuctions in http://kafka.apache.org/documentation.html#quickstart

Running unit tests

./gradlew test

Forcing re-running unit tests w/o code change

./gradlew cleanTest test

Running a particular unit test

./gradlew -Dtest.single=RequestResponseSerializationTest core:test

Building a binary release gzipped tar ball

./gradlew clean
./gradlew releaseTarGz  

The release file can be found inside ./core/build/distributions/.

Cleaning the build

./gradlew clean

Running a task on a particular version of Scala

either 2.8.0, 2.8.2, 2.9.1, 2.9.2 or 2.10.1) (If building a jar with a version other than 2.8.0, the scala version variable in bin/kafka-run-class.sh needs to be changed to run quick start.) ./gradlew -PscalaVersion=2.9.1 jar ./gradlew -PscalaVersion=2.9.1 test ./gradlew -PscalaVersion=2.9.1 releaseTarGz

Running a task for a specific project

This is for 'core', 'perf', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples' and 'clients' ./gradlew core:jar ./gradlew core:test

Listing all gradle tasks

./gradlew tasks

Building IDE project

./gradlew eclipse
./gradlew idea

Building the jar for all scala versions and for all projects

./gradlew jarAll

Running unit tests for all scala versions and for all projects

./gradlew testAll

Building a binary release gzipped tar ball for all scala versions

./gradlew releaseTarGzAll

Publishing the jar for all version of Scala and for all projects to maven

./gradlew uploadArchivesAll

Please note for this to work you need to create/update ~/.gradle/gradle.properties and assign the following variables

mavenUrl=
mavenUsername=
mavenPassword=
signing.keyId=
signing.password=
signing.secretKeyRingFile=

Building the test jar

./gradlew testJar

Determining how transitive dependencies are added

./gradlew core:dependencies --configuration runtime

Contribution

Apache Kafka interested in building the community; we would welcome any thoughts or patches. You can reach us on the Apache mailing lists.

To contribute follow the instructions here:

We also welcome patches for the website and documentation which can be found here: