mirror of https://github.com/apache/kafka.git
kafka-1171; Gradle build for Kafka; patched by David Arthur, Joe Stein, Chris Freeman and Jun Rao; reviewed by Guozhang Wang, Joel Koshy and Neha Narkhede
This commit is contained in:
parent
8c9a7811c4
commit
52614ad65e
|
@ -0,0 +1,16 @@
|
|||
Licensed to the Apache Software Foundation (ASF) under one
|
||||
or more contributor license agreements. See the NOTICE file
|
||||
distributed with this work for additional information
|
||||
regarding copyright ownership. The ASF licenses this file
|
||||
to you under the Apache License, Version 2.0 (the
|
||||
"License"); you may not use this file except in compliance
|
||||
with the License. You may obtain a copy of the License at
|
||||
|
||||
http://www.apache.org/licenses/LICENSE-2.0
|
||||
|
||||
Unless required by applicable law or agreed to in writing,
|
||||
software distributed under the License is distributed on an
|
||||
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
||||
KIND, either express or implied. See the License for the
|
||||
specific language governing permissions and limitations
|
||||
under the License.
|
|
@ -0,0 +1,60 @@
|
|||
# Apache Kafka #
|
||||
|
||||
See our [web site](http://kafka.apache.org) for details on the project.
|
||||
|
||||
## Building it ##
|
||||
1. ./sbt update
|
||||
2. ./sbt package
|
||||
3. ./sbt assembly-package-dependency
|
||||
|
||||
To build for a particular version of Scala (either 2.8.0, 2.8.2, 2.9.1, 2.9.2 or 2.10.1), change step 2 above to:
|
||||
2. ./sbt "++2.8.0 package"
|
||||
|
||||
To build for all supported versions of Scala, change step 2 above to:
|
||||
2. ./sbt +package
|
||||
|
||||
## Running it ##
|
||||
Follow instuctions in http://kafka.apache.org/documentation.html#quickstart
|
||||
|
||||
## Running unit tests ##
|
||||
./sbt test
|
||||
|
||||
## Building a binary release zip or gzipped tar ball ##
|
||||
./sbt release-zip
|
||||
./sbt release-tar
|
||||
The release file can be found inside ./target/RELEASE/.
|
||||
|
||||
## Other Build Tips ##
|
||||
Here are some useful sbt commands, to be executed at the sbt command prompt (./sbt). Prefixing with "++<version> " runs the
|
||||
command for a specific Scala version, prefixing with "+" will perform the action for all versions of Scala, and no prefix
|
||||
runs the command for the default (2.8.0) version of Scala. -
|
||||
|
||||
tasks : Lists all the sbt commands and their descriptions
|
||||
clean : Deletes all generated files (the target directory).
|
||||
compile : Compile all the sub projects, but not create the jars
|
||||
test : Run all unit tests in all sub projects
|
||||
release-zip : Create all the jars, run unit tests and create a deployable release zip
|
||||
release-tar : Create all the jars, run unit tests and create a deployable release gzipped tar tall
|
||||
package: Creates jars for src, test, docs etc
|
||||
projects : List all the sub projects
|
||||
project sub_project_name : Switch to a particular sub-project. For example, to switch to the core kafka code, use "project core-kafka"
|
||||
|
||||
The following commands can be run only on a particular sub project -
|
||||
test-only package.test.TestName : Runs only the specified test in the current sub project
|
||||
run : Provides options to run any of the classes that have a main method. For example, you can switch to project java-examples, and run the examples there by executing "project java-examples" followed by "run"
|
||||
|
||||
For more details please see the [SBT documentation](https://github.com/harrah/xsbt/wiki)
|
||||
|
||||
## Contribution ##
|
||||
|
||||
Kafka is a new project, and we are interested in building the community; we would welcome any thoughts or [patches](https://issues.apache.org/jira/browse/KAFKA). You can reach us [on the Apache mailing lists](http://kafka.apache.org/contact.html).
|
||||
|
||||
To contribute follow the instructions here:
|
||||
* http://kafka.apache.org/contributing.html
|
||||
|
||||
We also welcome patches for the website and documentation which can be found here:
|
||||
* https://svn.apache.org/repos/asf/kafka/site
|
||||
|
||||
|
||||
|
||||
|
104
README.md
104
README.md
|
@ -1,49 +1,77 @@
|
|||
# Apache Kafka #
|
||||
# Licensed to the Apache Software Foundation (ASF) under one or more
|
||||
# contributor license agreements. See the NOTICE file distributed with
|
||||
# this work for additional information regarding copyright ownership.
|
||||
# The ASF licenses this file to You under the Apache License, Version 2.0
|
||||
# (the "License"); you may not use this file except in compliance with
|
||||
# the License. You may obtain a copy of the License at
|
||||
#
|
||||
# http://www.apache.org/licenses/LICENSE-2.0
|
||||
#
|
||||
# Unless required by applicable law or agreed to in writing, software
|
||||
# distributed under the License is distributed on an "AS IS" BASIS,
|
||||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||
# See the License for the specific language governing permissions and
|
||||
# limitations under the License.
|
||||
|
||||
# Apache Kafka #
|
||||
See our [web site](http://kafka.apache.org) for details on the project.
|
||||
|
||||
## Building it ##
|
||||
1. ./sbt update
|
||||
2. ./sbt package
|
||||
3. ./sbt assembly-package-dependency
|
||||
|
||||
To build for a particular version of Scala (either 2.8.0, 2.8.2, 2.9.1, 2.9.2 or 2.10.1), change step 2 above to:
|
||||
2. ./sbt "++2.8.0 package"
|
||||
|
||||
To build for all supported versions of Scala, change step 2 above to:
|
||||
2. ./sbt +package
|
||||
|
||||
## Running it ##
|
||||
Follow instuctions in http://kafka.apache.org/documentation.html#quickstart
|
||||
## Building a jar and running it ##
|
||||
1. ./gradlew copyDependantLibs
|
||||
2. ./gradlew jar
|
||||
3. Follow instuctions in http://kafka.apache.org/documentation.html#quickstart
|
||||
|
||||
## Running unit tests ##
|
||||
./sbt test
|
||||
./gradlew test
|
||||
|
||||
## Building a binary release zip or gzipped tar ball ##
|
||||
./sbt release-zip
|
||||
./sbt release-tar
|
||||
The release file can be found inside ./target/RELEASE/.
|
||||
## Forcing re-running unit tests w/o code change ##
|
||||
./gradlew cleanTest test
|
||||
|
||||
## Other Build Tips ##
|
||||
Here are some useful sbt commands, to be executed at the sbt command prompt (./sbt). Prefixing with "++<version> " runs the
|
||||
command for a specific Scala version, prefixing with "+" will perform the action for all versions of Scala, and no prefix
|
||||
runs the command for the default (2.8.0) version of Scala. -
|
||||
## Running a particular unit test ##
|
||||
./gradlew -Dtest.single=RequestResponseSerializationTest core:test
|
||||
|
||||
tasks : Lists all the sbt commands and their descriptions
|
||||
clean : Deletes all generated files (the target directory).
|
||||
compile : Compile all the sub projects, but not create the jars
|
||||
test : Run all unit tests in all sub projects
|
||||
release-zip : Create all the jars, run unit tests and create a deployable release zip
|
||||
release-tar : Create all the jars, run unit tests and create a deployable release gzipped tar tall
|
||||
package: Creates jars for src, test, docs etc
|
||||
projects : List all the sub projects
|
||||
project sub_project_name : Switch to a particular sub-project. For example, to switch to the core kafka code, use "project core-kafka"
|
||||
## Building a binary release gzipped tar ball ##
|
||||
./gradlew clean
|
||||
./gradlew releaseTarGz
|
||||
The release file can be found inside ./core/build/distributions/.
|
||||
|
||||
The following commands can be run only on a particular sub project -
|
||||
test-only package.test.TestName : Runs only the specified test in the current sub project
|
||||
run : Provides options to run any of the classes that have a main method. For example, you can switch to project java-examples, and run the examples there by executing "project java-examples" followed by "run"
|
||||
## Cleaning the build ##
|
||||
./gradlew clean
|
||||
|
||||
For more details please see the [SBT documentation](https://github.com/harrah/xsbt/wiki)
|
||||
## Running a task on a particular version of Scala (either 2.8.0, 2.8.2, 2.9.1, 2.9.2 or 2.10.1) ##
|
||||
## (If building a jar with a version other than 2.8.0, the scala version variable in bin/kafka-run-class.sh needs to be changed to run quick start.) ##
|
||||
./gradlew -PscalaVersion=2.9.1 jar
|
||||
./gradlew -PscalaVersion=2.9.1 test
|
||||
./gradlew -PscalaVersion=2.9.1 releaseTarGz
|
||||
|
||||
## Running a task for a specific project in 'core', 'perf', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples', 'clients' ##
|
||||
./gradlew core:jar
|
||||
./gradlew core:test
|
||||
|
||||
## Listing all gradle tasks ##
|
||||
./gradlew tasks
|
||||
|
||||
# Building IDE project ##
|
||||
./gradlew eclipse
|
||||
./gradlew idea
|
||||
|
||||
# Building the jar for all scala versions and for all projects ##
|
||||
./gradlew jarAll
|
||||
|
||||
## Running unit tests for all scala versions and for all projects ##
|
||||
./gradlew testAll
|
||||
|
||||
## Building a binary release gzipped tar ball for all scala versions ##
|
||||
./gradlew releaseTarGzAll
|
||||
|
||||
## Publishing the jar for all version of Scala and for all projects to maven (To test locally, change mavenUrl in gradle.properties to a local dir.) ##
|
||||
./gradlew uploadArchivesAll
|
||||
|
||||
## Building the test jar ##
|
||||
./gradlew testJar
|
||||
|
||||
## Determining how transitive dependencies are added ##
|
||||
./gradlew core:dependencies --configuration runtime
|
||||
|
||||
## Contribution ##
|
||||
|
||||
|
@ -54,7 +82,3 @@ To contribute follow the instructions here:
|
|||
|
||||
We also welcome patches for the website and documentation which can be found here:
|
||||
* https://svn.apache.org/repos/asf/kafka/site
|
||||
|
||||
|
||||
|
||||
|
||||
|
|
|
@ -32,13 +32,40 @@ if [ -z "$SCALA_VERSION" ]; then
|
|||
SCALA_VERSION=2.8.0
|
||||
fi
|
||||
|
||||
# TODO: remove when removing sbt
|
||||
# assume all dependencies have been packaged into one jar with sbt-assembly's task "assembly-package-dependency"
|
||||
for file in $base_dir/core/target/scala-${SCALA_VERSION}/*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/perf/target/scala-${SCALA_VERSION}/kafka*.jar;
|
||||
# run ./gradlew copyDependantLibs to get all dependant jars in a local dir
|
||||
for file in $base_dir/core/build/dependant-libs-${SCALA_VERSION}/*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/perf/build/libs//kafka-perf_${SCALA_VERSION}*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/clients/build/libs//kafka-clients*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/examples/build/libs//kafka-examples*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/contrib/hadoop-consumer/build/libs//kafka-hadoop-consumer*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/contrib/hadoop-producer/build/libs//kafka-hadoop-producer*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
@ -49,7 +76,7 @@ do
|
|||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
||||
for file in $base_dir/kafka*.jar;
|
||||
for file in $base_dir/core/build/libs/kafka_${SCALA_VERSION}*.jar;
|
||||
do
|
||||
CLASSPATH=$CLASSPATH:$file
|
||||
done
|
||||
|
|
|
@ -0,0 +1,292 @@
|
|||
// Licensed to the Apache Software Foundation (ASF) under one or more
|
||||
// contributor license agreements. See the NOTICE file distributed with
|
||||
// this work for additional information regarding copyright ownership.
|
||||
// The ASF licenses this file to You under the Apache License, Version 2.0
|
||||
// (the "License"); you may not use this file except in compliance with
|
||||
// the License. You may obtain a copy of the License at
|
||||
//
|
||||
// http://www.apache.org/licenses/LICENSE-2.0
|
||||
//
|
||||
// Unless required by applicable law or agreed to in writing, software
|
||||
// distributed under the License is distributed on an "AS IS" BASIS,
|
||||
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||
// See the License for the specific language governing permissions and
|
||||
// limitations under the License.
|
||||
|
||||
buildscript {
|
||||
repositories {
|
||||
mavenCentral()
|
||||
}
|
||||
apply from: file('gradle/buildscript.gradle'), to: buildscript
|
||||
}
|
||||
|
||||
allprojects {
|
||||
apply plugin: 'idea'
|
||||
repositories {
|
||||
mavenCentral()
|
||||
}
|
||||
}
|
||||
|
||||
apply from: file('gradle/license.gradle')
|
||||
|
||||
subprojects {
|
||||
apply plugin: 'java'
|
||||
apply plugin: 'eclipse'
|
||||
apply plugin: 'maven'
|
||||
|
||||
uploadArchives {
|
||||
repositories {
|
||||
// To test locally, replace mavenUrl in gradle.properties to file://localhost/tmp/myRepo/
|
||||
mavenDeployer {
|
||||
repository(url: "${mavenUrl}") {
|
||||
authentication(userName: "${mavenUsername}", password: "${mavenPassword}")
|
||||
}
|
||||
afterEvaluate {
|
||||
pom.artifactId = "${archivesBaseName}"
|
||||
pom.project {
|
||||
name 'Apache Kafka'
|
||||
packaging 'jar'
|
||||
url 'http://kafka.apache.org'
|
||||
licenses {
|
||||
license {
|
||||
name 'The Apache Software License, Version 2.0'
|
||||
url 'http://www.apache.org/licenses/LICENSE-2.0.txt'
|
||||
distribution 'repo'
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
tasks.withType(ScalaCompile) {
|
||||
scalaCompileOptions.useAnt = false
|
||||
configure(scalaCompileOptions.forkOptions) {
|
||||
memoryMaximumSize = '1g'
|
||||
jvmArgs = ['-XX:MaxPermSize=512m']
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
for ( sv in ['2_8_0', '2_8_2', '2_9_1', '2_9_2', '2_10_1'] ) {
|
||||
String svInDot = sv.replaceAll( "_", ".")
|
||||
|
||||
tasks.create(name: "jar_core_${sv}", type: GradleBuild) {
|
||||
buildFile = './build.gradle'
|
||||
tasks = ['core:jar']
|
||||
startParameter.projectProperties = [scalaVersion: "${svInDot}"]
|
||||
}
|
||||
|
||||
tasks.create(name: "test_core_${sv}", type: GradleBuild) {
|
||||
buildFile = './build.gradle'
|
||||
tasks = ['core:test']
|
||||
startParameter.projectProperties = [scalaVersion: "${svInDot}"]
|
||||
}
|
||||
|
||||
tasks.create(name: "releaseTarGz_${sv}", type: GradleBuild) {
|
||||
buildFile = './build.gradle'
|
||||
tasks = ['releaseTarGz']
|
||||
startParameter.projectProperties = [scalaVersion: "${svInDot}"]
|
||||
}
|
||||
|
||||
tasks.create(name: "uploadCoreArchives_${sv}", type: GradleBuild) {
|
||||
buildFile = './build.gradle'
|
||||
tasks = ['core:uploadArchives']
|
||||
startParameter.projectProperties = [scalaVersion: "${svInDot}"]
|
||||
}
|
||||
}
|
||||
|
||||
tasks.create(name: "jarAll", dependsOn: ['jar_core_2_8_0', 'jar_core_2_8_2', 'jar_core_2_9_1', 'jar_core_2_9_2', 'jar_core_2_10_1', 'clients:jar', 'perf:jar', 'examples:jar', 'contrib:hadoop-consumer:jar', 'contrib:hadoop-producer:jar']) {
|
||||
}
|
||||
|
||||
tasks.create(name: "testAll", dependsOn: ['test_core_2_8_0', 'test_core_2_8_2', 'test_core_2_9_1', 'test_core_2_9_2', 'test_core_2_10_1', 'clients:test']) {
|
||||
}
|
||||
|
||||
tasks.create(name: "releaseTarGzAll", dependsOn: ['releaseTarGz_2_8_0', 'releaseTarGz_2_8_2', 'releaseTarGz_2_9_1', 'releaseTarGz_2_9_2', 'releaseTarGz_2_10_1']) {
|
||||
}
|
||||
|
||||
tasks.create(name: "uploadArchivesAll", dependsOn: ['uploadCoreArchives_2_8_0', 'uploadCoreArchives_2_8_2', 'uploadCoreArchives_2_9_1', 'uploadCoreArchives_2_9_2', 'uploadCoreArchives_2_10_1', 'perf:uploadArchives', 'examples:uploadArchives', 'contrib:hadoop-consumer:uploadArchives', 'contrib:hadoop-producer:uploadArchives']) {
|
||||
}
|
||||
|
||||
project(':core') {
|
||||
println "Building project 'core' with Scala version $scalaVersion"
|
||||
|
||||
apply plugin: 'scala'
|
||||
archivesBaseName = "kafka_${scalaVersion}"
|
||||
|
||||
def (major, minor, trivial) = scalaVersion.tokenize('.')
|
||||
|
||||
if(major.toInteger() >= 2 && minor.toInteger() >= 9) {
|
||||
sourceSets {
|
||||
main {
|
||||
scala {
|
||||
exclude 'kafka/utils/Annotations_2.8.scala'
|
||||
}
|
||||
}
|
||||
}
|
||||
} else {
|
||||
sourceSets {
|
||||
main {
|
||||
scala {
|
||||
exclude 'kafka/utils/Annotations_2.9+.scala'
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
dependencies {
|
||||
compile "org.scala-lang:scala-library:$scalaVersion"
|
||||
compile 'org.apache.zookeeper:zookeeper:3.3.4'
|
||||
compile 'com.101tec:zkclient:0.3'
|
||||
compile 'com.yammer.metrics:metrics-core:2.2.0'
|
||||
compile 'com.yammer.metrics:metrics-annotation:2.2.0'
|
||||
compile 'net.sf.jopt-simple:jopt-simple:3.2'
|
||||
compile 'org.xerial.snappy:snappy-java:1.0.5'
|
||||
|
||||
testCompile 'junit:junit:4.1'
|
||||
testCompile 'org.easymock:easymock:3.0'
|
||||
testCompile 'org.objenesis:objenesis:1.2'
|
||||
if (scalaVersion.startsWith('2.8')) {
|
||||
testCompile 'org.scalatest:scalatest:1.2'
|
||||
} else if (scalaVersion.startsWith('2.10')) {
|
||||
testCompile 'org.scalatest:scalatest_2.10:1.9.1'
|
||||
} else {
|
||||
testCompile "org.scalatest:scalatest_$scalaVersion:1.8"
|
||||
}
|
||||
|
||||
zinc 'com.typesafe.zinc:zinc:0.2.5'
|
||||
}
|
||||
|
||||
configurations {
|
||||
// manually excludes some unnecessary dependencies
|
||||
compile.exclude module: 'javax'
|
||||
compile.exclude module: 'jline'
|
||||
compile.exclude module: 'jms'
|
||||
compile.exclude module: 'jmxri'
|
||||
compile.exclude module: 'jmxtools'
|
||||
compile.exclude module: 'mail'
|
||||
}
|
||||
|
||||
tasks.create(name: "copyDependantLibs", type: Copy) {
|
||||
into "$buildDir/dependant-libs-${scalaVersion}"
|
||||
from configurations.runtime
|
||||
}
|
||||
|
||||
tasks.create(name: "releaseTarGz", dependsOn: configurations.archives.artifacts, type: Tar) {
|
||||
into "."
|
||||
compression = Compression.GZIP
|
||||
classifier = 'dist'
|
||||
from(project.file("../bin")) { into "bin/" }
|
||||
from(project.file("../config")) { into "config/" }
|
||||
from '../LICENSE'
|
||||
from '../NOTICE'
|
||||
from(configurations.runtime) { into("libs/") }
|
||||
from(configurations.archives.artifacts.files) { into("libs/") }
|
||||
}
|
||||
|
||||
task testJar(type: Jar) {
|
||||
appendix = 'test'
|
||||
from sourceSets.test.output
|
||||
}
|
||||
|
||||
test {
|
||||
testLogging {
|
||||
events "passed", "skipped", "failed"
|
||||
exceptionFormat = 'full'
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
project(':perf') {
|
||||
println "Building project 'perf' with Scala version $scalaVersion"
|
||||
|
||||
apply plugin: 'scala'
|
||||
archivesBaseName = "kafka-perf_${scalaVersion}"
|
||||
|
||||
dependencies {
|
||||
compile project(':core')
|
||||
compile "org.scala-lang:scala-library:$scalaVersion"
|
||||
compile 'net.sf.jopt-simple:jopt-simple:3.2'
|
||||
|
||||
zinc 'com.typesafe.zinc:zinc:0.2.5'
|
||||
}
|
||||
}
|
||||
|
||||
project(':contrib:hadoop-consumer') {
|
||||
archivesBaseName = "kafka-hadoop-consumer"
|
||||
|
||||
dependencies {
|
||||
compile project(':core')
|
||||
compile "org.apache.avro:avro:1.4.0"
|
||||
compile "org.apache.pig:pig:0.8.0"
|
||||
compile "commons-logging:commons-logging:1.0.4"
|
||||
compile "org.codehaus.jackson:jackson-core-asl:1.5.5"
|
||||
compile "org.codehaus.jackson:jackson-mapper-asl:1.5.5"
|
||||
compile "org.apache.hadoop:hadoop-core:0.20.2"
|
||||
compile files('lib/piggybank.jar')
|
||||
}
|
||||
|
||||
configurations {
|
||||
// manually excludes some unnecessary dependencies
|
||||
compile.exclude module: 'javax'
|
||||
compile.exclude module: 'jms'
|
||||
compile.exclude module: 'jmxri'
|
||||
compile.exclude module: 'jmxtools'
|
||||
compile.exclude module: 'mail'
|
||||
compile.exclude module: 'netty'
|
||||
}
|
||||
}
|
||||
|
||||
project(':contrib:hadoop-producer') {
|
||||
archivesBaseName = "kafka-hadoop-producer"
|
||||
|
||||
dependencies {
|
||||
compile project(':core')
|
||||
compile "org.apache.avro:avro:1.4.0"
|
||||
compile "org.apache.pig:pig:0.8.0"
|
||||
compile "commons-logging:commons-logging:1.0.4"
|
||||
compile "org.codehaus.jackson:jackson-core-asl:1.5.5"
|
||||
compile "org.codehaus.jackson:jackson-mapper-asl:1.5.5"
|
||||
compile "org.apache.hadoop:hadoop-core:0.20.2"
|
||||
compile files('lib/piggybank.jar')
|
||||
}
|
||||
|
||||
configurations {
|
||||
// manually excludes some unnecessary dependencies
|
||||
compile.exclude module: 'javax'
|
||||
compile.exclude module: 'jms'
|
||||
compile.exclude module: 'jmxri'
|
||||
compile.exclude module: 'jmxtools'
|
||||
compile.exclude module: 'mail'
|
||||
compile.exclude module: 'netty'
|
||||
}
|
||||
}
|
||||
|
||||
project(':examples') {
|
||||
archivesBaseName = "kafka-examples"
|
||||
|
||||
dependencies {
|
||||
compile project(':core')
|
||||
}
|
||||
}
|
||||
|
||||
project(':clients') {
|
||||
archivesBaseName = "kafka-clients"
|
||||
|
||||
dependencies {
|
||||
testCompile 'com.novocode:junit-interface:0.9'
|
||||
}
|
||||
|
||||
task testJar(type: Jar) {
|
||||
appendix = 'test'
|
||||
from sourceSets.test.output
|
||||
}
|
||||
|
||||
test {
|
||||
testLogging {
|
||||
events "passed", "skipped", "failed"
|
||||
exceptionFormat = 'full'
|
||||
}
|
||||
}
|
||||
}
|
|
@ -1 +0,0 @@
|
|||
Utility functions.
|
|
@ -0,0 +1,24 @@
|
|||
# Licensed to the Apache Software Foundation (ASF) under one or more
|
||||
# contributor license agreements. See the NOTICE file distributed with
|
||||
# this work for additional information regarding copyright ownership.
|
||||
# The ASF licenses this file to You under the Apache License, Version 2.0
|
||||
# (the "License"); you may not use this file except in compliance with
|
||||
# the License. You may obtain a copy of the License at
|
||||
#
|
||||
# http://www.apache.org/licenses/LICENSE-2.0
|
||||
#
|
||||
# Unless required by applicable law or agreed to in writing, software
|
||||
# distributed under the License is distributed on an "AS IS" BASIS,
|
||||
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||
# See the License for the specific language governing permissions and
|
||||
# limitations under the License.
|
||||
|
||||
group=org.apache.kafka
|
||||
version=0.8.1
|
||||
scalaVersion=2.8.0
|
||||
task=build
|
||||
|
||||
#mavenUrl=file://localhost/tmp/maven
|
||||
mavenUrl=http://your.maven.repository
|
||||
mavenUsername=your.username
|
||||
mavenPassword=your.password
|
|
@ -0,0 +1,12 @@
|
|||
repositories {
|
||||
repositories {
|
||||
// For license plugin.
|
||||
maven {
|
||||
url 'http://dl.bintray.com/content/netflixoss/external-gradle-plugins/'
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
dependencies {
|
||||
classpath 'nl.javadude.gradle.plugins:license-gradle-plugin:0.6.1'
|
||||
}
|
|
@ -0,0 +1,9 @@
|
|||
subprojects {
|
||||
apply plugin: 'license'
|
||||
|
||||
license {
|
||||
header rootProject.file('HEADER')
|
||||
// Skip Twitter bootstrap JS and CSS.
|
||||
skipExistingHeaders = true
|
||||
}
|
||||
}
|
Binary file not shown.
|
@ -0,0 +1,6 @@
|
|||
#Thu Jul 11 22:18:11 PDT 2013
|
||||
distributionBase=GRADLE_USER_HOME
|
||||
distributionPath=wrapper/dists
|
||||
zipStoreBase=GRADLE_USER_HOME
|
||||
zipStorePath=wrapper/dists
|
||||
distributionUrl=http\://services.gradle.org/distributions/gradle-1.6-bin.zip
|
|
@ -0,0 +1,164 @@
|
|||
#!/usr/bin/env bash
|
||||
|
||||
##############################################################################
|
||||
##
|
||||
## Gradle start up script for UN*X
|
||||
##
|
||||
##############################################################################
|
||||
|
||||
# Add default JVM options here. You can also use JAVA_OPTS and GRADLE_OPTS to pass JVM options to this script.
|
||||
DEFAULT_JVM_OPTS="-Xmx1024m -Xms256m -XX:MaxPermSize=512m"
|
||||
|
||||
APP_NAME="Gradle"
|
||||
APP_BASE_NAME=`basename "$0"`
|
||||
|
||||
# Use the maximum available, or set MAX_FD != -1 to use that value.
|
||||
MAX_FD="maximum"
|
||||
|
||||
warn ( ) {
|
||||
echo "$*"
|
||||
}
|
||||
|
||||
die ( ) {
|
||||
echo
|
||||
echo "$*"
|
||||
echo
|
||||
exit 1
|
||||
}
|
||||
|
||||
# OS specific support (must be 'true' or 'false').
|
||||
cygwin=false
|
||||
msys=false
|
||||
darwin=false
|
||||
case "`uname`" in
|
||||
CYGWIN* )
|
||||
cygwin=true
|
||||
;;
|
||||
Darwin* )
|
||||
darwin=true
|
||||
;;
|
||||
MINGW* )
|
||||
msys=true
|
||||
;;
|
||||
esac
|
||||
|
||||
# For Cygwin, ensure paths are in UNIX format before anything is touched.
|
||||
if $cygwin ; then
|
||||
[ -n "$JAVA_HOME" ] && JAVA_HOME=`cygpath --unix "$JAVA_HOME"`
|
||||
fi
|
||||
|
||||
# Attempt to set APP_HOME
|
||||
# Resolve links: $0 may be a link
|
||||
PRG="$0"
|
||||
# Need this for relative symlinks.
|
||||
while [ -h "$PRG" ] ; do
|
||||
ls=`ls -ld "$PRG"`
|
||||
link=`expr "$ls" : '.*-> \(.*\)$'`
|
||||
if expr "$link" : '/.*' > /dev/null; then
|
||||
PRG="$link"
|
||||
else
|
||||
PRG=`dirname "$PRG"`"/$link"
|
||||
fi
|
||||
done
|
||||
SAVED="`pwd`"
|
||||
cd "`dirname \"$PRG\"`/" >&-
|
||||
APP_HOME="`pwd -P`"
|
||||
cd "$SAVED" >&-
|
||||
|
||||
CLASSPATH=$APP_HOME/gradle/wrapper/gradle-wrapper.jar
|
||||
|
||||
# Determine the Java command to use to start the JVM.
|
||||
if [ -n "$JAVA_HOME" ] ; then
|
||||
if [ -x "$JAVA_HOME/jre/sh/java" ] ; then
|
||||
# IBM's JDK on AIX uses strange locations for the executables
|
||||
JAVACMD="$JAVA_HOME/jre/sh/java"
|
||||
else
|
||||
JAVACMD="$JAVA_HOME/bin/java"
|
||||
fi
|
||||
if [ ! -x "$JAVACMD" ] ; then
|
||||
die "ERROR: JAVA_HOME is set to an invalid directory: $JAVA_HOME
|
||||
|
||||
Please set the JAVA_HOME variable in your environment to match the
|
||||
location of your Java installation."
|
||||
fi
|
||||
else
|
||||
JAVACMD="java"
|
||||
which java >/dev/null 2>&1 || die "ERROR: JAVA_HOME is not set and no 'java' command could be found in your PATH.
|
||||
|
||||
Please set the JAVA_HOME variable in your environment to match the
|
||||
location of your Java installation."
|
||||
fi
|
||||
|
||||
# Increase the maximum file descriptors if we can.
|
||||
if [ "$cygwin" = "false" -a "$darwin" = "false" ] ; then
|
||||
MAX_FD_LIMIT=`ulimit -H -n`
|
||||
if [ $? -eq 0 ] ; then
|
||||
if [ "$MAX_FD" = "maximum" -o "$MAX_FD" = "max" ] ; then
|
||||
MAX_FD="$MAX_FD_LIMIT"
|
||||
fi
|
||||
ulimit -n $MAX_FD
|
||||
if [ $? -ne 0 ] ; then
|
||||
warn "Could not set maximum file descriptor limit: $MAX_FD"
|
||||
fi
|
||||
else
|
||||
warn "Could not query maximum file descriptor limit: $MAX_FD_LIMIT"
|
||||
fi
|
||||
fi
|
||||
|
||||
# For Darwin, add options to specify how the application appears in the dock
|
||||
if $darwin; then
|
||||
GRADLE_OPTS="$GRADLE_OPTS \"-Xdock:name=$APP_NAME\" \"-Xdock:icon=$APP_HOME/media/gradle.icns\""
|
||||
fi
|
||||
|
||||
# For Cygwin, switch paths to Windows format before running java
|
||||
if $cygwin ; then
|
||||
APP_HOME=`cygpath --path --mixed "$APP_HOME"`
|
||||
CLASSPATH=`cygpath --path --mixed "$CLASSPATH"`
|
||||
|
||||
# We build the pattern for arguments to be converted via cygpath
|
||||
ROOTDIRSRAW=`find -L / -maxdepth 1 -mindepth 1 -type d 2>/dev/null`
|
||||
SEP=""
|
||||
for dir in $ROOTDIRSRAW ; do
|
||||
ROOTDIRS="$ROOTDIRS$SEP$dir"
|
||||
SEP="|"
|
||||
done
|
||||
OURCYGPATTERN="(^($ROOTDIRS))"
|
||||
# Add a user-defined pattern to the cygpath arguments
|
||||
if [ "$GRADLE_CYGPATTERN" != "" ] ; then
|
||||
OURCYGPATTERN="$OURCYGPATTERN|($GRADLE_CYGPATTERN)"
|
||||
fi
|
||||
# Now convert the arguments - kludge to limit ourselves to /bin/sh
|
||||
i=0
|
||||
for arg in "$@" ; do
|
||||
CHECK=`echo "$arg"|egrep -c "$OURCYGPATTERN" -`
|
||||
CHECK2=`echo "$arg"|egrep -c "^-"` ### Determine if an option
|
||||
|
||||
if [ $CHECK -ne 0 ] && [ $CHECK2 -eq 0 ] ; then ### Added a condition
|
||||
eval `echo args$i`=`cygpath --path --ignore --mixed "$arg"`
|
||||
else
|
||||
eval `echo args$i`="\"$arg\""
|
||||
fi
|
||||
i=$((i+1))
|
||||
done
|
||||
case $i in
|
||||
(0) set -- ;;
|
||||
(1) set -- "$args0" ;;
|
||||
(2) set -- "$args0" "$args1" ;;
|
||||
(3) set -- "$args0" "$args1" "$args2" ;;
|
||||
(4) set -- "$args0" "$args1" "$args2" "$args3" ;;
|
||||
(5) set -- "$args0" "$args1" "$args2" "$args3" "$args4" ;;
|
||||
(6) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" ;;
|
||||
(7) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" ;;
|
||||
(8) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" "$args7" ;;
|
||||
(9) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" "$args7" "$args8" ;;
|
||||
esac
|
||||
fi
|
||||
|
||||
# Split up the JVM_OPTS And GRADLE_OPTS values into an array, following the shell quoting and substitution rules
|
||||
function splitJvmOpts() {
|
||||
JVM_OPTS=("$@")
|
||||
}
|
||||
eval splitJvmOpts $DEFAULT_JVM_OPTS $JAVA_OPTS $GRADLE_OPTS
|
||||
JVM_OPTS[${#JVM_OPTS[*]}]="-Dorg.gradle.appname=$APP_BASE_NAME"
|
||||
|
||||
exec "$JAVACMD" "${JVM_OPTS[@]}" -classpath "$CLASSPATH" org.gradle.wrapper.GradleWrapperMain "$@"
|
|
@ -0,0 +1,16 @@
|
|||
// Licensed to the Apache Software Foundation (ASF) under one or more
|
||||
// contributor license agreements. See the NOTICE file distributed with
|
||||
// this work for additional information regarding copyright ownership.
|
||||
// The ASF licenses this file to You under the Apache License, Version 2.0
|
||||
// (the "License"); you may not use this file except in compliance with
|
||||
// the License. You may obtain a copy of the License at
|
||||
//
|
||||
// http://www.apache.org/licenses/LICENSE-2.0
|
||||
//
|
||||
// Unless required by applicable law or agreed to in writing, software
|
||||
// distributed under the License is distributed on an "AS IS" BASIS,
|
||||
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
||||
// See the License for the specific language governing permissions and
|
||||
// limitations under the License.
|
||||
|
||||
include 'core', 'perf', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples', 'clients'
|
Loading…
Reference in New Issue