mirror of https://github.com/apache/kafka.git
KAFKA-14188; Getting started for Kafka with KRaft (#12604)
Update the quickstart HTML pages for Kafka and Kafka Stream to include how to quickly start and experiment with a Kafka cluster using KRaft in addition to ZooKeeper. Reviews: Colin Patrick McCabe <cmccabe@apache.org>, Chase Thomas <forlack@users.noreply.github.com>, Luke Chen <showuon@gmail.com>
This commit is contained in:
José Armando García Sancio
GitHub
parent
b7f20be809
commit
12c0ddc9c0
|
|
@ -46,12 +46,19 @@ $ cd kafka_{{scalaVersion}}-{{fullDotVersion}}</code></pre>
|
|||
NOTE: Your local environment must have Java 8+ installed.
|
||||
</p>
|
||||
|
||||
<p>
|
||||
Apache Kafka can be started using ZooKeeper or KRaft. To get started with either configuration follow one the sections below but not both.
|
||||
</p>
|
||||
|
||||
<h5>
|
||||
Kafka with ZooKeeper
|
||||
</h5>
|
||||
|
||||
<p>
|
||||
Run the following commands in order to start all services in the correct order:
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash"># Start the ZooKeeper service
|
||||
# Note: Soon, ZooKeeper will no longer be required by Apache Kafka.
|
||||
$ bin/zookeeper-server-start.sh config/zookeeper.properties</code></pre>
|
||||
|
||||
<p>
|
||||
|
|
@ -64,6 +71,32 @@ $ bin/kafka-server-start.sh config/server.properties</code></pre>
|
|||
<p>
|
||||
Once all services have successfully launched, you will have a basic Kafka environment running and ready to use.
|
||||
</p>
|
||||
|
||||
<h5>
|
||||
Kafka with KRaft
|
||||
</h5>
|
||||
|
||||
<p>
|
||||
Generate a Cluster UUID
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">$ KAFKA_CLUSTER_ID="$(bin/kafka-storage.sh random-uuid)"</code></pre>
|
||||
|
||||
<p>
|
||||
Format Log Directories
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">$ bin/kafka-storage.sh format -t $KAFKA_CLUSTER_ID -c config/kraft/server.properties</code></pre>
|
||||
|
||||
<p>
|
||||
Start the Kafka Server
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">$ bin/kafka-server-start.sh config/kraft/server.properties</code></pre>
|
||||
|
||||
<p>
|
||||
Once the Kafka server has successfully launched, you will have a basic Kafka environment running and ready to use.
|
||||
</p>
|
||||
</div>
|
||||
|
||||
<div class="quickstart-step">
|
||||
|
|
@ -303,7 +336,7 @@ wordCounts.toStream().to("output-topic", Produced.with(Serdes.String(), Serdes.L
|
|||
Stop the Kafka broker with <code>Ctrl-C</code>.
|
||||
</li>
|
||||
<li>
|
||||
Lastly, stop the ZooKeeper server with <code>Ctrl-C</code>.
|
||||
Lastly, if the Kafka with ZooKeeper section was followed, stop the ZooKeeper server with <code>Ctrl-C</code>.
|
||||
</li>
|
||||
</ol>
|
||||
|
||||
|
|
@ -312,7 +345,7 @@ wordCounts.toStream().to("output-topic", Produced.with(Serdes.String(), Serdes.L
|
|||
along the way, run the command:
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">$ rm -rf /tmp/kafka-logs /tmp/zookeeper</code></pre>
|
||||
<pre class="line-numbers"><code class="language-bash">$ rm -rf /tmp/kafka-logs /tmp/zookeeper /tmp/kraft-combined-logs</code></pre>
|
||||
|
||||
</div>
|
||||
|
||||
|
|
|
|||
|
|
@ -33,8 +33,7 @@
|
|||
</div>
|
||||
</div>
|
||||
<p>
|
||||
This tutorial assumes you are starting fresh and have no existing Kafka or ZooKeeper data. However, if you have already started Kafka and
|
||||
ZooKeeper, feel free to skip the first two steps.
|
||||
This tutorial assumes you are starting fresh and have no existing Kafka or ZooKeeper data. However, if you have already started Kafka, feel free to skip the first two steps.
|
||||
</p>
|
||||
|
||||
<p>
|
||||
|
|
@ -98,19 +97,46 @@ Note that there are multiple downloadable Scala versions and we choose to use th
|
|||
<h4><a id="quickstart_streams_startserver" href="#quickstart_streams_startserver">Step 2: Start the Kafka server</a></h4>
|
||||
|
||||
<p>
|
||||
Kafka uses <a href="https://zookeeper.apache.org/">ZooKeeper</a> so you need to first start a ZooKeeper server if you don't already have one. You can use the convenience script packaged with kafka to get a quick-and-dirty single-node ZooKeeper instance.
|
||||
Apache Kafka can be started using ZooKeeper or KRaft. To get started with either configuration follow one of the sections below but not both.
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">> bin/zookeeper-server-start.sh config/zookeeper.properties
|
||||
[2013-04-22 15:01:37,495] INFO Reading configuration from: config/zookeeper.properties (org.apache.zookeeper.server.quorum.QuorumPeerConfig)
|
||||
...</code></pre>
|
||||
<h5>
|
||||
Kafka with ZooKeeper
|
||||
</h5>
|
||||
|
||||
<p>Now start the Kafka server:</p>
|
||||
<pre class="line-numbers"><code class="language-bash">> bin/kafka-server-start.sh config/server.properties
|
||||
[2013-04-22 15:01:47,028] INFO Verifying properties (kafka.utils.VerifiableProperties)
|
||||
[2013-04-22 15:01:47,051] INFO Property socket.send.buffer.bytes is overridden to 1048576 (kafka.utils.VerifiableProperties)
|
||||
...</code></pre>
|
||||
<p>
|
||||
Run the following commands in order to start all services in the correct order:
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">> bin/zookeeper-server-start.sh config/zookeeper.properties</code></pre>
|
||||
|
||||
<p>
|
||||
Open another terminal session and run:
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">> bin/kafka-server-start.sh config/server.properties</code></pre>
|
||||
|
||||
<h5>
|
||||
Kafka with KRaft
|
||||
</h5>
|
||||
|
||||
<p>
|
||||
Generate a Cluster UUID
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">> KAFKA_CLUSTER_ID="$(bin/kafka-storage.sh random-uuid)"</code></pre>
|
||||
|
||||
<p>
|
||||
Format Log Directories
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">> bin/kafka-storage.sh format -t $KAFKA_CLUSTER_ID -c config/kraft/server.properties</code></pre>
|
||||
|
||||
<p>
|
||||
Start the Kafka Server
|
||||
</p>
|
||||
|
||||
<pre class="line-numbers"><code class="language-bash">> bin/kafka-server-start.sh config/kraft/server.properties</code></pre>
|
||||
|
||||
<h4><a id="quickstart_streams_prepare" href="#quickstart_streams_prepare">Step 3: Prepare input topic and start Kafka producer</a></h4>
|
||||
|
||||
|
|
@ -304,7 +330,7 @@ Looking beyond the scope of this concrete example, what Kafka Streams is doing h
|
|||
|
||||
<h4><a id="quickstart_streams_stop" href="#quickstart_streams_stop">Step 6: Teardown the application</a></h4>
|
||||
|
||||
<p>You can now stop the console consumer, the console producer, the Wordcount application, the Kafka broker and the ZooKeeper server in order via <b>Ctrl-C</b>.</p>
|
||||
<p>You can now stop the console consumer, the console producer, the Wordcount application, the Kafka broker and the ZooKeeper server (if one was started) in order via <b>Ctrl-C</b>.</p>
|
||||
|
||||
<div class="pagination">
|
||||
<a href="/{{version}}/documentation/streams" class="pagination__btn pagination__btn__prev">Previous</a>
|
||||
|
|
|
|||
Loading…
Reference in New Issue