mirror of https://github.com/apache/kafka.git
In the initial EOS example, a retry logic was implemented within the resetToLastCommittedPositions method. During refactoring, this logic was removed becasue a poison pill prevented the example from reaching the final phase of consuming from the output topic. In this change, I suggest to add it back, but with a retry limit defined as MAX_RETRIES. Once this limit is reached, the problematic batch will be logged and skipped, allowing the processor to move on and process remaining records. If some records are skipped, the example will still hit the hard timeout (2 minutes), but after consuming all processed records. Reviewers: Luke Chen <showuon@gmail.com> |
||
---|---|---|
.. | ||
bin | ||
src/main/java/kafka/examples | ||
README.md |
README.md
Kafka client examples
This module contains some Kafka client examples.
- Start a Kafka 2.5+ local cluster with a plain listener configured on port 9092.
- Run
examples/bin/java-producer-consumer-demo.sh 10000
to asynchronously send 10k records to topic1 and consume them. - Run
examples/bin/java-producer-consumer-demo.sh 10000 sync
to synchronous send 10k records to topic1 and consume them. - Run
examples/bin/exactly-once-demo.sh 6 3 10000
to create input-topic and output-topic with 6 partitions each, start 3 transactional application instances and process 10k records.