kafka/streams
Ken Huang bcda92b5b9
CI / build (push) Waiting to run Details
KAFKA-19080 The constraint on segment.ms is not enforced at topic level (#19371)
The main issue was that we forgot to set
`TopicConfig.SEGMENT_BYTES_CONFIG` to at least `1024 * 1024`, which
caused problems in tests with small segment sizes.

To address this, we introduced a new internal config:
`LogConfig.INTERNAL_SEGMENT_BYTES_CONFIG`, allowing us to set smaller
segment bytes specifically for testing purposes.

We also updated the logic so that if a user configures the topic-level
segment bytes without explicitly setting the internal config, the
internal value will no longer be returned to the user.

In addition, we removed
`MetadataLogConfig#METADATA_LOG_SEGMENT_MIN_BYTES_CONFIG` and added
three new internal configurations:
- `INTERNAL_MAX_BATCH_SIZE_IN_BYTES_CONFIG`
- `INTERNAL_MAX_FETCH_SIZE_IN_BYTES_CONFIG`
- `INTERNAL_DELETE_DELAY_MILLIS_CONFIG`

Reviewers: Jun Rao <junrao@gmail.com>, Chia-Ping Tsai
 <chia7712@gmail.com>
2025-05-25 20:57:22 +08:00
..
examples/src KAFKA-13722: code cleanup after deprecated StateStore.init() was removed (#18249) 2024-12-20 14:31:44 -08:00
integration-tests/src/test KAFKA-19080 The constraint on segment.ms is not enforced at topic level (#19371) 2025-05-25 20:57:22 +08:00
quickstart KAFKA-8116: Update Kafka Streams archetype for Java 11 (#18471) 2025-01-10 15:45:39 -08:00
src KAFKA-19080 The constraint on segment.ms is not enforced at topic level (#19371) 2025-05-25 20:57:22 +08:00
streams-scala KAFKA-19058 Running the streams/streams-scala module tests produces a streams-scala.log (#19324) 2025-04-02 12:12:16 -07:00
test-utils/src KAFKA-19128: Kafka Streams should not get offsets when close dirty (#19450) 2025-04-24 21:23:07 -07:00
upgrade-system-tests-10/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
upgrade-system-tests-11/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
upgrade-system-tests-20/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
upgrade-system-tests-21/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
upgrade-system-tests-22/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
upgrade-system-tests-23/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
upgrade-system-tests-24/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-25/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-26/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-27/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-28/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-30/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-31/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-32/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-33/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-34/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-35/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-36/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-37/src/test/java/org/apache/kafka/streams/tests KAFKA-17759 Remove Utils.mkSet (#17460) 2024-10-11 21:20:43 +08:00
upgrade-system-tests-38/src/test/java/org/apache/kafka/streams/tests MINOR: Add 4.0.0 to streams system tests (#19239) 2025-03-21 01:41:09 -07:00
upgrade-system-tests-39/src/test/java/org/apache/kafka/streams/tests MINOR: Add 4.0.0 to streams system tests (#19239) 2025-03-21 01:41:09 -07:00
upgrade-system-tests-40/src/test/java/org/apache/kafka/streams/tests MINOR: Add 4.0.0 to streams system tests (#19239) 2025-03-21 01:41:09 -07:00
upgrade-system-tests-0110/src/test/java/org/apache/kafka/streams/tests MINOR: Code cleanup Kafka Streams (#16050) 2024-10-23 16:54:06 -07:00
.gitignore