d38a90df2b
KAFKA-17672 Run quarantined tests separately ( #17329 )
...
Introduce new quarantinedTest that excludes tests tagged with "flaky". Also introduce two new build parameters "maxQuarantineTestRetries" and "maxQuarantineTestRetryFailures".
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-06 14:09:24 +08:00
3bb408c4de
MINOR: rename ConfigName.RENAME to ConfigName.RENAMES for replaceFiled ( #17369 )
...
Reviewers: Andrew Schofield <aschofield@confluent.io>, TengYao Chi <kitingiao@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-10-05 05:50:48 +08:00
979740b49d
KAFKA-17589 Move JUnit extensions to test-common module ( #17318 )
...
This patch completely removes the compile-time dependency on core for both test and main sources by introducing two new modules.
1) `test-common` include all the common test implementation code (including dependency on :core for BrokerServer, ControllerServer, etc)
2) `test-common:api` new sub-module that just includes interfaces including our junit extension
Reviewers: David Arthur <mumrah@gmail.com>
2024-10-03 10:28:37 +08:00
7fb25a2b06
KAFKA-16769 Remove add.source.alias.to.metrics configuration ( #17323 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-10-02 02:03:02 +08:00
818ee8a581
KAFKA-17078: Add SecurityManagerCompatibility shim ( #16522 )
...
Signed-off-by: Greg Harris <greg.harris@aiven.io>
Reviewers: José Armando García Sancio <jsancio@apache.org>, Omnia Ibrahim <o.g.h.ibrahim@gmail.com>, Chris Egerton <fearthecellos@gmail.com>, Luke Chen <showuon@gmail.com>, David Arthur <mumrah@gmail.com>
2024-09-30 08:06:14 -07:00
db56553fd3
KAFKA-17530 Remove blacklist/whitelist from ReplaceField ( #17237 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-25 01:02:28 +08:00
70f7418660
MINOR: Increase logging verbosity in Connect integration tests ( #17189 )
...
This patch increases the verbosity of the logging in Connect's integration tests. This is to better understand the causes of the flaky tests described in KAFKA-17493.
Reviewers: Chris Egerton <chrise@aiven.io>
2024-09-14 00:04:46 -07:00
9242723e4c
KAFKA-17435 remove use.incremental.alter.configs ( #17027 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-09-11 14:34:05 +08:00
50e7022a1b
MINOR: Improve error message when Connect's EmbeddedKafkaCluster::verifyClusterReadiness method fails ( #16918 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-09-07 10:23:59 -04:00
a39037e55c
KAFKA-17399 Apply LambdaValidator to code base ( #16980 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-08-26 21:53:49 +08:00
b40b5a24f4
KAFKA-17369: Remove Reflections from logging and update licenses ( #16924 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-08-19 16:27:36 -07:00
e24354a21d
KAFKA-15203: Use Classgraph since org.reflections is no longer under maintenance ( #16604 )
...
Reviewers: Liam Miller-Cushon <cushon@google.com>, Greg Harris <greg.harris@aiven.io>
2024-08-19 10:46:24 -07:00
4763d0fc30
KAFKA-17242: Do not log spurious timeout message for MirrorCheckpointTask sync store startup ( #16773 )
...
Reviewers: Chris Egerton <chrise@aiven.io>
2024-08-08 10:03:42 -04:00
0dc74c5556
KAFKA-17232: Do not generate task configs in MirrorCheckpointConnector if initial consumer group load times out ( #16767 )
...
Reviewers: Hongten <hongtenzone@foxmail.com>, Chris Egerton <chrise@aiven.io>
2024-08-08 09:58:11 -04:00
8152ee6519
MINOR: Increase test producer max.block.ms in MirrorConnectorsIntegrationTransactionsTest ( #16785 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-08-05 14:37:17 -04:00
3f3e376797
MINOR: Fix stage recording in DistributedHerder::addRequest ( #16784 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-08-05 14:36:39 -04:00
39b1586f93
MINOR: Fix ConnectWorkerIntegrationTest::testRequestTimeouts ( #16772 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-08-02 16:41:34 -04:00
5afdb17092
MINOR: Fix consumer group warmup in MirroMaker 2 integration tests ( #16771 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-08-02 13:57:05 -04:00
a524609f4c
MINOR: Add extended cluster readiness check for Connect's embedded Kafka cluster ( #16757 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-08-01 16:12:57 -04:00
8d8c367066
KAFKA-17192 Fix MirrorMaker2 worker config does not pass config.provi… ( #16678 )
...
Reviewers: Chris Egerton <chrise@aiven.io>
2024-07-31 16:50:22 -04:00
342bd2844f
MINOR: Unify Log4j levels across Connect runtime and MirrorMaker 2 integration tests ( #16733 )
...
Reviewers: Yash Mayya <yash.mayya@gmail.com>
2024-07-31 12:07:38 +02:00
7c0a96d08d
KAFKA-17185 Declare Loggers as static to prevent multiple logger instances ( #16680 )
...
As discussed in #16657 (comment) , we should make logger as static to avoid creating multiple logger instances.
I use the regex private.*Logger.*LoggerFactory to search and check all the results if certain logs need to be static.
There are some exceptions that loggers don't need to be static:
1) The logger in the inner class. Since java8 doesn't support static field in the inner class.
https://github.com/apache/kafka/blob/trunk/clients/src/test/java/org/apache/kafka/clients/consumer/internals/FetchRequestManagerTest.java#L3676
2) Custom loggers for each instance (non-static + non-final). In this case, multiple logger instances is actually really needed.
https://github.com/apache/kafka/blob/trunk/storage/src/test/java/org/apache/kafka/server/log/remote/storage/LocalTieredStorage.java#L166
3) The logger is initialized in constructor by LogContext. Many non-static but with final modifier loggers are in this category, that's why I use .*LoggerFactory to only check the loggers that are assigned initial value when declaration.
4) protected final Logger log = Logger.getLogger(getClass())
This is for subclass can do logging with subclass name instead of superclass name.
But in this case, if the log access modifier is private, the purpose cannot be achieved since subclass cannot access the log defined in superclass. So if access modifier is private, we can replace getClass() with <className>.class
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-07-31 02:37:36 +08:00
61f61d6240
KAFKA-14569: Migrate Connect's integration test EmbeddedKafkaCluster from ZK to KRaft mode ( #16599 )
...
Reviewers: Omnia Ibrahim <o.g.h.ibrahim@gmail.com>, Mickael Maison <mickael.maison@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>
2024-07-29 10:43:55 -04:00
738d8cc91e
MINOR: Update bootstrap.servers doc string ( #16655 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>
2024-07-26 15:08:01 +02:00
956d740c46
KAFKA-16068: Use TestPlugins mechanism in ConnectorValidationIntegrationTest to prevent ERROR-level log spam in unrelated test suites ( #16647 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-07-23 13:15:03 -04:00
defcbb51ee
KAFKA-17082 replace kafka.utils.LogCaptureAppender with org.apache.kafka.common.utils.LogCaptureAppender ( #16601 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-07-21 18:22:05 +08:00
208bb1fbc2
MINOR: Add integration test for plugin aliases ( #16621 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-07-19 12:47:41 -04:00
c97421c100
KAFKA-17150: Use Utils.loadClass instead of Class.forName to resolve aliases correctly ( #16608 )
...
Signed-off-by: Greg Harris <greg.harris@aiven.io>
Reviewers: Chris Egerton <chrise@aiven.io>, Chia-Ping Tsai <chia7712@gmail.com>, Josep Prat <josep.prat@aiven.io>
2024-07-17 16:00:45 -07:00
53ec055394
KAFKA-17105: Prevent redundant restarts for newly-created connectors ( #16581 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-07-17 14:33:47 -04:00
177b38ad66
KAFKA-16383: Ensure tasks have already polled their consumers before producing verified records in MirrorConnectorsIntegrationBaseTest::testReplicateFromLatest ( #16598 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-07-16 19:42:31 -04:00
6cffed56f6
KAFKA-16943: Synchronously verify Connect worker startup failure in InternalTopicsIntegrationTest ( #16451 )
...
Reviewers: Chris Egerton <chrise@aiven.io>
2024-07-16 14:20:44 -04:00
808498e939
KAFKA-14401: Fail kafka log read end requests if underneath work thread fails ( #14372 )
...
Reviewers: Chris Egerton <chrise@aiven.io>
2024-07-15 20:55:52 -04:00
6e9c039eea
KAFKA-17097 Add replace.null.with.default configuration to ValueToKey and ReplaceField ( #16571 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-07-15 18:12:59 +08:00
83081652ab
MINOR: Fix ConnectWorkerIntegrationTest::testBrokerCoordinator ( #16585 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-07-13 03:48:19 -04:00
3f43d27483
KAFKA-17111: explicitly register Afterburner module in JsonSerializer and JsonDeserializer ( #16565 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Josep Prat <josep.prat@aiven.io>, Greg Harris <greg.harris@aiven.io>
2024-07-11 14:17:27 +02:00
0781151794
KAFKA-16254: Allow MM2 to fully disable offset sync feature ( #15999 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Chris Egerton <fearthecellos@gmail.com>, Chia-Ping Tsai <chia7712@gmail.com>, Igor Soarez <soarez@apple.com>
2024-07-09 12:38:03 +02:00
515cdbb707
MINOR: Fix retry logic in DedicatedMirrorIntegrationTest::awaitTaskConfigurations ( #16525 )
...
Reviewers: Greg Harris <greg.harris@aiven.io>
2024-07-08 14:51:23 -04:00
e2ec389a7c
KAFKA-15838: KIP-1040: Add replace.null.with.default to InsertField, ExtractField, HeaderFrom, Cast, SetSchemaMetadata, TimestampConverter, MaskField transforms ( #15756 )
...
Reviewers: Mickael Maison <mickael.maison@gmail.com>, Greg Harris <greg.harris@aiven.io>
2024-07-08 11:09:54 -07:00
27220d146c
KAFKA-10816: Add health check endpoint for Kafka Connect ( #16477 )
...
Reviewers: Greg Harris <gharris1727@gmail.com>
2024-07-03 14:15:15 -04:00
4550550c7c
MINOR: Cleanup TestPlugins and normalize TestPlugin enum ( #13333 )
...
Signed-off-by: Greg Harris <greg.harris@aiven.io>
Reviewers: Chris Egerton <chrise@aiven.io>
2024-07-03 09:44:09 -07:00
e93242283d
KAFKA-15917: Wait for zombie sink tasks' consumers to commit offsets before trying to modify their offsets in integration tests ( #15302 )
...
Reviewers: Yash Mayya <yash.mayya@gmail.com>, Greg Harris <greg.harris@aiven.io>
2024-07-03 10:25:23 -04:00
6897b06b03
KAFKA-3346 Rename Mode to ConnectionMode ( #16403 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-07-03 02:46:04 +08:00
645eefe95a
KAFKA-17007 Fix SourceAndTarget#equal ( #16416 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-21 20:52:07 +08:00
0772144e51
MINOR: Add javadoc for Connect public packages/classes ( #16404 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-21 10:23:35 +02:00
8d92535382
KAFKA-10787 apply spotless to connect:runtime module ( #16412 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-21 16:04:51 +08:00
4de6a90801
KAFKA-16921 [6/N] Remove junit 4 dependency from connect:runtime module ( #16383 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-19 14:39:16 +08:00
d5592d8fe6
KAFKA-16921 [5/N] Migrate test of connect module to Junit5 (Runtime subpackage) ( #16350 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-18 18:20:14 +08:00
3a3f9ce48e
KAFKA-16921 [4/N] Migrate test of connect module to Junit5 (Runtime direct) ( #16351 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-18 18:09:40 +08:00
fc6f8b6591
KAFKA-16921 [3/N] migrate connect module to junit 5 ( #16330 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-15 00:37:59 +08:00
8682334b6a
KAFKA-16921 [2/N] migrate connect module to junit 5 ( #16328 )
...
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>
2024-06-15 00:25:41 +08:00
David Arthur
TaiJuWu
Chia-Ping Tsai
Mickael Maison
Greg Harris
David Jacot
Xuan-Zhang Gong
Chris Egerton
xijiu
Steven Xu
Dmitry Werner
TengYao Chi
Chris Egerton
Kondrat Bertalan
Chung, Ming-Yen
PaulRMellor
PoAn Yang
Zhengke Zhou
vamossagar12
Vikas Balani
Omnia Ibrahim
Fiore Mario Vitale
abhi-ksolves
gongxuanzhang
Ken Huang
Ken Huang