From 79598b49d6fff9bef686500f46a288b61a9013fd Mon Sep 17 00:00:00 2001 From: Yash Mayya Date: Tue, 5 Sep 2023 18:58:44 +0100 Subject: [PATCH] MINOR: Update the documentation's table of contents to add missing headings for Kafka Connect (#14337) Reviewers: Chris Egerton --- docs/connect.html | 4 ++-- docs/toc.html | 8 ++++++++ 2 files changed, 10 insertions(+), 2 deletions(-) diff --git a/docs/connect.html b/docs/connect.html index d324f4384b4..aecaccab3af 100644 --- a/docs/connect.html +++ b/docs/connect.html @@ -953,7 +953,7 @@ if (inputsChanged())

SinkConnectors usually only have to handle the addition of streams, which may translate to new entries in their outputs (e.g., a new database table). The framework manages any changes to the Kafka input, such as when the set of input topics changes because of a regex subscription. SinkTasks should expect new input streams, which may require creating new resources in the downstream system, such as a new table in a database. The trickiest situation to handle in these cases may be conflicts between multiple SinkTasks seeing a new input stream for the first time and simultaneously trying to create the new resource. SinkConnectors, on the other hand, will generally require no special code for handling a dynamic set of streams.

-

Connect Configuration Validation

+

Configuration Validation

Kafka Connect allows you to validate connector configurations before submitting a connector to be executed and can provide feedback about errors and recommended values. To take advantage of this, connector developers need to provide an implementation of config() to expose the configuration definition to the framework.

@@ -999,7 +999,7 @@ Struct struct = new Struct(schema)

Sink connectors are usually simpler because they are consuming data and therefore do not need to create schemas. However, they should take just as much care to validate that the schemas they receive have the expected format. When the schema does not match -- usually indicating the upstream producer is generating invalid data that cannot be correctly translated to the destination system -- sink connectors should throw an exception to indicate this error to the system.

-

Kafka Connect Administration

+

8.4 Administration

Kafka Connect's REST layer provides a set of APIs to enable administration of the cluster. This includes APIs to view the configuration of connectors and the status of their tasks, as well as to alter their current behavior (e.g. changing configuration and restarting tasks). diff --git a/docs/toc.html b/docs/toc.html index 4b8bf3d35e7..88dd62c92dd 100644 --- a/docs/toc.html +++ b/docs/toc.html @@ -207,6 +207,14 @@

  • Plugin Discovery
  • 8.3 Connector Development Guide
    • + +
  • 8.4 Administration
  • 9. Kafka Streams