Commit Graph

56 Commits

Author SHA1 Message Date
James Cheng 2fb5664bf4 KAFKA-5597: Autogenerate producer sender metrics
Subtask of https://issues.apache.org/jira/browse/KAFKA-3480

The changes are very similar to what was done for the consumer in https://issues.apache.org/jira/browse/KAFKA-5191 (pull request https://github.com/apache/kafka/pull/2993)

Author: James Cheng <jylcheng@yahoo.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>, Rajini Sivaram <rajinisivaram@googlemail.com>, Guozhang Wang <wangguoz@gmail.com>

Closes #3535 from wushujames/producer_sender_metrics_docs

Fix one minor naming bug
2017-09-05 17:38:58 -07:00
Eno Thereska 6bee1e9e57 HOTFIX: Fixes to metric names of Streams
A couple of fixes to metric names to match the KIP
- Removed extra strings in the metric names that are already in the tags
- add a separate metric for "all"

Author: Eno Thereska <eno.thereska@gmail.com>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #3491 from enothereska/hotfix-metric-names
2017-08-03 14:16:47 -07:00
Dong Lin 4003c9384b KAFKA-5341; Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics (KIP-164)
Author: Dong Lin <lindong28@gmail.com>

Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>

Closes #3583 from lindong28/KAFKA-5341
2017-07-28 11:28:33 -07:00
Jeff Klukas 0816e47bfe MINOR: Docs update, Java clients use Kafka Metrics
This contribution is my original work and I license the work to the project under the project's open source license.

Author: Jeff Klukas <jeff@klukas.net>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #3249 from jklukas/docs-no-more-yammer-metrics-in-client
2017-07-20 12:31:17 +01:00
Vahid Hashemian 3bfc073f03 MINOR: Make 'Topic-Level Configs' a doc section for easier access
Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #3415 from vahidhashemian/doc/make_topic_config_a_section
2017-07-19 14:25:02 +01:00
huxihx 6d203361a0 KAFKA-5508; Documentation for altering topics
Operations documentation should guide user to employ `kafka-configs.sh` to add/remove configs for a topic.

Author: huxihx <huxi_2b@hotmail.com>

Reviewers: Damian Guy <damian.guy@gmail.com>

Closes #3429 from huxihx/KAFKA-5508_Doc_for_altering_topics
2017-07-06 10:10:03 +01:00
Eno Thereska d1a279dcc7 MINOR: Cache metrics were missing
Author: Eno Thereska <eno.thereska@gmail.com>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #3262 from enothereska/minor-missing-metric
2017-06-07 20:52:54 -07:00
Guozhang Wang 57b0d0fe57 MINOR: syntax brush for java / bash / json / text
Author: Guozhang Wang <wangguoz@gmail.com>

Reviewers: Derrick Or <derrickor@gmail.com>, Ismael Juma <ismael@juma.me.uk>

Closes #3214 from guozhangwang/KMinor-doc-java-brush
2017-06-07 15:17:25 +01:00
Rajini Sivaram b38b74bb77 MINOR: Fix doc for producer throttle time metrics
Author: Rajini Sivaram <rajinisivaram@googlemail.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>, Jun Rao <junrao@gmail.com>

Closes #3169 from rajinisivaram/MINOR-producer-metrics
2017-05-30 16:35:25 -07:00
James Cheng 0bc4f75eed KAFKA-5191: Autogenerate Consumer Fetcher metrics
Autogenerate docs for the Consumer Fetcher's metrics. This is a smaller subset of the original PR https://github.com/apache/kafka/pull/1202.

CC ijuma benstopford hachikuji

Author: James Cheng <jylcheng@yahoo.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>, Guozhang Wang <wangguoz@gmail.com>

Closes #2993 from wushujames/fetcher_metrics_docs
2017-05-26 15:34:20 -07:00
Rajini Sivaram 670193f22d KAFKA-4957; Request rate quotas documentation
Author: Rajini Sivaram <rajinisivaram@googlemail.com>

Reviewers: Jun Rao <junrao@gmail.com>

Closes #3069 from rajinisivaram/KAFKA-4957
2017-05-16 16:36:25 -07:00
Vahid Hashemian be11272818 MINOR: Fix a documentation typo
Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Sriharsha Chintalapani <harsha@hortonworks.com>

Closes #2674 from vahidhashemian/minor/fix_typos_1703
2017-03-15 11:50:57 -07:00
Eno Thereska 2e1b00f262 MINOR: Stream metrics documentation
Author: Eno Thereska <eno@confluent.io>

Reviewers: Matthias J. Sax, Guozhang Wang

Closes #2542 from enothereska/minor-streams-metrics
2017-02-15 16:32:02 -08:00
Alex Loddengaard 8bd8751aa7 MINOR: changes to the production broker configuration docs.
Author: Alex Loddengaard <alexloddengaard@gmail.com>

Reviewers: Jun Rao <junrao@gmail.com>

Closes #2519 from alexlod/production-config-docs
2017-02-08 17:18:55 -08:00
huxi be98865dfc KAFKA-4727; A Production server configuration needs to be updated
1. Update value for queued.max.requests to 500
2. Removed invalid config 'controller.message.queue.size'
3. Removed flush configs including 'log.flush.interval.messages', 'log.flush.interval.ms' and 'log.flush.scheduler.interval.ms'

Author: huxi <huxi@zhenrongbao.com>

Reviewers: Grant Henke <granthenke@gmail.com>, Jun Rao <junrao@gmail.com>

Closes #2490 from amethystic/kafka4727_server_config_doc_update
2017-02-07 08:40:30 -08:00
Vahid Hashemian 63cf0e5877 MINOR: Update consumer group describe output in the documentation
Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>

Closes #2409 from vahidhashemian/doc/update_consumer_group_describe_output
2017-01-24 16:24:19 -08:00
Scott Ferguson 05d7664317 MINOR: fixup typo in ops.html
pretty boring docfix, "no" -> "not"

Author: Scott Ferguson <smferguson@gmail.com>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #2269 from smferguson/fixup_typo_in_add_remove_topics
2016-12-21 11:37:32 -08:00
Derrick Or 53428694a6 Separate Streams documentation and setup docs with easy to set variables
- Seperate Streams documentation out to a standalone page.
- Setup templates to use handlebars.js
- Create template variables to swap in frequently updated values like version number from a single file templateData.js

Author: Derrick Or <derrickor@gmail.com>

Reviewers: Guozhang Wang <wangguoz@gmail.com>

Closes #2245 from derrickdoo/docTemplates
2016-12-13 17:59:49 -08:00
Alex Loddengaard 6f0cbe7212 MINOR: doc fix related to monitoring consumer lag
Author: Alex Loddengaard <alexloddengaard@gmail.com>

Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>

Closes #1814 from alexlod/consumer-lag-doc-fix
2016-11-29 09:57:22 -08:00
Ismael Juma 079ea89b36 KAFKA-4417: Update build dependencies for 0.10.2 cycle
Notes on the updates:
* Gradle to 3.2: better incremental build and faster IDE import times (https://docs.gradle.org/3.2/release-notes)
* zkclient to 0.10: it now uses slf4j-api instead of log4j
* zookeeper to 3.4.9: a few important bug fixes (http://zookeeper.apache.org/doc/r3.4.9/releasenotes.html)
* jackson to 2.8.5: lots of updates (https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.6, https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.7, https://github.com/FasterXML/jackson/wiki/Jackson-Release-2.8)
* jersey to 2.24: bug fixes (https://jersey.java.net/release-notes/2.23.html, https://jersey.java.net/release-notes/2.24.html)
* jopt to 5.0.3: minor improvements, the major version bump is due to requiring Java 7 instead of 6 (https://pholser.github.io/jopt-simple/changes.html)
* argparse4j to 0.7.0: minor tweaks and improvements (https://github.com/tatsuhiro-t/argparse4j/blob/argparse4j-0.6.0/NEWS, https://github.com/tatsuhiro-t/argparse4j/blob/argparse4j-0.7.0/NEWS)
* Gradle plugins
* bcpkix to 1.55: quite a few additions, but nothing that matters to us (http://www.bouncycastle.org/releasenotes.html)

Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Ewen Cheslack-Postava <ewen@confluent.io>

Closes #2144 from ijuma/gradle-3.2-and-deps
2016-11-17 14:43:00 -08:00
Ben Stopford b8cfa167ed DOC: Documentation for Throttled Replication
Author: Ben Stopford <benstopford@gmail.com>

Reviewers: Jun Rao, Gwen Shapira

Closes #2033 from benstopford/throttling-docs
2016-10-18 14:24:52 -07:00
Vahid Hashemian ae9532c6b3 MINOR: Fixed broken links in the documentation
Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Jason Gustafson <jason@confluent.io>

Closes #2010 from vahidhashemian/doc/fix_hyperlinks
2016-10-11 20:25:35 -07:00
Vahid Hashemian 8e9e63138d MINOR: Fix table of contents and section numbers in the documentation
Removed a non-existing reference in table of contents and fixed some section numbers.

Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Jason Gustafson <jason@confluent.io>

Closes #2004 from vahidhashemian/doc/fix_toc
2016-10-10 17:09:52 -07:00
Vahid Hashemian e972d2afd3 MINOR: Fix typos in documentation
And improve readability by adding proper punctuations.

Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Jason Gustafson <jason@confluent.io>

Closes #2002 from vahidhashemian/doc/fix_typos
2016-10-10 15:58:37 -07:00
Rajini Sivaram 3c8925946d KAFKA-4252; Fix purgatory metric name in documentation
Author: Rajini Sivaram <rajinisivaram@googlemail.com>

Reviewers: Jason Gustafson <jason@confluent.io>

Closes #1980 from rajinisivaram/KAFKA-4252
2016-10-06 11:19:43 -07:00
Vahid Hashemian d2a267b111 KAFKA-3697; Clean up website documentation of client usage
This is to imply that the Java consumer/producer are the recommended consumer/producer now.

Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Jason Gustafson <jason@confluent.io>

Closes #1921 from vahidhashemian/KAFKA-3697
2016-09-29 19:37:20 -07:00
Ismael Juma 61d3378bc8 MINOR: Remove no longer required --new-consumer switch in docs
Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Jason Gustafson <jason@confluent.io>

Closes #1905 from ijuma/no-new-consumer-switch-in-examples
2016-09-27 16:49:46 -07:00
Rajini Sivaram f27a6f319a KAFKA-4079; Documentation for secure quotas
Details in KIP-55.

Author: Rajini Sivaram <rajinisivaram@googlemail.com>

Reviewers: Jun Rao <junrao@gmail.com>

Closes #1847 from rajinisivaram/KAFKA-4079
2016-09-19 12:16:45 -07:00
Andrew Otto b4ddd021b4 MINOR: Update MirrorMaker docs to remove multiple --consumer.config options
See:
- https://issues.apache.org/jira/browse/KAFKA-1650
- https://mail-archives.apache.org/mod_mbox/kafka-users/201512.mbox/%3CCAHwHRrUeTq_-EHXiUXdrbgHcRt-0E_t0+5kOYaF9Qy4aNVqYkAmail.gmail.com%3E

Author: Andrew Otto <acotto@gmail.com>

Reviewers: Gwen Shapira

Closes #1654 from ottomata/mirror-maker-doc-fix
2016-08-25 20:32:08 -07:00
Alex Loddengaard 20155ef87e MINOR: doc changes for QueueTimeMs JMX metrics.
Author: Alex Loddengaard <alexloddengaard@gmail.com>

Reviewers: Gwen Shapira

Closes #1706 from alexlod/doc-queuetimems-jmx
2016-08-25 20:29:20 -07:00
Kaufman Ng 6b2564811a KAFKA-3479: Add new consumer metrics documentation
added new consumer metrics section
refactored common metrics into new section
updated TOC

Author: Kaufman Ng <kaufman@confluent.io>

Reviewers: Jason Gustafson <jason@confluent.io>, Ewen Cheslack-Postava <ewen@confluent.io>

Closes #1361 from coughman/KAFKA-3479-consumer-metrics-doc
2016-08-07 14:29:03 -07:00
Samuel Taylor 0744449eaa MINOR: Fix typo in Operations section
This contribution is my original work, and I license the work to the project under the project's open source license.

Author: Samuel Taylor <staylor@square-root.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #1630 from ssaamm/trunk
2016-07-19 10:20:13 +01:00
Todd Palino e0eaa7f12e KAFKA-3725; Update documentation with regards to XFS
I've updated the ops documentation with information on using the XFS filesystem, based on LinkedIn's testing (and subsequent switch from EXT4).

I've also added some information to clarify the potential risk to the suggested EXT4 options (again, based on my experience with a multiple broker failure situation).

Author: Todd Palino <tpalino@linkedin.com>

Reviewers: Sriharsha Chintalapani <harsha@hortonworks.com>, Dana Powers <dana.powers@gmail.com>, Ismael Juma <ismael@juma.me.uk>

Closes #1605 from toddpalino/trunk
2016-07-11 09:01:04 +01:00
Thanasis Katsadas 0f8b679035 MINOR: Typo fix in docs ops
Author: Thanasis Katsadas <thanasis00@gmail.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #1552 from thanasis00/trunk
2016-07-02 02:20:42 +01:00
Filipe Azevedo 4c6d7ed95a KAFKA-3838; Update zkClient to 0.9 and Zookeeper to 3.4.8
Author: Filipe Azevedo <filipe@azevedo.io>

Reviewers: Flavio Junqueira <fpj@apache.org>, Ismael Juma <ismael@juma.me.uk>

Closes #1512 from mangas/trunk
2016-06-17 08:51:55 +02:00
Dustin Cote 0e1c012fb5 KAFKA-3683; Add file descriptor recommendation to ops guide
Adding sizing recommendations for file descriptors to the ops guide.

Author: Dustin Cote <dustin@confluent.io>
Author: Dustin Cote <dustin@dustins-mbp.attlocal.net>

Reviewers: Gwen Shapira

Closes #1353 from cotedm/KAFKA-3683 and squashes the following commits:

8120318 [Dustin Cote] Adding file descriptor sizing recommendations
0908aa9 [Dustin Cote] Merge https://github.com/apache/kafka into trunk
32315e4 [Dustin Cote] Merge branch 'trunk' of https://github.com/cotedm/kafka into trunk
13309ed [Dustin Cote] Update links for new consumer API
4dcffc1 [Dustin Cote] Update links for new consumer API
2016-05-24 17:26:54 -07:00
Ben Stopford 6978115514 MINOR: Documentation for Rack Awareness
Author: Ben Stopford <benstopford@gmail.com>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #1369 from benstopford/rack-awareness-docs
2016-05-11 15:28:18 +01:00
Dustin Cote 78de891ace KAFKA-3666; Update links for new consumer API
Pull request to update the consumer API links in the docs.

Author: Dustin Cote <dustin@dustins-mbp.attlocal.net>

Reviewers: Ismael Juma <ismael@juma.me.uk>

Closes #1331 from cotedm/KAFKA-3666
2016-05-06 16:33:01 +01:00
Dongjoon Hyun e79d9af3cf KAFKA-3461: Fix typos in Kafka web documentations.
This PR fixes 8 typos in HTML files of `docs` module. I wrote explicitly here since Github sometimes does not highlight the corrections on long lines correctly.
- docs/api.html: compatability => compatibility
- docs/connect.html: simultaneoulsy => simultaneously
- docs/implementation.html: LATIEST_TIME => LATEST_TIME, nPartions => nPartitions
- docs/migration.html: Decomission => Decommission
- docs/ops.html: stoping => stopping, ConumserGroupCommand => ConsumerGroupCommand, youre => you're

Author: Dongjoon Hyun <dongjoon@apache.org>

Reviewers: Ismael Juma

Closes #1138 from dongjoon-hyun/KAFKA-3461
2016-04-12 13:48:18 -07:00
Flavio Junqueira 75ec67eda8 KAFKA-2930: Update references to ZooKeeper in the docs.
Author: Flavio Junqueira <fpj@apache.org>

Reviewers: Ismael Juma, Gwen Shapira

Closes #615 from fpj/KAFKA-2930
2016-04-01 15:57:39 -07:00
Vahid Hashemian ad3dfc6ab2 KAFKA-3219: Fix long topic name validation
This fixes an issue with long topic names by considering, during topic
validation, the '-' and the partition id that is appended to the log
folder created for each topic partition.

Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Gwen Shapira, Grant Henke

Closes #898 from vahidhashemian/KAFKA-3219
2016-03-22 13:10:07 -07:00
Christian Posta 2fed0c62db MINOR: tidy up spacing for ConsumerGroupCommand related to KAFKA-1476 …
https://issues.apache.org/jira/browse/KAFKA-1476

Let me know if these kind of contributions should have their own requisite JIRA opened in advance.

Cheers..

Author: Christian Posta <christian.posta@gmail.com>

Reviewers: Gwen Shapira

Closes #945 from christian-posta/ceposta-tidy-up-consumer-groups-describe
2016-03-07 18:30:01 -08:00
Ashish Singh 4542b027c1 KAFKA-3243: Fix Kafka basic ops documentation for Mirror maker, blacklist is not supported for new consumers
…list is not supported for new consumers

Author: Ashish Singh <asingh@cloudera.com>

Reviewers: Grant Henke <granthenke@gmail.com>, Ewen Cheslack-Postava <ewen@confluent.io>

Closes #923 from SinghAsDev/KAFKA-3243
2016-02-26 10:37:41 -08:00
James Cheng 4fd60c6120 KAFKA-3216: "Modifying topics" section incorrectly says you can't change replication factor.
Correct the text that said that you can't change the replication factor of a topic.

Author: James Cheng <jylcheng@yahoo.com>

Reviewers: Ismael Juma

Closes #881 from wushujames/KAFKA-3216
2016-02-09 10:33:39 -08:00
Vahid Hashemian d00cf520fb MINOR: Improve Kafka documentation
Improve the documentation by fixing typos, punctuations, and correcting the content.

Author: Vahid Hashemian <vahidhashemian@us.ibm.com>

Reviewers: Grant Henke <granthenke@gmail.com>, Ewen Cheslack-Postava <ewen@confluent.io>

Closes #778 from vahidhashemian/typo05/fix_documentation_typos
2016-01-23 22:26:53 -08:00
Ján Koščo d61543e321 MINOR: Typo in documentation of topic config removal
Author: Ján Koščo <3k.stanley@gmail.com>

Reviewers: Ismael Juma, Grant Henke, Guozhang Wang

Closes #768 from s7anley/trunk
2016-01-13 14:58:37 -08:00
Sasaki Toru b0a4a57c56 MINOR: Improve document of MirrorMaker
Author: Sasaki Toru <sasakitoa@nttdata.co.jp>

Reviewers: Gwen Shapira

Closes #717 from sasakitoa/mirrorMaker_doc
2015-12-26 08:51:07 -08:00
Alex Loddengaard f7fc285386 MINOR: Trivial doc/ typo fixes.
The change in `docs/design.html` is hard to catch in the diff -- a `tbe` is changed to `the`. All other changes show up clearly in the diff.

This contribution is my original work and I license the work to the project under the project's open source license.

Author: Alex Loddengaard <alexloddengaard@gmail.com>

Reviewers: Grant Henke, Gwen Shapira

Closes #654 from alexlod/doc-typo-fixes
2015-12-09 17:39:53 -06:00
Ismael Juma fb6ea6b179 MINOR: Update LinkedIn JVM tuning settings
This is a follow-up as the previous update was missing some changes.

Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Todd Palino, Guozhang Wang

Closes #607 from ijuma/java-tuning-settings
2015-12-01 11:16:33 -08:00
Ismael Juma a35334908d MINOR: Update "Java Version" section
Use the latest information from LinkedIn and mention that the latest
released version is recommended from a security perspective.

Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Grant Henke

Closes #603 from ijuma/java-version-recommendation
2015-11-30 13:57:54 -08:00