Commit Graph

357 Commits

Author SHA1 Message Date
GitLab Bot 73add99b1f Add latest changes from gitlab-org/gitlab@master 2020-09-09 09:08:40 +00:00
GitLab Bot 4fa04f789e Add latest changes from gitlab-org/gitlab@master 2020-09-02 12:10:35 +00:00
GitLab Bot 2947190073 Add latest changes from gitlab-org/gitlab@master 2020-08-27 21:10:27 +00:00
GitLab Bot 0a22eaad01 Add latest changes from gitlab-org/gitlab@master 2020-08-01 03:09:36 +00:00
GitLab Bot ea937d0916 Add latest changes from gitlab-org/gitlab@master 2020-07-31 15:10:14 +00:00
GitLab Bot 55b5a8778c Add latest changes from gitlab-org/gitlab@master 2020-07-30 12:09:33 +00:00
GitLab Bot 937f82e11f Add latest changes from gitlab-org/gitlab@master 2020-07-29 00:09:37 +00:00
GitLab Bot 7ab026e2a2 Add latest changes from gitlab-org/gitlab@master 2020-07-23 18:10:06 +00:00
GitLab Bot 448ff1fb83 Add latest changes from gitlab-org/gitlab@master 2020-07-22 03:09:40 +00:00
GitLab Bot 3a9076e0a4 Add latest changes from gitlab-org/gitlab@master 2020-07-16 18:09:35 +00:00
GitLab Bot ce34395e91 Add latest changes from gitlab-org/gitlab@master 2020-07-13 12:09:18 +00:00
GitLab Bot 7cd0959043 Add latest changes from gitlab-org/gitlab@master 2020-07-11 06:09:15 +00:00
GitLab Bot 1782886ed2 Add latest changes from gitlab-org/gitlab@master 2020-07-10 15:09:07 +00:00
GitLab Bot 0a9efe0288 Add latest changes from gitlab-org/gitlab@master 2020-07-09 03:09:01 +00:00
GitLab Bot e49bd57279 Add latest changes from gitlab-org/gitlab@master 2020-07-07 21:09:13 +00:00
GitLab Bot a93bf027c2 Add latest changes from gitlab-org/gitlab@master 2020-07-07 15:08:49 +00:00
GitLab Bot 0254867cf0 Add latest changes from gitlab-org/gitlab@master 2020-07-07 12:09:16 +00:00
GitLab Bot 1c75400c24 Add latest changes from gitlab-org/gitlab@master 2020-07-03 09:08:53 +00:00
GitLab Bot 57b359e90c Add latest changes from gitlab-org/gitlab@master 2020-07-03 00:09:23 +00:00
GitLab Bot a64fb464b4 Add latest changes from gitlab-org/gitlab@master 2020-06-11 09:08:16 +00:00
GitLab Bot 6ff3eb60e3 Add latest changes from gitlab-org/gitlab@master 2020-06-09 15:08:05 +00:00
GitLab Bot 37c8b3b44e Add latest changes from gitlab-org/gitlab@master 2020-06-04 21:08:11 +00:00
GitLab Bot c66aadd2ee Add latest changes from gitlab-org/gitlab@master 2020-06-04 06:08:42 +00:00
GitLab Bot 810bd2a662 Add latest changes from gitlab-org/gitlab@master 2020-06-02 12:08:33 +00:00
GitLab Bot 8c826685ec Add latest changes from gitlab-org/gitlab@master 2020-06-02 09:08:01 +00:00
GitLab Bot 711f859532 Add latest changes from gitlab-org/gitlab@master 2020-06-01 15:08:16 +00:00
GitLab Bot c70ed55242 Add latest changes from gitlab-org/gitlab@master 2020-05-29 03:08:11 +00:00
GitLab Bot 1547279331 Add latest changes from gitlab-org/gitlab@master 2020-05-22 21:08:22 +00:00
GitLab Bot 707c0eca50 Add latest changes from gitlab-org/gitlab@master 2020-05-22 06:08:41 +00:00
GitLab Bot 8f306a7dc5 Add latest changes from gitlab-org/gitlab@master 2020-05-21 06:08:25 +00:00
GitLab Bot 374cf04cf2 Add latest changes from gitlab-org/gitlab@master 2020-05-20 12:07:52 +00:00
GitLab Bot 67cd2904c9 Add latest changes from gitlab-org/gitlab@master 2020-05-14 21:07:52 +00:00
GitLab Bot 868e4e69bb Add latest changes from gitlab-org/gitlab@master 2020-05-13 15:08:23 +00:00
GitLab Bot 0e65189f85 Add latest changes from gitlab-org/gitlab@master 2020-05-13 09:08:37 +00:00
GitLab Bot 17c8111494 Add latest changes from gitlab-org/gitlab@master 2020-05-07 21:09:26 +00:00
GitLab Bot b6a92c969b Add latest changes from gitlab-org/gitlab@master 2020-05-07 06:09:38 +00:00
GitLab Bot 7f305b576b Add latest changes from gitlab-org/gitlab@master 2020-04-30 15:09:46 +00:00
GitLab Bot 6b8e971261 Add latest changes from gitlab-org/gitlab@master 2020-04-30 03:09:32 +00:00
GitLab Bot f569792df8 Add latest changes from gitlab-org/gitlab@master 2020-04-27 18:09:41 +00:00
GitLab Bot 37a0fef392 Add latest changes from gitlab-org/gitlab@master 2020-04-22 03:09:19 +00:00
GitLab Bot ade18c9d68 Add latest changes from gitlab-org/gitlab@master 2020-04-02 09:08:14 +00:00
GitLab Bot 1219a9dce9 Add latest changes from gitlab-org/gitlab@master 2020-04-01 15:07:45 +00:00
GitLab Bot 83a3209c3f Add latest changes from gitlab-org/gitlab@master 2020-03-31 03:07:51 +00:00
GitLab Bot be2f4c5788 Add latest changes from gitlab-org/gitlab@master 2020-03-24 03:09:28 +00:00
GitLab Bot 1363ca12f1 Add latest changes from gitlab-org/gitlab@master 2020-03-18 12:09:13 +00:00
GitLab Bot 8ae26d705a Add latest changes from gitlab-org/gitlab@master 2020-03-17 12:09:52 +00:00
GitLab Bot 1fa79760ad Add latest changes from gitlab-org/gitlab@master 2020-03-10 12:08:16 +00:00
GitLab Bot a6011c3d70 Add latest changes from gitlab-org/gitlab@master 2020-03-06 03:08:08 +00:00
GitLab Bot 946771d0b0 Add latest changes from gitlab-org/gitlab@master 2020-03-03 15:08:08 +00:00
GitLab Bot df2eda3f14 Add latest changes from gitlab-org/gitlab@master 2020-02-20 18:08:51 +00:00
GitLab Bot 0eb3d2f799 Add latest changes from gitlab-org/gitlab@master 2020-02-06 15:09:11 +00:00
GitLab Bot f4d27d532e Add latest changes from gitlab-org/gitlab@master 2020-02-03 03:08:30 +00:00
GitLab Bot a1ed98e0c8 Add latest changes from gitlab-org/gitlab@master 2020-01-31 00:09:13 +00:00
GitLab Bot fedf978f9a Add latest changes from gitlab-org/gitlab@master 2020-01-28 15:08:36 +00:00
GitLab Bot 9b984f55ee Add latest changes from gitlab-org/gitlab@master 2020-01-24 09:08:32 +00:00
GitLab Bot d47f9d2304 Add latest changes from gitlab-org/gitlab@master 2020-01-16 15:08:41 +00:00
GitLab Bot 6f0f893bd8 Add latest changes from gitlab-org/gitlab@master 2020-01-10 18:07:43 +00:00
GitLab Bot e879335864 Add latest changes from gitlab-org/gitlab@master 2020-01-09 00:07:40 +00:00
GitLab Bot 30010b161d Add latest changes from gitlab-org/gitlab@master 2020-01-08 03:08:05 +00:00
GitLab Bot e440c86979 Add latest changes from gitlab-org/gitlab@master 2020-01-07 09:07:59 +00:00
GitLab Bot c2b98d3dbd Add latest changes from gitlab-org/gitlab@master 2019-12-17 15:08:15 +00:00
GitLab Bot 8cc5f27909 Add latest changes from gitlab-org/gitlab@master 2019-12-13 12:07:41 +00:00
GitLab Bot 134fe18200 Add latest changes from gitlab-org/gitlab@master 2019-12-05 21:07:40 +00:00
GitLab Bot 284ae7dd75 Add latest changes from gitlab-org/gitlab@master 2019-11-28 03:06:32 +00:00
GitLab Bot b42f312df5 Add latest changes from gitlab-org/gitlab@master 2019-11-13 21:06:45 +00:00
GitLab Bot b4e072cbaf Add latest changes from gitlab-org/gitlab@master 2019-10-11 06:06:27 +00:00
GitLab Bot 20450649ca Add latest changes from gitlab-org/gitlab@master 2019-09-27 09:06:26 +00:00
GitLab Bot 9735395f94 Add latest changes from gitlab-org/gitlab@master 2019-09-26 06:06:27 +00:00
GitLab Bot 3fdbfaf3e5 Add latest changes from gitlab-org/gitlab@master 2019-09-25 18:06:17 +00:00
GitLab Bot 80f61b4035 Add latest changes from gitlab-org/gitlab@master 2019-09-18 14:02:45 +00:00
Etienne Baqué 27fb694017 Updated description in the Gitlab Prometheus metrics section 2019-09-07 11:18:14 +00:00
Jacopo f599862e6c
Remove feature flags starting with `prometheus_transaction_`
Those feature flags were always enabled so we can remove them safely.
2019-09-05 11:01:02 +02:00
Thong Kuah 5af73e8451 Add docs for db_load_balancing metrics 2019-08-27 12:59:15 +12:00
Marcel Amirault d642c60df9 Add backticks and remove square brackets
Square and Angle bracket use causes kramdown warnings,
so changed or enclosed in backticks as needed
2019-08-26 20:17:51 +00:00
David Wilkins 7b917bf9b6 62514 - update prometheus metrics docs
- Strikeout for metrics that aren't reported anymore

- added 👍 for all the metrics that appear to be still
  available

- Added 🆕 for the new metrics.

- Determine Release when the new metrics appeared

- Add descriptions for the new metrics

- remove the adornments 🆕 and 👍

- removce the lines with strikeout
2019-08-23 13:10:39 +00:00
Aleksei Lipniagov 6fc7033725 Remove :puma_phase metrics
We don't use phase restarts, as we use `preload_app`:
https://github.com/puma/puma/blob/master/README.md#clustered-mode
`:puma_phase` values will always be zero.
2019-08-14 17:46:40 +03:00
Ben Kochie 442f599177 Adjust redis cache metrics
* Remove `controller` and `action` labels from duration histogram.
* Create a new simple counter for `controller` and `action`.
* Adjust histogram buckets to observe smaller response times.
2019-07-19 13:34:04 +00:00
Ben Kochie 382a13c015
Update example Prometheus scrape config
Use a full real-world example that is compatible with the omnibus
dashboards and follows Prometheus best practices.
2019-07-15 15:16:36 +02:00
Marcel Amirault 4633604424 Fix whitespace in many administration docs
Many code blocks are 4spaced, and they render in GitLab
without coloring as a result, even though they are
fenced with a language label. If in a list, other items
will render as being in a code block too, even if not
meant to. This fixes all these issues for many admin
docs (part 2)
2019-07-10 18:23:55 +00:00
Marcel Amirault 73c6477b7e Changing badges to use parentheses not brackets
Previously, we used brackets to denote the tier badges,
but this made Kramdown, the docs site Markdown renderer,
show many warnings when building the site. This is now
fixed by using parentheses instead of square brackets.

This was caused by [PREMIUM] looking like a link to
Kramdown, which couldn't find a URL there.

See:
- https://gitlab.com/gitlab-com/gitlab-docs/merge_requests/484
- https://gitlab.com/gitlab-org/gitlab-ce/issues/63800
2019-07-08 08:50:38 +00:00
Ryan Cobb 04962880ad Fix process start time
Previously we were recording process start time as seconds from boot.
This makes it so we record as epoch time.
2019-07-04 10:24:19 +00:00
Marcel Amirault 1464b1e000 Fix markdown to reduce number of kramdown warnings
Add backticks around square brackets, or fix links, as necessary.
2019-07-03 07:12:04 +00:00
Jan Provaznik 497acb1670 Add metric for measuring PumaWorkerKiller activity
PumaWorkerKiller is used for periodically checking and killing
workers (the biggest one) if overall memory reaches specified
limit. This metric allows us to watch number of killed workers.
2019-06-10 16:09:40 +00:00
Bob Van Landuyt 327cae1da7 Merge branch '61964-unicorn-instrumentation' into 'master'
Adds ruby and unicorn instrumentation

Closes #61964

See merge request gitlab-org/gitlab-ce!28499
2019-06-04 17:59:04 +00:00
Jan Provaznik 6d6bae66df Added rack-timeout for Puma
It assures that requests are aborted after 60 seconds, otherwise
an exception is raised. This exception is logged by Sentry, also
there is a Prometheus counter for measuring number of requests in each
state.
2019-05-29 18:53:44 +00:00
Ryan Cobb ddfff1e404 Update documentation to indicate new metrics for 12.0 2019-05-29 10:59:23 -06:00
Ryan Cobb 0393c5059d Merge branch 'master' into 61964-unicorn-instrumentation 2019-05-29 10:56:38 -06:00
Jan Provaznik a5adc6a024 Add Puma sampler
This sampler gathers Puma-specific metrics which can be used by
Prometheus then.
2019-05-29 12:27:44 +00:00
Ryan Cobb 9eeedfccbc Adds ruby and unicorn instrumentation
This adds ruby and unicorn instrumentation. This was originally
intended in 11.11 but due to performance concerns it was reverted. This
new commit foregoes the sys-proctable gem was causing performance issues
previously.
2019-05-20 13:36:59 -06:00
Ryan Cobb 2334b07726 Revert "Merge branch '56850-add-new-unicorn-metrics' into 'master'"
This reverts merge request !27474
2019-05-20 14:34:00 +00:00
Ash McKenzie c5a9bc17a1 Merge branch '56850-add-new-unicorn-metrics' into 'master'
Resolve "Add new Unicorn metrics"

Closes #56850

See merge request gitlab-org/gitlab-ce!27474
2019-05-07 16:21:40 +00:00
Marcel Amirault 0b006bfda8 Docs: Merge EE doc/administration/monitoring to CE 2019-05-05 12:51:26 +00:00
Ryan Cobb c16a7a8c56 Clarify wording in metrics documentation 2019-05-01 12:32:13 -06:00
Ryan Cobb 17986d91a5 Add back ruby_memory_bytes metric, limit duplication, clean up
This adds back ruby_memory_bytes for backwards compatibility, limits
code duplication, cleans up unused methods, and limits the unicorn
worker sampling scope.
2019-04-29 12:13:02 -06:00
Ryan Cobb bb27bf4a1c Update docs and calculate process start time via proc table
This updates monitor docs to reflect the new ruby and unicorn metrics as
well as making it so we fetch process start time via the proc table
instead of via CLOCK_BOOTTIME
2019-04-24 17:05:09 -06:00
Cindy Pallares 9bf740f725
Update external prometheus config
Updated to include missing metrics:
    * GitLab Workhorse
    * Nginx
    * Sidekiq
2019-04-16 16:39:57 -05:00
Evan Read c7fdfeea2f Fix note lists throughout docs 2019-03-20 13:45:15 +00:00
Marcel Amirault fd8234856e Docs: Fix all anchors in Admin docs 2019-03-04 00:17:57 +00:00
Takuya Noguchi e8fee6b8f7 Fix misspellings in docs
Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2019-02-25 10:31:35 +09:00
Joshua Lambert c2f79ab2ad Update Prometheus documentation to indicate on by default 2019-02-19 17:13:25 -05:00
Ben Kochie e1ea47bb5c
Update metrics docs
Update the list of GitLab metrics to include the missing metric names.
2019-02-06 15:15:13 +01:00
Chenjerai Katanda 414ca3f7a8 Add instructions on how to add Prometheus as data source in Grafana 2018-11-23 16:14:12 +00:00
Marcia Ramos 53996b6484 Merge branch 'patch-28' into 'master'
Fix punctuation error

See merge request gitlab-org/gitlab-ce!22345
2018-11-16 12:44:31 +00:00
Achilleas Pipinellis c1f2fa8e99 Merge branch 'add-prometheus-external-docs' into 'master'
Add docs for setting up external Prometheus

Closes #40949 and #37255

See merge request gitlab-org/gitlab-ce!22831
2018-11-14 08:06:33 +00:00
Achilleas Pipinellis 12d98ec0f0
Properly indent codeblocks 2018-11-14 09:00:43 +01:00
Joshua Lambert c1ae5bc0bc Incorporate feedback 2018-11-13 15:44:31 -05:00
Joshua Lambert b83917f9cf Add additional documentation for external Prometheus server 2018-11-13 00:53:37 -05:00
Evan Read 16cb782a79 Feature backported to CE in 11.5, not 10.7 2018-11-08 09:24:26 +10:00
Toon Claes 149b632722 Backport changes from EE
Now the files are identical again compared to EE.

These are backported from
https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/5050
2018-11-07 11:29:31 +01:00
Joshua Lambert b42234202b WIP update 2018-11-06 01:19:40 -05:00
Andrew Banchich 7067cbaef9 Fix punctuation error 2018-10-14 18:18:37 +00:00
Zeger-Jan van de Weg 30b4ce940d
Remove Git circuit breaker
Was introduced in the time that GitLab still used NFS, which is not
required anymore in most cases. By removing this, the API it calls will
return empty responses. This interface has to be removed in the next
major release, expected to be 12.0.
2018-10-10 09:08:18 +02:00
Ben Kochie e91c7469ad
Update example Prometheus queries
* Update metric names to match current release.
* Improve descriptions.
* Improve examples to show more query language functionality.

Memory:
* Show use of `or` function.
* Automatically select "MemAvailable" kernel metric if possible.

CPU:
* Show use of `avg without ...`.
* Show CPU utilization per node.

Network:
* Show use of `!=` label matching.
* Don't show "localhost" metrics.
2018-09-12 10:23:25 +02:00
Brett Walker b0be58a1b3 Resolve "CE documentation is not CommonMark compliant" 2018-09-06 16:52:18 +00:00
Lin Jen-Shin cf7cb4f6df Use title: "Unicorn Metrics available" as in EE 2018-07-18 17:22:51 +08:00
Stan Hu 7376ffc3a3 Add Prometheus metrics to track reCAPTCHA success/failures 2018-07-03 11:39:00 -07:00
Ben Kochie 78a9991543
Cleanup ruby sampler metrics
* Use a simple counter for sampler duration instead of a histogram.
* Use a counter to collect GC time.
* Remove unused objects metric.
* Cleanup metric names to match Prometheus conventions.
* Prefix generic GC stats with `gc_stat`.
* Include worker label on memory and file descriptor metrics.
2018-06-22 14:12:22 +02:00
Ben Bodenmiller ce7936176f cleanup Prometheus setup details 2018-05-29 08:29:19 +00:00
Joshua Lambert e4ebee4246 Remove experiemental notes from Prometheus docs 2018-05-21 10:48:59 +00:00
Pascal Borreli 12e3eff462 Fixed typos 2018-04-27 08:50:05 +00:00
Nathan Jones 33c163b347
Update index.md to describe leaving out the host in prometheus['listen_address'] to allow public access.
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-04-05 18:38:29 +02:00
Bob Van Landuyt d4d06bded1 Keep track of storage check timings 2017-12-11 13:18:39 +01:00
Bob Van Landuyt 9ced16d914 Add missing circuitbreaker metrics to prometheus documentation 2017-10-27 13:12:47 +02:00
Filipa Lacerda 25285d90a8 Merge branch 'pawel/prometheus_multiproc_dir_documentation' into 'master'
Documentation and link to explanation of prometheus_multiproc_dir

See merge request !12956
2017-07-20 16:56:37 +00:00
Pawel Chojnacki d4df306b07 Documentation and link to explanation of prometheus_multiproc_dir
- Change the wording a little bit
2017-07-20 10:18:06 +02:00
Ben Kochie 53c2f5538b Add versions to Prometheus metrics doc
Document the original release of each Prometheus metric.
2017-07-19 14:40:30 +02:00
Ben Kochie afba21f6a0 Update piplines created metric name
* Use `_total` naming convention.
* Add to metrics documentation.
2017-07-19 09:43:57 +02:00
Joshua Lambert 811108dce9 Fixed typos 2017-07-18 10:58:19 -04:00
Joshua Lambert 9f85578c0a Update admin docs 2017-07-17 00:29:21 -04:00
Achilleas Pipinellis 1322042bcb Split docs on IP whitelist for monitoring access 2017-07-16 11:25:34 +03:00
Ben Kochie 79465fb3d4 Update sessions metric name. 2017-07-12 15:05:51 +02:00
Ben Kochie 93be7b5a1c Update metrics docs. 2017-07-12 15:00:17 +02:00
Ben Kochie 86cbef4df4 Add unit to latency metrics.
Add `seconds` unit to latency metrics based on uptream naming
convention[0].

[0]: https://prometheus.io/docs/practices/naming/#metric-names
2017-07-12 14:48:46 +02:00
Achilleas Pipinellis e8a29506f6 Fix broken relative URL in prometheus docs 2017-06-21 11:29:47 +02:00
Joshua Lambert 9f7460c6e7 Add Prometheus metrics documentation 2017-06-19 19:10:05 -07:00
Joshua Lambert 2413a4b5eb Remove unnecessary paragraph 2017-03-20 11:24:40 -04:00
Joshua Lambert fa87ff0e30 Minor tweak 2017-03-20 11:21:24 -04:00
Joshua Lambert 24a3311848 Update docs to indicate prometheus k8s monitoring is on by default 2017-03-20 11:17:57 -04:00
Joshua Lambert 0ac690778c Fix config option to disable Prometheus 2017-03-16 22:06:47 +00:00
Achilleas Pipinellis 72bd0aa0ca Fix broken links limit lines to 80 chars
[ci skip]
2017-03-16 19:30:28 +01:00
Joshua Lambert 7726cb390e Add prometheus memory requirements, include additional detail on disabling prometheus in docs. 2017-03-16 14:02:07 -04:00
Joshua Lambert a5134f10fb Minor changes to administration doc 2017-03-15 15:41:10 -04:00
Achilleas Pipinellis 0d860ae39f Refactor Prometheus integration docs
[ci skip]
2017-03-15 10:37:07 +01:00
Lukas Raska 631d3c6baa Use correct GitLab Prometheus exporter name in docs 2017-02-24 07:50:45 +01:00
Achilleas Pipinellis 6ad9916833 Consider existing installations where the setting is not in gitlab.rb
[ci skip]
2017-02-09 10:31:02 +01:00
Achilleas Pipinellis 52313cfb14 Change to direct link for Omnibus Nginx docs
[ci skip]
2017-02-09 10:24:50 +01:00
Achilleas Pipinellis 419bbbf80d Add info on changing the default address/port Prometheus listens on
Reported in https://gitlab.com/gitlab-org/omnibus-gitlab/issues/1905

[ci skip]
2017-02-09 10:20:30 +01:00
Achilleas Pipinellis 614f371989 Fix GitLab monitor Omnibus setting
[ci skip]
2017-02-09 10:03:01 +01:00
Achilleas Pipinellis a114f7cbc7 Add link to issue where HSTS is discussed
[ci skip]
2017-02-09 09:48:03 +01:00
Achilleas Pipinellis c803254e38 Add changes from https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/8764 2017-02-09 09:44:05 +01:00
Achilleas Pipinellis 1bde5d11e3 Use underscores instead of dashes in gitlab.rb
[ci skip]
2017-02-08 15:45:43 +01:00
Achilleas Pipinellis 4049783d88 Add GitLab monitor exporter docs 2017-02-08 15:44:56 +01:00
Achilleas Pipinellis 19a315a42a Add postgres exporter to Prometheus docs 2017-02-08 14:40:28 +01:00
Achilleas Pipinellis 20dd13abfd Use localhost for node_exporter 2017-02-08 14:31:12 +01:00
Achilleas Pipinellis a28f3f73c6 Add Redis exporter to Prometheus docs 2017-02-08 14:29:02 +01:00
Achilleas Pipinellis 5c718b8261 Split node_exporter to its own page 2017-02-08 13:40:11 +01:00
Achilleas Pipinellis 1498786e4a Move prometheus docs into their own dir
[ci skip]
2017-02-08 11:38:58 +01:00