2020-01-28 00:10:08 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								# Prometheus
 
							 
						 
					
						
							
								
									
										
										
										
											2015-12-22 01:09:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								[][circleci]
							 
						 
					
						
							
								
									
										
										
										
											2016-04-26 23:23:41 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[][quay]
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								[][hub]
							 
						 
					
						
							
								
									
										
										
										
											2016-09-15 11:09:26 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[](https://goreportcard.com/report/github.com/prometheus/prometheus)
							 
						 
					
						
							
								
									
										
										
										
											2018-02-06 03:39:32 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[](https://bestpractices.coreinfrastructure.org/projects/486)
							 
						 
					
						
							
								
									
										
										
										
											2019-08-21 16:43:53 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[](https://fuzzit.dev)
							 
						 
					
						
							
								
									
										
										
										
											2020-08-14 23:23:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[](https://gitpod.io/#https://github.com/prometheus/prometheus)
							 
						 
					
						
							
								
									
										
										
										
											2012-11-24 19:14:12 +08:00 
										
									 
								 
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2016-04-13 09:01:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Visit [prometheus.io ](https://prometheus.io ) for the full documentation,
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								examples and guides.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2016-07-28 06:15:03 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Prometheus, a [Cloud Native Computing Foundation ](https://cncf.io/ ) project, is a systems and service monitoring system. It collects metrics
							 
						 
					
						
							
								
									
										
										
										
											2014-12-07 08:23:01 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								from configured targets at given intervals, evaluates rule expressions,
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								displays the results, and can trigger alerts if some condition is observed
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								to be true.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-10-01 07:26:54 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Prometheus's main distinguishing features as compared to other monitoring systems are:
							 
						 
					
						
							
								
									
										
										
										
											2014-12-07 07:05:10 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								-  a **multi-dimensional**  data model (timeseries defined by metric name and set of key/value dimensions)
							 
						 
					
						
							
								
									
										
										
										
											2020-08-05 04:38:08 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								-  PromQL, a **powerful and flexible query language**  to leverage this dimensionality
							 
						 
					
						
							
								
									
										
										
										
											2014-12-07 07:05:10 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								-  no dependency on distributed storage; **single server nodes are autonomous** 
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								-  timeseries collection happens via a **pull model**  over HTTP
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								-  **pushing timeseries** is supported via an intermediary gateway
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								-  targets are discovered via **service discovery**  or **static configuration** 
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								-  multiple modes of **graphing and dashboarding support** 
							 
						 
					
						
							
								
									
										
										
										
											2015-11-09 06:35:11 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								-  support for hierarchical and horizontal **federation** 
							 
						 
					
						
							
								
									
										
										
										
											2014-12-07 07:05:10 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2014-12-07 08:29:56 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								## Architecture overview
 
							 
						 
					
						
							
								
									
										
										
										
											2014-12-07 08:23:01 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2018-10-13 20:20:29 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2014-11-18 02:20:39 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2014-11-21 20:27:28 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								## Install
 
							 
						 
					
						
							
								
									
										
										
										
											2014-11-18 02:20:39 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2014-11-21 20:27:28 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								There are various ways of installing Prometheus.
							 
						 
					
						
							
								
									
										
										
										
											2014-11-18 02:20:39 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-05-22 19:31:59 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								### Precompiled binaries
 
							 
						 
					
						
							
								
									
										
										
										
											2012-11-24 19:33:34 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-05-22 19:31:59 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Precompiled binaries for released versions are available in the
							 
						 
					
						
							
								
									
										
										
										
											2016-09-07 20:32:48 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[*download* section ](https://prometheus.io/download/ )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								on [prometheus.io ](https://prometheus.io ). Using the latest production release binary
							 
						 
					
						
							
								
									
										
										
										
											2016-09-15 11:09:26 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								is the recommended way of installing Prometheus.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								See the [Installing ](https://prometheus.io/docs/introduction/install/ )
							 
						 
					
						
							
								
									
										
										
										
											2016-04-25 17:31:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								chapter in the documentation for all the details.
							 
						 
					
						
							
								
									
										
										
										
											2015-05-22 19:31:59 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2016-09-07 20:32:48 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								### Docker images
 
							 
						 
					
						
							
								
									
										
										
										
											2016-07-01 16:16:49 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2018-11-16 19:26:10 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Docker images are available on [Quay.io ](https://quay.io/repository/prometheus/prometheus ) or [Docker Hub ](https://hub.docker.com/r/prom/prometheus/ ).
							 
						 
					
						
							
								
									
										
										
										
											2013-01-25 07:33:16 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2017-03-13 18:37:25 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								You can launch a Prometheus container for trying it out with
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2018-11-16 19:26:10 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								    $ docker run --name prometheus -d -p 127.0.0.1:9090:9090 prom/prometheus
							 
						 
					
						
							
								
									
										
										
										
											2017-03-13 18:37:25 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								Prometheus will now be reachable at http://localhost:9090/.
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 00:20:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								### Building from source
 
							 
						 
					
						
							
								
									
										
										
										
											2013-01-25 07:33:16 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 00:20:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								To build Prometheus from the source code yourself you need to have a working
							 
						 
					
						
							
								
									
										
										
										
											2019-09-13 20:55:18 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Go environment with [version 1.13 or greater installed ](https://golang.org/doc/install ).
							 
						 
					
						
							
								
									
										
										
										
											2019-10-17 20:38:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								You will also need to have [Node.js ](https://nodejs.org/ ) and [Yarn ](https://yarnpkg.com/ )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								installed in order to build the frontend assets.
							 
						 
					
						
							
								
									
										
										
										
											2015-04-10 19:53:32 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 00:20:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								You can directly use the `go`  tool to download and install the `prometheus` 
							 
						 
					
						
							
								
									
										
										
										
											2017-10-13 06:15:29 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								and `promtool`  binaries into your `GOPATH` :
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2017-10-13 06:15:29 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								    $ go get github.com/prometheus/prometheus/cmd/...
							 
						 
					
						
							
								
									
										
										
										
											2017-08-08 15:19:35 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								    $ prometheus --config.file=your_config.yml
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-10-17 20:38:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								*However*, when using `go get`  to build Prometheus, Prometheus will expect to be able to
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								read its web assets from local filesystem directories under `web/ui/static`  and
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								`web/ui/templates` . In order for these assets to be found, you will have to run Prometheus
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								from the root of the cloned repository. Note also that these directories do not include the
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								new experimental React UI unless it has been built explicitly using `make assets`  or `make build` .
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-11-09 16:48:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								An example of the above configuration file can be found [here. ](https://github.com/prometheus/prometheus/blob/master/documentation/examples/prometheus.yml )
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-10-17 20:38:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								You can also clone the repository yourself and build using `make build` , which will compile in
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								the web assets so that Prometheus can be run from anywhere:
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 00:20:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								    $ mkdir -p $GOPATH/src/github.com/prometheus
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								    $ cd $GOPATH/src/github.com/prometheus
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								    $ git clone https://github.com/prometheus/prometheus.git
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								    $ cd prometheus
							 
						 
					
						
							
								
									
										
										
										
											2016-02-05 18:30:31 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								    $ make build
							 
						 
					
						
							
								
									
										
										
										
											2017-08-08 15:19:35 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								    $ ./prometheus --config.file=your_config.yml
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 15:34:17 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								The Makefile provides several targets:
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-10-17 20:38:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  *build*: build the `prometheus`  and `promtool`  binaries (includes building and compiling in web assets)
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 00:20:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  *test*: run the tests
							 
						 
					
						
							
								
									
										
										
										
											2017-04-07 19:46:06 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  *test-short*: run the short tests
							 
						 
					
						
							
								
									
										
										
										
											2015-09-18 00:20:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  *format*: format the source code
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								  *  *vet*: check the source code for common errors
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								  *  *docker*: build a docker container for the current `HEAD` 
							 
						 
					
						
							
								
									
										
										
										
											2013-06-13 21:17:03 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-11-15 02:53:10 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								## React UI Development
 
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								For more information on building, running, and developing on the new React-based UI, see the React app's [README.md ](https://github.com/prometheus/prometheus/blob/master/web/ui/react-app/README.md ).
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2014-11-21 20:27:28 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								## More information
 
							 
						 
					
						
							
								
									
										
										
										
											2013-05-06 16:54:27 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2019-02-20 17:50:45 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  The source code is periodically indexed: [Prometheus Core ](https://godoc.org/github.com/prometheus/prometheus ).
							 
						 
					
						
							
								
									
										
										
										
											2019-11-25 21:59:26 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  You will find a CircleCI configuration in `.circleci/config.yml` .
							 
						 
					
						
							
								
									
										
										
										
											2016-11-10 14:45:09 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								  *  See the [Community page ](https://prometheus.io/community ) for how to reach the Prometheus developers and users on various communication channels.
							 
						 
					
						
							
								
									
										
										
										
											2013-03-28 22:54:40 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								## Contributing
 
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2017-01-04 04:07:33 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Refer to [CONTRIBUTING.md ](https://github.com/prometheus/prometheus/blob/master/CONTRIBUTING.md )
							 
						 
					
						
							
								
									
										
										
										
											2013-04-14 12:59:55 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2013-01-25 04:56:08 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								## License
 
							 
						 
					
						
							
								
									
										
										
										
											2012-11-27 03:11:34 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
									
										
										
										
											2017-01-04 04:07:33 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								Apache License 2.0, see [LICENSE ](https://github.com/prometheus/prometheus/blob/master/LICENSE ).
							 
						 
					
						
							
								
									
										
										
										
											2015-12-22 01:09:38 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								[hub]: https://hub.docker.com/r/prom/prometheus/
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							 
							
							
								[circleci]: https://circleci.com/gh/prometheus/prometheus
							 
						 
					
						
							
								
									
										
										
										
											2016-04-26 23:23:41 +08:00 
										
									 
								 
							 
							
								
									
										 
									 
								
							 
							
								 
							 
							
							
								[quay]: https://quay.io/repository/prometheus/prometheus