Commit Graph

563 Commits

Author SHA1 Message Date
Todd Treece d7b031f318
Chore: Update Makefile to support go workspace (#83549) 2024-02-29 17:22:18 -05:00
Andreas Christou c9d8d8713b
CI: Bump `alpine` image version (#83716)
Bump image version
2024-02-29 18:00:21 +00:00
Todd Treece f4b432841b
Chore: Add env var check to `make drone` (#83337) 2024-02-23 21:28:30 +02:00
Andreas Christou 1477e658ec
CI: Add retry for yarn install (#83317)
Add retry for yarn install
2024-02-23 16:15:28 +00:00
Todd Treece 49d3cb29eb
Chore: Add go workspace (#83191)
---------

Co-authored-by: ismail simsek <ismailsimsek09@gmail.com>
2024-02-23 08:54:24 -05:00
Erik Sundell 3e456127cb
E2E: Add plugin-e2e scenario verification tests (#79969)
* add playwright test and plugin-e2e

* run tests in ci

* add ds config tests

* add panel edit tests

* add annotation test

* add variable edit page tests

* add explore page tests

* add panel plugin tests

* add readme

* remove comments

* fix broken test

* remove user.json

* remove newline in starlark

* fix lint issue

* ignore failure of playwright tests

* update code owners

* add detailed error messages in every expect

* update message frame

* fix link

* upload report to gcp

* echo url

* add playwright developer guide

* bump plugin-e2e

* add custom provisioning dir

* update plugin-e2e

* remove not used imports

* fix typo

* minor fixes

* use latest version of plugin-e2e

* fix broken link

* use latest plugin-e2e

* add feature toggle scenario verification tests

* bump version

* use auth file from package

* fix type error

* add panel data assertions

* rename parent dir and bump version

* fix codeowners

* reset files

* remove not used file

* update plugin-e2e

* separate tests per role

* pass prov dir

* skip using provisioning fixture

* wip

* fix permission test

* move to e2e dir

* fix path to readme

* post comment with report url

* format starlark

* post comment with report url

* post comment with report url

* fix token

* make test fail

* fix exit code

* bump version

* bump to latest plugin-e2e

* revert reporting message

* remove comments

* readding report comment

* change exit code

* format starlark

* force test to fail

* add new step that posts comment

* fix link

* use latest playwright image

* fix failing test

* format starlark

* remove unused fixture

Co-authored-by: Marcus Andersson <marcus.andersson@grafana.com>

---------

Co-authored-by: Marcus Andersson <marcus.andersson@grafana.com>
2024-02-23 12:39:30 +01:00
Jack Westbrook 5f89c69b66
Chore: Bump Lerna 8.x.x (#83233)
* chore(lerna): bump lerna to 8.x.x

* chore(lerna): run lerna repair command to update lerna.json

* ci(drone): use raw output (no quotes) when updating package.json version

* ci(drone): update config file
2024-02-22 16:22:23 +01:00
Carl Bergquist 53c19e4988
move codespell check into /docs (#83109)
Signed-off-by: bergquist <carl.bergquist@gmail.com>
2024-02-20 20:40:31 +01:00
Sofia Papagiannaki 6a47c8da8e
Drone: Do not upload artifacts if e2e tests have not run (#82451) 2024-02-15 10:26:43 +02:00
Andreas Christou dcbc3aa46a
Chore: Update `grabpl` to `v3.0.50` (#82379)
Bump grabpl version
2024-02-13 15:39:41 +00:00
Kevin Minehart 68345b9596
CI: Add dagger cloud token to PR steps for caching (#81817)
* Add dagger cloud token to steps for caching

* lint
2024-02-02 12:59:48 -06:00
Fabrizio 2d60c0123b
Chore: Improve how we install Python (#81695) 2024-02-01 13:27:29 +01:00
Andrej Ocenas cb945aa5df
NodeGraph: Use layered layout instead of force based layout (#78957) 2024-01-31 17:26:12 +01:00
Fabrizio 564a1d32b7
Add Python as dependency (#80979) 2024-01-31 12:44:22 +01:00
Kyle Brandt 43d0664340
Prometheus: (Experimental) Inject label matchers into queries (also change drone to fix ARM rpm build and Update Swagger) (#81396)
- Feature Toggle is `promQLScope`.
 - Query property is:

"scope": {
  "matchers": "{job=~\".*\"}"
 }

Misc:
 - Also updates drone GO version to address ARM bug https://github.com/golang/go/issues/58425
 - Also updates Swagger defs that were causing builds to fail

---------

Co-authored-by: Kevin Minehart <kmineh0151@gmail.com>
2024-01-29 22:22:17 +02:00
Josh Hunt a138ce668d
I18n: Remove unneeded i18n:compile script (#81184) 2024-01-24 17:24:24 +00:00
Timur Olzhabayev 4083d23f01
Chore: Bumping go to 1.21.6 (#80709)
* Bumping go to 1.25.6

* bumping sqlite to 1.14.19

* Bumping sqlite version
2024-01-23 14:32:26 +01:00
Santiago d4e831b051
Alerting: Use mimir:r274-1780c50 in CI (#80985)
* Alerting: Use new mimir image in CI

* add image to blocks, enable experimental routes
2024-01-22 16:25:50 +02:00
Dimitris Sotirakis 65104a7efa
`ImagePullSecrets`: Add `GAR` secret to `image_pull_secret` in `.drone.yml` (#80912)
* Add GAR secret to image_pull_secret

* Fix starlark fmt
2024-01-19 19:29:49 +02:00
Timur Olzhabayev 7c74ab7059
Revert "bumping go to 1.25.6"
This reverts commit 73439f2cd3.
2024-01-17 11:40:25 +01:00
Timur Olzhabayev 73439f2cd3
bumping go to 1.25.6 2024-01-17 11:38:25 +01:00
Horst Gutmann 01e430e821
chore: Bump Alpine base image to 3.18.5 (#80540) 2024-01-16 15:24:40 +01:00
Kevin Minehart 95a9074ad4
CI: Make --grafana-repo configurable via GRAFANA_REPO (#80378)
Make --grafana-repo configurable via GRAFANA_REPO
2024-01-11 17:53:02 +02:00
Kevin Minehart 9501000856
CI: add rgm promotion pipeline (#80296)
* add package upload promotion pipeline
2024-01-11 09:22:14 -06:00
Josh Hunt c9dd12851f
Chore: Temp allow verify-i18n step to fail (#80371)
allow verify-i18n to fail
2024-01-11 16:50:01 +02:00
Dimitris Sotirakis 7ba930b135
Chore: Update `grabpl` (#79758)
Update grabpl
2023-12-20 17:07:55 +02:00
Andreas Christou 1f25c5f830
Build: Re-add missing `armv7` images (#79751)
Readd missing images
2023-12-20 13:55:23 +00:00
Victor Marin 9dc015b595
Re-add arm32 builds (#79496)
* Re-add arm32 builds

* update grabpl version

* make drone

* make drone

* format drone
2023-12-15 16:56:22 +02:00
Timur Olzhabayev 4991e71b85
Chore: Upgrade Go to 1.21.5 (#79329)
* bumping grafanas go version to 1.21.5

* adding how to upgrade go doc

* removing the whole ci-build and corresponding pipelines

* clarifying that we have to run make drone

* fixing starlark linter and removing unused code

* Adding note about enterprise

* trying to change the underyling image to avoid musl issues

* only need to golang one
2023-12-15 10:36:49 +01:00
gotjosh 23fe8f4e9c
Alerting: Introduce a Mimir client as part of the Remote Alertmanager (#78357)
* Alerting: Introduce a Mimir client as part of the Remote Alertmanager

This is our first attempt at making Grafana communicate use Mimir as a backend - it uses a new set of APIs that we've developed on the Mimir side to upload the grafana configuration and alertmanager state so that it can then be ported over.

Codewise, we've introduced a couple of things:

A client to isolate in its own package all the communication that happens with Mimir
A few changes to the remote/alertmanager to include uploading the configuration and state when it starts
A few refactors that align a bit better with the design approach that we're thinking
An integration tests again these newly developed APIs using a custom image

---------

Signed-off-by: gotjosh <josue.abreu@gmail.com>
Co-authored-by: Santiago <santiagohernandez.1997@gmail.com>
2023-11-23 16:59:36 +00:00
Santiago eef8525a4b
Alerting: Fix remote Alertmanager integration tests (CI/Makefile) (#78541)
* Alerting: Fix remote Alertmanager integration tests (CI/Makefile)
2023-11-22 18:13:04 +00:00
Horst Gutmann d78b3fea2f
CI: Test backend on feature-toggles documentation changes (#78177)
Run backend tests if the feature-toggles documentation changes
2023-11-17 09:21:35 +01:00
Kevin Minehart f6d3238505
CI: Fix race condition when building docker on main (#77504)
* build docker after packages are updated

* use my branch for main pipelines for testing

* use my branch for main pipelines for testing

* use main instead now

* formatting
2023-11-01 18:25:49 +02:00
Ryan McKinley 5d5f8dfc52
Chore: Upgrade Go to 1.21.3 (#77304) 2023-11-01 09:17:38 -07:00
Kevin Minehart 8a5d4c4c6e
CI: Update RGM steps to use the artifacts command (#77470)
* update rgm steps to use artifacts subcmd

* format-drone

* make drone
2023-10-31 22:52:09 +02:00
Josh Hunt 75005a8482
Chore: Update to yarn 4 (#77156)
* update to yarn 4

* update project to yarn 4

* update tetherdrop archive

* update sdks

* change puppeteer image to official node 20 one

* revert previous, use grafana/docker-puppeteer:pre-node-20 instead

* okay, try original docker image, but use npx instead of yarn for wait-on

* remove wait-on from deps as we use it via npx now

* yarn dedupe

* remove logs from drone

* empty commit testing yarn cache :)

* comment explaining why no -y
2023-10-31 16:11:54 +02:00
Jack Baldry d8d7a40d13
Use latest grafana/docs-base image (#77299)
* Use latest grafana/docs-base image

The pinned tag does not support recent shortcodes like `docs/public-preview`.

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Always pull the image

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

---------

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
2023-10-27 18:30:56 +01:00
Horst Gutmann aa9fc3be72
CI: Fix release-npm-packages action (#77127)
* Remove dependency of NpmReleaseAction to the git binary

* Switch to using the node image for the release-npm-packages step
2023-10-27 10:20:20 +03:00
Niki Manoledaki 9a0af13dbc
Remove pr-swagger-gen dependency on clone-enterprise (#77217)
clone-enterprise step can fail in swagger-gen pipeline
2023-10-26 12:55:56 -04:00
Jack Westbrook 69af9f9ad7
Chore: Update to node 20 (#76097)
* chore(node): update node version to 20

* chore(node): bump to 20.8.0, update drone variables

* chore(drone): update yaml config

* chore(yarn): bump yarn to latest to fix building binaries ERR_IMPORT_ASSERTION_TYPE_MISSING errors

* test(grafana-data): update whitespace in time formats for node 20 (18.13+)

* chore(node): move to LTS 20.8.1

* chore(node): bump to LTS 20.9.0
2023-10-26 09:34:50 +02:00
Kat Yang bbcc81405b
Chore: Add CI Pipeline to generate Grafana's OpenAPI specification (#75393)
* chore: move over initial changes from sofia's pr #58029

* chore: remove go_image

* chore: begin removing edition, remove unused imports

* chore: remove edition from swagger_gen.star and generate .drone.yml

* chore: regen drone.yml

* fix: fix order of load statements

* fix: try #2 fix order of load statements

* linter fixes

* chore: add doc comment explaining purpose of new clone_pr_branch step

* fix: add placeholder documentation for ver_mode arg

* attempt #1 to import and use clone_enterprise_step_pr

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* attempt #2 to import and use clone_enterprise_step_pr

* fix: fix drone lint err invalid or unknown step dependency

* fix: regen hmac to make drone run

* fix: fix drone lint err

* fix: update swagger-clean cmd in step

* attempt to return non zero exit code

* test to see if pipeline fails

* fix: add git to clone pr branch step

* fix: add git and make to swagger-gen step

* try to rerun drone

* debug: figure out why cannot find make swagger-clean

* debug: see if cd grafana/grafana fixes things

* debug: undo cd grafana/grafana

* debug: add more logging statements

* debug: try and remove cd grafana in swagger-gen

* debug: removed grafana after clone statement; add debug before cloning

* fix: remove disable clone

* regen specs to see if swagger-gen step passes now

* add descriptive error message to swagger-gen step

* remove api-spec.json from .gitignore

* revert backend change, regen spec

* add back backend change, regen specs

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* Update scripts/drone/pipelines/swagger_gen.star

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* revert gitignore change, set enterprise source to drone source branch

* chore: remove unused variable, change committish var name to source

* testing functionality: make a new BE change without gen spec, pipeline should fail

* test functionality: does removing err msg cause step to fail properly

* test functionality: add back err msg and && after

* chore: remove debug statements from swagger gen step

* chore: remove debug lines from clone_pr_branch step

* test functionality: regen specs, swagger_gen step should pass

* test funcionality: regen specs again ????

* chore: update swagger-gen step err msg

* test functionality: make BE change dont regen spec, swagger gen should fail

* test functionality: regen the specs, swagger-gen should pass

* chore: revert test BE change, regen spec

* chore: remove unused clone step

* chore: regen drone.yml

---------

Co-authored-by: Timur Olzhabayev <timur.olzhabayev@grafana.com>
Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>
2023-10-24 13:01:04 -04:00
Horst Gutmann bd2b4e956b
CI: rgm-package must wait for update-package-json-version in main pip… (#77022)
CI: rgm-package must wait for update-package-json-version in main pipeline
2023-10-24 11:52:14 +03:00
Guilherme Caulada 442e533803
CI: Rename scripts that build artifacts to use _build_ (#77005)
Rename scripts that build artifacts to use _build_
2023-10-23 20:14:12 -03:00
Guilherme Caulada 24a14f3cd7
CI: Implement RGM pipeline parity between editions (#76283)
* Implement RGM pipeline parity between editions

* Use grafana/grafana-build:dev-11c8a20

* Use grafana/grafana-build:dev-261c863

* Use grafana/grafana-build:dev-2db3b18

* Switch nightly trigger for testing purposes

* Use grafana-dev api key for testing

* Use grafana/grafana-build:dev-d4d2e26

* Use grafana-dev api key

* Use production variables

* Revert nightly trigger to cron
2023-10-17 11:13:14 -03:00
Santiago 7d9b2c73c7
Alerting: Use Mimir image to run integration tests for the remote Alertmanager (#76608)
* Alerting: Use Mimir image to run integration tests for the remote Alertmanager

* skip integration test when running all tests

* skipping integration test when no Alertmanager URL is provided

* fix bad host for mimir_backend

* remove basic auth testing until we have an nginx image in our CI
2023-10-17 12:21:45 +02:00
Dimitris Sotirakis d28e365f74
Slack notifications: Remove CI changes notifications from the `grafana-delivery` channel (#76671)
Remove notification from the grafana-delivery channel
2023-10-17 12:12:02 +03:00
Dimitris Sotirakis faa22b8f20
CI: Remove `0.0.0-test` tag event (#76662)
Remove 0.0.0-test tag event
2023-10-17 10:20:14 +03:00
Horst Gutmann 6b52bb9c27
Chore: Upgrade Go to 1.20.10 (#76359) 2023-10-11 16:49:24 +03:00
Guilherme Caulada 165b4c3f66
CI: Use production gcom api for nightly builds (#76201)
* Use production gcom api for nightly builds

* Use production package repositories

* Remove unused confusing env variable

* Comment out previous gcom nightly pipeline

* Remove unused grafana-com-nightly pipeline

* Remove unused import from cron.star
2023-10-09 12:55:15 -03:00
Santiago 726260b2f6
CI: Add test Mimir backend image for integration tests (#76051)
* test mimir image drone

* add mimir service to services.star

* change name for mimir step

* change remote alertmanager step names, add commands for integration tests

* add  tag to mimir image
2023-10-05 15:09:26 -03:00
Guilherme Caulada 3b727eb96c
CI: Use nightly-release cron for nightly releases (#76000)
Use nightly-release cron for nightly releases
2023-10-05 07:44:24 +02:00
Guilherme Caulada 55781b486c
CI: Add nightly prerelease builds (#74119)
* Add nightly prerelease builds

* Fix duplicated pipeline names

* Fix misnamed dependencies

* Fix misnamed dependencies

* Fix string formatting

* Add option to specify bucket to RGM pipeline

* Fix trigger?

* Comment out cron triggers

* Fix windows bucket for nightly

* Fix versioning for windows and verify pipelines

* Use grafana/grafana-build:dev-209553c

* Fix version on windows steps

* Fix version on windows steps

* Fix windows .zip path

* Fix windows .zip path

* Remove windows builds from nightly for now

* Remove verify release pipeline from nightly

* Add docstring to rgm_release

* Revert changes to get_windows_steps

* Simplify changes to rgm.star

* Use grafana/grafana-build:dev-f5a15d4

* Add rgm copy step

* Use grafana/grafana-build:dev-d88be0f

* Fix destination variable

* Escape copy destination environment variable

* Add -r flag to rgm copy command

* Add dependency to rgm-copy step

* Add dist volume

* Use absolute path for dist volume

* Move dist folder to drone workspace

* Delegate drone workspace path to grafana-build

* Use grafana/grafana-build:dev-66149b8

* Lower folder depth

* Use grafana/grafana-build:dev-7355791

* Add rgm-nightly-publish pipeline

* Merge imports on rgm.star

* Fix rgm_copy to allow copying to local destination

* Use grafana/grafana-build:dev-36ec1e2

* Use grafana/grafana-build:dev-634d8dc

* Use grafana/grafana-build:dev-7a93728

* Use grafana/grafana-build:dev-5e36725

* Use grafana/grafana-build:dev-f5ebe1f

* Fix copy source for nightly builds

* Fix drone build number on rgm-copy step

* Use grafana/grafana-build:dev-637583f

* Use grafana/grafana-build:dev-f2cc524

* Allow tag trigger on grafana/grafana for testing

* Use grafana/grafana-build:dev-c71d4b7

* Use grafana/grafana-build:dev-63beac8

* Use grafana/grafana-build:dev-224a0dd

* Add environment variables for package publishing

* Revert unintentional change to dataquery.cue

* Add package publish step to nightly pipeline

* Use GCS path for package publish

* Pre-evaluate drone workspace on packages path

* Use hardcoded drone workspace path

* Remove unused env from publish packages step

* Use grafana/grafana-build:dev-657ea6a

* Use grafana/grafana-build:dev-1a9beec

* Use grafana/grafana-build:dev-f0053c8

* Use grafana/grafana-build:main

* Use grafana/grafana-build:dev-ae5182f

* Use grafana/grafana-build:dev-ec3ec36

* Use grafana/grafana-build:dev-5e160d8

* Use grafana/grafana-build:dev-142d2dc

* Use grafana/grafana-build:dev-db6bff1

* Use grafana/grafana-build:main

* Change nightly trigger to cron
2023-10-04 13:55:43 -03:00
Jack Baldry 9c295ea072
Add front matter that informs Hugo that the Grafana content is versioned (#74259)
This is necessary to allow version inference in CI builds.
Shortcodes like `docs/reference` and `docs/shared` use version inference to avoid the writer having to hardcode specific versions or use relative paths within the documentation set.

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
2023-10-03 09:14:06 +01:00
Dimitris Sotirakis c08606d2c5
Bug: Exclude 32-bit `arm` builds (#75448)
* Exclude 32 bit arm builds

# Conflicts:
#	pkg/build/config/versions.go

* Bump grabpl - remove arm/v7 from build.star

# Conflicts:
#	.drone.yml
2023-09-29 12:33:01 -05:00
Dimitris Sotirakis 1867fc5cee
Arm: Exclude `armv6/v7` from downstream builds only (#75465)
* Bump grabpl

* Disable armv6 and armv7 in downstream builds
2023-09-26 18:42:06 +03:00
Kat Yang 9532ff3799
Chore: Split OSS and Enterprise OAPI Spec Generation (#75133)
* chore: implement sofia makefile changes from #62456

* chore: clean up makefile and generate specs

* docs: update command to delete old specs

* fix: regenerate specs with enterprise linked

* chore: implement review comments

* Update Makefile

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>

* chore: update make command in drone step

* chore: update bingo, fix makefile indentation error, regen specs

* fix: revert .bingo/README changes to make prettier happy

* chore: add BEP as owners of api-enterprise-spec.json

* chore: rerun drone

---------

Co-authored-by: Sofia Papagiannaki <1632407+papagian@users.noreply.github.com>
2023-09-25 15:34:57 -04:00
Kevin Minehart f46b78ec38
CI: Remove pre from npm canary packages (#75376)
Remove pre from npm canary packages
2023-09-25 18:01:17 +03:00
Kat Yang 24a1f12826
Chore: Add new drone step to validate OpenAPI specification (#75034)
* chore: add new drone step to validate openapi specification

* fix: update make before running make command
2023-09-20 11:46:15 -04:00
Kevin Minehart 49ff1b9060
CI: Fix bump version step (#75047)
needs brackets
2023-09-19 01:37:32 +03:00
Kevin Minehart c7ef496750
CI: Add a step on main pipelines to temporarily update the package.json v… (#75018)
* Add a step on main pipelines to temporarily update the package.json version to include the build number
2023-09-18 18:53:42 -03:00
Horst Gutmann 85abf2bebd
Chore: Upgrade Alpine base image to 3.18.3 (#74984) 2023-09-18 12:44:04 +03:00
Kevin Minehart 1ee485ac43
CI: Fix npm canary release (#74915)
Install bash on this step
2023-09-14 16:59:34 +03:00
Kevin Minehart 84d35e9f0b
CI: Fix frontend-metrics-step (attempt #1) (#74838)
* use grafana/public instead

* parameterise script (still need to fix + run drone locally)

* make drone

---------

Co-authored-by: Ashley Harrison <ashley.harrison@grafana.com>
2023-09-14 14:48:31 +01:00
Kevin Minehart ad13663e74
CI: Don't run tag builds in grafana/grafana (#74850)
* Don't run tag builds in grafana/grafana

* remove unused code
2023-09-13 10:49:20 -05:00
Ashley Harrison fcdae0ca0b
Chore: move to cypress 13.1 (#74718)
* move to cypress 13.1

* update cloud-data-sources docker image
Co-authored-by: Ashley Harrison <ashley.harrison@grafana.com>
2023-09-13 11:08:43 +01:00
Dimitris Sotirakis 49165d35ad
Chore: Remove unused secret `enterprise2-cdn-path` (#74741)
Remove unused secret

# Conflicts:
#	.drone.yml
2023-09-13 10:35:51 +03:00
Kevin Minehart 69737cba6d
CI: Fixes for various main steps (#74768)
Fixes for various main steps
2023-09-13 00:44:33 +03:00
Kevin Minehart 3d50a6c87f
CI fix docker image format in PRs (#74766)
* fix docker image format
2023-09-12 22:02:32 +03:00
Kevin Minehart d2154387d8
This moves the ubuntu:22.10 image to 22.04 (which is available until… (#74757)
This moves the ubuntu:22.10 image to 22.04 (which is avaailable until april 2027)
2023-09-12 20:59:02 +03:00
Kevin Minehart 9221822dfe
CI: fix docker tag format on `main` branch and missing dependency on `ci-frontend-metrics.sh` (#74753)
* On main, set the docker tag format to be the same as it is in PRs

* Install bash when trying to push frontend metrics
2023-09-12 19:05:02 +03:00
Kevin Minehart 915f198ecb
Refactor starlark to remove references to the build_image (#74624)
* Refactor starlark to remove references to the build_image
2023-09-12 12:19:06 -03:00
Dimitris Sotirakis 02f617a20d
Nightlies: Push windows artifacts to GCS on main builds (#74709)
* Push windows artifacts to gcs

* Lint starlark

* Sign drone
2023-09-12 13:28:32 +03:00
Dimitris Sotirakis 36728dd671
Bring back windows installers for main builds (#74698) 2023-09-12 10:31:04 +03:00
Ashley Harrison 0f2f25c5d9
Chore: Move to Cypress 12 and decouple cypress from `@grafana/e2e` (#74084)
* update drone to use cypress 12 image

* upgrade cypress to 12 in core

* cypress config actually valid

* update @grafana/e2e imports and add lint rule

* ignore grafana-e2e from betterer now it's deprecated

* fix remaining type errors

* fix failing tests

* remove unnecessary tsconfig

* remove unnecessary comment

* update enterprise suite commands to work

* add cypress config to CODEOWNERS

* export setTimeRange in utils

* remove @grafana/e2e from core deps

* try running the command through yarn

* move CMD to scripts

* Update cloud-data-sources e2e image

* Update paths

---------

Co-authored-by: Andreas Christou <andreas.christou@grafana.com>
2023-09-08 16:51:59 +01:00
Julien Duchesne 566215c22c
CI: Get Github Token and Docker username/password from Vault (#74555)
CI: Get Docker username/password from Vault
Not Drone secrets
2023-09-07 12:26:43 -04:00
Dimitris Sotirakis f93d7f81a3
Nightly scans: Remove `cloud_datasources_e2e_image` from images to scan (#74313)
Remove cloud_datasources_e2e_image from images to scan
2023-09-04 10:55:26 +03:00
Dimitris Sotirakis dd2520ece0
Nightly builds: Add missing volumes for nightly builds (#74195)
Add missing volumes
2023-09-01 13:31:28 +03:00
Guilherme Caulada ab7e655737
CI: Use new release eng managed grafanacom api key (#74017)
Use new release eng managed grafanacom api key
2023-08-29 17:21:44 +03:00
Dimitris Sotirakis eea4adea29
CI: Mount /root/.docker/ dir in authenticate-gcr step (#73977)
Mount /root/.docker/ dir
2023-08-29 10:54:04 +03:00
Dimitris Sotirakis e100fc927e
Security: Authenticate to GCR for trivy scans (#72658)
* Authenticate to GCR for trivy scans

# Conflicts:
#	.drone.yml

* verify-starlark

* Change secret

# Conflicts:
#	.drone.yml
2023-08-28 13:52:08 +02:00
Dimitris Sotirakis de118a3736
CI: Update secrets for publishing steps (#73658)
Update secrets
2023-08-23 10:57:19 +03:00
Horst Gutmann 8fc3be6b5a
CI: Different secret for verification and do not ignore build failures (#73613) 2023-08-22 15:06:22 +02:00
Horst Gutmann c86a73c794
CI: Move npm token to Vault (#73407) 2023-08-17 17:43:26 +03:00
Dimitris Sotirakis 3463dc8e48
CI: Update `grabpl` to `v3.0.41` (#73373)
Update grabpl
2023-08-17 11:46:24 +02:00
Usman Ahmad b1fd399c10
Docs/k8s install update (#72567)
* added before you begin section

* just syncing up

* added namespace and yaml mainfest sections

* started the managed k8s section

* added external-ip section

* added minikube instructions

* added deployment rollout section

* added rolling update section

* added rollback stratgety section

* added the logging section

* fixed many typos

* Update docs/sources/setup-grafana/installation/kubernetes/index.md

* Update docs/sources/setup-grafana/installation/kubernetes/index.md

* Update docs/sources/setup-grafana/installation/kubernetes/index.md

* Update docs/sources/setup-grafana/installation/kubernetes/index.md

* Update docs/sources/setup-grafana/installation/kubernetes/index.md

* adjust codeblock spacing

* adjusts steps

* copy edit throughout

* Apply suggestions from code review

* more copy edit, updates links

* fixed minor typos

* Apply suggestions from code review

Co-authored-by: Clayton Cornell <131809008+clayton-cornell@users.noreply.github.com>

* Apply suggestions from code review

* Apply suggestions from code review

* explained the dry-run example

* Move .codespellignore out of Drone so that technical writers can modify it

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Fix spelling errors

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Add .codespellignore CODEOWNER

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

---------

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
Co-authored-by: Christopher Moyer <35463610+chri2547@users.noreply.github.com>
Co-authored-by: Chris Moyer <chris.moyer@grafana.com>
Co-authored-by: Clayton Cornell <131809008+clayton-cornell@users.noreply.github.com>
Co-authored-by: Jack Baldry <jack.baldry@grafana.com>
2023-08-03 08:53:13 -05:00
Kevin Minehart 6669d0a704
CI: Update secret refs to vault ones; update downstream repo origin (#72515)
Update secret refs to vault ones; update downstream repo origin
2023-07-28 20:36:31 +03:00
Kat Yang f04c673eb8
Chore: Turn validate-modfile failure into blocking drone step (#72537)
* Chore: Turn validate-modfile failure into blocking drone step

* test to see if removal of dependency owner causes validate-modfile to fail and block pipeline

* revert change
2023-07-28 13:23:54 -04:00
Guilherme Caulada 971f5f14be
CI: Make RGM the main pipeline for prerelease (#72295)
* Make RGM the main pipeline for prerelease

* Use grafana/grafana-build:dev-bd41660

* Use grafana/grafana-build:dev-fda506a

* Fix destination url

* Update vault secrets

* Move bucket path to environment

* Use grafana/grafana-build:dev-2f36afa

* Revert to grafana/grafana-build:main

* Add repo to rgm_main trigger
2023-07-28 09:58:22 -05:00
Kevin Minehart b019ef9a89
CI: use base64 key in windows installer build step (#72413)
use base64 key
2023-07-27 09:31:35 +03:00
Kevin Minehart 0c2b2219bb
CI: use the base64 key in the windows installer steps (#72372)
use the base64 key in the windows installer steps
2023-07-26 16:59:25 +03:00
Kevin Minehart c3d6f795ea
Only trigger downstream builds on Grafana (#72356) 2023-07-26 15:26:58 +02:00
Dimitris Sotirakis e3ec53b418
CI: Fix `deb/rpm` bug for linux package publishing (#72336)
Fix deb/rpm

(cherry picked from commit c3ebd388e3)
(cherry picked from commit 4c9bdef98d)

# Conflicts:
#	.drone.yml
2023-07-26 14:18:00 +03:00
Guilherme Caulada 142cbc2ec6
CI: Fix verify-prerelease-assets pipeline (#72226)
* Fix verify-prerelease-assets pipeline

* Comment out unused assets
2023-07-24 18:30:02 -03:00
Guilherme Caulada f005a375db
CI: Run only Grafana builds on RGM for grafana/grafana (#72144)
* Run only OSS builds on RGM for grafana/grafana

* Update script name

* Ignore windows step failure for RGM
2023-07-21 15:50:06 -05:00
Kevin Minehart 16e2808b43
CI: Use GCP keys in vault and not drone secrets (#72023) 2023-07-21 08:53:57 -05:00
Agnès Toulet ac445a25d5
Kindsys: update generated doc and add check in CI (#71871)
* clean up docs

* fix Windows path issue

* add verify-gen-cue to doc pipeline

* fix linting error
2023-07-20 11:48:12 +02:00
Kevin Minehart 9cf309288b
CI: Try setting the vault secret for 'grafana_api_key' (#71981)
* Try setting the vault secret

* Maybe?

* forgot .drone.yml
2023-07-19 23:40:03 +03:00
Kevin Minehart 6d6cd2011e
CI: Only run main pipeliens on Grafana (#71949)
Only run main pipeliens on Grafana
2023-07-19 14:03:07 +00:00
Guilherme Caulada 4c80bcf35f
CI: Allow RGM to create msi for multiple editions (#71883)
* Allow RGM to create msi for multiple editions

* Remove suffix from build-windows-installer step

* Invert exit code on verify_release_pipeline
2023-07-18 17:09:08 -03:00
Guilherme Caulada 4caa773401
CI: Add rgm compatible windows msi pipeline (#71678)
* Add rgm compatible windows msi pipeline

* Fix dependencies and platform

* Fix missing arg comment

* Fix linting issues

* Try to fix version on file path

* Fix dependency on verify release pipeline
2023-07-14 17:27:07 -03:00
Dimitris Sotirakis b13939b9af
[WIP] CI: Removes enterprise specific pipelines and steps (#70815)
* Removes enterprise specific pipelines and steps (#123)

* Comment out enterprise related pipelines and steps

* Suppress unused variable warning

* Removes all edition arguments

* Remove leftover comments

* Remove redundant oss on pipelines and steps names

* Remove leftover unused variable

* Remove leftovers

* Remove pipeline dependencies

* Rename pipelines

* Fix starlark

---------

Co-authored-by: dsotirakis <dimitrios.sotirakis@grafana.com>
(cherry picked from commit 642a81ba75e79138246797302aba5c35575f030d)

# Conflicts:
#	.drone.yml
#	scripts/drone/steps/lib.star

# Conflicts:
#	.drone.yml

* Add editions for static assets

# Conflicts:
#	.drone.yml

# Conflicts:
#	.drone.yml
2023-07-14 14:18:09 +03:00
Dimitris Sotirakis fd90737884
CI: Fix broken env vars in publish-artifacts step (#71471)
Fix env vars

(cherry picked from commit 64d2ff03c8)

# Conflicts:
#	.drone.yml
2023-07-13 11:12:15 +03:00
Emil Tullstedt e07fbeef60
Chore: Upgrade Go to 1.20.6 (#71440) 2023-07-12 15:32:40 +02:00
Emil Tullstedt 7a9847e196
CI: Provide a Drone promotion to build the build-container (#71133) 2023-07-11 13:08:05 +02:00
Kevin Minehart d5a4c81fa1
CI: Add GPG keys to rgm, don't clone RGM just use the docker image (#71143)
* Add GPG keys to rgm, dont' clone RGM just use the docker image

* remove the cd command

* forgot to make drone :(

* idk

* reference script more specifically

* i guess we'll just cd /src

* Only show not found artifacts
2023-07-07 16:42:40 +03:00
Sofia Papagiannaki e82d437e0e
Drone: Enable running go benchmarks on demand (#70359)
* Add benchmark

* Run pkg/api benchmarks in CI

* Conditionally run benchmarks for provided go packages

* Bypass fork check for promotes
2023-07-07 11:55:01 +03:00
Dimitris Sotirakis 7f55ba9c6e
CI: Cleanup - Remove security related steps (#70788)
* Remove security related steps

* More cleanup
2023-06-28 11:12:47 +03:00
Andreas Deininger 95b1f3c875
Fixing typos (#70487) 2023-06-22 09:43:38 +01:00
Jack Baldry 3d15d54a71
Use docs/reference for flexible linking for content reused in Grafana Cloud (#70253)
* Use docs/reference for flexible linking for content reused in Grafana Cloud

Documented in https://github.com/grafana/website/pull/13878

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

* Use docs-base image that has docs/reference shortcode

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>

---------

Signed-off-by: Jack Baldry <jack.baldry@grafana.com>
2023-06-16 17:24:21 +01:00
Dimitris Sotirakis b1e219e72c
CI: Update `grabpl` to `v3.0.39` (#70126)
Update grabpl to v3.0.39
2023-06-15 11:49:56 +03:00
owensmallwood f649619e20
Mysql Tests: For mysql5.7 integration tests use utf8mb4 charset (#69953)
for mysql5.7 integration tests, use utf8mb4 charset
2023-06-14 17:00:45 -06:00
Dimitris Sotirakis 91272ee4f9
CI: Add CI check for `what's new` link (#70046)
* Add whatsnewchecker

* Add whatsnewchecker_test

* Small fixes

* Add step in CI

* Fix lint

* Fix starlark

* t.Cleanup instead of separate func

* Skip check for test tags
2023-06-14 13:51:01 +03:00
Kevin Minehart 80c8701e80
CI: Update RGM and verification pipelines to support prerelease / rc names. (#69971)
* Install bash in RGM and support prerelease names for dev/rpms which use a tilde
2023-06-13 16:40:07 +03:00
Dimitris Sotirakis fa70fba0e3
Security Scans: Exclude windows container scans (#69977)
* Exclude windows container scans

* Fixes according to reviewer's comments
2023-06-13 10:38:18 +03:00
Dimitris Sotirakis 2cda971796
Security Scans: Add trivy scans to every docker image used for building/testing/publishing (#69911)
* Created images.star

* Fix typo

* Add cronjobs for build-images
2023-06-12 16:41:18 +03:00
Tobias Skarhed 134839d701
CI: Add i18n verification step (#69384)
* Add i18n verification step

* Add check for extracted translations

* Run extract

* Add newline for pseudo

* Format JSON output with prettier

* Print file diff

* Actually run make drone

* Only deo git diff on locales

* Update error message

* Verify that step fails on dynamic phrases

* Verify that it passes when fixed

* Verify that dynamic phrase fails, for real this time

* Extract error messages

* Change echo

* Fix string format

* Try double escaping

* Escape for Drone substitution

* Update character escape

* Remove dynamic phrase

* Verify multiple keys

* Remove double keys

* Readd en locale because of reasons

* Undo changes

* Format lint_frontend.star

* Update error message

* Update .drone.yml

* Add quotes for echo

* Verify fail to extract

* Fix diff stat command

* Reset footer changes
2023-06-06 09:29:04 +02:00
Kat Yang 293993ac09
CI: Add validate-modfile step in drone (#69232)
* chore: test drone step

* revert changes to lint_backend_step()

* try to add validate_modifle_step

* try to run check func

* remove CGO and wire-install

* update filepath to scripts/modowners

* make drone again

* correct the filepath

* try to ignore validate-modfile step if fail

* chore: remove log that says i am a programmer

* fix: spell modfile correctly

* chore: remove unecessary comment

* fix: check go.mod instead of go.txd
2023-05-31 16:57:45 -04:00
Dimitris Sotirakis 778f054419
CI: Don't run RGM pipeline on docs changes (#69243)
Don't run RGM pipeline on docs changes
2023-05-30 18:17:53 +03:00
Ricky Whitaker 68fe1e1cb0
fix verify_release_pipeline script execution (#69191)
* fix verify_release_pipeline script execution

* forgot to run make drone
2023-05-26 14:54:57 -05:00
Horst Gutmann f22d1d14a0
CI: Pin the google/cloud-sdk image (#69037) 2023-05-25 10:17:24 +03:00
Dimitris Sotirakis 7e816d010c
G10: Replace `beta` with `preview` references (#68347)
* Update references

* Update grabpl to v3.0.38
2023-05-24 09:46:07 +02:00
Kevin Minehart 79f49c9649
CI: Add release verify pipeline (#68756) 2023-05-23 10:01:09 +02:00
Dimitris Sotirakis 623c014cda
CI: Run `trigger-test-release` only on PRs against main (#68794)
Run trigger-test-release only on PRs against main
2023-05-22 12:32:48 +02:00
Dimitris Sotirakis 04e2d9055d
Docker images: Don't fail if a PR comes from a fork (#68765)
* Update grabpl

* Allow publish images to fail for PRs
2023-05-22 11:37:13 +02:00
Dimitris Sotirakis 44b1dae16d
Chore: Update `grabpl` to v3.0.36 (#68693)
Update grabpl to v3.0.36
2023-05-18 13:09:40 +02:00
Kevin Minehart a870b227db
Add dagger token to rgm builds (#68651) 2023-05-17 20:19:53 +03:00
Dimitris Sotirakis 26bacf6d4c
G10: Post `docker pull` commands for local testing (#67489)
* Add grabpl publish images

Update grabpl - add github pr token

* Replace github_pr_token with gh app

# Conflicts:
#	.drone.yml
#	scripts/drone/vault.star

# Conflicts:
#	.drone.yml

# Conflicts:
#	.drone.yml

* Lint starlark

Add forgotten secrets

Lint starlark

Change secrets

* Update grabpl to v3.0.35

* Lint starlark

* Remove unnecessary secrets
2023-05-17 17:57:37 +02:00
Dimitris Sotirakis 55622615de
CI: Add delivery bot secrets to publish images step (#68467)
Add delivery bot secrets
2023-05-15 16:33:31 +03:00
Horst Gutmann 35ccfa6131
CI: Update grabpl to 3.0.34 (#68456)
* CI: Port of init-enterprise fix from 9.4.10

* CI: Update grabpl to 3.0.34
2023-05-15 15:57:46 +03:00
Dimitris Sotirakis b7b13067a5
CI: Add `.drone.yml` in pathschanged trigger for `lint_backend` pipeline (#68348)
Add .drone.yml in pathschanged for lint_backend
2023-05-12 11:18:59 +03:00
Horst Gutmann acd02e8a48
CI: Move windows-tests into promotion pipeline (#68218) 2023-05-10 17:16:59 +03:00
Horst Gutmann 1e8cad625b
CI: Remove windows backend tests from release pipelines (#68166)
Remove windows backend tests from release pipelines

These are run in other places so there is no benefit to also include
them here.
2023-05-10 12:54:43 +03:00
Horst Gutmann b2fc285a5d
CI: Add Windows backend tests in more places (#66438)
* CI: Add Windows backend tests in more places

* CI: Add promotion pipeline for publishing new windows-test-images

* CI: Ignore windows backend-test failures for now

* CI: Fix linting issue in ci_images.star file
2023-05-08 15:22:34 +02:00
owensmallwood a4c7450c42
Grafana: Upgrades mysql images from 5.7 to 8 (#67604)
adds mysql integration build step for mysql 8
2023-05-04 11:42:48 -06:00
Sofia Papagiannaki 9812ad2cb2
Chore: Upgrade Go to 1.20.4 (#67748)
Upgrade Go to 1.20.4
2023-05-04 10:52:43 +03:00
Kevin Minehart 80543a0bfa
CI: set RGM deps on main merge not on tag (#67778)
set deps on main merge not on tag
2023-05-03 22:08:01 +03:00
Kevin Minehart 768efe9748
CI: Add rgm to drone (#66991)
* add drone stub that build grafana using 'grafana/build' (dagger)

---------

Co-authored-by: Ricky Whitaker <ricky.whitaker@grafana.com>
2023-05-03 13:56:02 -05:00
Jack Westbrook e97befa221
Fix: NPM canary releases (#66727)
* fix(packages): remove double trailing slash from npmrc credentials

* chore(packages): add new line to storybook config to trigger an npm canary release
2023-04-18 11:02:37 +02:00
Jack Westbrook efa641040d
Build: Improve NPM publishing (#65171)
* chore(packages): remove redundant npm scripts for publishing packages

* feat(packages): rewrite npm publishing script to work for manual and ci publishes

* ci(drone): update release-canary-npm-packages step to use new script

* docs(packages): update manual release instructions

* wip(packages): attempt to validate packed npm package

* fix(packages): release-canary-npm-packages should provide canary dist-tag

* ci(packages): clean up npm package validation script

* chore(devenv): add verdaccio config to allow anon publishing for easier dev npm testing

* ci(packages): clean up publishing script

* ci(drone): during build-frontend-packages, pack and validate packed tarballs

* chore(codeowners): update for publish/validate npm packages scripts

* ci(packages): fix esm loop bug matching e2e package

* ci(npm-packages): fix failing regex

* style(lib.star): run make format-drone

* style(npm-packages): shellcheck fixes for validate-npm-packages script

* docs(packages): update readme instructions for publishing locally and manually

* refactor(npm-publish): use drone when to trigger canary releases

* chore(drone): remove redundant trigger_npm_publish var

* chore(npm-publish): remove redundant echo
2023-04-18 10:19:37 +02:00
Serge Zaitsev 391a192310
Chore: Try a different way to run integration tests (#66653)
* try a different way to run integration tests

* fix formatting

* clean test cache again

* use previous command

* playing around with random commands

* dont run tests in parallel yet

* use parallel option instead of gomaxprocs

* use same package set for redis/memcached; use p=1
2023-04-17 18:33:43 +02:00
Emil Tullstedt 202afb9041
Chore: Upgrade Go to 1.20.3 (#66264) 2023-04-14 10:01:14 +02:00
Dimitris Sotirakis 24d348f804
CI: Split `/bin/build artifacts *` subcommand (#66005)
* Split go files

* Modify publishartifacts.go

* Split main

* FIXME: Temp add GCSCopy to gcloud/storage

* Fix lint

* Exported flags

* Update starlark - make drone

* Further backend lint fixes

* Add fallback_test.go

* Fix go imports order

* make drone

* Remove GCSCopy from static assets

* Remove GCSCopy from storybook

* Fix lint

* Remove GCSCopy

* Remove success logline

* drone yaml cleanup

* Add artifacts-editions flag

* Fix starlark

* Add default sting slice in artifacts packages command
2023-04-12 11:47:40 +03:00
Sofia Papagiannaki caac9838d8
Build: Fix Redis/Memcached integration tests (#64298)
* Build: Fix integration cache tests

* Allow REDIS_URL with scheme

* Reduce cache integration tests timeout to 5m

* Apply suggestion from code review

* Run redis/memcached integration tests in OSS pipelines

* Change redis image
2023-04-05 11:55:55 +03:00
Dimitris Sotirakis a18ea77aac
CI: Exclude cloud related tags from tag events (#65806)
* Exclude cloud related tags

* Fix starlark lint errors
2023-04-03 16:22:20 +03:00
Dimitris Sotirakis 821633c796
CI: Make `init-enterprise` depend on `grabpl` (#65797)
Make init-enterprise depend on grabpl

# Conflicts:
#	.drone.yml
2023-04-03 14:04:30 +03:00
Horst Gutmann e9aef20eb4
CI: Move release integration pipeline to standalone promotion pipeline (#65787) 2023-04-03 12:43:37 +02:00
Dimitris Sotirakis 89d642e001
CI: Cleanup unnecessary `grabpl` dependencies (#65330)
* Remove unnecessary grabpl dependencies

* Revert test-frontend change
2023-03-27 12:55:45 +02:00
Dimitris Sotirakis 3b00d2c273
CI: Remove `grabpl` dependency from `publish-packages` steps (#65329)
Remove grabpl dependency from publish packages
2023-03-27 11:03:49 +03:00
Dimitris Sotirakis d0be9610f0
CD: Remove `fetch-images` dependency from AWS marketplace automation (#65173)
* Remove fetch-images dependency

* Fix starlark link
2023-03-22 17:35:57 +02:00
Dimitris Sotirakis 4a80233bed
CI: Update `grabpl` to `3.0.30` (#65028)
Update grabpl
2023-03-20 11:46:17 +02:00