Commit Graph

241 Commits

Author SHA1 Message Date
GitLab Bot 83a3209c3f Add latest changes from gitlab-org/gitlab@master 2020-03-31 03:07:51 +00:00
GitLab Bot 6f2065c468 Add latest changes from gitlab-org/gitlab@master 2020-03-25 15:07:47 +00:00
GitLab Bot 7c38405be9 Add latest changes from gitlab-org/gitlab@master 2020-03-10 15:08:08 +00:00
GitLab Bot 83731155d9 Add latest changes from gitlab-org/gitlab@master 2020-03-06 18:08:08 +00:00
GitLab Bot 2fd92f2dc7 Add latest changes from gitlab-org/gitlab@master 2020-03-04 21:07:54 +00:00
GitLab Bot 988b28ec1a Add latest changes from gitlab-org/gitlab@master 2020-03-02 12:07:57 +00:00
GitLab Bot 43e3dc2f95 Add latest changes from gitlab-org/gitlab@master 2020-02-12 18:09:21 +00:00
GitLab Bot e723867717 Add latest changes from gitlab-org/gitlab@master 2019-12-17 18:07:48 +00:00
GitLab Bot d10a462fed Add latest changes from gitlab-org/gitlab@master 2019-12-16 12:07:43 +00:00
GitLab Bot 5e11c9b77c Add latest changes from gitlab-org/gitlab@master 2019-12-10 12:07:55 +00:00
GitLab Bot a19a376bf3 Add latest changes from gitlab-org/gitlab@master 2019-12-02 21:06:51 +00:00
GitLab Bot 20758bc3b3 Add latest changes from gitlab-org/gitlab@master 2019-11-27 18:06:30 +00:00
GitLab Bot 3269a20692 Add latest changes from gitlab-org/gitlab@master 2019-11-27 12:06:30 +00:00
GitLab Bot 59a349817c Add latest changes from gitlab-org/gitlab@master 2019-11-26 21:06:38 +00:00
GitLab Bot 8f1f6b374b Add latest changes from gitlab-org/gitlab@master 2019-11-25 12:06:13 +00:00
GitLab Bot 7aada820a9 Add latest changes from gitlab-org/gitlab@master 2019-11-21 18:06:26 +00:00
GitLab Bot 0a6ffb540e Add latest changes from gitlab-org/gitlab@master 2019-11-21 12:06:40 +00:00
GitLab Bot a048261403 Add latest changes from gitlab-org/gitlab@master 2019-11-21 09:06:16 +00:00
GitLab Bot 88542a5e96 Add latest changes from gitlab-org/gitlab@master 2019-11-19 15:06:24 +00:00
GitLab Bot eca3cd3a9e Add latest changes from gitlab-org/gitlab@master 2019-11-15 18:06:24 +00:00
GitLab Bot 61f0c58946 Add latest changes from gitlab-org/gitlab@master 2019-11-08 12:06:32 +00:00
GitLab Bot 90a06a20be Add latest changes from gitlab-org/gitlab@master 2019-11-07 15:06:33 +00:00
GitLab Bot 7b25b12016 Add latest changes from gitlab-org/gitlab@master 2019-11-04 18:06:28 +00:00
GitLab Bot 0f0a8be306 Add latest changes from gitlab-org/gitlab@master 2019-10-30 21:07:58 +00:00
GitLab Bot 3fe9588b1c Add latest changes from gitlab-org/gitlab@master 2019-10-30 15:14:17 +00:00
GitLab Bot dee9315801 Add latest changes from gitlab-org/gitlab@master 2019-10-29 15:07:20 +00:00
GitLab Bot ef326e805a Add latest changes from gitlab-org/gitlab@master 2019-10-28 21:06:24 +00:00
GitLab Bot 8db8e2a342 Add latest changes from gitlab-org/gitlab@master 2019-10-24 15:06:02 +00:00
GitLab Bot dc0622dbe3 Add latest changes from gitlab-org/gitlab@master 2019-10-24 09:06:18 +00:00
GitLab Bot b3e4ec8e8a Add latest changes from gitlab-org/gitlab@master 2019-10-23 09:06:03 +00:00
GitLab Bot 90cdc93911 Add latest changes from gitlab-org/gitlab@master 2019-10-23 06:06:39 +00:00
GitLab Bot 6791eefead Add latest changes from gitlab-org/gitlab@master 2019-10-21 09:06:22 +00:00
GitLab Bot 6b75320f52 Add latest changes from gitlab-org/gitlab@master 2019-10-17 12:07:33 +00:00
GitLab Bot 4226aca420 Add latest changes from gitlab-org/gitlab@master 2019-10-17 09:07:07 +00:00
GitLab Bot d2ffc30fd5 Add latest changes from gitlab-org/gitlab@master 2019-10-16 12:06:32 +00:00
GitLab Bot 8c30d396c5 Add latest changes from gitlab-org/gitlab@master 2019-10-14 18:06:24 +00:00
GitLab Bot d96abbee0b Add latest changes from gitlab-org/gitlab@master 2019-10-10 15:06:07 +00:00
GitLab Bot 185f428fa5 Add latest changes from gitlab-org/gitlab@master 2019-10-07 12:06:18 +00:00
GitLab Bot f1a5755898 Add latest changes from gitlab-org/gitlab@master 2019-09-24 15:06:34 +00:00
GitLab Bot 94e614c94c Add latest changes from gitlab-org/gitlab@master 2019-09-23 12:06:20 +00:00
GitLab Bot 930ff68c1e Add latest changes from gitlab-org/gitlab@master 2019-09-16 18:06:05 +00:00
GitLab Bot b7dfe2ae40 Add latest changes from gitlab-org/gitlab@master 2019-09-13 13:26:31 +00:00
Stan Hu ae69bdeaed Merge branch 'review-app-optimizations' into 'master'
Refine the review-app custom variables

See merge request gitlab-org/gitlab-ce!32783
2019-09-10 21:45:13 +00:00
Kyle Wiebers ac52c7ee74 Refine the review-app config variables
Add base-config.yaml to define non-environment
variable config for review app deploy. Define
resource requests and limits for all used apps
2019-09-10 13:54:58 -05:00
Kyle Wiebers 5a1659d884 Add review-cleanup-failed-deployment to prepare
Add in a job to purge previous release in Review App
2019-09-10 10:56:52 -05:00
Rémy Coutable f8f8ed471f Merge branch '66428-make-review-app-deployment-use-wait' into 'master'
Make Review App deployment use `--wait` instead of `--atomic` for better debugging

Closes #66428

See merge request gitlab-org/gitlab-ce!32223
2019-09-04 10:31:45 +00:00
Takuya Noguchi caceb797a6 Make download_chart function robust for its own Review App
Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2019-09-04 02:31:11 +09:00
Rémy Coutable 1593583337
Switch back to the '--wait' flag for the 'helm upgrade' command
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-09-03 18:06:45 +02:00
Balasankar "Balu" C 7d90f0f060
Use new location for helm charts repo
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2019-09-03 10:06:02 +05:30
Rémy Coutable 8f501a74bd
Remove the wait_for_review_app_to_be_accessible step from review-deploy
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-30 19:13:43 +02:00
Rémy Coutable 9870e86f6c
Use the --atomic flag when deploying Review Apps
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-30 09:25:28 +02:00
Nick Thomas 72c1680424 Merge branch 'qa-stop-printing-dots-while-retrieving-pod-names-in-review-deploy' into 'master'
Stop printing dots while retrieving pod in review-apps.sh

See merge request gitlab-org/gitlab-ce!31062
2019-07-25 14:19:27 +00:00
Sean McGivern c02c83fa9b Merge branch '64998-increase-helm-deploy-command-timeout' into 'master'
Increase the Review App deploy command timeout to 15 minutes

Closes #64998

See merge request gitlab-org/gitlab-ce!31061
2019-07-24 14:29:21 +00:00
Rémy Coutable 28d9e87d40
Stop printing dots while retrieving pod in review-apps.sh
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-23 18:30:47 +02:00
Rémy Coutable b4f695da6b
Increase the Review App deploy timeout to 15 minutes
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-23 17:53:21 +02:00
Rémy Coutable dccf643c42
Fix Review App debugging
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-23 17:11:13 +02:00
Jason Plum 3c82d9fc8f ReviewApps: CI pin external-dns to 2.x version
Pin the version of deployed external-dns to `2.y.z`, using SemVer
matching. (`^2.2.1`)

Update the properties for the service account keys per
*Upgrading to 2.0.0* of the `stable/external-dns` README.

Add `aws.batchChangeSize=400` to combat messages about RDATA being
too large.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/64356
2019-07-12 09:53:41 -04:00
Rémy Coutable 29dbac2e12
Add resources requests and limits for all Review Apps resources
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-04 18:14:11 +02:00
Rémy Coutable e266911019
Install Helm on dedicated nodes
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-25 11:09:06 +02:00
Rémy Coutable a90f12f77d
Let Helm handle the cleanup and print logs when deployment fails
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-25 11:09:06 +02:00
Rémy Coutable 7c1422c795 Apply suggestion to scripts/review_apps/review-apps.sh 2019-06-12 17:01:15 +00:00
Rémy Coutable 97037e4a11
[Review Apps] Set `global.imagePullPolicy: Always`
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-12 13:22:12 +02:00
Rémy Coutable 84103e2d2f
Disable HTTP for the nginx-ingress Review App service
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-30 09:49:10 +02:00
Rémy Coutable 9649c2ef47
Organize better Review Apps and QA jobs
Also, play manual jobs once dependency jobs are done instead of polling
for the dependent jobs to be finished.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-24 19:25:37 +02:00
Rémy Coutable d0efb430ce
Make the Review App cleanup more efficient
Ensure that the cleanup starts right away.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-19 10:50:43 +02:00
Rémy Coutable 955136b56d
Don't fail the job if the Review App doesn't deploy properly
It seems the deploy function causes the job to fail if it doesn't
succeed. That wasn't the intent as we want to curl the Review App after
the deploy finished (even if it failed) because sometimes the Review App
is just a bit long to be ready.

This change wraps the Review App deployment with "set +e"/"set -e" to
ensure that the job doesn't fail right away if the deploy fails.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-17 10:49:02 +02:00
Rémy Coutable 64960ae762
Conform scripts/review_apps/review-apps.sh to shellcheck
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-09 15:57:04 +02:00
Rémy Coutable 6dadd965dc
Poll Review App after it's deployed to ensure it's accessible
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-09 15:56:53 +02:00
Rémy Coutable 42102cd13a
Add more logging in the Review Apps deployment steps
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-03-28 11:56:38 +01:00
Rémy Coutable dc2a482ba1
Fix the .review-deploy-base job so that env variables are passed
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-03-19 08:31:20 +01:00
Rémy Coutable 18dae64c49
Only use 2 replicas for nginx-ingress.controller
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-02-01 14:36:24 +01:00
Rémy Coutable e86f0cc212
Don't install Prometheus in Review Apps
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-02-01 14:33:27 +01:00
Rémy Coutable 3440aa7fa9
Fine-tune Review Apps pod resource requests
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-02-01 14:33:27 +01:00
Lin Jen-Shin 64a738c0a1 Introduce echoinfo for information 2019-01-24 22:00:52 +08:00
Rémy Coutable 67dfd8786b
Use $CI_COMMIT_REF_SLUG in review-apps.sh
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-24 08:42:45 +01:00
Rémy Coutable a4f7324170
[Review Apps] Don't exit when dependable job fails
The function that retrieves the dependable job is pretty basic and
retrieves the first job found with the matching name, but this job can
be failed but then successfully retried. In that case, we would exit the
depending job even though the dependable job actually succeeded (the
second time). Let's simplify things, be optimistic and continue with the
depending job even if the dependable job fails.

That reverts to the original behavior.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-17 18:56:41 +01:00
Rémy Coutable 2064565abc Merge branch '55323-review-apps-use-2-replicas-for-the-tiller-deploy-deployment' into 'master'
[Review Apps] Use 2 replicas for the `tiller-deploy` Deployment

Closes #55323

See merge request gitlab-org/gitlab-ce!23806
2019-01-10 12:36:06 +00:00
Mark Lapierre 38a10e3870 Exit as error if job fails
If a script is waiting for a job to be done and that job fails,
exit with an error status so that the script doesn't continue
with a prerequisite in an invalid state.
2018-12-21 18:30:52 +00:00
Rémy Coutable ebf73a19ce
Use 2 replicas for the Deployment
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-12-19 11:23:43 +01:00
Rémy Coutable a76ce8b46b
Specify the 'sync' policy for the external-dns deployments
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-12-18 17:49:53 +01:00
Mark Lapierre 0f751f6f17 Run gitlab:assets:compile on qa jobs
Optionally compiling assets when needed for qa jobs proved
unworkable so instead we fall back on compiling them for
all qa jobs.
2018-12-17 15:30:52 -05:00
Rémy Coutable 73dce6c870
[QA] Better retrieve job ID for a retried job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-12-06 10:06:15 +01:00
Rémy Coutable f4b8ecbf9f
Add a manual job to run QA against a Review App
1. Renames review to review-deploy.
2. Renames stop_review to review-stop.
3. Adds a build-qa-image job to the prepare stage and save the QA
  Docker image as artifact (example:
  https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120967019).
4. Adds a manual review-qa job to the test stage to run QA tests
  against the Review App (example:
  https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120967238).
5. Make the review-deploy job plays the review-qa job as soon as the
  Review App is deployed (example:
  https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120988775).
6. Updates the Review Apps documentation accordingly.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-26 14:49:03 +01:00
Rémy Coutable 4383c7947e
Ensure we abort the cleanup if release is empty
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-13 18:01:46 +01:00
Balasankar "Balu" C 2b7ad9da09
Disable usage pings in review apps 2018-11-11 17:15:03 +05:30
Rémy Coutable f7f42cf345
Ensure we create the secrets at the right time
In `deploy`, if the previous deployment failed, we delete/cleanup all
the objects related to the release, including secrets. The problem is
that if we create the root password before that, it will be then
recreated during the deploy with a random value!

By creatigng the secret just before actually deplying a new release, we
ensure that it won't be overriden.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-09 12:30:51 +01:00
Ian Baum 41994c2adf Add omitted indentation fix 2018-10-23 10:05:57 -05:00
Ian Baum 58690a63fa Add review app to gitlab-ce
* Uses the same supporting code as used in EE
* Includes automated cleanup
* Install external-dns helm chart to review apps cluster if it isn't
already
* Adds variables REVIEW_APPS_AWS_SECRET_KEY and
REVIEW_APPS_AWS_ACCESS_key
* review-apps-ce uses a different cipher
2018-10-23 10:05:57 -05:00
Rémy Coutable 25d8c8d1f0
Improve automated Review Apps cleanup
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-22 09:57:50 +02:00
Rémy Coutable 159b650d74
Cleanup review apps more rapidly
- Stop review app's environment after 2 days
- Delete review app's environment after 3 days
- Delete Helm release after 4 days

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-01 14:08:40 +02:00
Rémy Coutable 3299680cdd
[CE] Port review apps file to CE
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-09-25 16:41:27 +02:00