Commit Graph

287 Commits

Author SHA1 Message Date
Mike Lewis 77ff2249e4 Fix docs URL in trigger-build-docs puts text 2019-07-08 15:44:50 +00:00
Rémy Coutable 29dbac2e12
Add resources requests and limits for all Review Apps resources
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-07-04 18:14:11 +02:00
Aleksei Lipniagov f44719f39c Get memory data after booting app in production
Preload the app in `production` env, hit it with a single request, and
gather total gem memory consumption data using `derailed exec perf:mem`
from `derailed_benchmarks`. Present the result as MR metrics.
2019-06-28 20:12:50 +03:00
Rémy Coutable 7c38c0b4b2 Revert "Merge branch '62722-boot-app-in-ci-and-check-memory' into 'master'"
This reverts merge request !30031
2019-06-28 15:55:54 +00:00
Aleksei Lipniagov fb1d433703 Get memory data after booting app in production
Preload the app in `production` env, hit it with a single request, and
gather total gem memory consumption data using `derailed exec perf:mem`
from `derailed_benchmarks`. Present the result as MR metrics.
2019-06-28 13:49:57 +03:00
Lin Jen-Shin 51011d1b2c Merge branch 'improve-review-apps-cleanup-when-previous-deployment-failed' into 'master'
Improve Review Apps cleanup when previous deployment failed by only issuing an `helm delete` command

Closes #63639 and #62161

See merge request gitlab-org/gitlab-ce!28661
2019-06-25 14:00:47 +00:00
Lin Jen-Shin 938db91322 Merge branch '62735-for-stable-branches-build-cng-images-from-corresponding-stable-branches-in-cng-mirror-project' into 'master'
Pass branch name to the CNG pipeline for stable branches

See merge request gitlab-org/gitlab-ce!29617
2019-06-25 11:18:54 +00:00
Rémy Coutable e266911019
Install Helm on dedicated nodes
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-25 11:09:06 +02:00
Rémy Coutable a90f12f77d
Let Helm handle the cleanup and print logs when deployment fails
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-25 11:09:06 +02:00
Qingyu Zhao 940fcc9ff2 Generate gem size metrics in memory CI
This includes several changes:
  - Rename memory-static to generate-gems-size-metrics-static
  - Rename memory-static-objects to generate-gems-memory-metrics-static
  - Change generate-gems-size-metrics-static interface. The script now
    expect `bundle exec derailed bundle:mem` output as its input. The
    script output to stdout, or stderr for error message.
  - Change generate-gems-memory-metrics-static interface. The script now
    expect `bundle exec derailed bundle:objects` output as its input.
    The script output to stdout, or stderr for error message.
  - Generate gem size metrics. Script generate-gems-size-metrics-static
    extract each gem size from `bundle exec derailed bundle:mem` output.
    Save output to metrics file in format: 'gem_size_mb{name="zip"} 0.5'
2019-06-21 20:05:59 +10:00
Paul Gascou-Vaillancourt bd9774e4d4 Add watch option to test script 2019-06-19 16:05:46 +00:00
Rémy Coutable 7fd2d687db
Pass branch name to the CNG pipeline for stable branches
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-19 16:37:33 +02:00
Aleksei Lipniagov c3b40ae131 Run static benchmarks from 'derailed_benchmarks'
Two static memory benchmarks will be included in our CI pipeline. It
will load gems from the Gemfile and check the amount of RAM consumed
as well as the number of objects allocated and retained.
Aggregated values will be included as 'metrics' into MRs while full
reports will be downloadable as job artifacts.
2019-06-19 12:16:44 +03:00
Bob Van Landuyt e6059b3d8d Merge branch 'zj-disable-hooks-testing' into 'master'
Disable hooks by setting an ENV var

See merge request gitlab-org/gitlab-ce!29672
2019-06-17 17:32:58 +00:00
Zeger-Jan van de Weg 679ac7f78e
Disable hooks by setting an ENV var
Prior to this change, the hooks directory got cleared. That works, but
is not the way to go about it as there's a better way. Setting the env
var this commits sets.
2019-06-14 13:10:02 +02:00
Rémy Coutable 7c1422c795 Apply suggestion to scripts/review_apps/review-apps.sh 2019-06-12 17:01:15 +00:00
Rémy Coutable 115966335b
Pass FORCE_RAILS_IMAGE_BUILDS=true to the CNG triggered pipeline
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-12 13:22:12 +02:00
Rémy Coutable 97037e4a11
[Review Apps] Set `global.imagePullPolicy: Always`
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-06-12 13:22:12 +02:00
Kamil Trzciński 21c809ce22 Merge branch '62151-broken-master' into 'master'
Fix MySQL CI jobs

Closes #62156 and #62151

See merge request gitlab-org/gitlab-ce!28593
2019-05-24 15:34:54 +00:00
Clement Ho 57d9f88fd5 Merge branch '58869-unified-fe-test-script' into 'master'
Create a unified script to run Jest & Karma tests

Closes #58869

See merge request gitlab-org/gitlab-ce!27239
2019-05-23 17:32:56 +00:00
Rémy Coutable d02d3e34dd
Fix MySQL CI jobs
[run mysql]

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-05-22 21:47:32 +02:00
Rémy Coutable 6145ddf515
Revert "Merge branch 'revert-04c3c6dd' into 'master'"
This reverts commit 744f1f2e70, reversing
changes made to c4d930e5f5.
2019-05-22 21:47:32 +02:00
Kamil Trzciński 4f20c9de6f Revert "Merge branch 'reorganize-tests-jobs-by-level' into 'master'"
This reverts merge request !27514
2019-05-22 11:45:46 +00:00
Kamil Trzciński 04c3c6dd5a Merge branch 'reorganize-tests-jobs-by-level' into 'master'
Reorganize test jobs by level

See merge request gitlab-org/gitlab-ce!27514
2019-05-22 10:21:38 +00:00
Yoginth 2f6a20ce66 Fix typos in the whole gitlab-ce project 2019-05-20 14:11:44 +00:00
Rémy Coutable 4d9c76e9e4
Reorganize test jobs by level
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-05-20 14:31:58 +02:00
Rémy Coutable 66b4c6564a
Clean up assets that are older than 4 days to reduce assets cache size
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-05-14 21:34:06 +02:00
Paul Slaughter 334cfe472a
Update FE test script
- Don't fail when no tests match
- Print the cmd prefix for each line in it's data
- Update exit code handling
- Add colors to summary message
2019-05-13 09:48:35 -05:00
Paul Gascou-Vaillancourt 88b02af305
Create a unified script to run Jest & Karma tests
- Created scripts/frontend/test.js
- Updated test task to call Node script
2019-05-13 09:48:34 -05:00
Marcel Amirault fd5749b2c9 Docs: Merge EE doc/gitlab-geo to CE 2019-05-05 16:27:37 +00:00
Marcel Amirault b05936cbfa Docs: Merge Various EE /doc dirs to CE 2019-05-05 15:59:22 +00:00
Marcel Amirault 8b710c8ba4 Docs: Merge EE doc/analytics to CE 2019-05-01 07:13:12 +00:00
Rémy Coutable 84103e2d2f
Disable HTTP for the nginx-ingress Review App service
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-30 09:49:10 +02:00
Rémy Coutable 9649c2ef47
Organize better Review Apps and QA jobs
Also, play manual jobs once dependency jobs are done instead of polling
for the dependent jobs to be finished.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-24 19:25:37 +02:00
Rémy Coutable d0efb430ce
Make the Review App cleanup more efficient
Ensure that the cleanup starts right away.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-19 10:50:43 +02:00
Rémy Coutable 955136b56d
Don't fail the job if the Review App doesn't deploy properly
It seems the deploy function causes the job to fail if it doesn't
succeed. That wasn't the intent as we want to curl the Review App after
the deploy finished (even if it failed) because sometimes the Review App
is just a bit long to be ready.

This change wraps the Review App deployment with "set +e"/"set -e" to
ensure that the job doesn't fail right away if the deploy fails.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-17 10:49:02 +02:00
Rémy Coutable 64960ae762
Conform scripts/review_apps/review-apps.sh to shellcheck
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-09 15:57:04 +02:00
Rémy Coutable 6dadd965dc
Poll Review App after it's deployed to ensure it's accessible
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-04-09 15:56:53 +02:00
Lin Jen-Shin 700e8d1917 Merge branch 'enable-rubocop-application-record' into 'master'
Document ApplicationRecord / pluck_primary_key

Closes #59690

See merge request gitlab-org/gitlab-ce!26764
2019-04-01 15:55:46 +00:00
Nick Thomas 98a5976b78
Document ApplicationRecord / pluck_primary_key
We also enable the rubocop that makes it mandatory
2019-03-29 20:54:06 +00:00
Rémy Coutable 42102cd13a
Add more logging in the Review Apps deployment steps
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-03-28 11:56:38 +01:00
Tim Zallmann 5b05d2b987 First iteration of GitLab own Stylelints
DRYed the code

Changed new rules to warnings

Manual prettified and added stylelint rules
2019-03-26 08:13:21 +00:00
Rémy Coutable dc2a482ba1
Fix the .review-deploy-base job so that env variables are passed
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-03-19 08:31:20 +01:00
Balasankar "Balu" C 313022c79a
Use gitlab-ce as default project name in asset image building
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2019-03-15 19:15:54 +05:30
Balasankar "Balu" C de2106998a
Set asset image name properly for all possible CE/EE project names
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2019-03-15 17:00:57 +05:30
Nick Thomas 9f05e97aad
Run rubocop -a 2019-03-13 13:42:43 +00:00
Balasankar "Balu" C 24426f37d7
Tag asset docker image with GitLab version also
Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>
2019-03-12 16:41:50 +05:30
Stan Hu f11030173b Batch insert CI rspec_profiling data
Instead of inserting a row after each example to an external database,
we save the CI profiling reports into the `rspec_profiling` directory
and insert the data in the update-tests-metadata CI stage.  This should
make each spec run faster and also reduce the number of PostgreSQL
connections needed by concurrent CI builds.

`scripts/insert-rspec-profiling-data` also inserts one file at a time
via the PostgreSQL COPY command for faster inserts. The one side effect
is that the `created_at` and `updated_at` timestamps aren't available
since they aren't generated in the CSV.

Closes https://gitlab.com/gitlab-org/gitlab-ee/issues/10154
2019-03-12 09:51:37 +00:00
Mike Greiling c46b791911
Remove node 6 trailing comma support
This removes trailing commas from node scripts which previously
omitted them for compatiblity with node 6
2019-03-11 14:16:41 -05:00
Stan Hu fb6a4e21d4 Bring back Rugged implementation of find_commit
This brings back some of the changes in
https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/20339.

For users using Gitaly on top of NFS, accessing the Git data directly
via Rugged is more performant than Gitaly. This merge request introduces
the feature flag `rugged_find_commit` to activate Rugged paths.

There are also Rake tasks `gitlab:features:enable_rugged` and
`gitlab:features:disable_rugged` to enable/disable these feature
flags altogether.

Part of four Rugged changes identified in
https://gitlab.com/gitlab-org/gitlab-ce/issues/57317.
2019-03-01 08:45:51 -08:00