Commit Graph

720 Commits

Author SHA1 Message Date
Alex Hanselka 2a885d7583
Correct the tags for asset compilation 2019-02-21 11:16:22 -08:00
Alex Hanselka eeacc7399c
Remove runner tags that are no longer needed 2019-02-20 16:15:15 -08:00
Rémy Coutable c735bfaa53
Do not retry jobs in quarantine since they are supposed to fail
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-02-14 15:19:11 +01:00
Lukas Eipert 8ccf1ea310
Use correct integrity hash for sprockets caching
Use self.integrity_uri over self.hexdigest_integrity_uri(digest), as the
latter always returned nil leading to improper cache invalidation.

We are alos enabling caching of `tmp/cache/assets/sprockets` again, to
get those performance gains.
2019-02-08 13:14:39 +01:00
Lukas Eipert 7e5c2d23dd
Disable caching for sprockets for now 2019-02-08 00:28:37 +01:00
Lukas Eipert 9f747da108
Fix increased package size of public/assets 2019-02-07 20:10:18 +01:00
Rémy Coutable 6b39f55d3f
Add cache to the 'compile-assets' and 'gitlab:assets:compile' jobs
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-02-05 14:04:54 +01:00
Rémy Coutable a7af604262
Fix the package-and-qa and review-build-cng jobs
By changing the `review-build-cng` job to be a `single-script-job`, the
repository content wasn't there, including the `*_VERSION` files, thus
leading to missing variables for components in the triggered pipeline.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-02-01 15:34:00 +01:00
Clement Ho 6e085eea53 Merge branch 'sh-bump-chrome-golang-ci-image' into 'master'
Bump CI image to use Chrome 71.0 and Golang 1.11

Closes #56614 and #55578

See merge request gitlab-org/gitlab-ce!24572
2019-01-24 16:25:31 +00:00
Achilleas Pipinellis 9060941162
Use the same path of the docs site as in production
This started with
https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/24339 where a
broken link was introduced, but the lint checker never caught it.

The docs-lint job does the following:

```yaml
  script:
    - mv doc/ /tmp/gitlab-docs/content/
    - cd /tmp/gitlab-docs
    # Build HTML from Markdown
    - bundle exec nanoc
    # Check the internal links
    - bundle exec nanoc check internal_links
```

It moves the `doc/` dir inside `content` where Nanoc is expecting the
markdown files to be. It then builds the site and finally checks for
the links. If the built website was deployed to production, that would
be under `docs.gitlab.com/doc`.

The interesting part here is that
`[the logs](/doc/administration/logs.md#productionlog)`
translates to `<a href="/doc/administration/logs.html#productionlog>`,
so, Nanoc correctly sees this as an existing file!

This MR changes the path of the docs content to be equal to
$DOCS_GITLAB_REPO_SUFFIX which is defined as an environment
variable and takes the value of the slug of each project:
'ce', 'ee', 'omnibus', 'runner'.
2019-01-23 19:24:25 +01:00
Rémy Coutable b8843fff37
Set API_TOKEN in the review-build-cng job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-23 10:24:47 +01:00
Stan Hu 2b83454141 Bump CI image to use Chrome 71.0 and Golang 1.11 2019-01-22 11:23:37 -08:00
Lin Jen-Shin f2d1aad225 All review jobs should share the same only & except 2019-01-23 02:29:41 +08:00
Rémy Coutable 988cddae4b
Move the CNG triggering to a new review-build-cng job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-21 19:58:58 +01:00
Rémy Coutable 11961f05ec Revert "Merge branch 'qa-use-mr-iid-in-review-app-slug' into 'master'"
This reverts merge request
https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/24388
2019-01-21 18:23:49 +09:00
Grzegorz Bizon b479ddc769 Merge branch 'qa-use-mr-iid-in-review-app-slug' into 'master'
Use MR IID in Review Apps slug and domain

See merge request gitlab-org/gitlab-ce!24388
2019-01-18 13:15:43 +00:00
Rémy Coutable 42bdfa7980
Retry Node QA jobs upon system and API failure
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-17 09:14:24 +01:00
Rémy Coutable bcde76eeb6
Use MR IID in Review Apps slug and domain
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-15 14:53:12 +01:00
Rémy Coutable d71eb8fc1a
Add jobs to run quarantine tests
Signed-off-by: Rémy Coutable <remy@rymai.me>
2019-01-15 14:43:03 +01:00
Winnie Hellmann 7999ca3224 Generate searchable JSDoc documentation 2019-01-14 21:46:21 +00:00
Lukas Eipert 06df35f41b
Remove QA job for node@6 2019-01-14 12:41:38 +01:00
DJ Mountney 9188c70b18 Run the cloud-image trigger job for tags, even if the tests fail 2019-01-08 16:08:37 -08:00
Mark Lapierre 0f751f6f17 Run gitlab:assets:compile on qa jobs
Optionally compiling assets when needed for qa jobs proved
unworkable so instead we fall back on compiling them for
all qa jobs.
2018-12-17 15:30:52 -05:00
Jasper Maes 44fef4fe4c Remove rails 4 support in CI, Gemfiles, bin/ and config/ 2018-12-14 19:36:22 +01:00
Stan Hu e7a6b84168 Merge branch 'add-docs-lint-back' into 'master'
Docs: Enable gitlab-docs lint

Closes gitlab-com/gitlab-docs#305

See merge request gitlab-org/gitlab-ce!23748
2018-12-11 22:10:29 +00:00
Mike Greiling 6adb769e88 Merge branch 'winh-check-yarn-version' into 'master'
Check that yarn version is at least 1.10.0

See merge request gitlab-org/gitlab-ce!23612
2018-12-11 21:22:31 +00:00
Marcia Ramos 9ab5326182 Enable `bundle exec nanoc check internal_links` 2018-12-11 17:07:36 -02:00
Yorick Peterse 09cf551413
Don't allow Danger to fail in CI any more
In https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/20654 this job
was marked as allowing failures, but this allows developers to ignore
the results that Danger produces. Since it's not clear why the job was
allowed to fail, and since it's somewhat counter productive, we no
longer allow it to fail.
2018-12-10 16:43:51 +01:00
Winnie Hellmann 60a1f54f41 Upgrade yarn to 1.12 in build image of gitlab:assets:compile job 2018-12-10 12:00:20 +01:00
Stan Hu b21463f063 Disable docs lint internal_links check
This check never worked once the global navigation changes were rolled
out in https://gitlab.com/gitlab-com/gitlab-docs/merge_requests/362. The
global nav will ALWAYS include /ce and /ee links, and the CE and EE
repos will never include documentation for both.  gitlab-docs now
expects the documentation to be in the following directories:

* /tmp/gitlab-docs/ce (CE)
* /tmp/gitlab-docs/ee (EE)
* /tmp/gitlab-docs/omnibus (Omnibus)

The problem is that the CE and EE repos will only include one of the
first two.

Let's disable this check until
https://gitlab.com/gitlab-com/gitlab-docs/issues/305 is resolved.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/55038
2018-12-07 13:39:45 -08:00
Rémy Coutable 2aeff4498b
Retry the review-{deploy,qa} jobs twice
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-12-06 10:06:14 +01:00
Yorick Peterse cc40947bd9
Remove merge:master job entirely
Apparently disabling it by checking for a variable doesn't actually
disable it.

[ci skip]
2018-12-05 12:15:54 +01:00
Mike Greiling d133c874fa Merge branch 'winh-add-jest' into 'master'
Setup Jest test environment

See merge request gitlab-org/gitlab-ce!23406
2018-12-05 10:43:38 +00:00
Winnie Hellmann a8a13d3259 Setup Jest test environment 2018-12-05 09:24:42 +01:00
ddavison 8031377e63
Do not attempt retry until allow_failure has been removed 2018-12-04 13:51:58 -08:00
Mek Stittri 9f3e0dc54d Allow review app smoke test to fail for now 2018-12-04 11:19:03 -08:00
Yorick Peterse 230beace20
Temporarily disable automatic merging
It appears that for some jobs
(https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/129705025 for example)
we process a range of commits far greater than necessary, which can lead
to commits getting reverted that were merged a long time ago.

[ci skip]
2018-12-04 19:26:45 +01:00
Rémy Coutable acd18a0900 Merge branch 'merge-train' into 'master'
Automatically merge CE master into EE master

See merge request gitlab-org/gitlab-ce!23453
2018-12-04 15:50:08 +00:00
Yorick Peterse ee6fb2b1ee
Automatically merge CE master into EE master
This sets up GitLab CI to automatically push CE master changes into EE
master, or revert them if the changes cause merge conflicts. The CI
configuration contains a single job to do this: `merge:master`. This job
is executed for every push to master, and periodically using a CI
schedule.

The periodic job is necessary because incremental jobs may not be able
to revert commits if newly added commits depend on these commits. By
re-running the job periodically (including all changes since a large
enough time frame), we can ensure that such commits are also reverted
(if they still conflict at that time).

The job runs in its own "merge" stage, _after_ the build and prepare
stages, but _before_ running the tests. This ensures that randomly
failing tests won't prevent code from being merged into EE. Running the
stage after the "prepare" stage reduces the chances of the job reverting
CE changes just because it ran before a corresponding EE MR was merged
into EE master.
2018-12-04 14:40:04 +01:00
DJ Mountney 34b84019b4 Fixes a typo that prevented assets from being properly compiled
For CE on dev.gitlab.org
2018-12-04 06:37:38 +00:00
Rémy Coutable 9c15c3985f
Retry the review-qa-smoke job twice
Also, enable debug mode.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-29 12:26:42 +01:00
Sean McGivern e8db29d086 Merge branch '49570-add-review_qa-job' into 'master'
Add an automatic job to run QA smoke tests against Review Apps

Closes #49570

See merge request gitlab-org/gitlab-ce!22853
2018-11-28 10:39:56 +00:00
Rémy Coutable f4b8ecbf9f
Add a manual job to run QA against a Review App
1. Renames review to review-deploy.
2. Renames stop_review to review-stop.
3. Adds a build-qa-image job to the prepare stage and save the QA
  Docker image as artifact (example:
  https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120967019).
4. Adds a manual review-qa job to the test stage to run QA tests
  against the Review App (example:
  https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120967238).
5. Make the review-deploy job plays the review-qa job as soon as the
  Review App is deployed (example:
  https://gitlab.com/gitlab-org/gitlab-ce/-/jobs/120988775).
6. Updates the Review Apps documentation accordingly.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-26 14:49:03 +01:00
Achilleas Pipinellis c1d14d3335
Exclude qa-frontend from running on docs-only branches 2018-11-23 16:02:58 +01:00
George Tsiolis 8ed21de403 Include wildcard for `gitlab:assets:compile` only parameter 2018-11-22 17:38:51 +02:00
George Tsiolis b31ef891b4 Limit `gitlab:assets:compile` job to branches 2018-11-22 15:00:50 +02:00
Robert Speicher 5c3c905994
Add dedicated runner tags to assets job
Ordinarily it would get the `gitlab-org` tag from
`dedicated-no-docs-pull-cache-job`, but adding the `docker` tag
overwrites rather than inherits, so this job has been running on the
underpowered hardware of the shared runners rather than our dedicated
runners.

We're also adding a `high-cpu` tag, which doesn't currently do anything
but will be useful for targeting a runner specifically for this job.
2018-11-20 18:26:11 +01:00
Kamil Trzciński 4916de7528 Merge branch 'rs-moar-runners' into 'master'
Increase rspec parallelization to 50

See merge request gitlab-org/gitlab-ce!23149
2018-11-19 20:19:10 +00:00
Winnie Hellmann 87dec8dd28 Provide application.css from master branch via GitLab Pages 2018-11-16 20:40:54 +00:00
Mike Greiling bff3733fe1 Merge branch '53813-test-compilation-against-multiple-node-versions' into 'master'
Check compilation of FE assets against multiple node versions

Closes #53813

See merge request gitlab-org/gitlab-ce!23068
2018-11-16 19:47:17 +00:00
Robert Speicher bec84f9112
Increase rspec parallelization to 50 2018-11-16 17:29:36 +01:00
Rémy Coutable 97e3d5ce29 Merge branch 'conditionally-build-assets-image' into 'master'
Add BUILD_ASSETS_IMAGE CI variable

See merge request gitlab-org/gitlab-ce!23076
2018-11-15 17:27:08 +00:00
Ian Baum 553eaf01f7 Add BUILD_ASSETS_IMAGE CI variable
* Defaults to FALSE
* Can be used to disable building/pushing the assets image in the
gitlab:compile:assets job
2018-11-15 09:45:04 -06:00
Rémy Coutable b27db6cf0a
Use the new parallel keyword in .gitlab-ci.yml
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-15 14:34:41 +01:00
Lukas Eipert 95d5518e54 Update to new security report syntax 2018-11-14 23:19:46 +00:00
Stan Hu 44e8a00b95 Exclude qa and docs from Rails 4 builds
Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/54059
2018-11-14 13:10:28 -08:00
Lukas Eipert 6e3aaf7b89
Check compilation of FE assets against multiple node versions 2018-11-14 18:03:26 +01:00
Sean McGivern af3a73ef9c Merge branch 'switch-rails' into 'master'
Switch to Rails 5

Closes #14286 and #48991

See merge request gitlab-org/gitlab-ce!21492
2018-11-14 14:01:14 +00:00
Marin Jankovski 28e3a90be8 Merge branch 'move-assets-compile-sooner' into 'master'
Move cloud-native-image to the post-test stage

Closes charts/gitlab#897

See merge request gitlab-org/gitlab-ce!22942
2018-11-14 12:27:51 +00:00
Jan Provaznik 7dcf3977eb Fix trigerring of rails 4 tests in CI 2018-11-14 12:41:16 +01:00
Jan Provaznik 62bd2aca04 Switch rails 4 to 5 in gitlab-ci
CI jobs will be triggered both with rails 4 and 5
to make sure we keep backward compatibility if it turns out
we have to switch back to rails 4.

Rails 4 jobs are not allowed to fail for now, these jobs will be
removed in a follow-up MR next cycle.
2018-11-14 12:38:30 +01:00
Ian Baum 58282ff1b9
Removing extra option for gitlab:assets:compile
* Don't need to specify stage as it is inherited from the job template
2018-11-13 14:24:33 -06:00
Ian Baum 07a1faa092 Move cloud-native-image job to the post-test stage
* The job depends on asset image created as part of the
gitlab:assets:compile job.

https://gitlab.com/charts/gitlab/issues/897
2018-11-13 14:21:50 -06:00
Stan Hu 1f5dca2d4f Upgrade to Ruby 2.5.3
Attempt to update google-protobuf for migration-paths

Because the one we were using aren't compatible with
Ruby 2.5.3, and it'll be troublesome to switch Ruby.
Upgrading google-protobuf will be much easier.

All of them will need to be updated for Ruby 2.5.3

We remove oj because we don't really need it and it
doesn't compile on 2.5.3 with that version.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/41825
2018-11-13 06:17:46 -08:00
Tim Zallmann f2ef5e2ee8 Merge branch 'leipert-upgrade-node-yarn' into 'master'
Upgrade to node v10.x and yarn 1.12.x

See merge request gitlab-org/gitlab-ce!22979
2018-11-13 12:22:07 +00:00
Lukas Eipert b71f0562d8
Upgrade to node v10.x 2018-11-12 10:48:17 +01:00
Lukas Eipert 00d3be46b9
Remove unnecessary job dependencies 2018-11-10 17:10:17 +01:00
Rémy Coutable f7f42cf345
Ensure we create the secrets at the right time
In `deploy`, if the previous deployment failed, we delete/cleanup all
the objects related to the release, including secrets. The problem is
that if we create the root password before that, it will be then
recreated during the deploy with a random value!

By creatigng the secret just before actually deplying a new release, we
ensure that it won't be overriden.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-11-09 12:30:51 +01:00
Robert Speicher dd807d46ff Merge branch 'add-docker-assets-image' into 'master'
Build an assets only container

See merge request gitlab-org/gitlab-ce!22235
2018-10-31 17:13:50 +00:00
Ian Baum 70ee4e1b3e Build a docker container storing only the frontent assets
* Run as part of gitlab:assets:compile job

* Will be used by omnibus-gitlab and the CNG images to avoid
compiling multiple times

https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/22235
2018-10-31 11:21:14 -05:00
Marcel Amirault 14fc739c94 Renaming Secret Variables in the codebase 2018-10-30 08:49:26 +00:00
Marin Jankovski 309d3ebb47
Review apps cleanup schedule runs on master 2018-10-25 16:25:52 +02:00
Robert Speicher f5d71ad8f3 Merge branch 'sh-bump-ruby-2.4.5' into 'master'
Upgrade to Ruby 2.4.5

See merge request gitlab-org/gitlab-ce!22484
2018-10-24 21:24:48 +00:00
Lin Jen-Shin 577bf59a75 Remove unused rails5-variables
They're no longer used and have no effect
2018-10-24 17:07:13 +08:00
Stan Hu 4ca19ab172 Upgrade to Ruby 2.4.5 2018-10-24 15:31:00 +08:00
Rémy Coutable 151a6c3349 Fix the schedule:review_apps_cleanup job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-23 10:05:57 -05:00
Ian Baum 69b2e5a947 Fix indentation, and move task to proper stage
* Use 2 space indentation in review-apps.sh script
* Move automated_review_cleanup back to build stage
2018-10-23 10:05:57 -05:00
Ian Baum 58690a63fa Add review app to gitlab-ce
* Uses the same supporting code as used in EE
* Includes automated cleanup
* Install external-dns helm chart to review apps cluster if it isn't
already
* Adds variables REVIEW_APPS_AWS_SECRET_KEY and
REVIEW_APPS_AWS_ACCESS_key
* review-apps-ce uses a different cipher
2018-10-23 10:05:57 -05:00
Robert Speicher def8e8dba6 Merge branch 'improve-review-apps' into 'master'
Improve review apps

Closes #6875

See merge request gitlab-org/gitlab-ee!6665

[ci skip]
2018-10-23 10:05:56 -05:00
Rémy Coutable 77ea33304a
Run karma for qa-* branches
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-22 17:51:18 +02:00
Evan Read 476c44ae5e Change image for docs linting 2018-10-04 10:12:06 +10:00
Robert Speicher b609c8f650 Merge branch 'test-against-postgres-96' into 'master'
Use minimum recommended PostgreSQL version to run our tests

See merge request gitlab-org/gitlab-ce!22060
2018-10-02 20:00:20 +00:00
Gabriel Mazetto e129402287 Use minimum recommended PostgreSQL version to run our tests 2018-10-02 16:05:25 -03:00
Mike Greiling 9ab5910065 Merge branch 'leipert-frontend-danger' into 'master'
Danger checks for the frontend

See merge request gitlab-org/gitlab-ce!21859
2018-10-02 18:55:26 +00:00
Fabio Busatto 7299429ba6 Update link to documentation testing 2018-10-01 09:27:17 +00:00
Lukas Eipert 685d579472
Danger check for ignored eslint rules
We disabled a lot of eslint rules on a per-file basis. This checks
touched files for those and reminds you to re-enable the rules and fix
them.
2018-09-29 08:22:12 +02:00
Lukas Eipert 4df24e5f04
Danger check for unprettified JavaScript
This adds a Dangerfile which executes `prettier` to find out if someone
touched Frontend files and forgot to run it on their current branch.
2018-09-28 22:04:26 +02:00
Mike Greiling 9ea6c8588a
Fix karma out-of-memory failures 2018-09-25 12:46:58 -05:00
Rémy Coutable 45d8c213fd
Refactor scripts/trigger-build and post a commit note with the downstream pipeline URL for omnibus triggers
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-09-24 18:24:13 +02:00
DJ Mountney 19d84a602a Move the cloud-native-image trigger job into the test stage
This is because the CNG pipeline now relies on the assets
compiled here in the gitlab:assets:compile job (It waits
up to 30 minutes for them)

Without this change, the cloud native job was holding up
the pipeline, preventing the assets compile job from being
run.
2018-09-19 14:50:43 -07:00
Winnie Hellmann 01b669640a Generate JUnit report for Karma tests 2018-09-11 21:03:05 +00:00
Ian Baum 636aa7d39b Provide a cached archive of compiled assets 2018-09-07 20:45:42 +00:00
Lukas Eipert 8327413ec2
forward build image to Chrome 69 2018-09-07 10:54:14 +02:00
Rémy Coutable 3a4d3dff51 Merge branch 'junit-results' into 'master'
Enable JUnit results for rspec

See merge request gitlab-org/gitlab-ce!21449
2018-09-04 13:33:50 +00:00
Kamil Trzciński 789fae50fb Enable JUnit results for rspec 2018-09-03 14:59:55 +02:00
Takuya Noguchi cb7d4340d0 Run review-docs-cleanup job for gitlab-org repos only 2018-09-02 12:40:38 +09:00
Sean McGivern 4f3a2347be Move package-and-qa to the test phase
The problem is this: when each phase starts, it checks if all jobs in earlier
phases are complete. package-and-qa is slow. As build is the first phase, if you
trigger package-and-qa before the prepare phase is finished, the entire test
phase will be blocked until package-and-qa completes, which isn't what we want.

But equally, if build came _after_ test, then package-and-qa couldn't be started
until the tests were finished. Putting it in the same stage as the tests means
we can have our cake and eat it.
2018-08-28 09:17:26 +01:00
Shinya Maeda bc53c4f0b6 Update .gitlab-ci.yml 2018-08-17 10:32:40 +00:00
Bob Van Landuyt 1ea6d58552 Disable danger in preparation branches
Most of these validations don't apply to preparation branches and they
cause a lot of noise in the merge request. Therefore disabling danger
when the branches look like branches that could be for a preparation MR.
2018-08-09 18:41:11 +02:00
Rémy Coutable c13dfc4d5e
Update the image for the 'danger-review' job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-07-26 16:02:50 +02:00