Commit Graph

237 Commits

Author SHA1 Message Date
Ian Baum 41994c2adf Add omitted indentation fix 2018-10-23 10:05:57 -05:00
Ian Baum 58690a63fa Add review app to gitlab-ce
* Uses the same supporting code as used in EE
* Includes automated cleanup
* Install external-dns helm chart to review apps cluster if it isn't
already
* Adds variables REVIEW_APPS_AWS_SECRET_KEY and
REVIEW_APPS_AWS_ACCESS_key
* review-apps-ce uses a different cipher
2018-10-23 10:05:57 -05:00
Mike Greiling a32511692f Fix/update prettier script 2018-10-22 17:47:03 +00:00
Rémy Coutable 25d8c8d1f0
Improve automated Review Apps cleanup
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-22 09:57:50 +02:00
Rémy Coutable 4d7c6a61d7
Improve the variables passed in trigger-build
Make the variable names consistent by following the
`TOP_UPSTREAM_SOURCE_*` pattern.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-10 12:10:04 +02:00
Rémy Coutable 02b456dbe8
Pass 'TOP_UPSTREAM_SOURCE_SHA' in trigger-build
This is needed because `GITLAB_VERSION` has a special meaning in
`omnibus-gitlab` triggers: this is the GitLab version to build.

The problem is that `omnibus-gitlab` also has triggers to run QA for an
`omnibus-gitlab` commit, and if we use `GITLAB_VERSION` in that case,
the comment would be posted on the GitLab CE/EE commit (stored in
`GITLAB_VERSION`), whci hwouldn't make any sense.
Thus we need `TOP_UPSTREAM_SOURCE_SHA` to represent the commit on
which we want to leave a comment.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-10 12:10:04 +02:00
Rémy Coutable 1922ca0e67
Improve downstream pipeine trigger class
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-08 14:23:58 +02:00
Alejandro Rodríguez a99bf447a2 Remove Gitlab::Git::Repository#rugged and Gollum code
Cleanup code, and refactor tests that still use Rugged. After this, there should
be no Rugged code that access the instance's repositories on non-test
environments. There is still some rugged code for other tasks like the
repository import task, but since it doesn't access any repository storage path
it can stay.
2018-10-02 16:34:28 -03:00
Rémy Coutable 159b650d74
Cleanup review apps more rapidly
- Stop review app's environment after 2 days
- Delete review app's environment after 3 days
- Delete Helm release after 4 days

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-10-01 14:08:40 +02:00
Rémy Coutable 3299680cdd
[CE] Port review apps file to CE
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-09-25 16:41:27 +02:00
Rémy Coutable 45d8c213fd
Refactor scripts/trigger-build and post a commit note with the downstream pipeline URL for omnibus triggers
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-09-24 18:24:13 +02:00
Achilleas Pipinellis 8cb39fa8da Merge branch 'docs-port-ee-community-contributions' into 'master'
Docs port ee community contributions

See merge request gitlab-org/gitlab-ce!21311
2018-09-03 10:18:42 +00:00
Jasper Maes 8f51727d95 Backport schema_changed.sh from EE which prints the diff if the schema is different 2018-08-30 08:29:08 +02:00
John Eismeier 2c06a13854
Update scripts/lint-doc.sh
Originally submitted at
https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/3056.

Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-08-29 17:35:41 +02:00
gfyoung 8a3d565c8e Don't use arguments keyword in gettext script
Causing SAST build to fail unnecessarily.

Follow-up to !19378.
2018-08-19 01:05:50 -07:00
🌴🇿🇦 Lukas Eipert (OOO until Summit) 8f9442fcdf Frontend: Proper gettext extraction with gettext-extractor 2018-08-16 19:03:57 +00:00
Ahmad Hassan 8ea9c81593 Use rugged to validate ref name 2018-07-19 12:23:46 +02:00
Winnie Hellmann d42cd343ca Removed return statements from prettier script 2018-07-09 09:53:23 +00:00
Achilleas Pipinellis 72fa064000
Simplify downstream branch name 2018-07-05 11:02:38 +02:00
Mike Greiling 70bf08073d Resolve "100% CPU for webpack-dev-server running in GDK" 2018-06-25 19:30:37 +00:00
Achilleas Pipinellis 82012d4608
Always run review app for docs-only branches 2018-06-25 15:21:15 +02:00
Rémy Coutable 67f310e41f
Ignore GitLab API hiccups in scripts/trigger-build
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-06-20 17:17:29 +02:00
Tim Zallmann e04dfff858
Fixed the searching on the whole disk :-P 2018-06-15 12:43:04 +02:00
Tim Zallmann 930baeb92a
Added possibility to run prettier against one specific directory to make our conversion easier 2018-06-15 12:43:03 +02:00
Tim Zallmann 5f3a219e14
Fixed Prettier Config Applying + Updated Prettier to newest version 2018-06-15 12:43:03 +02:00
Marin Jankovski dd72134eba
Move the trigger-build script into one location to serve both omnibus and cloud-native triggers. 2018-06-14 16:31:32 +02:00
blackst0ne e23fb005cf Add CI job to check Gemfile.rails5.lock 2018-06-12 11:23:58 +00:00
Lin Jen-Shin 7083b355a6 Follow Rubocop for scripts/prune-old-flaky-specs 2018-06-01 14:30:10 +08:00
Lin Jen-Shin 39b6f31c66 Eliminate constants warnings by:
* Replace `require` or `require_relative` with `require_dependency`
* Remove unneeded `autoload`
2018-06-01 13:46:46 +08:00
Rémy Coutable 0c977d1725 Merge branch 'dz-no-ee-check' into 'master'
Add check for top-level ee directory in CE repo

Closes #46239

See merge request gitlab-org/gitlab-ce!19062
2018-05-22 16:26:30 +00:00
Dmitriy Zaporozhets fba580e37f
Update no-ee-check with rubocop recommendation.
Signed-off-by: Dmitriy Zaporozhets <dmitriy.zaporozhets@gmail.com>
2018-05-22 18:35:51 +03:00
Dmitriy Zaporozhets 470f55351b
Add check for top-level ee directory in CE repo
Signed-off-by: Dmitriy Zaporozhets <dmitriy.zaporozhets@gmail.com>
2018-05-21 14:52:45 +03:00
Grzegorz Bizon 3834040aa8 Merge branch 'rc/improve-single-script-jobs-ci-config' into 'master'
Improve the single-script jobs CI config

See merge request gitlab-org/gitlab-ce!19040
2018-05-21 11:03:17 +00:00
Rémy Coutable bc57a62a5c
Improve the single-script jobs CI config
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-05-21 11:30:44 +02:00
DJ Mountney 0bc78d0800 Build cloud native images on tags
When on a tag, trigger a multi-project pipeline in the CNG repostiory.

Opting for a trigger rather than an addition to our release-tools
project for a few reasons:

- The Dockerfiles in the CNG image repo change infrequently, and as a result
I don't feel the need/overhead for stable branches in that repo at this time
- My intent with the CNG repo, is that once stable, the Dockerfiles
would actualy move to their component projects, to be versioned with the
code they are building
- It is likely that we will want to followup with a manually triggered package
for branches for devs, and possibly review apps, so it made sense to
build the CNG ci jobs to accept this sort of pipeline.
2018-05-17 15:17:53 -07:00
Lin Jen-Shin 0ab6469187 Grant privileges after database is created
Never drop the database when granting privileges
2018-05-16 21:52:08 +08:00
Lin Jen-Shin cdcde75bb7 Only setup db in the first checkout! 2018-05-16 21:52:08 +08:00
Jacob Vosmaer (out of office May 10-14) d291f69fd9 Fix gitaly-ruby bundle poisoning in CI 2018-05-14 08:10:29 +00:00
Rémy Coutable d8a58f62bf
Fix scripts/prune-old-flaky-specs requires Bundler to run
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-04-11 23:07:05 +02:00
Rémy Coutable bcb7a99575
Use RspecFlaky::Report in scripts/prune-old-flaky-specs
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-04-10 15:38:41 +02:00
Rémy Coutable 9bb97abf04
Introduce scripts/prune-old-flaky-specs to prune outdated flaky specs from the report
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-04-10 15:38:40 +02:00
Olivier Gonzalez 81aba67e54 Use standard codequality job 2018-04-04 10:01:52 +00:00
Grzegorz Bizon f50d0e4eee Correctly check whether package-and-qa runs for EE 2018-04-03 09:59:47 +02:00
Achilleas Pipinellis c8205203a1
Add test for new README.md in docs
Prefer index.md instead since they provide clean URLs in the docs site
2018-03-26 15:11:38 +02:00
Lukas Eipert d023244aa5 Make use of the prettier ignore file during our save script 2018-03-26 07:39:14 +00:00
Mike Greiling 569b06cf20
update eslintignore for node scripts 2018-03-23 11:53:12 -05:00
Mike Greiling 9238c5d5ca
prettify all node scripts 2018-03-23 11:52:54 -05:00
Tim Zallmann 51e454f3b1 Prettier Phase 1: Prettier Configuration, Prettifying of files and documentation 2018-03-14 19:32:36 +00:00
Achilleas Pipinellis 471728f8fb
Wait for the pipeline to start before canceling it 2018-03-08 14:22:59 +01:00
Achilleas Pipinellis fe7d45f26a
Fix race condition when previewing docs
Cancel the pipeline that gets created the first time the remote
branch is created in order not to overwrite the one we trigger
afterwards.

Closes https://gitlab.com/gitlab-com/gitlab-docs/issues/154
2018-03-06 10:02:21 +01:00
Robert Speicher a04ff31e40 Set security harness hook to executable after creation 2018-02-28 09:47:34 -06:00
Rémy Coutable a0ef01c872
Optimize and improve the inline documentation for the codequality job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-02-21 16:25:28 +01:00
Grzegorz Bizon 5ccd3bec95 Merge branch 'improve-codequality-job' into 'master'
Simplify the codequality job

See merge request gitlab-org/gitlab-ee!4602
2018-02-21 15:21:05 +01:00
Rémy Coutable 2f0d2ab55b
Run lint:all tasks in forks
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-02-14 17:34:34 +01:00
Rémy Coutable e4990b66df Combine all rake tasks in the static-analysis job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-02-14 15:18:59 +01:00
Robert Speicher ebdebae4ea Add a security harness script
This script toggles a Git pre-push hook that will prevent pushing to
remotes other than dev when the harness is enabled.
2018-02-13 13:09:57 -06:00
Jacob Vosmaer 4aedec1192 Ban Rugged from Repository 2018-02-01 15:44:36 +01:00
Jacob Vosmaer (GitLab) 5c2fe2d3d7 Decouple more of Repository from Rugged 2018-01-30 16:21:55 +00:00
Rémy Coutable 33ed96229b
Don't run scripts/lint-changelog-yaml in scripts/static-analysis but only in the 'docs lint' job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-01-30 11:08:32 +01:00
Lin Jen-Shin a2618310ae Use Process::Status rather than an integer
However keep backward compatibility
2018-01-26 19:42:48 +08:00
Lin Jen-Shin df2c47b9ff Don't print stdout in case we're just printing warnings
Otherwise it could be confusing
2018-01-26 19:42:48 +08:00
Lin Jen-Shin 54ca8d0d6c Fail static-analysis if there's output to stderr
TODO: fix offenders
2018-01-26 19:42:48 +08:00
Jacob Vosmaer 6d6f7536bd Look for rugged with static analysis 2018-01-25 14:05:11 +01:00
Rémy Coutable fca2a75266 Ensure Gitaly Ruby gems are installed using the correct Gemfile and at the correct location
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-01-23 15:29:20 +01:00
Tim Zallmann d7eb369218 Merge branch 'revert-c8ddf067' into 'master'
Revert "Merge branch 'pre-commit-prettier' into 'master'"

See merge request gitlab-org/gitlab-ce!16217
2018-01-17 13:31:16 +00:00
Lin Jen-Shin cfd75101d1 Merge remote-tracking branch 'upstream/master' into 1819-override-ce
* upstream/master: (621 commits)
  Add a note about GitLab QA page objects validator to docs
  Refactor dispatcher projects blame and blob path
  Update export message to mention we can download the file from the UI
  Fix Ctrl+Enter keyboard shortcut saving comment/note edit
  fix case where tooltip messes up :last-child selector
  Add reason to keep postgresql 9.2 for CI
  Remove warning noise in ProjectImportOptions
  Add changelog entry
  Add RedirectRoute factory
  Update Ingress extra cost note to be more generic
  Fix Rubocop offense
  Refactor dispatcher project branches path
  Revert "Revert "Fix Route validation for unchanged path""
  Document that we need rsync for backing up
  Docs: move article "Laravel and Envoy w/ CI/CD"
  Recommend against the use of EFS
  Adds Rubocop rule for line break around conditionals
  Update CHANGELOG.md for 10.1.6
  Filter out build traces from logged parameters
  Refactored project:n* imports in dispatcher.js
  ...
2018-01-12 19:43:38 +08:00
Filipa Lacerda ecf6f1f872 Revert "Merge branch 'pre-commit-prettier' into 'master'"
This reverts merge request !16061
2018-01-04 09:13:26 +00:00
Robert Speicher c8ddf067ed Merge branch 'pre-commit-prettier' into 'master'
Pre commit prettier

See merge request gitlab-org/gitlab-ce!16061
2018-01-03 19:52:26 +00:00
Jacob Schatz 2abf63899d Add check if run from gitlab development kit root directory. 2018-01-02 16:01:45 -05:00
Jacob Schatz f6e5772dfc Check for symlink instead of file before install. 2018-01-02 15:57:45 -05:00
Jacob Schatz 981aac02f5 Update script to work only when run in the gitlab directory. 2018-01-02 15:49:39 -05:00
Stan Hu ad88e3f88d Fix `rake db:seed_fu` not doing anything in CI
The default behavior of seed_fu is to load the fixtures using the RAILS_ENV
environment.  In CI, since we set RAILS_ENV=test, nothing is ever
loaded. Instead of `rake db:seed_fu`, use `rake gitlab:setup`, which sets up
MySQL properly with limits.

Closes #41517
2018-01-02 12:44:51 -08:00
Lin Jen-Shin 8139895b43 Use `Gitlab::Utils::Override` over defined?(super) 2017-12-26 17:18:10 +08:00
Rémy Coutable 7fdb77625e Merge branch 'dz-add-sast' into 'master'
Remove security checks from static analysis and add sast job

See merge request gitlab-org/gitlab-ce!16113
2017-12-23 14:19:51 +00:00
Dmitriy Zaporozhets ef82cbef90 Remove security checks from static analysis and add sast job 2017-12-23 14:18:39 +00:00
blackst0ne f20581773a Return exception messages in scripts/lint-changelog-yaml 2017-12-23 12:53:13 +11:00
Jacob Schatz 060bceeacb Remove `-f` to not ruin other people's existing pre-commit files. 2017-12-20 15:54:21 -05:00
Jacob Schatz b3b7d12496 Add changelog and newlines 2017-12-20 15:48:45 -05:00
Jacob Schatz 6f45cbd197 Add script to enable code formatters 2017-12-20 15:29:27 -05:00
Jacob Schatz 39efc5c80c Remove JSX since we don't use it. 2017-12-20 15:19:09 -05:00
Jacob Schatz 1d78753860 Initial install 2017-12-20 12:09:22 -05:00
Lin Jen-Shin 873bc3a685 Preserve gem path so that we use the same gems
Without this patch, I would end up with:

```
An error occurred in a `before(:suite)` hook.
Failure/Error: raise "could not connect to gitaly at #{socket.inspect} after #{sleep_time} seconds"

RuntimeError:
  could not connect to gitaly at "tmp/tests/gitaly/gitaly.socket" after 10 seconds
```

Digging into it, it's because `scripts/gitaly-test-spawn` could not
spawn the process, because it cannot find the installed gems.

I personally installed all my gems under $HOME, namely with:

* `gem install rake --user-install` or:
* `bundle install --path ~/.gem`

The gems would be installed to `~/.gem/ruby/2.4.0/gems`, where
the version is Ruby ABI version.

Now we're changing $HOME, making RubyGems think that the gems
would be installed to `tmp/tests/ruby/2.4.0/gems` which is
apparently not the case.

In order to workaround this, we could preserve $GEM_PATH
populated by RubyGems, ignoring the default path based on $HOME.
2017-12-19 17:41:59 +08:00
Balasankar "Balu" C 3bbdb8b230 Make rubocop happy 2017-12-15 11:29:52 +05:30
Balasankar "Balu" C fe95db625d Use guard clause 2017-12-15 11:29:52 +05:30
Balasankar "Balu" C f4030dc351 Improve language 2017-12-15 11:29:52 +05:30
Balasankar "Balu" C ab78b570f4 Prettify 2017-12-15 11:29:52 +05:30
Balasankar "Balu" C 963b007b01 Use temp branch 2017-12-15 11:29:52 +05:30
Balasankar "Balu" C bf8289ab54 Pass info about who started the job and which job triggered it 2017-12-15 11:29:52 +05:30
Grzegorz Bizon 90569a175d Do not raise when downstream pipeline is created 2017-12-11 09:43:56 +01:00
Balasankar C c9fd438080 Set EE variable 2017-12-01 10:57:12 +05:30
Jacob Vosmaer (GitLab) a14bd24a02 Set an artificial $HOME for gitaly in test 2017-11-30 12:58:51 +00:00
Grzegorz Bizon 2998b88603 Add a feedback mechanism to `package-qa` manual action 2017-11-24 15:54:35 +00:00
Lin Jen-Shin d6fcdec52f Make sure we're using git installed in gitlab-build-images 2017-11-23 18:26:41 +08:00
Achilleas Pipinellis 4756720923
Use slug as the prefix for the docs CI job preview URL 2017-11-17 14:07:06 +01:00
Achilleas Pipinellis e1fb8b35e7
Change logic of repo name and slugs in docs review script
We need to make room for Runner and Omnibus docs.
This change makes sure the correct values are defined
based on CI_PROJECT_NAME.
2017-11-16 08:05:32 +01:00
Stan Hu 8efdf75bcb Use a non-superuser user to access GitLab to ensure permissions are proper
We have run into permission issues with MySQL triggers in #36633 that
would have been caught earlier either if our migration tests or GitLab QA
tests had been testing against non-superuser users. This change creates
a non-superuser that has access to the GitLab test database and uses that.

Closes #39932
2017-11-09 22:14:03 -08:00
Rémy Coutable d048c8fe43
Use the --parallel Rubocop flag in the static-analysis and improve the job
Signed-off-by: Rémy Coutable <remy@rymai.me>
2017-11-03 17:00:49 +01:00
bogdanvlviv c17570d3b3
Update scripts/prepare_build.sh 2017-10-17 21:15:19 +03:00
Sean McGivern e73c9ddc9e Extend changelog checker to test file extensions
Changelogs without a .yml extension won't be picked up, and will be ignored
completely, so fail the pipeline when one of those is found.
2017-09-29 15:24:16 +01:00
Sean McGivern 3fba557d5c Add static analysis job to find invalid YAML in changelogs
When a changelog has invalid YAML (typically, there is an unquoted @ at the
start of the author field), then the entry will be discarded. This script checks
all unreleased changelogs for validity, and runs as part of the static-analysis
step, so the pipeline will fail if this happens in future.
2017-09-27 09:52:03 +01:00