Commit Graph

4708 Commits

Author SHA1 Message Date
Jan 1721bbcb01 Resolve "Quick actions are case sensitive" 2018-06-13 10:23:57 +00:00
Mario de la Ossa 379a6a709a
Sidebar Milestone - Fix wrong URL when selecting a parent group milestone 2018-06-12 17:22:12 -06:00
Nick Thomas 893c824ed3 Merge branch 'pr-importer-io-extra-error-handling' into 'master'
Ensure MR diffs always exist in the PR importer

Closes #47312

See merge request gitlab-org/gitlab-ce!19704
2018-06-12 14:08:51 +00:00
Douwe Maan 8b0d2283d7 Merge branch 'gitaly-disk-access-3' into 'master'
Find and mark more Git disk access locations, part 2

See merge request gitlab-org/gitlab-ce!19437
2018-06-12 13:32:46 +00:00
Jacob Vosmaer f376347f24 Find and mark more Git disk access locations, part 2 2018-06-12 14:33:37 +02:00
Francisco Javier López ab93f7cc79 Bumping gitlab-gollum-lib and gitlab-gollum-rugged_adapter 2018-06-12 12:31:10 +00:00
Yorick Peterse e4612df0e2
Ensure MR diffs always exist in the PR importer
In rare cases it could happen that an MR was created, but creating the
MR diffs somehow failed (e.g. due to an error). This commit adds an
additional check to make sure MR diffs are always present when importing
GitHub pull requests.
2018-06-12 13:30:41 +02:00
Yorick Peterse 450b9f6e30 Merge branch 'da-port-cte-to-ce' into 'master'
Add Gitlab::SQL:CTE for easily building CTE statements

See merge request gitlab-org/gitlab-ce!19652
2018-06-12 10:46:31 +00:00
Mayra Cabrera 421957cf8c Merge branch 'sh-expire-content-cache-after-import' into 'master'
Expire Wiki content cache after importing a repository

Closes #47546

See merge request gitlab-org/gitlab-ce!19617
2018-06-11 17:35:39 +00:00
Douglas Barbosa Alexandre fe8261fdb2
Add Gitlab::SQL:CTE for easily building CTE statements 2018-06-11 12:44:08 -03:00
Stan Hu 6defeb0a7d Expire Wiki content cache after importing a repository
The cache state for Wikis that were imported via GitHub or Bitbucket does
not appear to have been flushed after a successful import.

Closes #47546
2018-06-11 08:33:06 -07:00
Sean McGivern 75797ac3d2 Merge branch '47684-uploads-specs-are-failing-on-master' into 'master'
Resolve "Uploads specs are failing on master"

Closes #47684

See merge request gitlab-org/gitlab-ce!19638
2018-06-11 15:01:45 +00:00
Francisco Javier López 1418afc2d6 Avoid checking the user format in every url validation 2018-06-11 13:29:37 +00:00
Rémy Coutable 0f90c1fd73
Don't use Rails.root.join for upload fixture paths
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-06-11 13:54:25 +02:00
Jacob Vosmaer (GitLab) ea8dc10772 Don't use Gitlab::Utils.nlbr in Gitlab::Git 2018-06-11 10:42:09 +00:00
Rémy Coutable 7d3bbeeb31 Merge branch 'rs-update-rspec' into 'master'
Update rspec to 3.7

See merge request gitlab-org/gitlab-ce!19449
2018-06-11 09:59:25 +00:00
Mark Chao 68cb1c2651 Revert rename allow collaboration column 2018-06-08 13:12:51 +00:00
Kamil Trzciński b780efab26 Merge remote-tracking branch 'origin/master' into 38542-application-control-panel-in-settings-page 2018-06-07 20:27:30 +02:00
Douwe Maan 290ca339ad Merge branch 'feature/customizable-favicon' into 'master'
Customizable favicon

Closes #15661

See merge request gitlab-org/gitlab-ce!14497
2018-06-07 16:54:41 +00:00
Douwe Maan 7b562c9727 Merge branch 'sh-fix-schema-migrations-seq-scans' into 'master'
Avoid sequential scans loading schema_migrations table when loading application settings

See merge request gitlab-org/gitlab-ce!19541
2018-06-07 16:53:56 +00:00
Gabriel Mazetto 36c3376475 Resolve "Hashed Storage: Make possible to migrate single project" 2018-06-07 15:40:44 +00:00
Rémy Coutable 6afe6fa6bc
Make Gitlab::CurrentSettings.current_application_settings return cached settings early if they exist without issuing any DB query
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-06-07 17:23:49 +02:00
Balasankar C 9f76632d80 Add installation type to usage ping data 2018-06-07 15:01:20 +00:00
Robert Speicher 6d165c740c Make all uses of `fixture_file_upload` use relative paths 2018-06-07 09:54:41 -05:00
George Tsiolis 93c7976ae2 Restore navigation theme order 2018-06-07 12:24:57 +00:00
Douwe Maan 543459794a Merge branch 'fj-move-rev-list-option' into 'master'
Moving rev-list lfs options to LfsChanges

See merge request gitlab-org/gitlab-ce!19497
2018-06-07 08:18:50 +00:00
Annabel Gray 164dbc6b77 Resolve "Introduce new navigation themes in GitLab 11.0" 2018-06-07 07:37:02 +00:00
Francisco Javier López 86d39016a2
Moving rev-list lfs options to Lfschanges 2018-06-06 21:55:32 +02:00
Matija Čupić 9efb1875b7
Merge branch 'master' into 38542-application-control-panel-in-settings-page 2018-06-06 21:29:12 +02:00
Francisco Javier López e8f49b4bee Support LFS objects when creating a project by import 2018-06-06 16:42:18 +00:00
Sean McGivern e9ad837cf0 Merge branch '42751-rename-master-to-maintainer' into 'master'
Resolve "Rename the `Master` role to `Maintainer`"

Closes #42751

See merge request gitlab-org/gitlab-ce!19080
2018-06-06 15:00:24 +00:00
Kamil Trzciński 96747556e7 Merge branch 'live-trace-v2-persist-data' into 'master'
Live trace: Rescue stale live trace

See merge request gitlab-org/gitlab-ce!18680
2018-06-06 12:45:41 +00:00
Mark Chao a6c15c5b97 change wording 2018-06-06 21:01:44 +09:00
Yorick Peterse 4083ea1c74 Merge branch 'rails5-fix-47376' into 'master'
Rails 5 fix glob spec

Closes #47376

See merge request gitlab-org/gitlab-ce!19469
2018-06-06 11:10:22 +00:00
Douwe Maan 45444c8e30 Merge branch '47189-github_import_visibility' into 'master'
Use Github repo visibility during import while respecting restricted visibility levels

Closes #47189

See merge request gitlab-org/gitlab-ce!19450
2018-06-06 10:54:43 +00:00
Douwe Maan af9cc234f2 Merge branch 'bvl-graphql-start-34754' into 'master'
GraphQL setup: Basic Project and Merge request endpoint

Closes #34754

See merge request gitlab-org/gitlab-ce!19008
2018-06-06 10:03:34 +00:00
Imre Farkas c5e44dc5d1
Use Github repo visibility during import while respecting restricted visibility levels 2018-06-06 12:00:15 +02:00
Shinya Maeda 32f825c648 Add tests for each new code 2018-06-06 17:49:48 +09:00
Jasper Maes 2d1faddbcb Rails 5 fix glob spec 2018-06-06 08:50:11 +02:00
Robert Speicher a34666e655 Merge branch 'sh-reject-non-utf8-gpg' into 'master'
Reject GPG keys that have e-mail or names with non-valid UTF-8 encodings

Closes #47280

See merge request gitlab-org/gitlab-ce!19455
2018-06-05 22:07:35 +00:00
Stan Hu 36a8f1a677 Reject GPG keys that have e-mail or names with non-valid UTF-8 encodings
These were causing 500 Errors when accessing GPG keys for some users.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/47280
2018-06-05 14:39:44 -07:00
Nick Thomas 65dbead796
Fix repository archive generation when hashed storage is enabled 2018-06-05 20:44:07 +01:00
Nick Thomas 9c6c17cbcd Add a minimal GraphQL API 2018-06-05 20:47:42 +02:00
Kamil Trzciński ced0b4453e Merge branch 'master' into 'backstage/gb/use-persisted-stages-to-improve-pipelines-table'
# Conflicts:
#   db/schema.rb
2018-06-05 16:46:43 +00:00
Jacob Vosmaer (GitLab) a0808df0b6 Find and mark more Git disk access locations 2018-06-05 15:51:14 +00:00
Robert Speicher 6ced2f1243 Merge branch '42751-rename-mr-maintainer-push' into 'master'
Rephrase Merge Request Maintainer Edit

See merge request gitlab-org/gitlab-ce!19061
2018-06-05 15:04:18 +00:00
Alexis Reigel 949c30d42b
remove all .ico favicon variations, use png always
the ci status icons are generated client side, wo we don't need the
static files anymore.
2018-06-05 16:20:22 +02:00
Alexis Reigel 9e14f437b6
create favicon overlay on the client
the initial reason for this change was that graphicsmagick does not
support writing to ico files. this fact lead to a chain of changes:

1. use png instead of ico (browser support is good enough)
2. render the overlays on the client using the canvas API. this way we
   only need to store the original favion and generate the overlay versions
   dynamically.
   this change also enables (next step) to simplify the handling of the
   stock favicons as well, as we don't need to generate all the versions
   upfront.
2018-06-05 16:20:21 +02:00
Alexis Reigel 67fe0a17d8
call Gitlab::Favicon.status in serializer
this ways we can keep the `lib/gitlab/ci/status/*` classes to return the
bare favicon name as it was before.

also the favicon uploader versions are now have the same names as the
stock favicons (+ `favicon_` prefix), which makes working with the
status names easier.
2018-06-05 16:20:21 +02:00
Alexis Reigel 40ffa8401b
add request store caching to favicon 2018-06-05 16:20:21 +02:00
Alexis Reigel 822023c64c
Add a '?' to the custom favicon's urls
Without the '?' at the end of the favicon url the custom favicon (i.e.
the favicons that are served through `UploadController`) are not shown
in the browser. It may have something to do with how `#send_file` /
`#send_data` set http headers. When serving the same icon file from the
public directory everything is fine.
2018-06-05 16:20:20 +02:00
Alexis Reigel 44d7b15833
use custom favicon for ci build status favicons 2018-06-05 16:20:19 +02:00
Alexis Reigel a6f3f6b8cd
extract favicon logic to lib class 2018-06-05 16:20:19 +02:00
Grzegorz Bizon da246582db Merge branch 'master' into 'backstage/gb/use-persisted-stages-to-improve-pipelines-table'
# Conflicts:
#   db/schema.rb
2018-06-05 13:51:31 +00:00
Jacob Vosmaer (GitLab) 3a4ecfd0c9 Prevent Gitaly WriteConfig log noise 2018-06-05 12:55:41 +00:00
Kamil Trzciński 40dc82f862 Merge branch 'add-background-migrations-for-not-archived-traces' into 'master'
Add background migrations to archive legacy job traces

Closes #46642

See merge request gitlab-org/gitlab-ce!19194
2018-06-05 12:35:21 +00:00
Nick Thomas 049519e718 Merge branch 'override-consider-extend' into 'master'
Also verify if extending would override a class method

See merge request gitlab-org/gitlab-ce!19377
2018-06-05 12:11:58 +00:00
Nick Thomas 9ca8d88b07 Merge branch 'gh-importer-transactions' into 'master'
Perform pull request IO work outside a transaction

See merge request gitlab-org/gitlab-ce!19372
2018-06-05 11:11:36 +00:00
Grzegorz Bizon 809a50fcbf Merge branch 'master' into 'backstage/gb/use-persisted-stages-to-improve-pipelines-table'
Conflicts:
   app/models/ci/pipeline.rb
2018-06-05 07:39:59 +00:00
Lin Jen-Shin f71fc9328c Also verify if extending would override a class method
Since extending a class means including on the singleton class of the
class, this should now complain this:

``` ruby
module M
  extend Gitlab::Utils::Override

  override :f
  def f
    super.succ
  end
end

class C
  extend M

  def self.f
    0
  end
end
```

It should complain because `C.f` wasn't calling `M#f`.
This should pass verification:

``` ruby
module M
  extend Gitlab::Utils::Override

  override :f
  def f
    super.succ
  end
end

class B
  def self.f
    0
  end
end

class C < B
  extend M
end
```

Because `C.f` would now call `M#f`, and `M#f` does override something.
2018-06-05 13:40:52 +08:00
Oswaldo Ferreira f46739191a Adjust insufficient diff hunks being persisted on NoteDiffFile
This currently causes 500's errors when loading the MR page
(Discussion) in a few scenarios.

We were not considering detailed diff headers such as
"--- a/doc/update/mysql_to_postgresql.md\n+++ b/doc/update/mysql_to_postgresql.md"
to crop the diff. In order to address it, we're now using
Gitlab::Diff::Parser, clean the diffs and builds Gitlab::Diff::Line objects
we can iterate and filter on.
2018-06-05 01:02:30 -03:00
Yorick Peterse 71ed7987d3
Perform pull request IO work outside a transaction
When importing a GitHub pull request we would perform all work in a
single database transaction. This is less than ideal, because we perform
various slow Git operations when creating a merge request. This in turn
can lead to many DB connections being used, while just waiting for an IO
operation to complete.

To work around this, we now move most of the heavy lifting out of the
database transaction. Some extra error handling is added to ensure we
can resume importing a partially imported pull request, instead of just
throwing an error.

This commit also changes the specs for IssueImporter so they don't rely
on deprecated RSpec methods.
2018-06-04 18:33:56 +02:00
Francisco Javier López 7350eb1fa8 Add ability to search wiki titles 2018-06-04 11:41:37 +00:00
Douwe Maan 8c7bffa437 Merge branch 'sh-fix-issue-43981' into 'master'
Fix intermittent failing spec in spec/support/helpers/cycle_analytics_helpers.rb

Closes #43981

See merge request gitlab-org/gitlab-ce!19338
2018-06-04 08:45:40 +00:00
Shinya Maeda 8f1f73d4e3 Fix typo in spec. Add a test for the case of when trace is stored in database 2018-06-04 14:28:21 +09:00
Shinya Maeda bcd664f53a Fix specs. Rename migration file name which was conflicted with background migration's. 2018-06-04 14:14:20 +09:00
Shinya Maeda 0d00d02e84 Directly refer application code from migration code 2018-06-04 14:14:20 +09:00
Shinya Maeda 89b4304f12 Add background migrations to arhive legacy traces 2018-06-04 14:14:20 +09:00
Shinya Maeda eb05d475b7 Fix wording in spec. Add PIPELINE_IID in examples of debugged variables in documants. 2018-06-04 12:12:02 +09:00
Stan Hu d65cdd4416 Fix intermittent failing spec in spec/support/helpers/cycle_analytics_helpers.rb
There was a race condition in the spec where if the commit is created on disk
within a second of the frozen `Timecop` time, the test fails.

Closes #43981
2018-06-02 15:10:35 -07:00
Matija Čupić 5403a4a07e
Add deploy_strategy to safe model attributes 2018-06-02 11:46:55 +02:00
Shinya Maeda e8ecae7e0b Reveert build_relations and simply add a line for creating iid 2018-06-02 11:55:42 +09:00
Shinya Maeda b02b2602c1 Merge branch 'master' into per-project-pipeline-iid 2018-06-02 11:15:53 +09:00
Jacob Vosmaer (GitLab) edb9db37ed Add "deny disk access" Gitaly feature (tripswitch) 2018-06-01 11:56:29 +00:00
Francisco Javier López 840f80d48b Add validation to webhook and service URLs to ensure they are not blocked because of SSRF 2018-06-01 11:43:53 +00:00
Shinya Maeda c89e57842e Use shared examples for populate spec 2018-06-01 15:46:15 +09:00
Shinya Maeda c418d68765 Remove unneccesary spec 2018-06-01 15:41:33 +09:00
Shinya Maeda f7f60ab54a Add spec for variables expressions with pipeline iid 2018-06-01 14:53:00 +09:00
Shinya Maeda 4beeb60255 Fix populate_spec 2018-06-01 14:36:52 +09:00
Mark Chao 0d44f4d50e Rephrase "maintainer" to more precise "members who can merge to the target branch"
"Maintainer" will be freed to be used for #42751
2018-06-01 14:33:12 +09:00
Shinya Maeda 272b8dca80 Merge branch 'master' into per-project-pipeline-iid 2018-06-01 14:32:40 +09:00
Grzegorz Bizon 68ef6ae2da Merge branch '41587-osw-mr-metrics-migration-take-two' into 'master'
Take two for MR metrics population background migration

See merge request gitlab-org/gitlab-ce!19097
2018-05-31 15:08:50 +00:00
Imre Farkas 20dfe25c15 Export assigned issues in iCalendar feed 2018-05-31 14:01:04 +00:00
Douwe Maan 711ba61a78 Merge branch '46445-fix-gitaly-tree-entry-encoding' into 'master'
Fix encoding bug in Gitaly::Commit::TreeEntry

Closes #46445 and gitaly#1208

See merge request gitlab-org/gitlab-ce!19243
2018-05-31 09:55:05 +00:00
Francisco Javier López 4d3f7ae1ef
Removed API endpoint and specs 2018-05-30 18:23:07 +02:00
Kim "BKC" Carlbäcker 0db994fedc Fix encoding error in Gitaly::Commit::TreeEntry 2018-05-30 17:33:17 +02:00
Oswaldo Ferreira 54ad5fb8a2 Take two for MR metrics population background migration 2018-05-30 11:51:29 -03:00
Douwe Maan 62d96d8854 Merge branch 'fix/bitbucket_import_anonymous' into 'master'
Import bitbucket issues that are reported by an anonymous user

Closes #44381

See merge request gitlab-org/gitlab-ce!18199
2018-05-30 09:52:58 +00:00
Shinya Maeda 0e22b50df8 Add spec for variables expression 2018-05-30 16:42:55 +09:00
Phil Hughes fd79df64c5 Merge branch 'blackst0ne-squash-and-merge-in-gitlab-core-ce' into 'master'
Resolve "Squash and merge in GitLab Core (CE)"

Closes #34591

See merge request gitlab-org/gitlab-ce!18956
2018-05-30 07:38:31 +00:00
Shinya Maeda 09122f93c3 Merge branch 'master' into per-project-pipeline-iid 2018-05-30 14:50:09 +09:00
Mayra Cabrera 4aae86f6f7 Merge remote-tracking branch 'dev/master' 2018-05-29 13:51:31 -05:00
Mayra Cabrera 0033e57269 Merge branch 'security-fj-import-export-assignment' into 'master'
[master] Arbitrary assignment of Project fields using "Import project" from a Gitlab tar.gz

Closes #2678

See merge request gitlab/gitlabhq!2378
2018-05-29 18:43:04 +00:00
Grzegorz Bizon a2f6aa96a9 Merge branch 'master' into backstage/gb/use-persisted-stages-to-improve-pipelines-table
* master: (583 commits)
2018-05-29 17:24:50 +02:00
blackst0ne 4cff66a6c4 Add 'squash and rebase' feature to CE 2018-05-29 20:51:43 +11:00
Stan Hu 16e04e006c Log queue duration for Grape API calls
This mimics the same thing the RailsQueueDuration does for Rails controller
requests and will help diagnose issues with API delays.

Closes #46601
2018-05-28 13:56:42 -07:00
Shinya Maeda 1d20679e9c Merge branch 'master' into per-project-pipeline-iid 2018-05-28 20:01:56 +09:00
Yorick Peterse 265b1fafe6 Merge branch 'sh-fix-admin-page-counts-take-2' into 'master'
Fix fast admin counters not working when PostgreSQL has secondaries

Closes #46742

See merge request gitlab-org/gitlab-ce!19154
2018-05-28 10:36:26 +00:00
Douwe Maan a45b9fc96c Merge branch 'bvl-add-username-to-terms-message' into 'master'
Add username to terms message in git and API calls

Closes #46649

See merge request gitlab-org/gitlab-ce!19126
2018-05-28 09:53:58 +00:00
Stan Hu b6125f7045 Fix fast admin counters not working when PostgreSQL has secondaries
This commit does a number of things:

1. Reduces the number of queries needed by perform a single query to get all
the tuples for the relevant rows.

2. Uses a transaction to query the tuple counts to ensure that the data
is retrieved from the primary.

Closes #46742
2018-05-25 22:58:43 -07:00
Grzegorz Bizon 1af2274b41 Restore lazy loading of pipeline commits in preloader 2018-05-25 13:45:08 +02:00
Oswaldo Ferreira bb8f2520b4 Persist truncated note diffs on a new table
We request Gitaly in a N+1 manner to build discussion diffs. Once the diffs are from different revisions, it's hard to make a single request to the service in order to build the whole response.
With this change we solve this problem and simplify a lot fetching this piece of info.
2018-05-24 15:34:43 -03:00
Bob Van Landuyt 7a139c1602 Add username to terms message in git and API calls
This will make it clearer to users which account is being used to make
the API/git call. So they know which account needs to be used to
accept the terms.

Closes #46649
2018-05-24 18:19:48 +02:00
Bart Libert 4bfd54f3d2
Import bitbucket issues that are reported by an anonymous user
For these kind of issues, the "reporter" field is present but zero.
In such a case, "fetch" will not return the default value, but it will
return nil.
Hence, importing fails, because the "username" field of nil is referenced

Fixes issue #44381
2018-05-24 13:28:58 +02:00
Rémy Coutable 2bdf6edefa
Simplify Gitlab::CurrentSettings now that the logic is in CacheableAttributes
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-05-23 16:14:43 +02:00
Grzegorz Bizon dab3ae39a2 Do not paginate pipelines active relation twice 2018-05-23 13:29:21 +02:00
Douwe Maan 3f7b9244dc Merge branch 'issue-25256' into 'master'
skip email trim when email is creating new issue

See merge request gitlab-org/gitlab-ce!18865
2018-05-23 09:54:20 +00:00
Olivier Gonzalez 40dd12c775 Resolve "Deprecate Gemnasium project service" 2018-05-23 09:40:45 +00:00
Grzegorz Bizon f89f232d19 Simplify pipelines preloader implementation 2018-05-23 10:22:28 +02:00
Cameron Crockett 421dbb1746 skip email trim when email is creating new issue
Updates from MR discussion

1. Added test for ReplyParser
2. Changed param to trim_reply with default set as true

Removed keyword param in favor of normal options param

updates for MR discussion

Resolutions for code review comments

more code review fixes
2018-05-22 23:05:51 -05:00
Grzegorz Bizon e4eb330af7 Add pipeline stages factory method import/export support 2018-05-22 14:00:42 +02:00
Grzegorz Bizon ea35fd05bb Refactor pipeline preloader to split reponsibilities better 2018-05-22 13:55:05 +02:00
Shinya Maeda 8e92e25b62 Remvoe disable_ddl_transaction! and redandant RecordNotUnique exception rescue 2018-05-22 15:21:45 +09:00
Shinya Maeda f61666c0d7 Merge branch 'master' into per-project-pipeline-iid 2018-05-22 14:32:40 +09:00
Grzegorz Bizon b113330fab Merge branch 'zj-workhorse-archive-mandatory' into 'master'
Move git archives downloading to Gitaly

See merge request gitlab-org/gitlab-ce!18990
2018-05-21 07:08:58 +00:00
Grzegorz Bizon ad9e00917f Merge branch 'xeodon/gitlab-ce-fix/45743-master-fix-gitaly-delete-refs' into 'master'
Fix error when deleting an empty list of refs

Closes #45743

See merge request gitlab-org/gitlab-ce!19053
2018-05-19 05:42:16 +00:00
Sergey Sinev 100c687cbc Fix error when deleting an empty list of refs
Closes #45743
2018-05-18 20:47:46 -07:00
Robert Speicher 076ab2e8e0 Merge branch 'fix/handle-large-commit-tag-message' into 'master'
Add handling for commit/tags with big messages

See merge request gitlab-org/gitlab-ce!17892
2018-05-18 19:28:25 +00:00
Ahmad Sherif 019f5e2469 Add handling for commit/tags with big messages 2018-05-18 20:51:10 +02:00
Robert Speicher c09498535c Merge branch '5913-extract-ee-specific-lines-for-lib-gitlab-auth' into 'master'
[CE] Resolve "Extract EE specific files/lines for lib/gitlab/auth"

See merge request gitlab-org/gitlab-ce!19037
2018-05-18 18:08:46 +00:00
Nick Thomas 8bacfbd1cc Merge branch 'zj-calculate-checksum-mandator' into 'master'
Calculating repository checksums executed by Gitaly

Closes gitaly#1105 and #46293

See merge request gitlab-org/gitlab-ce!18907
2018-05-18 15:53:35 +00:00
Rémy Coutable 63831a24a6 Merge branch 'memoize-database-version' into 'master'
Memoize Gitlab::Database.version

See merge request gitlab-org/gitlab-ce!19021
2018-05-18 14:54:47 +00:00
Rémy Coutable d34d6a58fd
Minimize CE/EE difference in Gitlab::Auth::LDAP::User
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-05-18 16:30:54 +02:00
Rémy Coutable 6226d19c71
Minimize CE/EE difference in Gitlab::Auth::LDAP::Config
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-05-18 16:30:53 +02:00
Rémy Coutable 8b287679a1
Minimize CE/EE difference in Gitlab::Auth::LDAP::Access
Signed-off-by: Rémy Coutable <remy@rymai.me>
2018-05-18 16:30:53 +02:00
Zeger-Jan van de Weg 18a8eb96b3
Calculating repository checksums executed by Gitaly
OPT_OUT status has been removed, and alternative implementation removed.
Also checks if the repository exists before executing the checksum RPC
to guard against NotFound errors.

Closes gitlab-org/gitaly#1105
2018-05-18 16:07:29 +02:00
Kamil Trzciński 46d5ab68b7 Merge branch 'feature/gb/add-regexp-variables-expression' into 'master'
Add support for variables expression regexp syntax

Closes #43601

See merge request gitlab-org/gitlab-ce!18902
2018-05-18 12:08:12 +00:00
Kamil Trzciński 40663fb945 Merge branch 'ccr/regexp_anchor' into 'master'
Add anchor for incoming email regex, closes 44989

See merge request gitlab-org/gitlab-ce!18917
2018-05-18 11:47:33 +00:00
Grzegorz Bizon af9b0bfbae Simplify untrusted regexp factory method 2018-05-18 10:14:10 +02:00
Yorick Peterse 63c58a6dd0
Memoize Gitlab::Database.version
This removes the need for running a database query every time we want to
check the database version.
2018-05-17 21:23:42 +02:00
Yorick Peterse 19428e8008
Preload pipeline data for project pipelines
When displaying the pipelines of a project we now preload the following
data:

1. Authors of the commits that belong to these pipelines
2. The number of warnings per pipeline, which is used by
   Ci::Pipeline#has_warnings?

== Commit Authors

Previously this data was queried for every Commit separately, leading to
20 SQL queries being executed in the worst case. With an average of 3 to
5 milliseconds per SQL query this could result in 100 milliseconds being
spent in _just_ getting Commit authors.

To preload this data Commit#author now uses BatchLoader (through
Commit#lazy_author), and a separate module
Gitlab::Ci::Pipeline::Preloader is used to ensure all authors are loaded
before they are used.

== Number of warnings

This changes Ci::Pipeline#has_warnings? so it supports preloading of the
number of warnings per pipeline. This removes the need for executing a
COUNT(*) query for every pipeline just to see if it has any warnings or
not.
2018-05-17 13:53:00 +02:00
Grzegorz Bizon 61d55b56ab Update variables expressions statement specs 2018-05-17 12:55:19 +02:00
Grzegorz Bizon 8b3e21b66b Add variables expression pattern validation support 2018-05-17 12:44:46 +02:00
Grzegorz Bizon a1f1e08670 Add anti-corruption layer above expressions pattern matching 2018-05-17 12:35:20 +02:00
Grzegorz Bizon 0ce63efe96 Add extended /regexp/ scheme support to untrusted regexp 2018-05-17 12:29:47 +02:00
Grzegorz Bizon 48877dfc7e Merge branch 'zj-workhorse-commit-patch-diff' into 'master'
Workhorse to send raw diff and patch for commits

Closes gitaly#1196

See merge request gitlab-org/gitlab-ce!18974
2018-05-17 08:12:33 +00:00
Zeger-Jan van de Weg 94b209b32c
Move git archives downloading to Gitaly 2018-05-17 09:31:50 +02:00
Shinya Maeda 1c636b8080 Merge branch 'master' into per-project-pipeline-iid 2018-05-17 15:51:33 +09:00
Yorick Peterse f3d60d7e73 Merge branch 'sh-fast-admin-counts' into 'master'
Fix Error 500 viewing admin page due to statement timeouts

Closes #46255

See merge request gitlab-org/gitlab-ce!18982
2018-05-16 17:31:48 +00:00
Stan Hu e38938b332 Fix Error 500 viewing admin page due to statement timeouts
Uses PostgreSQL tuple estimates to provide a much faster yet approximate
count. See https://wiki.postgresql.org/wiki/Slow_Counting for more details.
We only use this fast method if the table has been analyzed or vacuumed
within the last hour.

Closes #46255
2018-05-16 08:27:48 -07:00
Yorick Peterse 33af33d7cb
Fix GPM content types for Doorkeeper
Certain controllers (e.g. Doorkeeper::TokensController) don't expose the
method "request_format". This commit changes
Gitlab::Metrics::WebTransaction so we don't rely on this method, instead
using the underlying code this method uses.

Fixes https://gitlab.com/gitlab-org/gitlab-ce/issues/46412
2018-05-16 12:53:54 +02:00
Zeger-Jan van de Weg dfdd881510
Workhorse to send raw diff and patch for commits
Prior to this change, this was done through unicorn. In theory this
could time out. Workhorse has been sending these raw patches and diffs
for a long time and is stable in doing so.

Added bonus is the fact that `Commit#to_patch` can be removed.

`Commit#to_diff` too, which closes
https://gitlab.com/gitlab-org/gitaly/issues/324

Closes https://gitlab.com/gitlab-org/gitaly/issues/1196
2018-05-16 11:52:43 +02:00
Robert Speicher 0288e2525f Merge branch 'zj-ref-contains-sha-mandatory' into 'master'
Ref contains oid check done by Gitaly

Closes gitaly#884

See merge request gitlab-org/gitlab-ce!18944
2018-05-16 03:44:08 +00:00
Stan Hu 728441a408 Merge branch 'fix-metrics-content-types' into 'master'
Fix setting Gitlab metrics content types

Closes gitlab-com/infrastructure#3499

See merge request gitlab-org/gitlab-ce!18975
2018-05-15 18:25:32 +00:00
Grzegorz Bizon bdf279b151 Merge branch '45584-add-nip-io-domain-suggestion-in-auto-devops' into 'master'
Resolve "Add nip.io domain suggestion in the Kubernetes cluster details view"

Closes #45584

See merge request gitlab-org/gitlab-ce!18496
2018-05-15 16:33:06 +00:00
Yorick Peterse c003337729
Fix setting Gitlab metrics content types
The method "content_type" on a controller does not always return the
correct content type. On the other hand, the method "request_format"
does _and_ immediately returns a Symbol (e.g. :json) instead of a
mime-type name (e.g. application/json). With these changes metrics
should again report their action names correctly.

Fixes https://gitlab.com/gitlab-com/infrastructure/issues/3499
2018-05-15 17:38:39 +02:00
Grzegorz Bizon f52de2f73c Make variables expression pattern case-sensitivity explicit 2018-05-15 15:18:18 +02:00
Grzegorz Bizon 7babc59e47 Use parameterized RSpec to improve variables expressions specs 2018-05-15 13:15:38 +02:00
Grzegorz Bizon 65f4e7b2a1 Add support for pattern matching in variables expressions 2018-05-15 13:04:18 +02:00
Grzegorz Bizon 475d2edf04 Reorganize exceptions in pipeline expressions module 2018-05-15 12:37:09 +02:00
Jan Provaznik 91f8656c2c Disable greedy mode when matching filename 2018-05-15 10:20:18 +00:00
Grzegorz Bizon bbba6d7e62 Merge branch 'master' into feature/gb/add-regexp-variables-expression
* master: (76 commits)

Conflicts:
	lib/gitlab/untrusted_regexp.rb
2018-05-15 12:01:07 +02:00
Dylan Griffith 46eeaafc25 Display help text below auto devops domain with nip.io domain name (#45561) 2018-05-15 10:36:57 +02:00
Rémy Coutable 59ef79689e Merge branch 'backstage/gb/backport-untrusted-regexp-ee-code' into 'master'
Backport EE-specific untrusted regexp implementation

See merge request gitlab-org/gitlab-ce!18938
2018-05-14 15:23:33 +00:00
Zeger-Jan van de Weg 7fc185ab25
Ref contains oid check done by Gitaly
These two endpoints are in opt-out, and no one noticed. Has been running
on .com for 4 months now and considered stable.

Closes https://gitlab.com/gitlab-org/gitaly/issues/884
2018-05-14 15:55:27 +02:00
Grzegorz Bizon f16f2b5994 Add pattern matching variables expression lexeme 2018-05-14 15:03:10 +02:00
Grzegorz Bizon ac65257c40 Raise variables statement exception if pattern is invalid 2018-05-14 14:38:08 +02:00
Grzegorz Bizon b784a985f2 Do not raise if variable expression can not be evaluated 2018-05-14 14:27:07 +02:00
Grzegorz Bizon da5c28a422 Backport EE-specific untrusted regexp implementation 2018-05-14 10:43:45 +02:00
Shinya Maeda 1e76f289fb Merge branch 'master' into per-project-pipeline-iid 2018-05-14 17:20:47 +09:00
Francisco Javier López 761d890a68
Blacklisting attributes in the project import process 2018-05-14 09:28:33 +02:00
Stan Hu 1be2ec2d04 Fix system hook not firing for blocked users when LDAP sign-in is used
An LDAP sign-in request results in a different request parameter than
a standard GitLab sign-in. Since Warden doesn't pass us the user that
was blocked, we first search for a `username` in the request parameters
and then look for `user.login`.

Closes #46307
2018-05-12 22:33:29 -07:00
Chantal Rollison be73838bdf Add anchor for incoming email regex, closes 44989 2018-05-11 14:51:21 -07:00
Douwe Maan 0842ab8746 Merge branch 'bvl-restrict-api-git-for-terms' into 'master'
Block access to API & git when terms are enforced

Closes #45849

See merge request gitlab-org/gitlab-ce!18816
2018-05-11 14:37:14 +00:00
Bob Van Landuyt e0768a9bcb Allow triggered builds git access
Allow builds that have been triggered by a user before terms were
enforced access to git. That way the builds can complete as usual.
2018-05-11 15:20:11 +02:00
Zeger-Jan van de Weg cc7931cc9c
Remove Gitlab::RepoPath.strip_storage_path
This used to be executed because of the post receive worker, but this
uses Gitlab::GlRepository.parse now. So this removes dead code and
reduces the number of calls on `#legacy_storage_path`.
2018-05-11 13:57:43 +02:00
Grzegorz Bizon 8b736c91fc Implement variables expression untrusted pattern lexeme 2018-05-11 13:29:05 +02:00
Kamil Trzciński a99e8a7592 Merge branch 'zj-validation-initializer' into 'master'
Remove method call to deprecated method

See merge request gitlab-org/gitlab-ce!18815
2018-05-11 08:19:30 +00:00
Shinya Maeda a74184eb5e Fix static analysys 2018-05-11 16:52:48 +09:00
Shinya Maeda 46fa3089c8 Rescue RecordNotUnique when pipeline is created with non-unique iid 2018-05-11 16:49:18 +09:00
Zeger-Jan van de Weg b788863c68
Remove method call to deprecated method
Given the settings initializer creates Gitaly Storage Settings objects
already, the calls to path can be moved to that initializer.
2018-05-11 08:57:06 +02:00
Shinya Maeda 910a7d02a8 Remove numericality as it's redandant with integer column and validates nil IID 2018-05-11 15:34:36 +09:00
Bob Van Landuyt f7f13f9db0 Block access to API & git when terms are enforced
When terms are enforced, but the user has not accepted the terms
access to the API & git is rejected with a message directing the user
to the web app to accept the terms.
2018-05-10 17:02:27 +02:00
Nick Thomas b7e9c968c2 Merge branch 'sh-reset-prometheus-metrics-tests' into 'master'
Support resetting of Prometheus metrics between test runs

Closes #39968

See merge request gitlab-org/gitlab-ce!18836
2018-05-10 12:31:36 +00:00
Stan Hu 204af2e101 Support resetting of Prometheus metrics between test runs
Adding the :prometheus tag to an rspec test will clear out
memory-mapped files and reset the registry.

Closes https://gitlab.com/gitlab-org/gitlab-ce/issues/39968
2018-05-09 14:33:42 -07:00
Rubén Dávila 5b584a0fd2 Backport some changes from gitlab-ee!5476
The lib/gitlab/git/repository.rb needs to have the same content between
gitlab-ce and gitlab-ee in order to have Gitaly working fine.
2018-05-09 13:20:28 -05:00
Stan Hu ee9d4386fd Merge branch '5750-backport-checksum-git-commanderror-exit-status-128' into 'master'
Raise InvalidRepository error for non-valid git repositories

See merge request gitlab-org/gitlab-ce!18594
2018-05-08 20:56:46 +00:00
Douwe Maan 94099f2dd6 Merge branch '5480-epic-notifications-ce' into 'master'
Backport 5480-epic-notifications from EE

See merge request gitlab-org/gitlab-ce!18724
2018-05-07 19:55:00 +00:00
Mario de la Ossa 02741ca4c5
Backport 5480-epic-notifications from EE 2018-05-07 12:58:47 -06:00
Douglas Barbosa Alexandre 17258b37c8
Raise InvalidRepository error for non-valid git repositories 2018-05-07 14:22:16 -03:00
Douwe Maan f50d8079f0 Merge branch 'ccr/weight_1481' into 'master'
Backport of 1481-changing-weight-values-should-trigger-system-notes

See merge request gitlab-org/gitlab-ce!18699
2018-05-07 16:35:37 +00:00
Douwe Maan d0cbef7e8f Merge branch '42099-port-push-mirroring-to-ce-ce-port-v-2' into 'master'
CE backport of Backports Push Mirrors to CE

Closes #42099

See merge request gitlab-org/gitlab-ce!18715
2018-05-07 15:15:57 +00:00
Zeger-Jan van de Weg 713c7fa9a5
Client implementation GetRawChanges
Part of https://gitlab.com/gitlab-org/gitaly/issues/1138
2018-05-07 15:37:49 +02:00
Zeger-Jan van de Weg 92482e01b4
Bump Gitaly to 0.98.0
Hooks were run for wikis, but given the internal API wasn't responding
failures happended, as seen on:
https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/18693
2018-05-07 14:10:04 +02:00
Tiago Botelho 9a13059332 Backports every CE related change from ee-5484 to CE 2018-05-07 11:59:51 +02:00
Shinya Maeda 1fd10d4f24 Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-05-07 12:04:30 +09:00
Shinya Maeda 1f39fcd112 Merge branch 'master' into live-trace-v2 2018-05-07 11:59:43 +09:00
Kamil Trzciński 58aa2d7f39 Merge branch '44059-specify-variables-when-executing-a-manual-pipeline-from-the-ui' into 'master'
Resolve "Specify variables when executing a manual pipeline from the UI"

Closes #44059

See merge request gitlab-org/gitlab-ce!18440
2018-05-06 16:48:00 +00:00
Tiago Botelho bddbcaefc2 Backports every CE related change from ee-44542 to CE 2018-05-04 17:33:26 +02:00
Shinya Maeda 8fd76a752b Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-05-04 20:20:07 +09:00
Shinya Maeda e1ad8ca6d0 Test trace_spec on both conditions - ci_enable_live_trace is on/off 2018-05-04 19:49:26 +09:00
Matija Čupić c6e394bb84
Improve variable comparison 2018-05-04 12:35:36 +02:00
Chantal Rollison 1019dff237 Backport of 1481-changing-weight-values-should-trigger-system-notes 2018-05-03 11:18:51 -07:00
Dylan Griffith d39b3d4b8d Merge branch 'master' into feature/runner-per-group 2018-05-03 09:54:12 +02:00
Shinya Maeda 90da0d4fe2 Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-05-03 14:21:37 +09:00
Shinya Maeda 30464bceaa Merge branch 'master' into live-trace-v2 2018-05-03 14:21:06 +09:00
Matija Čupić fc42ba6c5d
Merge branch 'master' into 44059-specify-variables-when-executing-a-manual-pipeline-from-the-ui 2018-05-02 15:54:06 +02:00
Kamil Trzciński 8b0b4ecee2 Merge branch 'backstage/gb/migrate-pipeline-stages-index' into 'master'
Migrate pipeline stages indices

Closes #43009

See merge request gitlab-org/gitlab-ce!18420
2018-05-02 07:28:15 +00:00
Shinya Maeda 502b170927 Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-05-02 14:46:57 +09:00
Shinya Maeda 65c11f3261 Merge branch 'master' into live-trace-v2 2018-05-02 14:23:47 +09:00
Kamil Trzciński 1134f540d2 Merge branch 'helm-add-alpine-mirrors' into 'master'
Add alpine mirrors while operating on k8s cluster

Closes gitlab-ee#4922

See merge request gitlab-org/gitlab-ce!18651
2018-05-01 13:08:59 +00:00
Grzegorz Bizon 0fd0b64be6 Use stages position column to track stage index 2018-05-01 14:30:44 +02:00
Grzegorz Bizon b337a086d5 Merge branch 'master' into backstage/gb/migrate-pipeline-stages-index
* master: (106 commits)
2018-05-01 14:24:39 +02:00
Shinya Maeda b9cc1188a9 Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-05-01 14:21:36 +09:00
Shinya Maeda 54695563ca Merge branch 'master' into live-trace-v2 2018-05-01 14:13:12 +09:00
Jose d3327e0dfa Merge branch 'master' into 44059-specify-variables-when-executing-a-manual-pipeline-from-the-ui 2018-04-30 17:00:16 -05:00
Douwe Maan 9cf4e47341 Merge branch 'security-45689-fix-archive-cache-bug' into 'security-10-7'
Serve archive requests with the correct file in all cases (10.7)

See merge request gitlab/gitlabhq!2376
2018-04-30 15:00:14 -05:00
Alessio Caiazza ce5723c849
Add alpine mirrors while operating on k8s cluster 2018-04-30 15:12:26 +02:00
Shinya Maeda 671f004451 Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-04-30 14:53:38 +09:00
Shinya Maeda 0d99298aa3 Merge branch 'master' into live-trace-v2 2018-04-30 14:14:20 +09:00
Shinya Maeda 0a4e57f3d7 Merge branch 'master' into live-trace-v2 2018-04-27 23:11:15 +09:00
Jacob Vosmaer (GitLab) 7da1b4cbf1 Add gitlab-pages admin ping rake task 2018-04-27 11:01:54 +00:00
Kamil Trzciński 6b2eb865ca Merge branch 'performance/gb/improve-pipeline-creation-service' into 'master'
Improve pipeline creation service performance

Closes #37987

See merge request gitlab-org/gitlab-ce!18582
2018-04-26 08:35:19 +00:00
Shinya Maeda 645b404d89 Fix specs. Align with the new table name ci_build_trace_chunk 2018-04-26 17:25:20 +09:00
Shinya Maeda 9d6fe7bfdf Refactoring ci_job_trace to ci_build_trace 2018-04-26 15:06:04 +09:00
Shinya Maeda 4eb67ccff3 Merge branch 'master' into live-trace-v2 2018-04-26 14:23:36 +09:00
Dylan Griffith c80e6b9c12 Merge branch 'master' into siemens-runner-per-group 2018-04-26 09:45:01 +08:00
Douwe Maan 6587d3680e Merge branch 'zj-storage-path-deprecation' into 'master'
Legacy disk path refactor

Closes gitaly#1111

See merge request gitlab-org/gitlab-ce!18364
2018-04-25 13:55:21 +00:00
Grzegorz Bizon 37b9a441c1 Merge branch 'master' into 'backstage/gb/migrate-pipeline-stages-index'
# Conflicts:
#   db/schema.rb
2018-04-25 13:40:13 +00:00
Zeger-Jan van de Weg ec4423665c
Gitlab::Shell works on shard name, not path
Direct disk access is done through Gitaly now, so the legacy path was
deprecated. This path was used in Gitlab::Shell however. This required
the refactoring in this commit.

Added is the removal of direct path access on the project model, as that
lookup wasn't needed anymore is most cases.

Closes https://gitlab.com/gitlab-org/gitaly/issues/1111
2018-04-25 13:36:22 +02:00
Grzegorz Bizon e4d6984465 Do not save associated records for pipeline builds twice 2018-04-25 13:35:40 +02:00
Douwe Maan 906fc00c33 Merge branch 'bvl-fix-maintainer-push-error' into 'master'
Fix errors on pushing/editing files on empty repositories

Closes #44618 and #42583

See merge request gitlab-org/gitlab-ce!18462
2018-04-24 14:49:38 +00:00
Grzegorz Bizon c9dc51111d Rename stage index column name to priority column 2018-04-24 15:48:10 +02:00
Bob Van Landuyt 35a49922e6 Allow admins to push to empty repos 2018-04-24 14:06:59 +02:00
Kamil Trzciński f5524d554b Merge branch '10244-add-project-ci-cd-settings' into 'master'
Introduce new ProjectCiCdSettings model with group_runners_enabled

See merge request gitlab-org/gitlab-ce!18144
2018-04-24 11:05:20 +00:00
Douwe Maan 1e624f3401 Merge branch 'jej/refactor-omniauth-controller' into 'master'
Refactor OmniauthCallbacksController to remove duplication

Closes #26559

See merge request gitlab-org/gitlab-ce!16694
2018-04-24 10:18:10 +00:00
Grzegorz Bizon fc6ec8adab Remove empty line from stages index migration specs 2018-04-24 11:07:37 +02:00
Grzegorz Bizon 02999234d4 Add background migration that migrates stages indices 2018-04-24 11:07:37 +02:00
Grzegorz Bizon 10df70146e Add stage index to safe import/export attributes 2018-04-24 11:07:37 +02:00
Grzegorz Bizon cae3092f23 Fix specs creating a pipeline stage with implicit index 2018-04-24 11:07:37 +02:00
Grzegorz Bizon f0d59b95f1 Validate presence of a stage index in the model 2018-04-24 11:07:37 +02:00
Dylan Griffith 51cc01b6c9 Merge branch 'master' into siemens-runner-per-group 2018-04-24 17:26:08 +10:00
Shinya Maeda fd8a63f71e Merge branch 'master' into live-trace-v2 2018-04-24 14:10:57 +09:00
Dylan Griffith 1b9c1ac3ad Merge branch 'master' into 10244-add-project-ci-cd-settings 2018-04-24 15:07:34 +10:00
Lin Jen-Shin ab286656b2 Resolve "Namespace factory is problematic" 2018-04-23 15:48:26 +00:00
James Edwards-Jones dd09a19ad6 Auth::User classes refactor adds should_save? 2018-04-23 16:24:56 +01:00
James Edwards-Jones d3a8a07423 Unify Saml::IdentityLinker and OAuth::IdentityLinker 2018-04-23 13:53:32 +01:00
Francisco Javier López c921e686b8 Moved committer and spec. Added some extra code to run hooks or not depending on the options 2018-04-23 10:56:46 +00:00
Alexis Reigel 1a009f1bdb
update MODELS_JSON with new Project#settings attr 2018-04-23 09:21:55 +02:00
Shinya Maeda 8a7654a52b Fix statis analysys 2018-04-23 15:20:55 +09:00
Shinya Maeda 9b6a495208 Merge branch 'master' into live-trace-v2 2018-04-23 14:21:01 +09:00
James Edwards-Jones f8d54913bb Show error on failed OAuth account link 2018-04-22 23:50:56 +01:00
James Edwards-Jones f10c999bca Refactor OmniauthCallbacksController to remove duplication
Moves LDAP to its own controller with tests
Provides path forward for implementing GroupSaml
2018-04-22 23:50:55 +01:00
Shinya Maeda 0a6b7caac8 Merge branch 'master' into live-trace-v2 2018-04-20 21:51:44 +09:00
Douwe Maan 6d2c7cbead Merge branch 'rd-45502-uploading-project-export-with-lfs-file-locks-fails' into 'master'
Don't include lfs_file_locks data in export bundle

Closes #45502

See merge request gitlab-org/gitlab-ce!18495
2018-04-20 09:40:22 +00:00
Rubén Dávila 2d7efd9637 Don't include lfs_file_locks data in export bundle 2018-04-19 23:30:32 -05:00
Nick Thomas 672733aa66
Add an API endpoint to download git repository snapshots 2018-04-19 17:25:01 +01:00
Mayra Cabrera 93780da67c Resolve "Show `failure_reason` in jobs view content section" 2018-04-19 07:20:53 +00:00
Francisco Javier López e8a27a67fa Fix Custom hooks are not triggered by UI wiki edit 2018-04-18 17:50:56 +00:00
Matija Čupić 317477fc67
Extend Gitlab::Ci::Pipeline::Chain::Command with variables_attributes 2018-04-18 19:28:59 +02:00
🙈 jacopo beschi 🙉 c6b1043e9d Resolve "Make a Rubocop that forbids returning from a block" 2018-04-18 09:19:40 +00:00
Grzegorz Bizon bcd89dcd1f Merge branch 'sh-memoize-repository-empty' into 'master'
Memoize Git::Repository#has_visible_content?

See merge request gitlab-org/gitlab-ce!18383
2018-04-17 12:34:58 +00:00
Bob Van Landuyt 5f7f5eda92 Method to track recoverable exceptions in sentry
This adds a method to track errors that can be recovered from in
sentry.

It is useful when debugging performance issues, or exceptions that are
hard to reproduce.
2018-04-17 11:39:23 +02:00
Shinya Maeda 23634e4567 Merge branch 'master' into live-trace-v2 2018-04-17 12:07:56 +09:00
Yorick Peterse 392c411bdc
Introduce new ProjectCiCdSetting
This model and the corresponding table will be used for storing settings
specific to CI/CD, starting with the "group_runners_enabled" boolean.

The model is called ProjectCiCdSetting and not ProjectCiCdSettings. The
project exporter doesn't like plural model names as it uses "classify"
which turns those into singular (so "ProjectCiCdSettings" becomes
"ProjectCiCdSetting", producing an error if said class is undefined).

The initial work in this commit was done by Dylan Griffith, with most of
the migration work being done by Yorick Peterse.
2018-04-16 14:05:35 +02:00
Grzegorz Bizon a6a1b7310f Merge branch '44582-clear-pipeline-status-cache' into 'master'
Allow `rake cache:clear` clearing pipeline status cache

Closes #44582

See merge request gitlab-org/gitlab-ce!18257
2018-04-16 07:27:09 +00:00
Stan Hu 74e5ec198c Fix failing ./spec/lib/backup/repository_spec.rb by clearing the memoized value 2018-04-14 15:36:36 -07:00
Stan Hu b1f15dfa42 Memoize Git::Repository#has_visible_content?
This is called repeatedly when viewing a merge request, and this should
improve performance significantly by avoiding shelling out to git every time.

This should help https://gitlab.com/gitlab-com/infrastructure/issues/4027.
2018-04-14 14:37:28 -07:00
Douwe Maan db6854b2cd Merge branch 'backport-of-rd-3429-enabling-maximum-file-size-limit-in-repository-causes-pushes-to-fail' into 'master'
Backport of EE !4989

See merge request gitlab-org/gitlab-ce!18238
2018-04-12 08:46:36 +00:00
Marin Jankovski b9d868e33d Merge branch 'fix/gb/fix-pipeline-statuses-illustrations' into 'master'
Fix empty state for build that does not have a trace

Closes #45204

See merge request gitlab-org/gitlab-ce!18278
2018-04-12 07:54:48 +00:00
Rubén Dávila d28b1dfc46 Backport of EE !4989 2018-04-11 22:05:07 -05:00
Douwe Maan b2f57a561f Merge branch 'zj-info-attributes' into 'master'
Client implementation for InfoAttributes

See merge request gitlab-org/gitlab-ce!18261
2018-04-11 12:58:52 +00:00
Zeger-Jan van de Weg c830b8e3b7
Client implementation for InfoAttributes
Clients can now request the attributes from `$GIT_DIR/info/attributes`
through Gitaly. The Gitaly migration is described in gitlab-org/gitaly#1082.

The parser algorithm was implemented in a way it could handle both file
contents or a File handle, and both were already tested.

Other than that, using the boy scout rule, I've removed a class,
InfoAttributes, as it was delegating everything to the parser and
therefor wasn't really needed in my opinion.
2018-04-11 14:21:27 +02:00
Grzegorz Bizon 2ea25cbcaf Revert adding `Empty` extended status to avoid N+1 queries 2018-04-11 10:52:09 +02:00
Grzegorz Bizon 199e31eb24 Extend specs for detailed build extended statuses 2018-04-11 10:52:09 +02:00
Grzegorz Bizon 07c781dcc0 Fix file-specific variables collection item option 2018-04-11 10:07:15 +02:00
Michael Kozono e67759bbc9 Fix email handler spec for EE 2018-04-10 17:40:33 -07:00
Lin Jen-Shin 4b30aec0aa Allow `rake cache:clear` clearing pipeline status cache
* Use the correct key prefix
* Clear old cache keys

TODO:

At some point we could remove clearing old cache keys.
2018-04-10 20:57:00 +08:00
Riccardo Padovani f68aab1945 Make email handler clearer 2018-04-09 09:39:03 +00:00
Kamil Trzciński b38439a3ae Use proper auth_scope for deploy token 2018-04-07 10:35:00 +02:00
Mayra Cabrera c4f56a8802 Increase test suite around deploy tokens behavior
Also, fixes broken specs
2018-04-06 21:20:17 -05:00
Mayra Cabrera a475411f43 Fixes broken schema and minor changes 2018-04-06 21:20:16 -05:00
Mayra Cabrera 8315861c9a Include ProjectDeployTokens
Also:
- Changes scopes from serializer to use boolean columns
- Fixes broken specs
2018-04-06 21:20:16 -05:00
Kamil Trzciński 72220a99d1 Support Deploy Tokens properly without hacking abilities 2018-04-06 21:20:16 -05:00
Mayra Cabrera 171b2625b1 Addreses backend review suggestions
- Remove extra method for authorize_admin_project
- Ensure project presence
- Rename 'read_repo' to 'read_repository' to be more verbose
2018-04-06 21:20:16 -05:00
Mayra Cabrera 7deab31722 Removes logic from Jwt and handle different scenarios on Gitlab::Auth
- When using 'read_repo' password and project are sent, so we used both
  of them to fetch for the token
- When using 'read_registry' only the password is sent, so we only use
  that for fetching the token
2018-04-06 21:20:16 -05:00
Mayra Cabrera aaa6d80870 Implement read_registry for DeployTokens 2018-04-06 21:20:16 -05:00
Mayra Cabrera 370fc05da7 Implement 'read_repo' for DeployTokens
This will allow to download a repo using the token from the DeployToken
2018-04-06 21:20:16 -05:00
Mayra Cabrera db18993f65 Create barebones for Deploytoken
Includes:
- Model, factories, create service and controller actions
- As usual, includes specs for everything
- Builds UI (copy from PAT)
- Add revoke action

Closes #31591
2018-04-06 21:20:16 -05:00
Kamil Trzciński 9421a597b7 Merge branch '42568-pipeline-empty-state' into 'master'
Resolve "Wrong empty state for cancelled build, hides existing logs!"

Closes #42568

See merge request gitlab-org/gitlab-ce!17646
2018-04-06 22:32:44 +00:00
Douglas Barbosa Alexandre 76cd2d7881
Move checksum calculation to Gitlab::Git::Repository 2018-04-06 13:25:07 -03:00
Douglas Barbosa Alexandre 13992ac92e
Checksum calculation is handled by Gitaly when feature is enabled 2018-04-06 13:23:23 -03:00
Douglas Barbosa Alexandre e892eeb546
Add calculate_checksum method to the Gitaly repository client 2018-04-06 13:23:22 -03:00
Sean McGivern b81c6f142c Merge branch 'sh-add-cleanup-rpc-gitaly' into 'master'
Automatically cleanup stale worktrees and lock files upon a push

Closes #44115

See merge request gitlab-org/gitlab-ce!18095
2018-04-06 15:50:51 +00:00
Francisco Javier López f20912df03 Extend API for importing a project export with overwrite support 2018-04-06 15:23:49 +00:00
Stan Hu a18eea8c32 Automatically cleanup stale worktrees and lock files upon a push
git 2.16 will fail badly if there are stale worktrees.

Closes #44115
2018-04-06 08:17:07 -07:00
Douwe Maan 44f4a674e2 Merge branch 'jramsay-38830-tarball' into 'master'
Add alternative archive route

Closes #38830

See merge request gitlab-org/gitlab-ce!17225
2018-04-06 14:14:39 +00:00
James Ramsay 07f517d441 Add new repository archive route
Repository archives are always named `<project>-<ref>-<sha>` even if
the ref is a commit. A consequence of always including the sha even
for tags is that packaging a release is more difficult because both
the ref and sha must be known by the packager.

- add `<project>/-/archive/<ref>/<filename>.<format>` route using the
`-` separator to prevent namespace collisions. If the filename is
`<project>-<ref>` or the ref is a sha, the sha will be omitted,
otherwise the default filename will be used.
- deprecate previous archive route `repository/<ref>/archive`
2018-04-06 08:45:17 -04:00
blackst0ne 20695052db [Rails5] Update `type_cast_*_database` methods 2018-04-06 10:57:19 +00:00
Shinya Maeda cffee49f7f Change Redis TTL to 1day. Fixing nitpicks 2018-04-06 19:30:23 +09:00
Kamil Trzciński 2bf8345542 Merge branch 'master' into '42568-pipeline-empty-state'
# Conflicts:
#   app/views/projects/jobs/show.html.haml
#   lib/gitlab/ci/status/core.rb
2018-04-06 09:16:40 +00:00
Shinya Maeda 4c6cb3cf06 Fix Stream#file? duplicates. And the spec 2018-04-06 15:07:55 +09:00
Shinya Maeda b525b416c8 Merge branch 'master' into live-trace-v2 2018-04-06 15:01:52 +09:00
Mayra Cabrera d54cf868f8 Resolve "Show `failure_reason` and upgrade tooltips of jobs" 2018-04-05 21:04:42 +00:00
Grzegorz Bizon dd271e2460 Merge branch 'direct-upload-of-artifacts' into 'master'
Direct upload of artifacts

See merge request gitlab-org/gitlab-ce!18160
2018-04-05 20:59:40 +00:00
Shinya Maeda ddf74e513f Merge branch 'master' into live-trace-v2 2018-04-06 04:48:26 +09:00
Shinya Maeda 7297a06cb6 Fix bunch of texts 2018-04-06 04:41:45 +09:00
Kamil Trzciński 1367e4ff9f Merge branch '44389-always-allow-http-for-ci-git-operations' into 'master'
Resolve "Allow HTTPS cloning by Runners if it is disabled for users"

Closes #44389

See merge request gitlab-org/gitlab-ce!18021
2018-04-05 18:34:00 +00:00
Shinya Maeda 1a71dd049b Fix rubocop 2018-04-06 00:57:05 +09:00
Shinya Maeda 8c86705206 Add spec for Ci::Trace 2018-04-06 00:42:25 +09:00