Commit Graph

733 Commits

Author SHA1 Message Date
Shinya Maeda 0a4e57f3d7 Merge branch 'master' into live-trace-v2 2018-04-27 23:11:15 +09:00
Shinya Maeda 645b404d89 Fix specs. Align with the new table name ci_build_trace_chunk 2018-04-26 17:25:20 +09:00
Shinya Maeda 1fb66181db Merge branch 'live-trace-v2' into live-trace-v2-efficient-destroy-all 2018-04-26 16:39:56 +09:00
Shinya Maeda f819bb7270 Optimize Trace#write/append/raw by caching data and avoiding unnecesary truncate 2018-04-26 16:30:27 +09:00
Shinya Maeda 9d6fe7bfdf Refactoring ci_job_trace to ci_build_trace 2018-04-26 15:06:04 +09:00
Grzegorz Bizon e4d6984465 Do not save associated records for pipeline builds twice 2018-04-25 13:35:40 +02:00
Grzegorz Bizon c9dc51111d Rename stage index column name to priority column 2018-04-24 15:48:10 +02:00
Kamil Trzciński 12711de256 Implement efficient destroy of job_trace_chunks 2018-04-24 15:13:46 +02:00
Grzegorz Bizon f0d59b95f1 Validate presence of a stage index in the model 2018-04-24 11:07:37 +02:00
Shinya Maeda 94ce223391 Swap redis chunks when build finished 2018-04-24 14:53:14 +09:00
Shinya Maeda 0a6b7caac8 Merge branch 'master' into live-trace-v2 2018-04-20 21:51:44 +09:00
Matija Čupić 317477fc67
Extend Gitlab::Ci::Pipeline::Chain::Command with variables_attributes 2018-04-18 19:28:59 +02:00
🙈 jacopo beschi 🙉 c6b1043e9d Resolve "Make a Rubocop that forbids returning from a block" 2018-04-18 09:19:40 +00:00
Kamil Trzciński (OoO till 16th of April) df0a457d6f Merge branch '44981-http-io-trace-with-multi-byte-char' into 'master'
Fix `Trace::HttpIO` can not render multi-byte chars

Closes #44981

See merge request gitlab-org/gitlab-ce!18417
2018-04-18 08:25:53 +00:00
blackst0ne 18c2b06268 [Rails5] Remove `as` keyword from `Gitlab:Ci:Trace:Stream.delegate :valid?` 2018-04-18 08:15:02 +00:00
Shinya Maeda 1e817e0018 Align force_encoding strategy into Trace::Stream 2018-04-18 15:19:53 +09:00
Shinya Maeda c91b64366a Make HTTPIO compatible with multi-byte chars (Extracted from ChunkedIO) 2018-04-17 14:50:32 +09:00
Shinya Maeda 23634e4567 Merge branch 'master' into live-trace-v2 2018-04-17 12:07:56 +09:00
Marin Jankovski b9d868e33d Merge branch 'fix/gb/fix-pipeline-statuses-illustrations' into 'master'
Fix empty state for build that does not have a trace

Closes #45204

See merge request gitlab-org/gitlab-ce!18278
2018-04-12 07:54:48 +00:00
Grzegorz Bizon c079474b8a Merge branch '45159-fix-illustration' into 'master'
Resolve "Illustration for the case where the job has finished and the log was erased"

Closes #45159

See merge request gitlab-org/gitlab-ce!18253
2018-04-11 12:29:54 +00:00
Grzegorz Bizon 8196794c1e Add a test for job empty state with missing trace 2018-04-11 10:52:09 +02:00
Grzegorz Bizon 2ea25cbcaf Revert adding `Empty` extended status to avoid N+1 queries 2018-04-11 10:52:09 +02:00
Grzegorz Bizon 199e31eb24 Extend specs for detailed build extended statuses 2018-04-11 10:52:09 +02:00
Grzegorz Bizon 160ffb6870 Fix empty state for build that doesn ot have a trace
It also adds a fallback that covers other edge cases that might surface
later.
2018-04-11 10:52:08 +02:00
Grzegorz Bizon 07c781dcc0 Fix file-specific variables collection item option 2018-04-11 10:07:15 +02:00
Filipa Lacerda ea7a1e030d
Fixes illustration for when job log was erased 2018-04-09 13:16:08 +01:00
Shinya Maeda 8a9955cf5c Fix wrong sql at calculation size 2018-04-06 20:41:56 +09:00
Shinya Maeda cffee49f7f Change Redis TTL to 1day. Fixing nitpicks 2018-04-06 19:30:23 +09:00
Kamil Trzciński 2bf8345542 Merge branch 'master' into '42568-pipeline-empty-state'
# Conflicts:
#   app/views/projects/jobs/show.html.haml
#   lib/gitlab/ci/status/core.rb
2018-04-06 09:16:40 +00:00
Shinya Maeda 4c6cb3cf06 Fix Stream#file? duplicates. And the spec 2018-04-06 15:07:55 +09:00
Shinya Maeda b525b416c8 Merge branch 'master' into live-trace-v2 2018-04-06 15:01:52 +09:00
Mayra Cabrera d54cf868f8 Resolve "Show `failure_reason` and upgrade tooltips of jobs" 2018-04-05 21:04:42 +00:00
Shinya Maeda ddf74e513f Merge branch 'master' into live-trace-v2 2018-04-06 04:48:26 +09:00
Shinya Maeda 7297a06cb6 Fix bunch of texts 2018-04-06 04:41:45 +09:00
Shinya Maeda 2c6b90f086 Fix HttpIO and spec 2018-04-06 01:41:39 +09:00
Shinya Maeda 1a71dd049b Fix rubocop 2018-04-06 00:57:05 +09:00
Matija Čupić 99edc15127
Put Erased empty state at the beginning 2018-04-05 17:32:03 +02:00
Shinya Maeda b94c84e597 Add spec for ChunkedIO 2018-04-05 23:43:21 +09:00
Matija Čupić f379e1b370
Rename success to erased empty state spec 2018-04-05 13:52:54 +02:00
Shinya Maeda 9c990bbe7a Add test 2018-04-05 20:42:08 +09:00
Shinya Maeda d6b18d3946 Fix 2018-04-05 20:42:08 +09:00
Shinya Maeda 9b7a0533ed Fix database trace to read raw 2018-04-05 20:42:08 +09:00
Shinya Maeda 14ec3adfe4 Use w+b mode when Trace#set 2018-04-05 16:16:01 +09:00
Shinya Maeda 908aad0a5c Revert httpio fix 2018-04-05 15:54:55 +09:00
Shinya Maeda 8630249f44 Support IO.copy_stream 2018-04-05 15:26:57 +09:00
Shinya Maeda 26fec9d460 Fix #read to increament tell correctly 2018-04-05 14:14:54 +09:00
Kamil Trzciński 2fac77b081 Simpler chunking :) 2018-04-05 14:14:54 +09:00
Kamil Trzciński de5194cdb8 Removed unused code 2018-04-05 14:14:54 +09:00
Shinya Maeda cb3a0e33a0 Fix bug; truncate did not reset size and tell 2018-04-05 14:14:54 +09:00
Shinya Maeda 9766af363d Remove unrelated chanages 2018-04-05 14:14:54 +09:00
Shinya Maeda 91fe68a6af Use bytesize everywhere instead of length 2018-04-05 14:14:54 +09:00
Shinya Maeda 098fbac199 Add a gurad logic not to hit chunk_store if unnecessary 2018-04-05 14:14:54 +09:00
Shinya Maeda f0ddad75e9 Fix archive method. Fix trace spec 2018-04-05 14:14:54 +09:00
Shinya Maeda a689a220d3 Fix static analysys 2018-04-05 14:14:54 +09:00
Shinya Maeda 1de5b8db5a Fix Live trace 2018-04-05 14:14:54 +09:00
Shinya Maeda 3a99a6b903 Consolidate ChunkedIO 2018-04-05 14:14:54 +09:00
Shinya Maeda ebf69adc21 Optimize chunk_store selector 2018-04-05 14:14:54 +09:00
Shinya Maeda 3a0f900318 Remove OS changes 2018-04-05 14:14:54 +09:00
Shinya Maeda 3a87bfb296 Add lock for delete 2018-04-05 14:14:54 +09:00
Shinya Maeda 0971f301fb Add new concerns 2018-04-05 14:14:54 +09:00
Shinya Maeda d1632da8c3 Implement basic live trace feature 2018-04-05 14:14:54 +09:00
Shinya Maeda 8a1c2bc474 Add tests for ChunkStore::Database too 2018-04-05 14:14:54 +09:00
Shinya Maeda 1a05c60ee6 Add spec for chunked_io 2018-04-05 14:14:53 +09:00
Shinya Maeda 1108df181c Add chunks_store database spec 2018-04-05 14:14:53 +09:00
Shinya Maeda f49aea7522 Add spec for ChunkStore::Redis 2018-04-05 14:14:53 +09:00
Shinya Maeda 3868a84795 Reorgnize archetecture 2018-04-05 14:14:53 +09:00
Shinya Maeda eb64ecb2cb Clarify namespaces 2018-04-05 14:14:53 +09:00
Shinya Maeda 85ae610c5e Introduce chunks store 2018-04-05 14:14:53 +09:00
Shinya Maeda 0142f9e031 Revert some changes 2018-04-05 14:14:53 +09:00
Shinya Maeda d4400e6b5c Live trace PoC 2018-04-05 14:14:53 +09:00
Matija Čupić 00b45348b9
Fix job setup in success empty state specs 2018-04-04 22:15:18 +02:00
Matija Čupić d883fe1cce
Add success CI Build empty state status 2018-04-04 21:00:32 +02:00
Filipa Lacerda 35dd0b6dfb [ci skip] Merge branch 'master' into 42568-pipeline-empty-state
* master: (293 commits)
  Revert changelog entry for removed feature
  Revert "Allow CI/CD Jobs being grouped on version strings"
  Resolve "Protected branches count is wrong when a wildcard includes several protected branches"
  Use standard codequality job
  Resolve "Allow the configuration of a project's merge method via the API"
  [Rails5] Rename `sort` methods to `sort_by_attribute`
  Add better LDAP connection handling
  Updated components to PascalCase
  Handle invalid params when trying update_username
  Move network related app settings to expandable blocks
  [Rails5] Update Gemfile.rails5.lock [ci skip]
  Update Security Products examples documentation
  Backport Gitlab::Git::Checksum to CE
  Add changelog
  Refactor discussions/notes code
  Remove unnecessary section looking in admin settings qa
  Explicitly use page context for qa/factory/settings/hashed_storage.rb
  Use gitlab_environment because we need:
  Allow feature gate removal through the API
  Use shard name in Git::GitlabProjects instead of shard path
  ...
2018-04-04 14:39:53 +01:00
Matija Čupić 8a4ec84965
Add action_button_title Core status method 2018-04-03 16:54:03 +02:00
Grzegorz Bizon c05d79172c Fix build variables policy after renaming methods 2018-03-30 11:29:05 +02:00
Matija Čupić ddabac46b9
Move action button titles to respective statuses 2018-03-29 19:24:19 +02:00
Grzegorz Bizon 5501dfd13f Merge branch 'master' into 'feature/gb/variables-expressions-in-only-except'
Conflicts:
   app/models/ci/build.rb
2018-03-29 11:07:54 +00:00
Matija Čupić 490d18691c
Merge branch 'master' into 42568-pipeline-empty-state 2018-03-28 16:36:27 +02:00
Matija Čupić bb0483dc2f
Move the empty state extended status to be the beginning 2018-03-28 16:18:06 +02:00
Matija Čupić b57fcbe616
Separate the manual empty state from the action empty state 2018-03-28 14:57:17 +02:00
Tomasz Maczukin 6ecde0076a
Remove Ci::Build#timeout 2018-03-28 14:00:05 +02:00
Matija Čupić c48f33c5be
Move action link to build extended status illustration 2018-03-28 13:51:30 +02:00
Matija Čupić 0969f19849
Move illustration to build specific statuses 2018-03-28 13:31:53 +02:00
Kamil Trzciński 51d92fb568 Merge branch '43603-ci-lint-support' into 'master'
Resolve "/ci/lint should support include keyword in config file"

Closes #43603

See merge request gitlab-org/gitlab-ce!17729
2018-03-28 08:01:33 +00:00
Grzegorz Bizon 937630bb8e Do not raise when validating variables expression 2018-03-27 14:46:58 +02:00
Grzegorz Bizon da6bfd9b80 Decouple build variables from persisted environment 2018-03-27 13:05:29 +02:00
Sean McGivern 835fe4d324 Merge branch '40781-os-to-ce' into 'master'
Bring Object Storage to CE

Closes #4171, #4163, #3370, #2841, and #29203

See merge request gitlab-org/gitlab-ce!17358
2018-03-27 08:20:03 +00:00
Grzegorz Bizon dbe9e0dff8 Merge branch 'master' into feature/gb/variables-expressions-in-only-except
* master: (199 commits)

Conflicts:
	lib/gitlab/ci/pipeline/seed/stage.rb
2018-03-27 10:12:56 +02:00
Mayra Cabrera 56c95fb6a1 Changes ci/lints controller to use authorize before action
Also includes a comment on Ci::Config regarding that's going to be
override by EE
2018-03-26 17:03:12 -06:00
Mayra Cabrera 80f9aff34b Make ci/lint page context aware:
- Create ci/lints controller inside project/
- Move js pages to be inside projects/
- Copy view ci/lint view to be inside project folder
- Remove ci/lint view and js files

Closes #43603
2018-03-26 17:03:11 -06:00
Matija Čupić d0349362a7
Extend Gitlab::Ci::Status#illustration to include metadata 2018-03-26 17:40:12 +02:00
Grzegorz Bizon 5b019f4317 Make stage seed instance variables less ambiguous 2018-03-26 10:34:09 +02:00
Matija Čupić d696194f8f
Add illustrations to build statuses 2018-03-24 11:46:04 +01:00
Grzegorz Bizon 1c2530ded3 Expose evaluable variables method from build object 2018-03-23 15:21:31 +01:00
Grzegorz Bizon bf59ed3cf9 Simplify how we set pipeline builds user on creation 2018-03-23 14:52:33 +01:00
Grzegorz Bizon b6e4e449fb Integrate build seeds with variables expressions policy 2018-03-23 13:56:16 +01:00
Grzegorz Bizon 8a2bc9b445 Integration variables collections with expressions 2018-03-23 13:44:12 +01:00
Grzegorz Bizon 0335d09e58 Integrate variables policy with new pipeline services 2018-03-23 12:26:21 +01:00
Grzegorz Bizon f2ec6c1c34 Merge branch 'backstage/gb/populating-pipeline-refactoring' into feature/gb/variables-expressions-in-only-except
* backstage/gb/populating-pipeline-refactoring: (860 commits)
  Add specs for extracted pipeline-related methods
  Bring seeds size method back to CI/CD pipeline class
  Improve YAML processor specs and remove unused code
  Fix static analysis and tests related to YAML processing
  Add specs for pipeline chain that builds stages and jobs
  Do not select included stage seeds in populate chain
  Decouple YAML processor from pipeline objects
  Move policy related specs our of YAML processor tests
  Fix rubocop offense in pipeline build seed class
  Add a guard clause to avoid creating empty stages
  Evaluate only/except policies outside of YAML processor
  Make it easier to test pipeline stage seeds
  Reduce stage seeds coupling between pipeline and YAML
  Add specs for chain element that populates a pipeline
  Populate pipeline with objects before creating it
  Remove legacy service for creating pipeline stages
  Decouple pipeline stage seeds from building environments
  Support building all pipeline resource before saving
  Introduce pipeline build seeds
  Start building abstraction over pipeline seeds
  ...

Conflicts:
	lib/gitlab/ci/yaml_processor.rb
	spec/lib/gitlab/ci/yaml_processor_spec.rb
2018-03-23 12:13:44 +01:00
Grzegorz Bizon b40d5d0fbb Fix static analysis and tests related to YAML processing 2018-03-22 15:22:50 +01:00