Commit Graph

66 Commits

Author SHA1 Message Date
GitLab Bot 329f63356a Add latest changes from gitlab-org/gitlab@master 2024-07-24 18:10:15 +00:00
GitLab Bot d1b3f24693 Add latest changes from gitlab-org/gitlab@master 2024-05-23 12:14:18 +00:00
GitLab Bot 5f89187f04 Add latest changes from gitlab-org/gitlab@master 2023-11-08 12:12:37 +00:00
GitLab Bot 5842aa3556 Add latest changes from gitlab-org/gitlab@master 2023-07-11 18:10:34 +00:00
GitLab Bot 59712a466f Add latest changes from gitlab-org/gitlab@master 2023-07-05 21:08:43 +00:00
GitLab Bot 45a8c43afe Add latest changes from gitlab-org/gitlab@master 2023-05-15 09:08:57 +00:00
GitLab Bot 28e90894e1 Add latest changes from gitlab-org/gitlab@master 2023-04-11 12:09:05 +00:00
GitLab Bot c1f98d9590 Add latest changes from gitlab-org/gitlab@master 2023-02-16 15:07:53 +00:00
GitLab Bot 2eff77c2ef Add latest changes from gitlab-org/gitlab@master 2023-02-03 21:08:05 +00:00
GitLab Bot d4e22f4ade Add latest changes from gitlab-org/gitlab@master 2022-12-19 18:09:34 +00:00
GitLab Bot b26eec8cbc Add latest changes from gitlab-org/gitlab@master 2022-12-02 00:07:06 +00:00
GitLab Bot 67fa8362ae Add latest changes from gitlab-org/gitlab@master 2022-05-06 15:09:03 +00:00
GitLab Bot 3d440ae03e Add latest changes from gitlab-org/gitlab@master 2022-02-09 00:15:57 +00:00
GitLab Bot 20c68317f8 Add latest changes from gitlab-org/gitlab@master 2022-01-10 18:14:07 +00:00
GitLab Bot cb8bd7d594 Add latest changes from gitlab-org/gitlab@master 2021-07-22 12:10:04 +00:00
GitLab Bot e58ce90f14 Add latest changes from gitlab-org/gitlab@master 2021-06-11 18:10:13 +00:00
GitLab Bot ede2fbdc87 Add latest changes from gitlab-org/gitlab@master 2021-04-12 09:09:09 +00:00
GitLab Bot a0b872fdb4 Add latest changes from gitlab-org/gitlab@master 2020-12-12 00:09:52 +00:00
GitLab Bot a97f1426db Add latest changes from gitlab-org/gitlab@master 2020-11-02 21:09:10 +00:00
GitLab Bot 4fa04f789e Add latest changes from gitlab-org/gitlab@master 2020-09-02 12:10:35 +00:00
GitLab Bot f6905d2ed2 Add latest changes from gitlab-org/gitlab@master 2020-06-10 18:09:15 +00:00
GitLab Bot e5731d5194 Add latest changes from gitlab-org/gitlab@master 2020-05-15 09:07:59 +00:00
GitLab Bot 028bb5dda7 Add latest changes from gitlab-org/gitlab@master 2020-04-30 18:09:38 +00:00
GitLab Bot e33f87ac0f Add latest changes from gitlab-org/gitlab@master 2020-04-21 15:21:10 +00:00
GitLab Bot b7c735c8ac Add latest changes from gitlab-org/gitlab@master 2020-04-15 12:09:18 +00:00
GitLab Bot 00a8c64ffd Add latest changes from gitlab-org/gitlab@master 2020-04-15 06:09:49 +00:00
GitLab Bot e2ee1eec50 Add latest changes from gitlab-org/gitlab@master 2020-04-08 03:09:31 +00:00
GitLab Bot ba174c982f Add latest changes from gitlab-org/gitlab@master 2020-04-06 12:10:44 +00:00
GitLab Bot 619d0b6922 Add latest changes from gitlab-org/gitlab@master 2020-02-26 18:09:24 +00:00
GitLab Bot 11e5d1b9ca Add latest changes from gitlab-org/gitlab@master 2020-02-10 15:08:54 +00:00
GitLab Bot 40254b9ace Add latest changes from gitlab-org/gitlab@master 2020-01-17 21:08:29 +00:00
GitLab Bot 22a0d312ae Add latest changes from gitlab-org/gitlab@master 2020-01-17 18:08:41 +00:00
GitLab Bot 2a65a97e12 Add latest changes from gitlab-org/gitlab@master 2019-12-18 00:08:09 +00:00
GitLab Bot fd0691c6c0 Add latest changes from gitlab-org/gitlab@master 2019-10-31 00:07:00 +00:00
Kamil Trzciński 0e56c1e7cb Improve performance and memory usage of project export
ActiveModel::Serialization is simple in that it recursively calls
`as_json` on each object to serialize everything. However, for a model
like a Project, this can generate a query for every single association,
which can add up to tens of thousands of queries and lead to memory
bloat.

To improve this, we can do several things:

1. We use `tree:` and `preload:` to automatically generate
   a list of all preloads that could be used to serialize
   objects in bulk.

2. We observe that a single project has many issues, merge requests,
   etc. Instead of serializing everything at once, which could lead to
   database timeouts and high memory usage, we take each top-level
   association and serialize the data in batches.

For example, we serialize the first 100 issues and preload all of
their associated events, notes, etc. before moving onto the next
batch. When we're done, we serialize merge requests in the same way.
We repeat this pattern for the remaining associations specified in
import_export.yml.
2019-09-09 15:40:49 +00:00
Kamil Trzciński 0eeadb2dd2 Normalize import_export structure
This brings a significant refactor to how
we handle `import_export.yml`, merge it with EE
and how we handle that for reader and saver.

This is meant to simplify the code, and remove
a ton of conditions to handle different models
of the structure.

This is also meant to prepare the structure
to extend it much easier, like adding `preload:`
or additional object types when needed.

This does not change the behavior of import/export,
rather unifies and simplifies the current implementation.
2019-09-06 14:21:17 +02:00
Thong Kuah f0391c2517 Add frozen_string_literal to spec/support
Using the sed script from
https://gitlab.com/gitlab-org/gitlab-ce/issues/59758
2019-07-25 17:33:34 +12:00
Andrew Newdigate 3288e1a874 Adds the Rubocop ReturnNil cop
This style change enforces `return if ...` instead of
`return nil if ...` to save maintainers a few minor review points
2019-03-06 17:51:56 +02:00
James Lopez 43cc0d5a4a
Fix persistent symlink in project import
- Fix permissions after untar is done
- Refactor command line util
2018-12-17 16:14:35 +01:00
Takuya Noguchi e902f462c2 Eliminate duplicated words
Signed-off-by: Takuya Noguchi <takninnovationresearch@gmail.com>
2018-11-22 01:01:23 +09:00
James Lopez f1277fbf0b
refactor code based on feedback 2018-09-07 14:43:51 +02:00
James Lopez 27442862cf
refactor code based on feedback 2018-09-07 13:42:49 +02:00
James Lopez a2aa505805
Refactor code to remove object storage flag from Import/Export
Updated docs, refactor import/export code
Fix AvatarUploader path issue
Fix project export upload webhook error
2018-09-06 16:52:42 +02:00
Mayra Cabrera 33311cb677 CE Port of Protected Environments backend 2018-08-10 13:45:14 +00:00
Mark Chao a63bce1a4b Resolve "Rename the `Master` role to `Maintainer`" Backend 2018-07-11 14:36:08 +00:00
Oswaldo Ferreira 54ad5fb8a2 Take two for MR metrics population background migration 2018-05-30 11:51:29 -03:00
James Lopez 40819467b9 fix typo 2017-08-28 17:11:28 +02:00
James Lopez 49495fe63d fix spec 2017-08-28 15:24:24 +02:00
Robert Speicher 9513bd18c4 Ensure all project factories use `:repository` trait or `:empty_project` 2017-08-01 14:51:52 -04:00
Valery Sizov 387c4b2c21 Backport of multiple_assignees_feature [ci skip] 2017-05-04 17:11:53 +03:00