533309f5fc
Add latest changes from gitlab-org/gitlab@master
2021-12-17 03:12:52 +00:00
7dd9256e5e
Add latest changes from gitlab-org/gitlab@master
2021-11-09 03:42:22 +00:00
331eae9a3e
Add latest changes from gitlab-org/gitlab@master
2021-11-05 21:10:23 +00:00
d9e285a74b
Add latest changes from gitlab-org/gitlab@master
2021-08-12 00:10:37 +00:00
811600560e
Add latest changes from gitlab-org/gitlab@master
2021-01-20 00:10:39 +00:00
eef9c80f1c
Add latest changes from gitlab-org/gitlab@master
2020-08-27 15:10:21 +00:00
8991d7b8a2
Add latest changes from gitlab-org/gitlab@master
2020-06-30 00:09:05 +00:00
2c89e16976
Add latest changes from gitlab-org/gitlab@master
2020-02-12 15:09:37 +00:00
667f6fbc8d
Add latest changes from gitlab-org/gitlab@master
2020-01-10 21:07:33 +00:00
f155cc9034
Add latest changes from gitlab-org/gitlab@master
2019-10-16 03:06:12 +00:00
285fcb4744
Add methods to check dead and retrying jobs
...
It adds two methods for checking if a background job
(for a given class) has dead or retrying jobs.
2019-04-08 19:47:36 -03:00
c34f6ea604
Consume remaining MigrateApproverToApprovalRulesInBatch
...
Allow `steal` to handle dead jobs.
2019-02-02 21:45:10 +08:00
3ab5af14a2
Check if specific type of background migration are done
...
Useful for checking progress.
2019-01-08 15:19:45 +08:00
c858f70d07
Enable frozen string for lib/gitlab/*.rb
2018-10-22 07:00:50 +00:00
91b752dce6
Respond to DB health in background migrations
...
This changes the BackgroundMigration worker so it checks for the health
of the DB before performing a background migration. This in turn allows
us to reduce the minimum interval, without having to worry about blowing
things up if we schedule too many migrations.
In this setup, the BackgroundMigration worker will reschedule jobs as
long as the database is considered to be in an unhealthy state. Once the
database has recovered, the migration can be performed.
To determine if the database is in a healthy state, we look at the
replication lag of any replication slots defined on the primary. If the
lag is deemed to great (100 MB by default) for too many slots, the
migration is rescheduled for a later point in time.
The health checking code is hidden behind a feature flag, allowing us to
disable it if necessary.
2018-08-06 15:20:36 +02:00
2930c0e3d0
Remove obsolete argument from bg migrations code
2017-07-18 10:43:12 +02:00
e41d42d6a2
Simplify background migrations stealing code
...
Simply re-raise an exception when it occurs, but guarantee that no
background migration is lost in the process.
2017-07-17 14:02:12 +02:00
af41bd41e9
Fix off-by-one error in background migration retries
2017-07-17 10:45:52 +02:00
7b146ab6c3
Recover from all exceptions when stealing bg migration
...
It also makes it possible to gracefully retry a migration in order to
avoid problems like deadlocks.
2017-07-17 10:16:56 +02:00
01c55ffca8
Catch exceptions when stealing background migrations
2017-07-14 15:40:51 +02:00
39b96f02dc
Avoid race condition when stealing a background migration
...
We first pop a job from the Sidekiq queue / scheduled set and only if
this has been successfully deleted we process the job. This makes it
possible to minimize a possibility of a race condition happening.
2017-07-14 12:55:52 +02:00
beffbc8aa2
Fix mocks in background migrations specs
2017-07-13 12:08:03 +02:00
2a0ead2c47
Implement draining scheduled sets of background migrations
2017-07-13 11:44:52 +02:00
388abbd10c
Extract background migratons queue class method
2017-07-11 15:42:00 +02:00
0430b76441
Enable Style/DotPosition Rubocop 👮
2017-06-21 13:48:12 +00:00
d83ee2bbd1
Add the ability to perform background migrations
...
Background migrations can be used to perform long running data
migrations without these blocking a deployment procedure.
See MR https://gitlab.com/gitlab-org/gitlab-ce/merge_requests/11854 for
more information.
2017-06-12 13:24:04 +02:00
GitLab Bot
Oswaldo Ferreira
Mark Chao
gfyoung
Yorick Peterse
Grzegorz Bizon
Grzegorz Bizon