gitlab-ce/lib/gitlab
Lin Jen-Shin 8e2350ae95 Raise encoding confidence threshold to 50
It is recommended that we set this to 50:
https://gitlab.com/gitlab-org/gitlab-ce/issues/35098#note_35036746

In this particular issue, the confidence was 42 for Shift JIS,
but in fact that's encoded in UTF-8 just with a single bad
character. In this case, we shouldn't try to treat it as Shift JIS,
but just treat it as UTF-8 and remove invalid bytes.

Treating it like Shift JIS would corrupt the whole data.

Unfortunately, the diff which would cause this could not be
disclosed therefore we can't use it as a test example.
2017-08-08 19:09:56 +08:00
..
auth Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
background_migration Migrate MR commits and diffs to new tables 2017-08-03 13:20:26 +01:00
badge Reword success to passing for pipeline badges 2017-07-21 10:22:11 +02:00
bitbucket_import Rename many path_with_namespace -> full_path 2017-08-01 07:26:58 +02:00
cache Remove old request store wrap 2017-07-18 20:17:24 +08:00
checks Remove GitAccessStatus (no longer needed) 2017-06-05 05:32:26 -07:00
ci Short-circuit build coverage extraction for empty regexes 2017-07-22 07:12:19 +01:00
conflict Include new URL helpers retroactively into includers of Gitlab::Routing 2017-07-07 10:43:37 -05:00
cycle_analytics Add table for merge request commits 2017-07-06 17:36:10 +01:00
data_builder Load and process at most 100 commits when pushing into default branch 2017-07-28 17:23:13 +02:00
database Add a foreign key to `merge_requests.head_pipeline_id` 2017-07-18 10:51:19 +02:00
dependency_linker Fix diff of requirements.txt file by not matching newlines as part of package names 2017-06-27 16:20:01 -05:00
diff Remove unused (?) code 2017-07-31 17:19:25 +02:00
downtime_check Enable Style/MutableConstant 2017-02-23 09:31:56 -06:00
email Check against "Auto-Submitted: no" instead 2017-08-03 19:29:18 +08:00
etag_caching Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
fogbugz_import Backport of multiple_assignees_feature [ci skip] 2017-05-04 17:11:53 +03:00
gfm Fix cross-project references copy to include the project reference 2017-01-03 13:01:46 +01:00
git Merge branch 'feature/migrate-repository-size-to-gitaly' into 'master' 2017-08-07 21:29:32 +00:00
gitaly_client Merge branch 'feature/migrate-find-commits-by-message-to-gitaly' into 'master' 2017-08-07 21:33:45 +00:00
github_import Rename more path_with_namespace -> full_path or disk_path 2017-08-01 07:28:13 +02:00
gitlab_import
google_code_import Enable the Style/PreferredHashMethods cop 2017-06-02 19:11:26 +02:00
gpg optimize query, only select relevant db columns 2017-07-27 15:46:04 +02:00
graphs
health_checks Add a Circuitbreaker for storage paths 2017-08-04 15:38:48 +02:00
import_export Exclude merge_jid on Import/Export attribute configuration 2017-08-07 20:04:16 -03:00
ldap Pass OmniAuth formatted options to OmniAuth::LDAP::Adaptor 2017-07-31 11:43:35 +02:00
markdown
metrics Add sidekiq metrics endpoint and add http server to sidekiq 2017-08-07 17:13:02 +00:00
middleware Fix go-get support for projects in nested groups 2017-03-07 19:40:19 -06:00
o_auth Uniquify reserved word usernames on OAuth user creation 2017-08-02 09:40:49 -04:00
performance_bar Merge branch 'rc/bump-peek-performance_bar' into 'master' 2017-07-19 08:52:01 +00:00
project_authorizations Enable Style/DotPosition Rubocop 👮 2017-06-21 13:48:12 +00:00
prometheus Use correct `Environment`-class within `Gitlab` namespace 2017-08-07 15:54:30 +02:00
quick_actions Fixes #29385: Add /shrug and /tableflip commands 2017-07-28 14:37:44 -05:00
redis Make `Redis::Wrapper#_raw_config` and `#fetch_config` more resilient 2017-07-11 16:49:57 -04:00
request_profiler Don't require lib/gitlab/request_profiler/middleware.rb in config/initializers/request_profiler.rb 2017-02-02 17:22:10 +01:00
saml Fix code for cops 2017-02-23 09:31:57 -06:00
sanitizers Enable Style/MultilineArrayBraceLayout 2017-02-23 09:32:22 -06:00
serializer Enable and autocorrect the CustomErrorClass cop 2017-03-01 15:28:10 +00:00
sherlock Enable Style/DotPosition Rubocop 👮 2017-06-21 13:48:12 +00:00
sidekiq_middleware Merge branch 'aiionx_sidekiq_log_patch' into 'master' 2016-10-03 14:20:18 +00:00
sidekiq_status Periodically mark projects that are stuck in importing as failed 2017-04-05 16:11:51 +02:00
slash_commands Improve wording related to deploy chatops command 2017-07-28 12:16:07 +02:00
sql Backports for ee-2112 2017-07-06 16:25:03 +08:00
template Submodule Dockerfile templates 2017-04-26 15:57:44 +00:00
testing Introduce a new middleware for the test environment that can block requests 2017-03-22 19:45:21 +01:00
view/presenter implement Presenter::Base#declarative_policy_delegate 2017-06-27 12:41:54 -07:00
access.rb Enable the Style/TrailingCommaInLiteral cop 2017-05-10 18:25:45 +02:00
allowable.rb convert all the policies to DeclarativePolicy 2017-06-27 12:44:37 -07:00
app_logger.rb
asciidoc.rb Fix LaTeX formatting for AsciiDoc wiki 2017-05-24 15:47:35 +02:00
auth.rb Cleanup tests and add admin_container_image to 2017-08-02 17:51:29 +08:00
background_migration.rb Remove obsolete argument from bg migrations code 2017-07-18 10:43:12 +02:00
blame.rb Blob#load_all_data! doesn’t need an argument 2017-06-07 14:28:33 -05:00
changes_list.rb Enable Style/ClassCheck 2017-02-23 09:32:22 -06:00
chat_name_token.rb Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
ci_access.rb Refactor to remove a special case 2017-06-05 05:32:26 -07:00
closing_issue_extractor.rb
color_schemes.rb
config_helper.rb
contributions_calendar.rb fix rubocop violations 👮 2017-07-31 18:19:18 -05:00
contributor.rb
current_settings.rb Repair Regression caused by - !11573 2017-07-11 14:23:51 +08:00
daemon.rb Add sidekiq metrics endpoint and add http server to sidekiq 2017-08-07 17:13:02 +00:00
database.rb Fix Gitlab::Database.bulk_insert for non-UTF-8 data 2017-06-26 17:21:40 +01:00
dependency_linker.rb Autolink package names in requirements.txt 2017-05-23 15:35:59 -05:00
downtime_check.rb Enable Style/DotPosition Rubocop 👮 2017-06-21 13:48:12 +00:00
ee_compat_check.rb Always fetch branches before finding the merge base, otherwise we could find an outdated merge base 2017-08-01 13:52:44 +02:00
emoji.rb Moved the title onto the emoji tag 2017-04-24 17:08:12 +01:00
encoding_helper.rb Raise encoding confidence threshold to 50 2017-08-08 19:09:56 +08:00
environment.rb Move hostname to Gitlab::Environment 2017-08-04 15:38:49 +02:00
environment_logger.rb Show log corresponding to env in admin/logs 2016-11-03 22:02:47 +01:00
exclusive_lease.rb Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
fake_application_settings.rb If migrations are pending, make CurrentSettings use existing values and populate missing columns with defaults 2017-06-19 09:54:48 -07:00
file_detector.rb Add auxiliary blob viewers to dependency files 2017-05-17 14:10:00 -05:00
file_finder.rb Backport FileFinder from EE 2017-05-12 13:21:30 +03:00
git.rb Incorporate RefsService.FindAllBranches Gitaly RPC 2017-07-27 15:40:54 -04:00
git_access.rb Add “Project moved” error to Git-over-SSH 2017-06-16 14:14:19 -07:00
git_access_wiki.rb Remove GitAccessStatus (no longer needed) 2017-06-05 05:32:26 -07:00
git_logger.rb
git_post_receive.rb Added repository_update hook 2017-05-12 23:26:48 +01:00
git_ref_validator.rb More Gitaly annotations 2017-07-13 18:05:55 +02:00
gitaly_client.rb Implement GRPC call to RepositoryService 2017-07-26 09:32:34 +02:00
gl_id.rb
gl_repository.rb Pass GL_REPOSITORY in Workhorse responses 2017-05-05 10:52:06 -03:00
gon_helper.rb configure webpack publicPath dynamically to account for CDN or relative path settings 2017-06-28 22:26:16 -05:00
gpg.rb store gpg user name and email on the signature 2017-07-27 15:44:39 +02:00
group_hierarchy.rb Enable Style/DotPosition Rubocop 👮 2017-06-21 13:48:12 +00:00
highlight.rb Enable Style/DotPosition Rubocop 👮 2017-06-21 13:48:12 +00:00
i18n.rb Add Korean translation to i18n 2017-08-07 09:19:41 +00:00
identifier.rb Use Commit#author so we share logic and cache 2016-11-24 02:33:55 +08:00
import_export.rb Fixes race condition in project uploads 2017-08-07 14:31:45 +02:00
import_formatter.rb
import_sources.rb Set the new GitHub import as import source 2017-08-07 13:06:13 -03:00
incoming_email.rb No strong reasons to freeze them 2017-02-07 01:28:58 +08:00
issuable_metadata.rb Remove remaining N+1 queries in merge requests API with emojis and labels 2017-07-08 22:19:34 -07:00
issuable_sorter.rb Change issues sentence to use natural sorting 2017-04-25 18:57:08 -05:00
issues_labels.rb Pass user instance to Labels::FindOrCreateService or skip_authorization: true 2016-10-28 11:31:45 +02:00
job_waiter.rb Reduce wait timings for Sidekiq jobs 2017-06-19 16:14:07 +02:00
key_fingerprint.rb Backport changes in https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/2551 to CE 2017-08-07 19:17:11 +01:00
kubernetes.rb Encode certificate-authority-data in base64 2017-07-06 19:38:41 +08:00
lazy.rb
lfs_token.rb Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
logger.rb
mail_room.rb Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
markup_helper.rb Use constants in Gitlab::MarkupHelper 2017-04-20 00:39:29 +00:00
metrics.rb Add missing trailing newlines 2017-06-02 19:45:58 +02:00
optimistic_locking.rb Merge branch 'dm-meer-blauw-op-straat' into 'master' 2017-02-23 17:19:28 +00:00
other_markup.rb Enable Style/DotPosition Rubocop 👮 2017-06-21 13:48:12 +00:00
otp_key_rotator.rb Added EachBatch for iterating tables in batches 2017-07-07 16:39:36 +02:00
pages_transfer.rb Rename pages namespace or project path when changed 2017-01-31 22:53:56 +00:00
path_regex.rb Add contents of `public` as forbidden top-level routes 2017-07-25 09:18:54 +02:00
performance_bar.rb Expire cached user IDs that can see the performance after 5 minutes 2017-07-17 13:29:33 +02:00
polling_interval.rb Convert value to string before setting Poll-Interval header 2017-04-05 15:35:05 +02:00
popen.rb Accept environment variables from the `pre-receive` script. 2016-12-16 23:32:25 +05:30
project_search_results.rb Backport FileFinder from EE 2017-05-12 13:21:30 +03:00
project_template.rb Rename GitLabProjectImporterService and misc fixes 2017-08-01 14:36:42 +02:00
project_transfer.rb Rename pages namespace or project path when changed 2017-01-31 22:53:56 +00:00
prometheus_client.rb Remove orig file + rubocop cleanup 2017-06-05 21:00:57 +02:00
protocol_access.rb
recaptcha.rb Use reCaptcha when an issue identified as spam 2017-02-07 12:56:20 +01:00
reference_extractor.rb Support both internal and external issue trackers 2017-07-24 08:13:43 +02:00
regex.rb Add a test for container repository name regexp 2017-07-19 10:52:03 +02:00
repo_path.rb Add “Project moved” error to Git-over-SSH 2017-06-16 14:14:19 -07:00
repository_check_logger.rb
request_context.rb Remove unecessary defaults for uniq ip block, cleanup refactoring leftovers 2017-03-06 15:45:43 +01:00
request_forgery_protection.rb Add log messages to clarify log messages about API CSRF token verification failure 2017-07-28 15:39:39 +02:00
request_profiler.rb Enable Style/MutableConstant 2017-02-23 09:31:56 -06:00
route_map.rb Merge branch '24570-use-re2-for-user-supplied-regexp-9-3' into 'security-9-3' 2017-07-19 22:28:41 -05:00
routing.rb Also inject new route helpers into includers of GitlabRoutingHelper 2017-07-08 16:24:18 -05:00
search_results.rb Fix blob highlighting in search 2017-04-03 18:51:44 +01:00
seeder.rb Fix the `Gitlab::Seeder` monkey patch to disable mail delivery 2017-03-02 20:29:30 -05:00
sentry.rb Enable the Style/TrailingCommaInArguments cop 2017-05-10 18:25:45 +02:00
shell.rb Backport changes in https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/2551 to CE 2017-08-07 19:17:11 +01:00
shell_adapter.rb Move Gitlab::Shell and Gitlab::ShellAdapter files to lib/ 2017-01-27 16:16:55 +01:00
sherlock.rb
sidekiq_logger.rb
sidekiq_status.rb Periodically mark projects that are stuck in importing as failed 2017-04-05 16:11:51 +02:00
sidekiq_throttler.rb Refactored Sidekiq Throttler and updated documentation 2016-11-11 11:14:58 -06:00
snippet_search_results.rb Reduce query count for snippet search 2017-02-16 08:47:48 +00:00
string_range_marker.rb Extract generic parts of Gitlab::Diff::InlineDiffMarker 2017-05-10 08:26:21 -05:00
string_regex_marker.rb Add Gitlab::StringRegexMarker 2017-05-10 08:26:21 -05:00
time_tracking_formatter.rb Add some API endpoints for time tracking. 2017-01-18 10:48:16 -06:00
timeless.rb
untrusted_regexp.rb Upgrade the re2 gem to 1.1.0 2017-07-24 11:03:37 +01:00
update_path_error.rb Enable and autocorrect the CustomErrorClass cop 2017-03-01 15:28:10 +00:00
upgrader.rb Don’t exclude some file in lib from rubocop 2017-02-23 09:32:42 -06:00
uploads_transfer.rb Bring in security changes from the 9.2.5 release 2017-06-07 21:16:20 -07:00
url_blocker.rb Merge branch 'ssrf' into 'security' 2017-03-20 18:53:45 -07:00
url_builder.rb Don't reload ActiveRecord objects when building note URLs 2017-07-11 13:02:55 +01:00
url_sanitizer.rb Don't allow to pass a user to ProjectWiki#http_url_to_repo 2017-05-30 14:18:58 +02:00
usage_data.rb Use correct `Environment`-class within `Gitlab` namespace 2017-08-07 15:54:30 +02:00
user_access.rb Fix tests and fine tweak permission error message 2017-07-19 22:37:38 +08:00
user_activities.rb Support multiple Redis instances based on queue type 2017-07-11 03:35:47 +00:00
utils.rb Frontend implementation, tests, and changelog 2017-05-25 19:31:21 +08:00
version_info.rb
visibility_level.rb Always return the translated level name. 2017-07-13 12:11:09 -05:00
workhorse.rb Enable gitaly_post_upload_pack by default 2017-07-25 15:23:41 +02:00