Commit Graph

380 Commits

Author SHA1 Message Date
GitLab Bot b7dfe2ae40 Add latest changes from gitlab-org/gitlab@master 2019-09-13 13:26:31 +00:00
Adam Hegyi ff7c992ebd Setup counter for Productivity Analytics
This change sets up a usage counter for productivity analytics feature.
2019-09-12 11:12:29 +00:00
Igor a8040a61d8 Add usage pings for merge request creating
Code Review Usage Ping for Create SMAU
2019-08-26 14:30:45 +00:00
Nick Thomas 3028cd687a Merge branch '39-count-unique-users-for-more-accurate-smau-reporting' into 'master'
Allow UsageData.count to use count_by:

See merge request gitlab-org/gitlab-ce!30770
2019-08-19 14:45:24 +00:00
rossfuhrman 3fbc51d333 Remove Security Dashboard feature flag
This removes the group_overview_security_dashboard feature flag
2019-08-16 17:40:33 +00:00
Adam Hegyi c5cb5da4ac Track page views for cycle analytics show page
This change adds a new counter 'cycle_analytics_views' to the usage data
metrics to count the page views for cycle analytics show page.
2019-08-14 16:12:12 +00:00
Igor 04598039a5 Add usage pings for source code pushes
Source Code Usage Ping for Create SMAU
2019-08-13 22:33:16 +00:00
Mark Chao 4a6f959ab8 Record usage on snippet usage
Generalize wiki page counter for other page types to extend to.
2019-08-08 13:18:57 +00:00
Francisco Javier López 26e9efc011 Added navbar searches usage ping counter
Added usage ping counter when the user makes
a search through the navbar search component.
2019-07-29 09:58:58 +00:00
Alex Kalderimis 7320758611 Count wiki page creation
This adds a counter to count page creation, which is reflected in the
usage-data we collect.

The number created is stored in Redis, avoiding DB access.
2019-07-21 01:26:19 +00:00
Francisco Javier López 01685eed76 Added Usage Data for some Web IDE actions
The actions tracked in the web IDE are:
- creation of commits
- creation of merge requests
- projects loaded
2019-07-19 11:11:27 +00:00
Ash McKenzie d00d60a66d
Allow UsageData.count to use count_by: 2019-07-18 12:13:19 +10:00
Francisco Javier López bcd2458076 Refactor RedisCounter and WebIdeCommitsCounter
This MR refactor RedisCounter and WebIdeCommitsCounter
to be reused by other components.
2019-07-17 23:45:35 +00:00
Francisco Javier López 556d213cbc Refactored WebIdeCommitsCount class
We're adding more redis base counters to the web ide and other
classes. We're refactoring this class in other to use the logic
in other places.
2019-07-16 13:12:37 +00:00
Zeger-Jan van de Weg 44528f6c44
Add Gitaly data to the usage ping
Gitaly data wasn't available to the team, an this change is a first
iteration towards understanding what data we need and how to interpret
it. Later more values will be added.

For now the most important thing is the filesystem String Array, as that
includes data on ext4 exposure and NFS.

Part of: https://gitlab.com/gitlab-org/gitlab-ce/issues/60602
2019-06-20 15:26:56 +02:00
Zeger-Jan van de Weg a3f80f9f2e Add PoolRepository to the usage ping
PoolRepository is a relatively new model of which the counts could help
to further determine the priority of new features. Also gives some
insight into the number of forks customers have.
2019-05-17 09:10:29 +00:00
Ryan Cobb 64b04fb075 Use Gitlab::Metrics methods for checking if metrics are enabled 2019-04-11 11:34:37 -06:00
Ryan Cobb bb225b6675 Adds instance metrics to usage ping
This adds influxdb_metrics_enabled and prometheus_metrics_enabled to
usage ping.
2019-04-10 11:22:05 -06:00
Logan King 0cd7ebf717 Add error tracking usage counts 2019-03-25 07:42:08 +00:00
Darby Frey ff2de2f179 Adding additional usage metrics for Release to weekly ping 2019-03-07 17:08:29 +00:00
João Cunha ed2f7e23d6 Rename scope to imply :installed and :updated result
- Adds to specs the case where apps are also updated
- Rename scope calls on Gitlab::UsageData and Clusters::Cluster
- Removes a duplicated spec
2019-02-15 11:16:45 +00:00
Victor Zagorodny fa518963ec Protect group overview usage ping w/ feature flag
user_preferences key is includes into system usage
data only if group_overview_security_dashboard
feature flag is enabled; see
https://gitlab.com/gitlab-org/gitlab-ee/issues/7048
2019-02-12 12:46:31 +02:00
Victor Zagorodny 60bd0a24f5 Add user_preferences_usage to usage ping 2019-02-12 12:46:31 +02:00
Balasankar "Balu" C 232a7a36e2
Add number of repositories to usage ping data 2019-01-31 18:46:07 +05:30
Oswaldo Ferreira ed3034bbb7 Allow suggesting single line changes in diffs 2018-12-13 19:17:19 +00:00
Jan Provaznik 3720d02b8b Use approximate counts for big tables 2018-12-06 16:07:14 +00:00
Dylan Griffith 821b4fdec7 Add UsageData for group/project clusters 2018-12-05 14:50:30 +01:00
Amit Rathi 2945ab47d6 Fix usage data and install command spec 2018-11-20 16:48:23 +05:30
Sean McGivern cc9e3d0900 Merge branch 'jira-ping-differentiate-cloud' into 'master'
Usage ping - Differentiate Jira Server and Cloud

Closes #51043

See merge request gitlab-org/gitlab-ce!22791
2018-11-07 20:09:24 +00:00
Mario de la Ossa 013d097e8b
Usage ping - Differentiate Jira Server and Cloud 2018-11-07 11:28:04 -06:00
Chris Baumbauer 28a9bbceb7 Remove comments from migration script and add usage data 2018-11-01 08:14:49 -07:00
gfyoung c858f70d07 Enable frozen string for lib/gitlab/*.rb 2018-10-22 07:00:50 +00:00
Tiago Botelho 1e662293e8 Implements Web IDE commits counter in Redis
This makes a temporary implementation of the
Web IDE commits counter using Redis while
https://gitlab.com/gitlab-org/gitlab-ce/issues/52096
is being discussed further for a more generic
approach to counters
2018-10-03 11:34:48 +01:00
Tiago Botelho 9b2e17ac71 Adds WebIDE commits to UsagePing
Implements UsageCounters model to track feature usage counters
and makes easy to extend for future counters
2018-10-01 16:11:09 +01:00
Yorick Peterse 2039c8280d
Disable existing offenses for the CodeReuse cops
This whitelists all existing offenses for the various CodeReuse cops, of
which most are triggered by the CodeReuse/ActiveRecord cop.
2018-09-11 17:32:00 +02:00
Sean McGivern f5f439f2c9 Ensure services counts always have values in usage pings 2018-09-05 17:51:47 +01:00
Sean McGivern d13ae9c260 Handle statement timeouts in usage ping 2018-09-05 17:51:47 +01:00
Chantal Rollison e9c1f184bc Added count for label, assignee, and milestone lists 2018-08-21 08:21:01 -07:00
Lin Jen-Shin d0afab482f Disable SAML if OmniAuth is disabled
We also try to unify the way we setup OmniAuth, and how we check
if it's enabled or not.
2018-07-20 18:54:46 +08:00
Douglas Barbosa Alexandre 727bba8ef5
Add enabled prefix to feature keys to be consistent with other keys 2018-06-20 14:16:14 -03:00
Balasankar C 9f76632d80 Add installation type to usage ping data 2018-06-07 15:01:20 +00:00
Tiago Botelho 9a13059332 Backports every CE related change from ee-5484 to CE 2018-05-07 11:59:51 +02:00
Matija Čupić b26913a30c
Extract cluster installed query to scope 2018-03-30 18:31:11 +02:00
Matija Čupić 6fccd9dfcf
Change order of queries for gcp cluster usage data count 2018-03-29 21:49:18 +02:00
Matija Čupić 8c1cfcbc22
Use cluster scopes to deflate usage data implementation 2018-03-29 21:26:12 +02:00
Matija Čupić 427eeb43bf
Query GCP provider table instead of selecting clusters 2018-03-29 20:57:25 +02:00
Matija Čupić 8853e183a8
Make cluster usage datapoints more specific 2018-03-26 22:32:04 +02:00
Matija Čupić 4478103d99
Rename cluster datapoint names to be more specific 2018-03-26 21:54:13 +02:00
Matija Čupić e46950f284
Disable rubocop Metrics/AbcSize on UsageData#system_usage_data 2018-03-22 14:57:56 +01:00
Matija Čupić 0bf79bf12e
Add additional cluster usage metrics 2018-03-22 00:44:06 +01:00
Tiago Botelho 335ee79a73 Refactors median code to work with both single and multiple projects 2018-02-28 10:46:20 +00:00
Tiago Botelho 3f31da9c69 Restrict cycle analytics usage data to instances that use postgres only 2018-02-28 10:46:20 +00:00
Tiago Botelho a7b3f11edd Adds get all medians to Cycle Analytics model 2018-02-28 10:46:19 +00:00
Mario de la Ossa eaada9d706 use Gitlab::UserSettings directly as a singleton instead of including/extending it 2018-02-02 18:39:55 +00:00
Markus Koller 257fd57134 Allow password authentication to be disabled entirely 2017-11-23 13:16:14 +00:00
Shinya Maeda 6571efb6c3 Fix spec. Fix usage ping. Fix warnings by adding new models and attributes. 2017-11-01 16:12:44 +09:00
Shinya Maeda a6b2387d3f Collect usage pings `Gcp::Cluster.enabled` and `Gcp::Cluster.disabled`, instead of `Gcp::Cluster.count` 2017-10-11 23:02:47 +09:00
Kamil Trzcinski f16ac0efda Added usage ping 2017-10-04 21:09:40 +02:00
Tiago Botelho 25932308c0 Adds gitlab features and components to usage ping data. 2017-09-21 14:47:35 +01:00
Zeger-Jan van de Weg 74bf291c78
Add auto devops enabled/disabled to usage ping 2017-09-12 12:33:48 +02:00
Zeger-Jan van de Weg 5c6f40ab6e
Add usage ping for Auto DevOps
Fixes gitlab-org/gitlab-ce#37648
2017-09-08 19:38:02 +02:00
Sean McGivern 5883ce95ef `current_application_settings` belongs on `Gitlab::CurrentSettings`
The initializers including this were doing so at the top level, so every object
loaded after them had a `current_application_settings` method. However, if
someone had rack-attack enabled (which was loaded before these initializers), it
would try to load the API, and fail, because `Gitlab::CurrentSettings` didn't
have that method.

To fix this:

1. Don't include `Gitlab::CurrentSettings` at the top level. We do not need
   `Object.new.current_application_settings` to work.
2. Make `Gitlab::CurrentSettings` explicitly `extend self`, as we already use it
   like that in several places.
3. Change the initializers to use that new form.
2017-08-31 13:38:33 +01:00
Bob Van Landuyt fda83a6179 Use correct `Environment`-class within `Gitlab` namespace 2017-08-07 15:54:30 +02:00
Jarka Kadlecova 124ef7dd60 Add Slack and JIRA services counts to Usage Data 2017-07-24 12:59:06 +02:00
Jarka Kadlecova 2cc063e592 Add github imported projects count to usage data 2017-07-19 15:22:05 +02:00
Kamil Trzciński efb7b2d341 Merge branch 'zj-usage-ping-only-gl-pipelines' into 'master'
Only count GL pipelines in usage data ping

Closes #33172

See merge request !12277
2017-06-29 13:55:19 +00:00
Z.J. van de Weg 4447006832 Split pipelines by origin on usage data
When sending the usage data, it now includes all pipelines. This commit
will split the pipelines in two; internal and external.

This will lead to historical data being incorrectly marked this way.

Fixes gitlab-org/gitlab-ce#33172
2017-06-27 12:47:44 +02:00
Z.J. van de Weg e7d12a70d2 Add in_review_folder to usage ping
As its hard to reliably check how many review apps there are on the
clients machine, we start by checking where the type is `review`. This
means the folder is called that way. This will lead to a seq
scan on the table. However, this is done once a week, so the benefit of
adding an index seems not to apply here.
2017-06-27 09:39:05 +02:00
Ruben Davila 3396edcea0 Remove Services count from usage ping payload.
This query was timing out and is blocking the sync of usage data for
GitLab.com
2017-05-18 11:49:11 -05:00
Sean McGivern d2d6435372 Add hostname to usage ping 2017-05-11 09:20:12 +01:00
Zeger-Jan van de Weg 8df3997a92 Add Pipeline Schedules that supersedes experimental Trigger Schedule 2017-05-07 22:35:56 +00:00
Sean McGivern b61199ce0c Add prometheus services to usage ping 2017-04-14 15:20:55 +02:00
Sean McGivern 092258e924 Add edition to usage ping 2017-04-14 15:20:55 +02:00
Robert Speicher e21ed5fe77 Add Upload count to usage data 2017-04-14 15:20:55 +02:00
Stan Hu f30a46b401 Used named parameter for refreshing usage data 2017-04-14 15:20:55 +02:00
Stan Hu bca368990a Cache the last usage data to avoid unicorn timeouts 2017-04-14 15:20:55 +02:00
Sean McGivern c53afeda0c Port 'Add uuid to usage ping' to CE
CE port of https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/1521
2017-04-14 15:20:55 +02:00
Z.J. van de Weg f5b42881c8 Track Mattermost usage 2017-04-14 15:20:55 +02:00
Ruben Davila f41b693fc7 Remove pushes count from usage ping payload
This query is constantly generating timeout errors on large installations and we don't
have a simple solution for now and also we don't think having this counter is
really critical.
2017-04-14 15:20:55 +02:00
Sean McGivern 0483019e98 Port 'Add more usage data to EE ping' to CE
CE port of https://gitlab.com/gitlab-org/gitlab-ee/merge_requests/735
2017-04-14 15:20:55 +02:00