11 Commits

Author	SHA1	Message	Date
Stephanie Hingtgen	e01e61a156	Trash: Keep provisioned objects out of the trash (#111714)	2025-09-28 20:33:57 +00:00
Georges Chaudy	c251ebf4d5	kvstore: merge the metadata store into the datastore (#110334) ... * migrate eventstore to datastore * Add folder to event key * lint * lint * lint * lint * remove foundkye * refactor the Keys methods to move the Sort outside the ListKey method * remove bad import * fix missing params * lint * fix test * perf improvement	2025-09-16 12:16:29 +02:00
owensmallwood	7ce971cba1	Unified Storage: Adds pruner for kv eventstore (#110785) ... * Adds pruner for eventstore - default 24 hours. Adds tests. * update comment * remove delay on startup. formatting * updates log message type and removes useless comment * caller handles goroutine for runCleanupOldEvents() * simplify timestamp extraction * adds config for event pruning interval * uses start and end key to get all expired events * remove sort when listing keys in event pruner - order doesnt matter * use snowflake constants * log when we delete 0 rows * pass time.Time to cleanup old events func	2025-09-12 14:40:16 -06:00
owensmallwood	310893292f	Unified Storage: Add sort order to keys func in datastore (#110714) ... * Add sort order to keys func in datastore. Add test to not prune deleted events. * include sort field in the ListRequestKey instead of it being a separate param	2025-09-11 14:12:30 -06:00
owensmallwood	d715bda8af	Unified Storage: Adds pruner to kv backend (#110549) ... * WIP adding pruner to kv store impl * pruner only keeps 20 most recent versions * ignore grafana-kv-data folder * extracts some stuff to pruner.go file. Adds tests. Adds kvBackendOptions. * update logging, comments, exports kvbackendoptions fields * update nooppruner ref * fixes field casing in test * fix test * linter fixes * remove comment * make KvStorageBackend private * Adds pruner key validation and tests. Fixes broken tests. * update error message when validating pruner key	2025-09-05 10:02:11 -06:00
Will Assis	ea7c370edd	unified-storage: add ListSinceModified to kv store (#110250) ... * implement ListKeysSince in event store implement data store version --------- Co-authored-by: Georges Chaudy <chaudyg@gmail.com>	2025-09-04 12:26:40 -04:00
owensmallwood	cace999671	Unified Storage: Add ListSinceModified to StorageBackend (#109697) ... * WIP added ListSinceModified to StorageBackend interface * fix compile time check * Fix method name * Fix naming * fix the rest of the ListSinceModified names * Uses resource key without name field * get latest rv from resource_version. Update test. * adds moar tests * adds method stub for ListModifiedSince to other StorageBackend implementations * adds dummy impl to noop storage backend for ListModifiedSince * skip tests for badger kv backend for now * fixes tests and adds badgerkv impl for ListModifiedSince * add badger kv impl * adds test for new query * adds test data for new query * adds ListModifiedSince stub to mockStorageBackend * uncomment tests * refactors ListModifiedSince to return an iter.seq2 and handles deduplication. Updates tests. Updates query result sorting. * remove comments * remove folder from query (dont need it, yet?) * regen test queries * updates test * updates function comment * use resourcepb.ResourceKey instead of ModifiedResourceKey * wrap seq in single transaction. Rollback transaction after 30s if iterator never used. Only track last seen event. Formatting. * skip TestListModifiedSince for kv backend * use WatchEvent_Type for action type * remove redundant fields from order by clause and regen test data for query * remove redundant fields from order by clause and regen test data for query	2025-08-20 11:54:31 -06:00
Mustafa Sencer Özcan	7b4fcd486a	Revert "fix: unified resource server list queries order column" (#109529)	2025-08-12 17:29:50 +02:00
Mustafa Sencer Özcan	4a779c4ccb	fix: unified resource server list queries order column (#108094)	2025-07-16 08:09:31 +02:00
Georges Chaudy	b6dd08da2f	unistore: fix delete and db closed in kv store (#107918) ... * fix delete and db closed * fix tests	2025-07-10 11:34:36 +02:00
Georges Chaudy	696657bdd1	unistore: add kv based storage backend (#107305) ... * Add datastore * too many slashes * lint * add metadata store * simplify meta * Add eventstore * golint * lint * Add datastore * too many slashes * lint * pr comments * extract ParseKey * readcloser * remove get prefix * use dedicated keys * parsekey * sameresource * unrelated * name * renmae tests * add key validation * fix tests * refactor a bit * lint * allow empty ns * get keys instead of list * rename the functions * refactor yield candidate * update test * unistore: add LastResourceVersion to datastore * lint * use map string * missing err check * fix * Add storage backend * remove hasmore * fix tests * small refactor * pre-alloc * extract the folder * lint * refactor * handle context canceled in ListHistory to pass the tests * fix the resource test * unistore: provide generic tests for the kv interface (#107443) unistore: move the kv tests to the testing package * Update pkg/storage/unified/resource/storage_backend_test.go Co-authored-by: Peter Štibraný <pstibrany@gmail.com> * address comments * comments * comments * comments * normalise the names and add helper method * events comments * rename function --------- Co-authored-by: Peter Štibraný <pstibrany@gmail.com>	2025-07-02 10:57:37 +00:00