open-notebook/commands
LUIS NOVO 48e2800211 fix: reduce retry log noise during concurrent chunk processing
Addresses issue #362 - users were seeing hundreds of ERROR/WARNING logs
when processing large documents due to SurrealDB v2 transaction conflicts
during concurrent chunk embedding operations.

Changes:
- Upgraded to surreal-commands v1.3.0 which includes retry_log_level feature
- Increased retry attempts from 5 to 15 with max wait time 120s (from 30s)
  to handle deep queues during concurrent processing
- Set retry_log_level to "debug" in embed_chunk and process_source commands
- Changed repository.py RuntimeError logging from ERROR to DEBUG level
- Updated command exception handlers to log retries at DEBUG level
- Updated documentation to reflect retry strategy

This is a temporary workaround for SurrealDB v2.x transaction conflict
issues with SEARCH indexes. Settings can be reduced after migrating to
SurrealDB v3 which fixes the underlying concurrency issue.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-01-05 11:30:55 -03:00
..
CLAUDE.md fix: reduce retry log noise during concurrent chunk processing 2026-01-05 11:30:55 -03:00
__init__.py Version 1 (#160) 2025-10-18 12:46:22 -03:00
embedding_commands.py fix: reduce retry log noise during concurrent chunk processing 2026-01-05 11:30:55 -03:00
example_commands.py Version 1 (#160) 2025-10-18 12:46:22 -03:00
podcast_commands.py refactor: reorganize folder structure for better maintainability 2026-01-03 14:04:27 -03:00
source_commands.py fix: reduce retry log noise during concurrent chunk processing 2026-01-05 11:30:55 -03:00