ea0013d7fd
Implement LiteLLM fallback models for reliability ( #453 )
...
* feat: Add LiteLLM Router for fallback models
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Add model to litellm_params for LiteLLM Router
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor: Prioritize operation model in LiteLLM Router fallbacks
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor: Cache LiteLLM Routers in APIWrapper
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor: Separate completion and embedding routers
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Add fallback models example configuration
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* feat: Add fallback models to LiteLLM Router
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor Router fallbacks to use list of dicts
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Remove example fallback config file
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Feat: Add version constraint for paddlepaddle
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-14 13:17:47 -08:00
50e45cf7db
Refactor: Use num_tokens instead of token_count ( #430 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-15 15:32:33 -07:00
1a41df6cb5
fix: add system prompt and other config vars to python api ( #356 )
2025-05-03 18:05:22 -07:00
d20c3982e4
feat: add TPM rate limits & pipeline settings to DocWrangler ( #338 )
...
* add TPM rate limit
* feat: add rate limiting in docwrangler; tpm
* feat: add rate limiting in docwrangler; tpm
* feat: add rate limiting in docwrangler; tpm
2025-04-19 22:38:48 -07:00
f4abe55191
feat: support pdf upload and add tutorial ( #309 )
2025-02-09 21:19:17 -08:00
662d6a2c5a
feat: add azure openai for the FE assistants ( #256 )
...
* chore: ui nits
* chore: ui nits
* feat: add tutorial for the supreme court hearings
* fix: output csv writing should work even if not all documents have all the keys
* feat: add azure openai for prompt improvement and chat, with logging
* Add system prompts to documentation
* fix: add setSystemPrompt to restore pipeline context
* docs: add vercel json
2025-01-01 11:41:43 -08:00
d939a86220
refactor: md changes documents -> items
2024-10-14 00:28:14 +05:30
2e6997d646
Merge staging to main (after parsers refactor) ( #82 )
...
* Parsers can now return any number of fields, and can access the whole item
* nit: change gpt-4o to gpt-4o-mini in tests
* feat: add verbose parameter for gleaning
* feat: add verbose parameter for gleaning
* fix: tokenizers should be wrapped in try catch
* fix: resort to eval if ast eval does not work
* docs: update docs to reflect new custom parsing API
---------
Co-authored-by: Egil <egil.moller@freecode.no>
2024-10-07 21:33:32 -07:00
a7e9a41c5f
docs: adding documentation
...
Co-authored-by: redhog <redhog@users.noreply.github.com>
2024-10-07 09:51:25 -07:00
988988ce23
docs: clean up drop keys ref
2024-10-03 18:02:19 -07:00
f4242bf8e9
docs: clean up custom parsing
2024-10-03 17:55:24 -07:00
3f9ba17395
docs: add clarification for split-gather example
2024-10-03 14:36:43 -07:00
455125d0b8
docs: add documentation for using split gather pipeline
2024-10-03 14:14:10 -07:00
34148bb27c
docs: add documentation for using split gather pipeline
2024-10-03 14:04:50 -07:00
f670b4a833
feat: add paddleocr
2024-10-02 10:06:31 -07:00
47b8b6b10f
docs: show root heading in custom parsing
2024-10-01 15:08:33 -07:00
fc22210535
feat: add azure document intelligence for basic OCR
2024-10-01 14:53:22 -07:00
715ce70faf
docs: improve clarity for custom parsing
2024-09-30 23:04:28 -07:00
438956d59e
docs: improve clarity for custom parsing
2024-09-30 22:51:16 -07:00
ca32fa73f6
fix: remove check for function calling for ollama models
2024-09-30 22:19:24 -07:00
9846f01324
docs: update documentation for custom parsers
2024-09-30 22:14:39 -07:00
efe78f55bf
docs: update documentation for custom parsers
2024-09-30 21:25:56 -07:00
a86ceb1972
docs: link to ollama chat
2024-09-30 11:42:10 -07:00
c1904b2204
docs: add ollama usage to documentation
2024-09-29 15:57:43 -07:00
78e3a3bf07
Update docs
2024-09-17 10:57:06 -07:00
c6f6819f0c
Add full pipeline config to steam sample
2024-09-15 14:20:21 -07:00
f1b771a97e
Adding steam reviews
2024-09-15 14:17:54 -07:00
104a562499
Update docs
2024-09-15 09:44:17 -07:00
6ae7247e1e
Adding an example
2024-09-15 00:22:17 -07:00
9db82e9421
Add mkdocs
2024-09-12 18:29:39 -07:00
Shreya Shankar
Anurag