docetl2/docs/examples
Shreya Shankar ea0013d7fd
Implement LiteLLM fallback models for reliability (#453)
* feat: Add LiteLLM Router for fallback models

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Add model to litellm_params for LiteLLM Router

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Refactor: Prioritize operation model in LiteLLM Router fallbacks

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Refactor: Cache LiteLLM Routers in APIWrapper

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Refactor: Separate completion and embedding routers

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Add fallback models example configuration

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* feat: Add fallback models to LiteLLM Router

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Refactor Router fallbacks to use list of dicts

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Remove example fallback config file

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Feat: Add version constraint for paddlepaddle

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-14 13:17:47 -08:00
..
annotating-legal-documents.md Adding an example 2024-09-15 00:22:17 -07:00
characterizing-troll-behavior.md Adding an example 2024-09-15 00:22:17 -07:00
custom-parsing.md refactor: md changes documents -> items 2024-10-14 00:28:14 +05:30
fallback_models_example.yaml Implement LiteLLM fallback models for reliability (#453) 2025-11-14 13:17:47 -08:00
mining-product-reviews.md Refactor: Use num_tokens instead of token_count (#430) 2025-09-15 15:32:33 -07:00
ollama.md feat: add azure openai for the FE assistants (#256) 2025-01-01 11:41:43 -08:00
pdf-analysis-gemini.md feat: support pdf upload and add tutorial (#309) 2025-02-09 21:19:17 -08:00
presidential-debate-themes.md fix: add system prompt and other config vars to python api (#356) 2025-05-03 18:05:22 -07:00
rate-limiting.md feat: add TPM rate limits & pipeline settings to DocWrangler (#338) 2025-04-19 22:38:48 -07:00
split-gather.md feat: add azure openai for the FE assistants (#256) 2025-01-01 11:41:43 -08:00