Shreya Shankar
|
ea0013d7fd
|
Implement LiteLLM fallback models for reliability (#453)
* feat: Add LiteLLM Router for fallback models
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Add model to litellm_params for LiteLLM Router
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor: Prioritize operation model in LiteLLM Router fallbacks
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor: Cache LiteLLM Routers in APIWrapper
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor: Separate completion and embedding routers
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Add fallback models example configuration
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* feat: Add fallback models to LiteLLM Router
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Refactor Router fallbacks to use list of dicts
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Remove example fallback config file
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
* Feat: Add version constraint for paddlepaddle
Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>
---------
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
|
2025-11-14 13:17:47 -08:00 |