Commit Graph

20 Commits

Author SHA1 Message Date
Shreya Shankar 0f6d9514e3
Add type checks to validation functions (#427)
* feat: Add output type validation to map and reduce operations

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Refine API error message for validation failures

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Test map type validation for integer answers

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* fix test for validating schemas

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-12 16:18:21 -07:00
Shreya Shankar 4cee4d7817
Clean up and reorganize pytest tests (#377)
* Replace api_wrapper with runner in test fixtures and configurations

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

* Refactor test fixtures and reorganize configuration in test files

Co-authored-by: ss.shankar505 <ss.shankar505@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-07-03 22:15:33 -07:00
Shreya Shankar b8d2beb602
feat: adding conditional gleaning (#375)
* fix: improve caching and don't raise error for bad gather configs

* fix: improve caching and don't raise error for bad gather configs

* feat: adding conditional gleaning
2025-07-01 22:40:38 -07:00
Shreya Shankar 631ea0c34f
feat: Add calibration support to map operations for improved consistency (#365)
* chore: run pre-commit

* feat: add calibration to map ops

* feat: add calibration to map ops

* fix: comment out flaky test
2025-06-14 23:04:13 -07:00
shabie 4793c89e92
feat: add flag to stream map operation outputs to disk (#323)
* feat: add flag to stream map operation outputs to disk

* flush partial results default False

* comment out print statement in test basic map

* rewrite test to not use batched config

---------

Co-authored-by: Shreya Shankar <ss.shankar505@gmail.com>
2025-03-19 19:17:56 -06:00
Shreya Shankar 05c4357c59
docs: add verbose param (#283) 2025-01-22 12:23:46 +01:00
Rohit Rawat 0e077aa740
added enum support (#254)
* added enum support

* tests: add test for enum type output

* docs: update docs to support enum type schemas

---------

Co-authored-by: Shreya Shankar <ss.shankar505@gmail.com>
2024-12-26 17:50:23 -06:00
Shreya Shankar 7242da81f4 fix: allow user to pass in litellm completion kwargs 2024-11-11 14:04:40 -08:00
Shreya Shankar 604ac257fe feat: adding batching for map and filter calls 2024-10-29 19:14:30 -07:00
Shreya Shankar 50936a8901 fix test: comment out timeout test 2024-10-27 19:25:34 -07:00
Shreya Shankar f6e3cd0473 mark as flaky test 2024-10-22 12:47:31 -07:00
Shreya Shankar a6f72510cd refactor: remove optimizer from configwrapper 2024-10-19 13:25:00 -07:00
Shreya Shankar 7635afa8e7 fix: change gleaning prompt to validation_prompt 2024-10-13 13:53:17 -04:00
Shreya Shankar c158ae11e8 refactor: move validation and gleaning into call llm 2024-10-11 17:17:32 -07:00
Shreya Shankar 27de5f2615 refactor: improving tests and consistency in the rate limits refactor 2024-10-06 22:55:06 -07:00
Shreya Shankar 74fad079af fix: enable gleaning llm calls to work 2024-10-05 09:20:59 -07:00
Shreya Shankar 5883fb354f fix: enable gleaning llm calls to work 2024-10-05 09:00:25 -07:00
Shreya Shankar 4454949429 feat: support for gemini 2024-10-03 11:44:02 -07:00
Shreya Shankar e8694356b2 chore: refactor schemas.py to also include ops from api.py 2024-09-30 15:57:47 -07:00
Shreya Shankar 3e98bcfe9d rebase with main 2024-09-30 15:14:49 -07:00