Commit Graph

3 Commits

Author SHA1 Message Date
Benjamin Trent 9bf8b5a442
[ML] Adds progress reporting for transforms (#41278)
* [ML] Adds progress reporting for transforms

* fixing after master merge

* Addressing PR comments

* removing unused imports

* Adjusting afterKey handling and percentage to be 100*

* Making sure it is a linked hashmap for serialization

* removing unused import

* addressing PR comments

* removing unused import

* simplifying code, only storing total docs and decrementing

* adjusting for rewrite

* removing initial progress gathering from executor
2019-04-25 07:54:06 -05:00
Benjamin Trent e79da922a3
[ML] Add data frame task state object and field (#40169)
* [ML] Add data frame task state object and field

* A new state item is added so that the overall task state can be
accoutned for
* A new FAILED state and reason have been added as well so that failures
can be shown to the user for optional correction

* Addressing PR comments

* adjusting after master merge

* addressing pr comment

* Adjusting auditor usage with failure state

* Refactor, renamed state items to task_state and indexer_state

* Adding todo and removing redundant auditor call

* Address HLRC changes and PR comment

* adjusting hlrc IT test
2019-03-26 15:59:01 -05:00
David Kyle 474ef8b4ed
[ML] Data Frame HLRC Get Stats API (#40327) 2019-03-26 08:57:12 +00:00