[OPIK-1833]: [P SDK] Implement evaluation engine for threads#2514

Draft

yaricom wants to merge 26 commits intomainfrom

OPIK-1833-threads-evaluation-engine

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[OPIK-1833]: [P SDK] Implement evaluation engine for threads#2514

[OPIK-1833]: [P SDK] Implement evaluation engine for threads#2514
yaricom wants to merge 26 commits intomainfrom
OPIK-1833-threads-evaluation-engine

Commits on Jun 18, 2025

[OPIK-1833]: Added threads evaluation engine stub

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

Commits on Jun 19, 2025

[OPIK-1833]: Added ThreadsClient stub with core methods for thread search and feedback logging

[OPIK-1833]: Added ThreadsClient stub with core methods for thread search and feedback logging

[OPIK-1833]: Implemented threads evaluation engine with multi-threading support

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

[OPIK-1833]: Implemented proper handling of score results

[OPIK-1833]: Refactored `ThreadsEvaluationEngine` constructor to accept an instance of `threads_client.ThreadsClient` to allow easy mocking during testing.

Commits on Jun 20, 2025

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

[OPIK-1833]: Refactored conversation imports to use a centralized ` types ` module

[OPIK-1833]: Enhanced error handling and logging in `ThreadsEvaluationEngine`

[OPIK-1833]: Added unit tests for `ThreadsEvaluationEngine`

Commits on Jun 23, 2025

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

[OPIK-1833]: Added `evaluate_threads` function and updated `init.py` exports

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

[OPIK-1833]: Wrapped threads evaluation by `async_http_connections_expire_immediately` context manager

[OPIK-1833]: Replaced `MetricComputationError` with `EvaluationError` in thread evaluation logic

[OPIK-1833]: Fixed typo in `_get_conversation_thread` method name and updated logic to handle scoring failures

[OPIK-1833]: Refactored `ThreadsEvaluationEngine` methods and added context management for evaluations

[OPIK-1833]: Refactored threads evaluation to align with the shared engine framework

[OPIK-1833]: Added better type annotations and comments

Commits on Jun 24, 2025

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

[OPIK-1833]: Refactored threading helpers and removed redundant methods

[OPIK-1833]: Fixed coment

Commits on Jun 25, 2025

Merge branch 'main' into OPIK-1833-threads-evaluation-engine

[OPIK-1833]: [P SDK] Implement evaluation engine for threads#2514yaricom wants to merge 26 commits intomaincomet-ml/opik:mainfrom OPIK-1833-threads-evaluation-enginecomet-ml/opik:OPIK-1833-threads-evaluation-engineCopy head branch name to clipboard

Commits

Commits on Jun 18, 2025

Commits on Jun 19, 2025

Commits on Jun 20, 2025

Commits on Jun 23, 2025

Commits on Jun 24, 2025

Commits on Jun 25, 2025

[OPIK-1833]: [P SDK] Implement evaluation engine for threads#2514
yaricom wants to merge 26 commits intomainfrom
OPIK-1833-threads-evaluation-engine