8000 Add benchmark tests in CI to prevent regression · Issue #19 · amrit110/oli · GitHub

More Web Proxy on the site http://driver.im/

Add benchmark tests in CI to prevent regression #19

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

amrit110 opened this issue Mar 20, 2025 · 0 comments

Labels

tests

Owner

7216 amrit110 commented

•

Is your feature request related to a problem? Please describe.

Need some simple tests once the basic stuff works to prevent regression.

I think one approach is to launch an ollama model in CI, and then run benchmark tests of oli-server on humaneval or swe-bench.

amrit110 added the tests label

amrit110 changed the title ~~Add tests to prevent regression~~ Add benchmark tests in CI to prevent regression

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

0