8000 GitHub - Nayjest/lm-proxy: LM-Proxy is OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

LM-Proxy is OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

License

Notifications You must be signed in to change notification settings

Nayjest/lm-proxy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

PYPI Release Code Style Tests License

LM-Proxy

LM-Proxy is OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

Development Status: bookmark it and go away, it is still in early development.

✨ Features

  • @todo

🚀 Quickstart

# Install LM-Proxy via pip
pip install lm-proxy

🤝 Contributing

We ❤️ contributions! See CONTRIBUTING.md.

📝 License

Licensed under the MIT License.

© 2022—2025 Vitalii Stepanenko

About

LM-Proxy is OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published
0