An OpenAI API-based server built on Predacons to host any Torch and Hugging Face LLM model.
To run the application locally, follow these steps:
- Docker installed on your system
- Docker Compose installed on your system
-
Clone the repository:
git clone https://github.com/Predacons/predacons-server.git
-
Change into the project directory:
cd predacons-server -
Build the Docker image:
docker-compose build
-
Start the containers:
docker-compose up
-
Access the application at:
Environment Variables
You can configure environment variables in the env directory. For example, you can add a .env file with the following contents:
API_KEYS=your-api-key
an openai api based server built on predacons to host any torch and hugging face llm model
- Model Hosting: Easily host and manage PyTorch and Hugging Face models.
- API Key Authentication: Secure access through API key authentication for both free and paid users.
- Scalable Architecture: Designed to scale horizontally to handle increasing loads and concurrent requests.
- Easy Integration: Provides a straightforward REST API for integrating with existing applications or services.
To get started with predacons-server, follow these steps:
- Clone the repository to your local machine.
- Install the required dependencies using
pip install -r requirements.txt. - Set up your environment variables, including your API keys in a
.envfile. - Run the server using
uvicorn main:app --reload.
For detailed instructions and documentation, please refer to our Wiki or Getting Started Guide.
Contributions are welcome! If you'd like to contribute, please fork the repository and use a feature branch. Pull requests are warmly welcome.
If you encounter any issues or require assistance, please open an issue on our GitHub repository.
Thank you for considering predacons-server for your AI model hosting needs!
This project is licensed under multiple licenses:
-
For free users, the project is licensed under the terms of the GNU Affero General Public License (AGPL). See
LICENSE-AGPLfor more details. -
For paid users, there are two options:
- A perpetual commercial license. See
LICENSE-COMMERCIAL-PERPETUALfor more details. - A yearly commercial license. See
LICENSE-COMMERCIAL-YEARLYfor more details.
- A perpetual commercial license. See
Please ensure you understand and comply with the license that applies to you.