8000 GitHub - BeOne-PL/ai-stack
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

BeOne-PL/ai-stack

Repository files navigation

AI Stack

License
An example integration of multiple AI-related components with Alfresco as the content repository to enable Retrieval-Augmented Generation (RAG) for chat-based responses.

Prerequisites

  • Java (17.0.9)
  • Maven (3.9.5)
  • Angular (18.1.0)
  • Node.js (v20.9.0)
  • NPM (10.1.0)
  • Docker [tested on Windows using Docker Desktop (v4.40.0) with WSL2]

Local environment notes

Recommended limits for wsl in C:/Users/<current_user>/.wslconfig

[wsl2]
memory=34GB 
processors=6

NVIDIA GPU notes - additional drivers for docker:

  1. NVIDIA container-toolkit:
  2. Test:
docker run --rm -it --gpus=all nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -gpu -benchmark

Note: If the command hangs without producing any output, the issue may be related to the Docker Desktop version. Ensure that Docker Desktop is version 4.18 or higher, or exactly 4.17.0. This behavior has been observed and resolved in version 4.40.0.
Source: Stack Overflow

Architecture

Fallback architecture images

generalArch
generalArch
generalArch
generalArch

Manual steps after deployment

Pipelines configuration

  1. Navigate to http://<your_domain>/basic-panel/chat (OpenWebUI chat window) and obtain your API key (AI_PIPELINE_API_KEY env).
  2. Connect Open WebUI with Pipelines
  3. Set the API URL to http://ai-pipelines:9099 and the API key to 0p3n-w3bu!.

For full documentation see: https://docs.openwebui.com/pipelines.

Development

  1. Clone current repository.
  2. Fix git autocrlf: git config core.autocrlf input.
  3. Update environment variables in ./docker/.env.
  4. Build components and deploy them locally:./run.sh build_start.

Technologies and tools used

Sources of AI models are being downloaded from:

Models:

License

This project is licensed under the Apache License 2.0. See the LICENSE file for details.

Acknowledgments

Special thanks to the Alfresco and Hyland teams for their ongoing commitment to open-source innovation in the fields of content management and artificial intelligence.
We also extend our sincere gratitude to Angel Borroy for his valuable work on the alfresco-ai-framework, which served as an inspiration and foundation for parts of this project.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published
0