An example integration of multiple AI-related components with Alfresco as the content repository to enable Retrieval-Augmented Generation (RAG) for chat-based responses.
- Java (17.0.9)
- Maven (3.9.5)
- Angular (18.1.0)
- Node.js (v20.9.0)
- NPM (10.1.0)
- Docker [tested on Windows using Docker Desktop (v4.40.0) with WSL2]
Recommended limits for wsl in C:/Users/<current_user>/.wslconfig
[wsl2]
memory=34GB
processors=6
NVIDIA GPU notes - additional drivers for docker:
- NVIDIA container-toolkit:
- Test:
docker run --rm -it --gpus=all nvcr.io/nvidia/k8s/cuda-sample:nbody nbody -gpu -benchmark
Note: If the command hangs without producing any output, the issue may be related to the Docker Desktop version. Ensure that Docker Desktop is version 4.18 or higher, or exactly 4.17.0.
This behavior has been observed and resolved in version 4.40.0.
Source: Stack Overflow
- Navigate to http://<your_domain>/basic-panel/chat (OpenWebUI chat window) and obtain your API key (AI_PIPELINE_API_KEY env).
- Connect Open WebUI with Pipelines
- Set the API URL to http://ai-pipelines:9099 and the API key to 0p3n-w3bu!.
For full documentation see: https://docs.openwebui.com/pipelines.
- Clone current repository.
- Fix git autocrlf:
git config core.autocrlf input
. - Update environment variables in
./docker/.env
. - Build components and deploy them locally:
./run.sh build_start
.
- Alfresco
- Alfresco Application Development Framework
- Open WebUI
- Pipelines by Open WebUI
- aborroy/alfresco-ai-framework
- Ollama
- Elasticsearch
Sources of AI models are being downloaded from:
Models:
This project is licensed under the Apache License 2.0. See the LICENSE file for details.
Special thanks to the Alfresco and Hyland teams for their ongoing commitment to open-source innovation in the fields of content management and artificial intelligence.
We also extend our sincere gratitude to Angel Borroy for his valuable work on the alfresco-ai-framework, which served as an inspiration and foundation for parts of this project.