This is a 5G expert system. It uses retrieval augmented generation to augment the Q&A capabilities of an LLM.
Make sure you have a settings.yml
file in the same directory as settings.py
.
It should have these vars:
API_KEY
DOC_DIR
MODEL_NAME
NUM_EXTRA_DOCS
-> the number of additional docs to retrieve per run. NOT depth, closer to top kCHROMA_DIR
-> The directory the chromadb sqlite db will be stored
Do python frontend.py
gradio langchain_openai langchain_community chromadb bs4 docx2txt
Initializing the db only happens when the resync button is hit. The DB is persistent so between runs you access the same database.