Demo RAG App for Oracle Cloud Generative AI. No longer being developed.
- Takes user queries via Streamlit's
st.chat_inputand displays both user queries and model responses withst.chat_message - Uses LlamaIndex to load and index data and create a chat engine that will retrieve context from that data to respond to each user query
No longer live. Please see https://github.com/cgpavlakos/genai_agent/ for an improved version.
Instructions here
- Make sure you have port 8502 open on security list
- Launch a VM with ubuntu base image
- SSH into it (ubuntu@ipaddress) and run setup.sh
- Your app is running on http://ipaddress:8502
- Replace contents of ~/src/GenAI-Demo-main/data with whatever other documents you want to have for this demo
- Use run.sh to run the demo again after you have already created it
- Create VM using Canonical Ubuntu 22.04 platform image
- attach
rag-demo-setup.shas cloud-init script - talk to Chris if you need this - ssh in and check setup log with
tail -f llama_setup.log - when its done, your application will be running on
ipaddress:8502
to customize: replace the PDFs in ~/src/GenAI-Demo-main/docs
If you get ValidationError: 1 validation error for OCIGenAIEmbeddings __root__ Could not authenticate with OCI client then there is an issue with the oci credentials, easy to fix:
sudo rebootcd ~/src/GenAI-Demo-mainsudo chmod +x run.sh./run.sh