Bosquet is on a mission to make building AI applications simple. All nontrivial AI applications need to work with prompt templates that quickly grow in complexity, limited LLM context windows require memory management, and agents are needed for AI applications to interact with the outside world.
Bosquet provides instruments to work with those AI application concepts:
- LLM and Tool service management
- Prompt templating via integration with the excellent Selmer templating library
- Prompt chaining and composition via a powerful Pathom graph processing machine
- Agent and tools definition abstractions for the interactions with external APIs
- LLM memory handling
- Other instruments like call response caching (see documentation)
Full project documentation (WIP)
Secrets like keys are stored in secrets.edn file and local parameters are kept in config.edn. Make a copy of config.edn.sample and config.edn.sample files. Change as needed.
Command line interface demo
Run the following command to get CLI options
clojure -M -m bosquet.cli
Set the default model with
clojure -M -m bosquet.cli llms set --service openai --temperature 0 --model gpt-4o
Do not forget to set the API KEY for your service (change 'openai' to a different name if needed)
clojure -M -m bosquet.cli keys set openai
With that set, you can run generations:
clojure -M -m bosquet.cli "2+{{x}}="
Or using files
clojure -M -m bosquet.cli -p demo/play-writer-prompt.edn -d demo/play-writer-data.edn
Simple prompt completion can be done like this.
(require '[bosquet.llm.generator :refer [generate llm]])
(generate "When I was 6 my sister was half my age. Now I’m 70 how old is my sister?")
=>
"When you were 6, your sister was half your age, which means she was 6 / 2 = 3 years old.\nSince then, there is a constant age difference of 3 years between you and your sister.\nNow that you are 70, your sister would be 70 - 6 = 64 years old."}
(require '[bosquet.llm :as llm])
(require '[bosquet.llm.generator :refer [generate llm]])
(generate
llm/default-services
{:question-answer "Question: {{question}} Answer: {{answer}}"
:answer (llm :openai)
:self-eval ["Question: {{question}}"
"Answer: {{answer}}"
""
"Is this a correct answer?"
"{{test}}"]
:test (llm :openai)}
{:question "What is the distance from Moon to Io?"})
=>
{:question-answer
"Question: What is the distance from Moon to Io? Answer:",
:answer
"The distance from the Moon to Io varies, as both are orbiting different bodies. On average, the distance between the Moon and Io is approximately 760,000 kilometers (470,000 miles). However, this distance can change due to the elliptical nature of their orbits.",
:self-eval
"Question: What is the distance from Moon to Io?\nAnswer: The distance from the Moon to Io varies, as both are orbiting different bodies. On average, the distance between the Moon and Io is approximately 760,000 kilometers (470,000 miles). However, this distance can change due to the elliptical nature of their orbits.\n\nIs this a correct answer?",
:test
"No, the answer provided is incorrect. The Moon is Earth's natural satellite, while Io is one of Jupiter's moons. Therefore, the distance between the Moon and Io can vary significantly depending on their relative positions in their respective orbits around Earth and Jupiter."}
(require '[bosquet.llm.generator :refer [generate llm]])
(require '[bosquet.llm.wkk :as wkk])
(generate
[[:system "You are an amazing writer."]
[:user ["Write a synopsis for the play:"
"Title: {{title}}"
"Genre: {{genre}}"
"Synopsis:"]]
[:assistant (llm wkk/openai
wkk/model-params {:temperature 0.8 :max-tokens 120}
wkk/var-name :synopsis)]
[:user "Now write a critique of the above synopsis:"]
[:assistant (llm wkk/openai
wkk/model-params {:temperature 0.2 :max-tokens 120}
wkk/var-name :critique)]]
{:title "Mr. X"
:genre "Sci-Fi"})
=>
#:bosquet{:conversation
[[:system "You are an amazing writer."]
[:user
"Write a synopsis for the play:\nTitle: Mr. X\nGenre: Sci-Fi\nSynopsis:"]
[:assistant "In a futuristic world where technology ..."]
[:user "Now write a critique of the above synopsis:"]
[:assistant
"The synopsis for the play \"Mr. X\" presents an intriguing premise ..."]],
:completions
{:synopsis
"In a futuristic world where technology has ...",
:critique
"The synopsis for the play \"Mr. X\" presents an intriguing premise set ..."}}Generation returns :bosquet/conversation listing full chat with generated parts filled in, and :bosquet/completions containing only generated data
Supports tools for chats for openai and ollama based models similar to how ragtacts does it
(require '[bosquet.llm.generator :refer [generate llm]])
(require 'bosquet.llm.wkk :as wkk)
;define a tool for the weather station
(defn ^{:desc "Get the current weather in a given location"} get-current-weather
[^{:type "string" :desc "The city, e.g. San Francisco"} location]
(prn (format "Applying get-current-weather for location %s" location))
(case (str/lower-case location)
"tokyo" {:location "Tokyo" :temperature "10" :unit "fahrenheit"}
"san francisco" {:location "San Francisco" :temperature "72" :unit "fahrenheit"}
"paris" {:location "Paris" :temperature "22" :unit "fahrenheit"}
{:location location :temperature "unknown"}))
(generate [[:system "You are a weather reporter"]
[:user "What is the temperature in San Francisco"]
[:assistant (llm wkk/ollama wkk/model-params
{:model "llama3.2:b" wkk/tools [#'get-current-weather]}
wkk/var-name :weather-report)]])
=>
#:bosquet{:conversation
[[:system "You are a weather reporter"]
[:user "What is the temperature in San Francisco"]
[:assistant
"According to the current weather conditions, the temperature in San Francisco is 72°F (Fahrenheit)."]],
:completions
{:weather-report
"According to the current weather conditions, the temperature in San Francisco is 72°F (Fahrenheit)."},
:usage
{:weather-report {:prompt 90, :completion 21, :total 111},
:bosquet/total {:prompt 90, :completion 21, :total 111}},
:time 3034}
;;Write some calculator functions
(defn ^{:desc "add 'x' and 'y'"} add
[^{:type "number" :desc "First number to add"} x
^{:type "number" :desc "Second number to add"} y]
(prn (format "Applying add for %s %s" x y))
(+ (if (number? x) x (Float/parseFloat x) )
(if (number? y) y (Float/parseFloat y) )))
(defn ^{:desc "subtract 'y' from 'x'"} sub
[^{:type "number" :desc "Number to subtract from"} x
^{:type "number" :desc "Number to subtract"} y]
(prn (format "Applying sub %s %s" x y))
(- (if (number? x) x (Float/parseFloat x) )
(if (number? y) y (Float/parseFloat y) )))
(generate [[:system "You are a math wizard"]
[:user "What is 2 + 2 - 3"]
[:assistant (llm wkk/openai
wkk/model-params {wkk/tools [#'add #'sub]}
wkk/var-name :answer)]])
=>
#:bosquet{:conversation
[[:system "You are a math wizard"]
[:user "What is 2 + 2 - 3"]
[:assistant "2 + 2 - 3 equals 1"]],
:completions {:answer "2 + 2 - 3 equals 1"},
:usage
{:answer {:prompt 181, :completion 12, :total 193},
:bosquet/total {:prompt 181, :completion 12, :total 193}},
:time 1749}