Local Ollama (#53)

- Fix typo 'Start' 'End'
- Add llama3.1 selection
- Use 'quick_think_llm' model instead of hard-coding GPT
This commit is contained in:
Max Wong
2025-06-26 00:27:01 -04:00
committed by GitHub
parent 26c5ba5a78
commit 43aa9c5d09
4 changed files with 13 additions and 11 deletions

View File

@@ -9,7 +9,7 @@ class FinancialSituationMemory:
self.embedding = "nomic-embed-text"
else:
self.embedding = "text-embedding-3-small"
self.client = OpenAI()
self.client = OpenAI(base_url=config["backend_url"])
self.chroma_client = chromadb.Client(Settings(allow_reset=True))
self.situation_collection = self.chroma_client.create_collection(name=name)