klas/t6_mem0
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update llms card to properly use local ollama (#1395)

Browse Source
This commit is contained in:
golemus
2024-06-09 18:09:49 +02:00
committed by GitHub
parent e22293294e
commit 11fc4a8451
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/components/llms.mdx
View File

@@ -330,6 +330,7 @@ Setup Ollama using https://github.com/jmorganca/ollama
```python main.py ```python main.py
import os import os
os.environ["OLLAMA_HOST"] = "http://127.0.0.1:11434"
from embedchain import App from embedchain import App
# load llm configuration from config.yaml file # load llm configuration from config.yaml file
@@ -345,6 +346,12 @@ llm:
top_p: 1 top_p: 1
stream: true stream: true
base_url: 'http://localhost:11434' base_url: 'http://localhost:11434'
embedder:
provider: ollama
config:
model: znbang/bge:small-en-v1.5-q8_0
base_url: http://localhost:11434
``` ```
</CodeGroup> </CodeGroup>