77 lines
2.2 KiB
Plaintext
77 lines
2.2 KiB
Plaintext
---
|
|
title: Azure OpenAI
|
|
---
|
|
|
|
To use Azure OpenAI models, you have to set the `LLM_AZURE_OPENAI_API_KEY`, `LLM_AZURE_ENDPOINT`, `LLM_AZURE_DEPLOYMENT` and `LLM_AZURE_API_VERSION` environment variables. You can obtain the Azure API key from the [Azure](https://azure.microsoft.com/).
|
|
|
|
## Usage
|
|
|
|
```python
|
|
import os
|
|
from mem0 import Memory
|
|
|
|
os.environ["LLM_AZURE_OPENAI_API_KEY"] = "your-api-key"
|
|
os.environ["LLM_AZURE_DEPLOYMENT"] = "your-deployment-name"
|
|
os.environ["LLM_AZURE_ENDPOINT"] = "your-api-base-url"
|
|
os.environ["LLM_AZURE_API_VERSION"] = "version-to-use"
|
|
|
|
config = {
|
|
"llm": {
|
|
"provider": "azure_openai",
|
|
"config": {
|
|
"model": "your-deployment-name",
|
|
"temperature": 0.1,
|
|
"max_tokens": 2000,
|
|
"azure_kwargs": {
|
|
"azure_deployment": "",
|
|
"api_version": "",
|
|
"azure_endpoint": "",
|
|
"api_key": "",
|
|
"default_headers": {
|
|
"CustomHeader": "your-custom-header",
|
|
}
|
|
}
|
|
}
|
|
}
|
|
}
|
|
|
|
m = Memory.from_config(config)
|
|
m.add("Likes to play cricket on weekends", user_id="alice", metadata={"category": "hobbies"})
|
|
```
|
|
|
|
We also support the new [OpenAI structured-outputs](https://platform.openai.com/docs/guides/structured-outputs/introduction) model.
|
|
|
|
```python
|
|
import os
|
|
from mem0 import Memory
|
|
|
|
os.environ["LLM_AZURE_OPENAI_API_KEY"] = "your-api-key"
|
|
os.environ["LLM_AZURE_DEPLOYMENT"] = "your-deployment-name"
|
|
os.environ["LLM_AZURE_ENDPOINT"] = "your-api-base-url"
|
|
os.environ["LLM_AZURE_API_VERSION"] = "version-to-use"
|
|
|
|
config = {
|
|
"llm": {
|
|
"provider": "azure_openai_structured",
|
|
"config": {
|
|
"model": "your-deployment-name",
|
|
"temperature": 0.1,
|
|
"max_tokens": 2000,
|
|
"azure_kwargs": {
|
|
"azure_deployment": "",
|
|
"api_version": "",
|
|
"azure_endpoint": "",
|
|
"api_key": "",
|
|
"default_headers": {
|
|
"CustomHeader": "your-custom-header",
|
|
}
|
|
}
|
|
}
|
|
}
|
|
}
|
|
```
|
|
|
|
## Config
|
|
|
|
All available parameters for the `azure_openai` config are present in [Master List of All Params in Config](../config).
|