Spaces:
Paused
Paused
|
Download docs/source/configuration/models/providers/aws.md from maksym-work/chat_ui: direct link, hf CLI and curl.
- Browser
- Download file 822 Bytes
-
https://huggingface.co/spaces/maksym-work/chat_ui/resolve/main/docs/source/configuration/models/providers/aws.md
- Command line
-
hf download hf://spaces/maksym-work/chat_ui/docs/source/configuration/models/providers/aws.md
-
curl -L -o aws.md https://huggingface.co/spaces/maksym-work/chat_ui/resolve/main/docs/source/configuration/models/providers/aws.md
822 Bytes
Amazon Web Services (AWS)
| Feature | Available |
|---|---|
| Tools | No |
| Multimodal | No |
You may specify your Amazon SageMaker instance as an endpoint for Chat UI:
MODELS=`[{
"name": "your-model",
"displayName": "Your Model",
"description": "Your description",
"parameters": {
"max_new_tokens": 4096
},
"endpoints": [
{
"type" : "aws",
"service" : "sagemaker"
"url": "",
"accessKey": "",
"secretKey" : "",
"sessionToken": "",
"region": "",
"weight": 1
}
]
}]`
You can also set "service": "lambda" to use a lambda instance.
You can get the accessKey and secretKey from your AWS user, under programmatic access.