use my local url and api-key #12858
Replies: 2 comments
-
|
my test url: |
Beta Was this translation helpful? Give feedback.
-
|
Having similar issues when using helm chart on EKS (which reference the url as local url. the local url looks like |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm using a local vLLM instance with multiple models, and /v1/models is working correctly. The problem is that when I set the base_url and api_key in the UI, it doesn't auto-populate the model list. It looks like it might have trouble with local URLs. Here’s my setup:
librechat.yaml
env.txt
Beta Was this translation helpful? Give feedback.
All reactions