LiteLLM
LiteLLM is LLM Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format., used for AI Agents/Chatbots/RAG AI Models Unified Interface AI Writing and Creative Content Generation . LLM Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format.
Prepare
When referring to this document to use LiteLLM, please read and ensure the following points:
-
Login to Websoft9 Console and find or install LiteLLM:
- Go to My Apps listing applications
- Go to App Store installing target application
-
This application is installed by Websoft9 console.
-
The purpose of this application complies with the MIT open source license agreement.
-
Configure the domain name or server security group opens external network ports for application access.
Getting started
Initial setup
-
When completed installation of LiteLLM at Websoft9 Console, get the applicaiton's Overview and Access information from My Apps
-
Complete the install wizard step by step
Login verification
-
Completed installation LiteLLM at Websoft9 console, get the applicaiton's overview and access credentials from My Apps
-
Starting to verify it
Configuration options
- CLI
- Multilingual (√)
- SMTP (√)
Administer
- Password recover
- Change URL
- HTTPS
- Online backup
- Online upgrade