Skip to main content
Version: Next

LiteLLM

LiteLLM is LLM Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format., used for AI Agents/Chatbots/RAG AI Models Unified Interface AI Writing and Creative Content Generation . LLM Gateway to provide model access, fallbacks and spend tracking across 100+ LLMs. All in the OpenAI format.

gui

Prepare​

When referring to this document to use LiteLLM, please read and ensure the following points:

  • Login to Websoft9 Console and find or install LiteLLM:

    • Go to My Apps listing applications
    • Go to App Store installing target application

  • This application is installed by Websoft9 console.

  • The purpose of this application complies with the MIT open source license agreement.

  • Configure the domain name or server security group opens external network ports for application access.

Getting started​

Initial setup​

  1. When completed installation of LiteLLM at Websoft9 Console, get the applicaiton's Overview and Access information from My Apps

  2. Complete the install wizard step by step

Login verification​

  1. Completed installation LiteLLM at Websoft9 console, get the applicaiton's overview and access credentials from My Apps

  2. Starting to verify it

Configuration options​

  • CLI
  • Multilingual (√)
  • SMTP (√)

Administer​

  • Password recover
  • Change URL
  • HTTPS
  • Online backup
  • Online upgrade

Troubleshooting​

502 failed code?​