Skip to main content
Version: Next

Ollama

Ollama is Open source large language models running and management platform, used for Local AI model Service and Runtime . Ollama is an open source tool that simplifies the deployment and management of machine learning models, supporting multiple model formats.

gui

Prepare​

When referring to this document to use Ollama, please read and ensure the following points:

  • Login to Websoft9 Console and find or install Ollama:

    • Go to My Apps listing applications
    • Go to App Store installing target application

  • This application is installed by Websoft9 console.

  • The purpose of this application complies with the MIT open source license agreement.

  • Configure the domain name or server security group opens external network ports for application access.

Getting started​

Initial setup​

  1. When completed installation of Ollama at Websoft9 Console, get the applicaiton's Overview and Access information from My Apps

  2. Local browser access Ollama URL and when display Ollama is running it mean deployment successfully

WebUI chat with Ollama​

You can install Web AI tools like AnythingLLM and Open WebUI at Websoft9 Console to connect Ollama for chat

Configuration options​

  • Install LLM Model: docker exec to ollama container to run command ollama run tinydolphin (tinydolphin is a small LLM　model for your reference)

Administer​

Troubleshooting​