使用ollama部署大模型

下载 ollama

download ollama

启动命令行：

ollama
Usage:
  ollama [flags]
  ollama [command]

Available Commands:
  serve       Start ollama
  create      Create a model from a Modelfile
  show        Show information for a model
  run         Run a model
  stop        Stop a running model
  pull        Pull a model from a registry
  push        Push a model to a registry
  list        List models
  ps          List running models
  cp          Copy a model
  rm          Remove a model
  help        Help about any command

Flags:
  -h, --help      help for ollama
  -v, --version   Show version information

Use "ollama [command] --help" for more information about a command.

下载模型

模型网站：https://ollama.com/search

ollama pull llama3.2
# or
ollama run llama3.2

usage

安装 web ui

需要 python 版本>=3.11

pip install open-webui

运行

open-webui serve

默认网址：http://localhost:8080

webui

comment: