最終更新:2024-04-10 (水) 17:00:28 (19d)  

Ollama
Top / Ollama

Run Llama 2, Code Llama, and other models. Customize and create your own.

https://ollama.com/

https://github.com/ollama/ollama

Windows

  • タスクトレイに常駐する

動かし方

  • ollama run llama2

コマンド

  • ollama run?
  • ollama pull?
  • ollama list?
  • ollama show?
  • ollama create?
  • ollama rm?

GPU

help

  • Large language model runner
    
    Usage:
      ollama [flags]
      ollama [command]
    
    Available Commands:
      serve       Start ollama
      create      Create a model from a Modelfile
      show        Show information for a model
      run         Run a model
      pull        Pull a model from a registry
      push        Push a model to a registry
      list        List models
      cp          Copy a model
      rm          Remove a model
      help        Help about any command
    
    Flags:
      -h, --help      help for ollama
      -v, --version   Show version information
    
    Use "ollama [command] --help" for more information about a command.
    

Ollama/モデル

ModelParametersSizeDownload
Llama 27B3.8GBollama run llama2
Mistral?7B4.1GBollama run mistral
Dolphin Phi?2.7B1.6GBollama run dolphin-phi
Phi-2?2.7B1.7GBollama run phi
Neural Chat?7B4.1GBollama run neural-chat
Starling?7B4.1GBollama run starling-lm
Code Llama7B3.8GBollama run codellama
Llama 2 Uncensored?7B3.8GBollama run llama2-uncensored
Llama 2 13B13B7.3GBollama run llama2:13b
Llama 2 70B70B39GBollama run llama2:70b
Orca Mini?3B1.9GBollama run orca-mini
Vicuna7B3.8GBollama run vicuna
LLaVA?7B4.5GBollama run llava
Gemma2B1.4GBollama run gemma:2b
Gemma7B4.8GBollama run gemma:7b

APIサーバ

  • http://localhost:11434