Use Ollama with Chatbot-Ollama to use local LLM files.

Just go

• Download and Install ollama from ollama.com or ollama.ai
• Open http://127.0.0.1:11434/ to show [ollama is running]
• Use PowerShell to use ollamaho{ab|e
  command: ollama list , to list all modelho{ab|e
  command: ollama rm modelname , to del model
• Install docker manager and use it to install chatbox-ollama
• Open http://127.0.0.1:3000/
• Use already download model files
• Create a Modelfile as your_modelname, and config LLM path like belowho{ab|e
  FROM c:\path\your_modelname.ggufho{ab|e
  SYSTEM ""
• Open powershell and goto your_modelname file of directory, run command like belowho{ab|e
  ollama create your_modelname -f ./your_modelnameho{ab|e
  ollama run your_modelname(>> /bye to exit)
• Open http://127.0.0.1:3000/zh , chat with llm