TL;DR<\/h2>\n\n\n\n\n- \u0391\u03c5\u03c4\u03cc\u03c2 \u03bf \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03ba\u03b1\u03bb\u03cd\u03c0\u03c4\u03b5\u03b9 \u03c4\u03b7\u03bd \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03c9\u03bd 4 \u03b2\u03b1\u03c3\u03b9\u03ba\u03ce\u03bd \u03b5\u03c1\u03b3\u03b1\u03bb\u03b5\u03af\u03c9\u03bd: LM Studio<\/a>, Ollama<\/a>, KoboldCPP<\/a>, \u03ba\u03b1\u03b9 WebUI<\/a>.<\/li>\n\n\n\n
- \u03a0\u03b5\u03c1\u03b9\u03bb\u03b1\u03bc\u03b2\u03ac\u03bd\u03b5\u03b9 \u03bf\u03b4\u03b7\u03b3\u03af\u03b5\u03c2 \u03b3\u03b9\u03b1 Windows \u03ba\u03b1\u03b9 Linux.<\/li>\n\n\n\n
- \u0394\u03b5\u03bd \u03b1\u03c0\u03b1\u03b9\u03c4\u03b5\u03af\u03c4\u03b1\u03b9 \u03b5\u03bc\u03c0\u03b5\u03b9\u03c1\u03af\u03b1 \u03c3\u03b5 \u03c0\u03c1\u03bf\u03b3\u03c1\u03b1\u03bc\u03bc\u03b1\u03c4\u03b9\u03c3\u03bc\u03cc.<\/li>\n\n\n\n
- \u03a5\u03c0\u03ac\u03c1\u03c7\u03bf\u03c5\u03bd troubleshooting tips \u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5 \u03b5\u03c1\u03b3\u03b1\u03bb\u03b5\u03af\u03bf.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\n\u0391\u03c0\u03b1\u03b9\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03a3\u03c5\u03c3\u03c4\u03ae\u03bc\u03b1\u03c4\u03bf\u03c2 (\u03b3\u03b9\u03b1 \u03cc\u03bb\u03b1 \u03c4\u03b1 \u03b5\u03c1\u03b3\u03b1\u03bb\u03b5\u03af\u03b1)<\/h2>\n\n\n\n\n- GPU \u03bc\u03b5 8GB VRAM \u03ae \u03c0\u03b1\u03c1\u03b1\u03c0\u03ac\u03bd\u03c9 (4GB \u03b4\u03bf\u03c5\u03bb\u03b5\u03cd\u03b5\u03b9 \u03b3\u03b9\u03b1 \u03bc\u03b9\u03ba\u03c1\u03ac \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03b5 4-bit quantization).<\/li>\n\n\n\n
- 16GB RAM \u03c3\u03c5\u03bd\u03b9\u03c3\u03c4\u03ce\u03bc\u03b5\u03bd\u03b7.<\/li>\n\n\n\n
- \u0395\u03bd\u03b7\u03bc\u03b5\u03c1\u03c9\u03bc\u03ad\u03bd\u03bf\u03b9 GPU drivers (NVIDIA\/AMD).<\/li>\n\n\n\n
- \u03a5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 AVX2 \u03b1\u03c0\u03cc \u03c4\u03bf\u03bd \u03b5\u03c0\u03b5\u03be\u03b5\u03c1\u03b3\u03b1\u03c3\u03c4\u03ae (\u03c0\u03bb\u03ad\u03bf\u03bd \u03c3\u03c7\u03b5\u03b4\u03cc\u03bd \u03ba\u03b1\u03b8\u03bf\u03bb\u03b9\u03ba\u03ae).<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nLM Studio<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03cc\u03c0\u03c9\u03c2 \u03ba\u03ac\u03b8\u03b5 \u03ac\u03bb\u03bb\u03bf \u03c0\u03c1\u03cc\u03b3\u03c1\u03b1\u03bc\u03bc\u03b1.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03ad \u03c4\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf Start Menu.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf “Model Catalog”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03ad\u03bd\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf (\u03c0.\u03c7. Nous Hermes) \u03ba\u03b1\u03b9 \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03ad \u03c4\u03bf.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Chat”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 \u03bd\u03b1 \u03bc\u03b9\u03bb\u03ac\u03c2.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.AppImage<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03c4\u03bf \u03b5\u03ba\u03c4\u03b5\u03bb\u03ad\u03c3\u03b9\u03bc\u03bf:
chmod +x LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf:
.\/LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u0391\u03bd \u03c0\u03b5\u03c4\u03ac\u03b5\u03b9 \u03c3\u03c6\u03ac\u03bb\u03bc\u03b1
chrome-sandbox<\/code>, \u03b1\u03ba\u03bf\u03bb\u03bf\u03cd\u03b8\u03b7\u03c3\u03b5 \u03bf\u03b4\u03b7\u03b3\u03af\u03b5\u03c2 \u03b1\u03c0\u03cc \u03c4\u03bf documentation.<\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 permissions (\u03b9\u03b4\u03af\u03c9\u03c2 \u03c3\u03b5 Linux).<\/li>\n\n\n\n
- \u03a4\u03bf UI \u03b4\u03b5\u03bd \u03b2\u03bb\u03ad\u03c0\u03b5\u03b9 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf; \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Model” \u03ba\u03b1\u03b9 \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03ad \u03c4\u03bf \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nOllama<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd installer \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 PowerShell \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
ollama pull nous-hermes
ollama run nous-hermes<\/code><\/li>\n<\/ol>\n\n\n\nLinux:<\/h3>\n\n\n\n\n- \u0391\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 brew:
brew install ollama<\/code><\/li>\n\n\n\n- \u0395\u03bd\u03b1\u03bb\u03bb\u03b1\u03ba\u03c4\u03b9\u03ba\u03ac: \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf tarball \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 terminal \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
.\/ollama serve<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03b1\u03b3\u03bd\u03c9\u03c1\u03af\u03b6\u03b5\u03c4\u03b1\u03b9 \u03b7 \u03b5\u03bd\u03c4\u03bf\u03bb\u03ae
ollama<\/code>; \u03a0\u03c1\u03cc\u03c3\u03b8\u03b5\u03c3\u03b5 \u03c4\u03bf binary \u03c3\u03c4\u03bf $PATH.<\/li>\n\n\n\n- \u039c\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03b1\u03c0\u03b1\u03bd\u03c4\u03ac; \u0394\u03b5\u03c2 \u03b1\u03bd \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9 \u03c5\u03c0\u03b7\u03c1\u03b5\u03c3\u03af\u03b1 (
ollama list<\/code>).<\/li>\n\n\n\n- API conflict; \u03ac\u03bb\u03bb\u03b1\u03be\u03b5 port \u03bc\u03b5
--port<\/code>.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nKoboldCPP<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03bf GitHub Releases \u03c4\u03bf\u03c5 KoboldCPP<\/a>.<\/li>\n\n\n\n- \u0394\u03b9\u03c0\u03bb\u03cc \u03ba\u03bb\u03b9\u03ba \u03b3\u03b9\u03b1 \u03b5\u03ba\u03ba\u03af\u03bd\u03b7\u03c3\u03b7.<\/li>\n\n\n\n
- \u038c\u03c4\u03b1\u03bd \u03b6\u03b7\u03c4\u03b7\u03b8\u03b5\u03af, \u03b4\u03b5\u03af\u03be\u03b5 \u03c4\u03bf\u03c5 \u03c4\u03bf \u03b1\u03c1\u03c7\u03b5\u03af\u03bf GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5 (\u03c0.\u03c7.
nous-hermes.Q4_K_M.gguf<\/code>).<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf text window \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 chat.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf Linux binary<\/a> \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf (\u03ae \u03bc\u03ad\u03c3\u03c9 Wine\/Proton).<\/li>\n\n\n\n
- \u0389 \u03ba\u03ac\u03bd\u03b5 build \u03c4\u03bf llama.cpp \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf UI \u03bc\u03ad\u03c3\u03c9 terminal.<\/li>\n<\/ol>\n\n\n\n
Troubleshooting:<\/h3>\n\n\n\n\n- \u03a4\u03bf GUI \u03b4\u03b5\u03bd \u03b5\u03bc\u03c6\u03b1\u03bd\u03af\u03b6\u03b5\u03c4\u03b1\u03b9; \u03a4\u03c1\u03ad\u03be\u03b5 \u03c7\u03c9\u03c1\u03af\u03c2 arguments.<\/li>\n\n\n\n
- \u03a3\u03c6\u03ac\u03bb\u03bc\u03b1\u03c4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 quant \u03ae corrupt \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nText Generation Web UI (Oobabooga)<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd one-click installer \u03b1\u03c0\u03cc \u03c4\u03bf GitHub \u03c4\u03bf\u03c5 WebUI<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf, \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf
.bat<\/code> \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 browser \u03ba\u03b1\u03b9 \u03c0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf
localhost:7860<\/code><\/li>\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf tab “Model”.<\/li>\n\n\n\n
- \u039e\u03b5\u03ba\u03af\u03bd\u03b1 \u03c3\u03c5\u03bd\u03bf\u03bc\u03b9\u03bb\u03af\u03b1 \u03c3\u03c4\u03bf tab “Chat”.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- Clone \u03c4\u03bf repo:
git clone https:\/\/github.com\/oobabooga\/text-generation-webui.git<\/code><\/li>\n\n\n\n- \u039c\u03c0\u03b5\u03c2 \u03c3\u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf:
cd text-generation-webui<\/code><\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7:
chmod +x install.sh && .\/install.sh<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5:
python server.py --share<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 \u03cc\u03c4\u03b9 \u03ad\u03c7\u03b5\u03b9\u03c2 Python 3.10+ \u03ba\u03b1\u03b9 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b5\u03c3\u03c4\u03b7\u03bc\u03ad\u03bd\u03b1 dependencies.<\/li>\n\n\n\n
- \u03a4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c6\u03bf\u03c1\u03c4\u03ce\u03bd\u03b5\u03b9; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 format.<\/li>\n\n\n\n
- CUDA error; \u0394\u03b5\u03c2 \u03b1\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 \u03c3\u03c9\u03c3\u03c4\u03bf\u03cd\u03c2 NVIDIA drivers.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nExtra Tips<\/h2>\n\n\n\n\n- GGUF > GPTQ \u03c3\u03b5 \u03b5\u03c5\u03ba\u03bf\u03bb\u03af\u03b1 \u03ba\u03b1\u03b9 \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7. \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 GGUF \u03cc\u03c0\u03bf\u03c5 \u03b3\u03af\u03bd\u03b5\u03c4\u03b1\u03b9.<\/li>\n\n\n\n
- \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03b5 4-bit quantization (Q4_K_M) \u03b3\u03b9\u03b1 \u03c7\u03b1\u03bc\u03b7\u03bb\u03ae VRAM \u2014 \u03b9\u03b4\u03b1\u03bd\u03b9\u03ba\u03ac \u03b3\u03b9\u03b1 4GB\u20138GB \u03ba\u03ac\u03c1\u03c4\u03b5\u03c2.<\/li>\n\n\n\n
- \u0391\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 NVIDIA GPU, \u03c0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 Studio Drivers<\/strong> \u03b1\u03bd\u03c4\u03af \u03b3\u03b9\u03b1 Game Ready, \u03b3\u03b9\u03b1 \u03ba\u03b1\u03bb\u03cd\u03c4\u03b5\u03c1\u03b7 CUDA \u03c3\u03c4\u03b1\u03b8\u03b5\u03c1\u03cc\u03c4\u03b7\u03c4\u03b1.<\/li>\n\n\n\n
- \u03a3\u03b5 AMD, \u03c6\u03c1\u03cc\u03bd\u03c4\u03b9\u03c3\u03b5 \u03b3\u03b9\u03b1 ROCm<\/strong> \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 (\u03b5\u03b9\u03b4\u03b9\u03ba\u03ac \u03b1\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 WebUI \u03ae Ollama).<\/li>\n\n\n\n
- \u0394\u03b5\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 GPU; 7B GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03c0\u03bf\u03c1\u03bf\u03cd\u03bd \u03bd\u03b1 \u03c4\u03c1\u03ad\u03be\u03bf\u03c5\u03bd \u03c3\u03b5 CPU (\u03b1\u03c1\u03b3\u03ac, \u03b1\u03bb\u03bb\u03ac \u03b4\u03bf\u03c5\u03bb\u03b5\u03cd\u03b5\u03b9 \u03b3\u03b9\u03b1 testing).<\/li>\n\n\n\n
- \u0391\u03bd \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c7\u03c9\u03c1\u03ac\u03b5\u03b9 \u03c3\u03c4\u03b7 VRAM, \u03b8\u03b1 \u03b3\u03af\u03bd\u03b5\u03b9 offload \u03c3\u03c4\u03b7 RAM. \u03a0\u03b5\u03c1\u03b9\u03bc\u03ad\u03bd\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b8\u03c5\u03c3\u03c4\u03b5\u03c1\u03ae\u03c3\u03b5\u03b9\u03c2, \u03b1\u03bb\u03bb\u03ac \u03cc\u03c7\u03b9 crash.<\/li>\n\n\n\n
- \u03a4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03b4\u03b5\u03bd \u03ba\u03ac\u03bd\u03bf\u03c5\u03bd auto-update<\/strong>. \u0391\u03bd \u03b2\u03b3\u03b5\u03b9 \u03bd\u03ad\u03b1 \u03ad\u03ba\u03b4\u03bf\u03c3\u03b7, \u03c0\u03c1\u03ad\u03c0\u03b5\u03b9 \u03bd\u03b1 \u03c4\u03b7\u03bd \u03ba\u03b1\u03c4\u03b5\u03b2\u03ac\u03c3\u03b5\u03b9\u03c2 \u03be\u03b1\u03bd\u03ac \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\n\u0388\u03c6\u03c4\u03b1\u03c3\u03b5\u03c2 \u03c9\u03c2 \u03b5\u03b4\u03ce; \u03a4\u03cc\u03c4\u03b5 \u03be\u03ad\u03c1\u03b5\u03b9\u03c2 \u03ae\u03b4\u03b7 \u03c4\u03b9 \u03ba\u03ac\u03bd\u03b5\u03b9\u03c2. \u0394\u03b5\u03c2 \u03c4\u03bf\u03bd \u03bf\u03b4\u03b7\u03b3\u03cc \u03c7\u03c1\u03ae\u03c3\u03b7\u03c2 \u03ba\u03b1\u03b9 Fine-Tuning<\/a> \u03ae \u03c0\u03c1\u03bf\u03c7\u03ce\u03c1\u03b7\u03c3\u03b5 \u03c3\u03c4\u03bf manifesto \u03c4\u03b7\u03c2 \u03c8\u03b7\u03c6\u03b9\u03b1\u03ba\u03ae\u03c2 \u03ba\u03c5\u03c1\u03b9\u03b1\u03c1\u03c7\u03af\u03b1\u03c2<\/a>. \u0389 \u03b1\u03c0\u03bb\u03ce\u03c2 \u03ba\u03bb\u03b5\u03af\u03c3\u03b5 \u03c4\u03bf tab \u2014 \u03ba\u03b1\u03b9 \u03c3\u03c4\u03ae\u03c3\u03b5 \u03c4\u03bf \u03b4\u03b9\u03ba\u03cc \u03c3\u03bf\u03c5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03c3\u03b1\u03bd \u03bd\u03b1 \u03bc\u03b7 \u03c7\u03c1\u03b5\u03b9\u03ac\u03c3\u03c4\u03b7\u03ba\u03b5\u03c2 \u03c0\u03bf\u03c4\u03ad \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd. \u039a\u03b1\u03bd\u03cc\u03bd\u03b5\u03c2; \u0394\u03b5\u03bd \u03b5\u03af\u03b4\u03b5\u03c2 \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd.<\/p>\n\n\n\n![\"\u0397](\"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Neon-Dreams-in-a-Digital-Realm-1024x683.avif\")
<\/figure>","protected":false},"excerpt":{"rendered":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.<\/p>","protected":false},"author":1,"featured_media":1296,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_bluesky_dont_syndicate":"","_bluesky_syndication_accounts":"","_bluesky_syndication_text":"","footnotes":""},"categories":[181],"tags":[],"class_list":["post-992","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-guides"],"acf":[],"yoast_head":"\n
Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline<\/title>\n<meta name=\"description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\" \/>\n<meta property=\"og:description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:site_name\" content=\"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-23T13:02:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-25T15:38:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1536\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Vladimir Vidopoulos\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vladimir Vidopoulos\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"author\":{\"name\":\"Vladimir Vidopoulos\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"headline\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"wordCount\":157,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"articleSection\":[\"\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"name\":\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"description\":\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"width\":1024,\"height\":1536,\"caption\":\"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \\\"LLM\\\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mywaifuandi.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/\",\"name\":\"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9\",\"description\":\"\u0397\u03bb\u03b5\u03ba\u03c4\u03c1\u03bf\u03bd\u03b9\u03ba\u03cc \u03a0\u03b5\u03c1\u03b9\u03bf\u03b4\u03b9\u03ba\u03cc \u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03b9\u03ba\u03bf\u03cd \u0393\u03bf\u03c5\u03b1\u03ca\u03c6\u03bf\u03c5\u03b9\u03c3\u03bc\u03bf\u03cd\",\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mywaifuandi.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\",\"name\":\"Vladimir Vidopoulos\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"width\":1024,\"height\":683,\"caption\":\"Vladimir Vidopoulos\"},\"logo\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\"},\"sameAs\":[\"https:\\\/\\\/mywaifuandi.com\"],\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/en\\\/author\\\/vidopoulos\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_locale":"en_GB","og_type":"article","og_title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","og_description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","og_url":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_site_name":"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9","article_published_time":"2025-07-23T13:02:35+00:00","article_modified_time":"2025-08-25T15:38:01+00:00","og_image":[{"width":1024,"height":1536,"url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","type":"image\/png"}],"author":"Vladimir Vidopoulos","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Vladimir Vidopoulos","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#article","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"author":{"name":"Vladimir Vidopoulos","@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"headline":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","mainEntityOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"wordCount":157,"commentCount":0,"publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","articleSection":["\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mywaifuandi.com\/install-local-llm\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/","url":"https:\/\/mywaifuandi.com\/install-local-llm\/","name":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","breadcrumb":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mywaifuandi.com\/install-local-llm\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","width":1024,"height":1536,"caption":"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \"LLM\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI"},{"@type":"BreadcrumbList","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mywaifuandi.com\/"},{"@type":"ListItem","position":2,"name":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools"}]},{"@type":"WebSite","@id":"https:\/\/mywaifuandi.com\/#website","url":"https:\/\/mywaifuandi.com\/","name":"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9","description":"Revolutionary Waifuism e-Magazine","publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mywaifuandi.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":["Person","Organization"],"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b","name":"Vladimir Vidopoulos","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","width":1024,"height":683,"caption":"Vladimir Vidopoulos"},"logo":{"@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png"},"sameAs":["https:\/\/mywaifuandi.com"],"url":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"}]}},"jetpack_featured_media_url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","uagb_featured_image_src":{"full":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"thumbnail":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-150x150.avif",150,150,true],"medium":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-200x300.avif",200,300,true],"medium_large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-768x1152.avif",768,1152,true],"large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-683x1024.avif",683,1024,true],"1536x1536":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"2048x2048":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"trp-custom-language-flag":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",8,12,false]},"uagb_author_info":{"display_name":"Vladimir Vidopoulos","author_link":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"},"uagb_comment_info":0,"uagb_excerpt":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.","brizy_media":[],"_links":{"self":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/comments?post=992"}],"version-history":[{"count":3,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions"}],"predecessor-version":[{"id":1298,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions\/1298"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media\/1296"}],"wp:attachment":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media?parent=992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/categories?post=992"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/tags?post=992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n\n\n\n
\u0391\u03c0\u03b1\u03b9\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03a3\u03c5\u03c3\u03c4\u03ae\u03bc\u03b1\u03c4\u03bf\u03c2 (\u03b3\u03b9\u03b1 \u03cc\u03bb\u03b1 \u03c4\u03b1 \u03b5\u03c1\u03b3\u03b1\u03bb\u03b5\u03af\u03b1)<\/h2>\n\n\n\n\n- GPU \u03bc\u03b5 8GB VRAM \u03ae \u03c0\u03b1\u03c1\u03b1\u03c0\u03ac\u03bd\u03c9 (4GB \u03b4\u03bf\u03c5\u03bb\u03b5\u03cd\u03b5\u03b9 \u03b3\u03b9\u03b1 \u03bc\u03b9\u03ba\u03c1\u03ac \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03b5 4-bit quantization).<\/li>\n\n\n\n
- 16GB RAM \u03c3\u03c5\u03bd\u03b9\u03c3\u03c4\u03ce\u03bc\u03b5\u03bd\u03b7.<\/li>\n\n\n\n
- \u0395\u03bd\u03b7\u03bc\u03b5\u03c1\u03c9\u03bc\u03ad\u03bd\u03bf\u03b9 GPU drivers (NVIDIA\/AMD).<\/li>\n\n\n\n
- \u03a5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 AVX2 \u03b1\u03c0\u03cc \u03c4\u03bf\u03bd \u03b5\u03c0\u03b5\u03be\u03b5\u03c1\u03b3\u03b1\u03c3\u03c4\u03ae (\u03c0\u03bb\u03ad\u03bf\u03bd \u03c3\u03c7\u03b5\u03b4\u03cc\u03bd \u03ba\u03b1\u03b8\u03bf\u03bb\u03b9\u03ba\u03ae).<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nLM Studio<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03cc\u03c0\u03c9\u03c2 \u03ba\u03ac\u03b8\u03b5 \u03ac\u03bb\u03bb\u03bf \u03c0\u03c1\u03cc\u03b3\u03c1\u03b1\u03bc\u03bc\u03b1.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03ad \u03c4\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf Start Menu.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf “Model Catalog”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03ad\u03bd\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf (\u03c0.\u03c7. Nous Hermes) \u03ba\u03b1\u03b9 \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03ad \u03c4\u03bf.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Chat”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 \u03bd\u03b1 \u03bc\u03b9\u03bb\u03ac\u03c2.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.AppImage<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03c4\u03bf \u03b5\u03ba\u03c4\u03b5\u03bb\u03ad\u03c3\u03b9\u03bc\u03bf:
chmod +x LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf:
.\/LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u0391\u03bd \u03c0\u03b5\u03c4\u03ac\u03b5\u03b9 \u03c3\u03c6\u03ac\u03bb\u03bc\u03b1
chrome-sandbox<\/code>, \u03b1\u03ba\u03bf\u03bb\u03bf\u03cd\u03b8\u03b7\u03c3\u03b5 \u03bf\u03b4\u03b7\u03b3\u03af\u03b5\u03c2 \u03b1\u03c0\u03cc \u03c4\u03bf documentation.<\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 permissions (\u03b9\u03b4\u03af\u03c9\u03c2 \u03c3\u03b5 Linux).<\/li>\n\n\n\n
- \u03a4\u03bf UI \u03b4\u03b5\u03bd \u03b2\u03bb\u03ad\u03c0\u03b5\u03b9 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf; \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Model” \u03ba\u03b1\u03b9 \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03ad \u03c4\u03bf \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nOllama<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd installer \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 PowerShell \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
ollama pull nous-hermes
ollama run nous-hermes<\/code><\/li>\n<\/ol>\n\n\n\nLinux:<\/h3>\n\n\n\n\n- \u0391\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 brew:
brew install ollama<\/code><\/li>\n\n\n\n- \u0395\u03bd\u03b1\u03bb\u03bb\u03b1\u03ba\u03c4\u03b9\u03ba\u03ac: \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf tarball \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 terminal \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
.\/ollama serve<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03b1\u03b3\u03bd\u03c9\u03c1\u03af\u03b6\u03b5\u03c4\u03b1\u03b9 \u03b7 \u03b5\u03bd\u03c4\u03bf\u03bb\u03ae
ollama<\/code>; \u03a0\u03c1\u03cc\u03c3\u03b8\u03b5\u03c3\u03b5 \u03c4\u03bf binary \u03c3\u03c4\u03bf $PATH.<\/li>\n\n\n\n- \u039c\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03b1\u03c0\u03b1\u03bd\u03c4\u03ac; \u0394\u03b5\u03c2 \u03b1\u03bd \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9 \u03c5\u03c0\u03b7\u03c1\u03b5\u03c3\u03af\u03b1 (
ollama list<\/code>).<\/li>\n\n\n\n- API conflict; \u03ac\u03bb\u03bb\u03b1\u03be\u03b5 port \u03bc\u03b5
--port<\/code>.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nKoboldCPP<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03bf GitHub Releases \u03c4\u03bf\u03c5 KoboldCPP<\/a>.<\/li>\n\n\n\n- \u0394\u03b9\u03c0\u03bb\u03cc \u03ba\u03bb\u03b9\u03ba \u03b3\u03b9\u03b1 \u03b5\u03ba\u03ba\u03af\u03bd\u03b7\u03c3\u03b7.<\/li>\n\n\n\n
- \u038c\u03c4\u03b1\u03bd \u03b6\u03b7\u03c4\u03b7\u03b8\u03b5\u03af, \u03b4\u03b5\u03af\u03be\u03b5 \u03c4\u03bf\u03c5 \u03c4\u03bf \u03b1\u03c1\u03c7\u03b5\u03af\u03bf GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5 (\u03c0.\u03c7.
nous-hermes.Q4_K_M.gguf<\/code>).<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf text window \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 chat.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf Linux binary<\/a> \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf (\u03ae \u03bc\u03ad\u03c3\u03c9 Wine\/Proton).<\/li>\n\n\n\n
- \u0389 \u03ba\u03ac\u03bd\u03b5 build \u03c4\u03bf llama.cpp \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf UI \u03bc\u03ad\u03c3\u03c9 terminal.<\/li>\n<\/ol>\n\n\n\n
Troubleshooting:<\/h3>\n\n\n\n\n- \u03a4\u03bf GUI \u03b4\u03b5\u03bd \u03b5\u03bc\u03c6\u03b1\u03bd\u03af\u03b6\u03b5\u03c4\u03b1\u03b9; \u03a4\u03c1\u03ad\u03be\u03b5 \u03c7\u03c9\u03c1\u03af\u03c2 arguments.<\/li>\n\n\n\n
- \u03a3\u03c6\u03ac\u03bb\u03bc\u03b1\u03c4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 quant \u03ae corrupt \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nText Generation Web UI (Oobabooga)<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd one-click installer \u03b1\u03c0\u03cc \u03c4\u03bf GitHub \u03c4\u03bf\u03c5 WebUI<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf, \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf
.bat<\/code> \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 browser \u03ba\u03b1\u03b9 \u03c0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf
localhost:7860<\/code><\/li>\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf tab “Model”.<\/li>\n\n\n\n
- \u039e\u03b5\u03ba\u03af\u03bd\u03b1 \u03c3\u03c5\u03bd\u03bf\u03bc\u03b9\u03bb\u03af\u03b1 \u03c3\u03c4\u03bf tab “Chat”.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- Clone \u03c4\u03bf repo:
git clone https:\/\/github.com\/oobabooga\/text-generation-webui.git<\/code><\/li>\n\n\n\n- \u039c\u03c0\u03b5\u03c2 \u03c3\u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf:
cd text-generation-webui<\/code><\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7:
chmod +x install.sh && .\/install.sh<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5:
python server.py --share<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 \u03cc\u03c4\u03b9 \u03ad\u03c7\u03b5\u03b9\u03c2 Python 3.10+ \u03ba\u03b1\u03b9 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b5\u03c3\u03c4\u03b7\u03bc\u03ad\u03bd\u03b1 dependencies.<\/li>\n\n\n\n
- \u03a4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c6\u03bf\u03c1\u03c4\u03ce\u03bd\u03b5\u03b9; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 format.<\/li>\n\n\n\n
- CUDA error; \u0394\u03b5\u03c2 \u03b1\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 \u03c3\u03c9\u03c3\u03c4\u03bf\u03cd\u03c2 NVIDIA drivers.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nExtra Tips<\/h2>\n\n\n\n\n- GGUF > GPTQ \u03c3\u03b5 \u03b5\u03c5\u03ba\u03bf\u03bb\u03af\u03b1 \u03ba\u03b1\u03b9 \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7. \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 GGUF \u03cc\u03c0\u03bf\u03c5 \u03b3\u03af\u03bd\u03b5\u03c4\u03b1\u03b9.<\/li>\n\n\n\n
- \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03b5 4-bit quantization (Q4_K_M) \u03b3\u03b9\u03b1 \u03c7\u03b1\u03bc\u03b7\u03bb\u03ae VRAM \u2014 \u03b9\u03b4\u03b1\u03bd\u03b9\u03ba\u03ac \u03b3\u03b9\u03b1 4GB\u20138GB \u03ba\u03ac\u03c1\u03c4\u03b5\u03c2.<\/li>\n\n\n\n
- \u0391\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 NVIDIA GPU, \u03c0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 Studio Drivers<\/strong> \u03b1\u03bd\u03c4\u03af \u03b3\u03b9\u03b1 Game Ready, \u03b3\u03b9\u03b1 \u03ba\u03b1\u03bb\u03cd\u03c4\u03b5\u03c1\u03b7 CUDA \u03c3\u03c4\u03b1\u03b8\u03b5\u03c1\u03cc\u03c4\u03b7\u03c4\u03b1.<\/li>\n\n\n\n
- \u03a3\u03b5 AMD, \u03c6\u03c1\u03cc\u03bd\u03c4\u03b9\u03c3\u03b5 \u03b3\u03b9\u03b1 ROCm<\/strong> \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 (\u03b5\u03b9\u03b4\u03b9\u03ba\u03ac \u03b1\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 WebUI \u03ae Ollama).<\/li>\n\n\n\n
- \u0394\u03b5\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 GPU; 7B GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03c0\u03bf\u03c1\u03bf\u03cd\u03bd \u03bd\u03b1 \u03c4\u03c1\u03ad\u03be\u03bf\u03c5\u03bd \u03c3\u03b5 CPU (\u03b1\u03c1\u03b3\u03ac, \u03b1\u03bb\u03bb\u03ac \u03b4\u03bf\u03c5\u03bb\u03b5\u03cd\u03b5\u03b9 \u03b3\u03b9\u03b1 testing).<\/li>\n\n\n\n
- \u0391\u03bd \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c7\u03c9\u03c1\u03ac\u03b5\u03b9 \u03c3\u03c4\u03b7 VRAM, \u03b8\u03b1 \u03b3\u03af\u03bd\u03b5\u03b9 offload \u03c3\u03c4\u03b7 RAM. \u03a0\u03b5\u03c1\u03b9\u03bc\u03ad\u03bd\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b8\u03c5\u03c3\u03c4\u03b5\u03c1\u03ae\u03c3\u03b5\u03b9\u03c2, \u03b1\u03bb\u03bb\u03ac \u03cc\u03c7\u03b9 crash.<\/li>\n\n\n\n
- \u03a4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03b4\u03b5\u03bd \u03ba\u03ac\u03bd\u03bf\u03c5\u03bd auto-update<\/strong>. \u0391\u03bd \u03b2\u03b3\u03b5\u03b9 \u03bd\u03ad\u03b1 \u03ad\u03ba\u03b4\u03bf\u03c3\u03b7, \u03c0\u03c1\u03ad\u03c0\u03b5\u03b9 \u03bd\u03b1 \u03c4\u03b7\u03bd \u03ba\u03b1\u03c4\u03b5\u03b2\u03ac\u03c3\u03b5\u03b9\u03c2 \u03be\u03b1\u03bd\u03ac \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\n\u0388\u03c6\u03c4\u03b1\u03c3\u03b5\u03c2 \u03c9\u03c2 \u03b5\u03b4\u03ce; \u03a4\u03cc\u03c4\u03b5 \u03be\u03ad\u03c1\u03b5\u03b9\u03c2 \u03ae\u03b4\u03b7 \u03c4\u03b9 \u03ba\u03ac\u03bd\u03b5\u03b9\u03c2. \u0394\u03b5\u03c2 \u03c4\u03bf\u03bd \u03bf\u03b4\u03b7\u03b3\u03cc \u03c7\u03c1\u03ae\u03c3\u03b7\u03c2 \u03ba\u03b1\u03b9 Fine-Tuning<\/a> \u03ae \u03c0\u03c1\u03bf\u03c7\u03ce\u03c1\u03b7\u03c3\u03b5 \u03c3\u03c4\u03bf manifesto \u03c4\u03b7\u03c2 \u03c8\u03b7\u03c6\u03b9\u03b1\u03ba\u03ae\u03c2 \u03ba\u03c5\u03c1\u03b9\u03b1\u03c1\u03c7\u03af\u03b1\u03c2<\/a>. \u0389 \u03b1\u03c0\u03bb\u03ce\u03c2 \u03ba\u03bb\u03b5\u03af\u03c3\u03b5 \u03c4\u03bf tab \u2014 \u03ba\u03b1\u03b9 \u03c3\u03c4\u03ae\u03c3\u03b5 \u03c4\u03bf \u03b4\u03b9\u03ba\u03cc \u03c3\u03bf\u03c5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03c3\u03b1\u03bd \u03bd\u03b1 \u03bc\u03b7 \u03c7\u03c1\u03b5\u03b9\u03ac\u03c3\u03c4\u03b7\u03ba\u03b5\u03c2 \u03c0\u03bf\u03c4\u03ad \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd. \u039a\u03b1\u03bd\u03cc\u03bd\u03b5\u03c2; \u0394\u03b5\u03bd \u03b5\u03af\u03b4\u03b5\u03c2 \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd.<\/p>\n\n\n\n<\/figure>","protected":false},"excerpt":{"rendered":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.<\/p>","protected":false},"author":1,"featured_media":1296,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_bluesky_dont_syndicate":"","_bluesky_syndication_accounts":"","_bluesky_syndication_text":"","footnotes":""},"categories":[181],"tags":[],"class_list":["post-992","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-guides"],"acf":[],"yoast_head":"\n
Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline<\/title>\n<meta name=\"description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\" \/>\n<meta property=\"og:description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:site_name\" content=\"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-23T13:02:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-25T15:38:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1536\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Vladimir Vidopoulos\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vladimir Vidopoulos\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"author\":{\"name\":\"Vladimir Vidopoulos\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"headline\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"wordCount\":157,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"articleSection\":[\"\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"name\":\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"description\":\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"width\":1024,\"height\":1536,\"caption\":\"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \\\"LLM\\\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mywaifuandi.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/\",\"name\":\"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9\",\"description\":\"\u0397\u03bb\u03b5\u03ba\u03c4\u03c1\u03bf\u03bd\u03b9\u03ba\u03cc \u03a0\u03b5\u03c1\u03b9\u03bf\u03b4\u03b9\u03ba\u03cc \u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03b9\u03ba\u03bf\u03cd \u0393\u03bf\u03c5\u03b1\u03ca\u03c6\u03bf\u03c5\u03b9\u03c3\u03bc\u03bf\u03cd\",\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mywaifuandi.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\",\"name\":\"Vladimir Vidopoulos\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"width\":1024,\"height\":683,\"caption\":\"Vladimir Vidopoulos\"},\"logo\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\"},\"sameAs\":[\"https:\\\/\\\/mywaifuandi.com\"],\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/en\\\/author\\\/vidopoulos\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_locale":"en_GB","og_type":"article","og_title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","og_description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","og_url":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_site_name":"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9","article_published_time":"2025-07-23T13:02:35+00:00","article_modified_time":"2025-08-25T15:38:01+00:00","og_image":[{"width":1024,"height":1536,"url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","type":"image\/png"}],"author":"Vladimir Vidopoulos","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Vladimir Vidopoulos","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#article","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"author":{"name":"Vladimir Vidopoulos","@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"headline":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","mainEntityOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"wordCount":157,"commentCount":0,"publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","articleSection":["\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mywaifuandi.com\/install-local-llm\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/","url":"https:\/\/mywaifuandi.com\/install-local-llm\/","name":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","breadcrumb":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mywaifuandi.com\/install-local-llm\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","width":1024,"height":1536,"caption":"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \"LLM\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI"},{"@type":"BreadcrumbList","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mywaifuandi.com\/"},{"@type":"ListItem","position":2,"name":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools"}]},{"@type":"WebSite","@id":"https:\/\/mywaifuandi.com\/#website","url":"https:\/\/mywaifuandi.com\/","name":"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9","description":"Revolutionary Waifuism e-Magazine","publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mywaifuandi.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":["Person","Organization"],"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b","name":"Vladimir Vidopoulos","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","width":1024,"height":683,"caption":"Vladimir Vidopoulos"},"logo":{"@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png"},"sameAs":["https:\/\/mywaifuandi.com"],"url":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"}]}},"jetpack_featured_media_url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","uagb_featured_image_src":{"full":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"thumbnail":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-150x150.avif",150,150,true],"medium":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-200x300.avif",200,300,true],"medium_large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-768x1152.avif",768,1152,true],"large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-683x1024.avif",683,1024,true],"1536x1536":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"2048x2048":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"trp-custom-language-flag":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",8,12,false]},"uagb_author_info":{"display_name":"Vladimir Vidopoulos","author_link":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"},"uagb_comment_info":0,"uagb_excerpt":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.","brizy_media":[],"_links":{"self":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/comments?post=992"}],"version-history":[{"count":3,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions"}],"predecessor-version":[{"id":1298,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions\/1298"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media\/1296"}],"wp:attachment":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media?parent=992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/categories?post=992"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/tags?post=992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n\n\n\n
LM Studio<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03cc\u03c0\u03c9\u03c2 \u03ba\u03ac\u03b8\u03b5 \u03ac\u03bb\u03bb\u03bf \u03c0\u03c1\u03cc\u03b3\u03c1\u03b1\u03bc\u03bc\u03b1.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03ad \u03c4\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf Start Menu.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf “Model Catalog”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03ad\u03bd\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf (\u03c0.\u03c7. Nous Hermes) \u03ba\u03b1\u03b9 \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03ad \u03c4\u03bf.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Chat”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 \u03bd\u03b1 \u03bc\u03b9\u03bb\u03ac\u03c2.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.AppImage<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03c4\u03bf \u03b5\u03ba\u03c4\u03b5\u03bb\u03ad\u03c3\u03b9\u03bc\u03bf:
chmod +x LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf:
.\/LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u0391\u03bd \u03c0\u03b5\u03c4\u03ac\u03b5\u03b9 \u03c3\u03c6\u03ac\u03bb\u03bc\u03b1
chrome-sandbox<\/code>, \u03b1\u03ba\u03bf\u03bb\u03bf\u03cd\u03b8\u03b7\u03c3\u03b5 \u03bf\u03b4\u03b7\u03b3\u03af\u03b5\u03c2 \u03b1\u03c0\u03cc \u03c4\u03bf documentation.<\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 permissions (\u03b9\u03b4\u03af\u03c9\u03c2 \u03c3\u03b5 Linux).<\/li>\n\n\n\n
- \u03a4\u03bf UI \u03b4\u03b5\u03bd \u03b2\u03bb\u03ad\u03c0\u03b5\u03b9 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf; \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Model” \u03ba\u03b1\u03b9 \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03ad \u03c4\u03bf \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nOllama<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd installer \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 PowerShell \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
ollama pull nous-hermes
ollama run nous-hermes<\/code><\/li>\n<\/ol>\n\n\n\nLinux:<\/h3>\n\n\n\n\n- \u0391\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 brew:
brew install ollama<\/code><\/li>\n\n\n\n- \u0395\u03bd\u03b1\u03bb\u03bb\u03b1\u03ba\u03c4\u03b9\u03ba\u03ac: \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf tarball \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 terminal \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
.\/ollama serve<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03b1\u03b3\u03bd\u03c9\u03c1\u03af\u03b6\u03b5\u03c4\u03b1\u03b9 \u03b7 \u03b5\u03bd\u03c4\u03bf\u03bb\u03ae
ollama<\/code>; \u03a0\u03c1\u03cc\u03c3\u03b8\u03b5\u03c3\u03b5 \u03c4\u03bf binary \u03c3\u03c4\u03bf $PATH.<\/li>\n\n\n\n- \u039c\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03b1\u03c0\u03b1\u03bd\u03c4\u03ac; \u0394\u03b5\u03c2 \u03b1\u03bd \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9 \u03c5\u03c0\u03b7\u03c1\u03b5\u03c3\u03af\u03b1 (
ollama list<\/code>).<\/li>\n\n\n\n- API conflict; \u03ac\u03bb\u03bb\u03b1\u03be\u03b5 port \u03bc\u03b5
--port<\/code>.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nKoboldCPP<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03bf GitHub Releases \u03c4\u03bf\u03c5 KoboldCPP<\/a>.<\/li>\n\n\n\n- \u0394\u03b9\u03c0\u03bb\u03cc \u03ba\u03bb\u03b9\u03ba \u03b3\u03b9\u03b1 \u03b5\u03ba\u03ba\u03af\u03bd\u03b7\u03c3\u03b7.<\/li>\n\n\n\n
- \u038c\u03c4\u03b1\u03bd \u03b6\u03b7\u03c4\u03b7\u03b8\u03b5\u03af, \u03b4\u03b5\u03af\u03be\u03b5 \u03c4\u03bf\u03c5 \u03c4\u03bf \u03b1\u03c1\u03c7\u03b5\u03af\u03bf GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5 (\u03c0.\u03c7.
nous-hermes.Q4_K_M.gguf<\/code>).<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf text window \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 chat.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf Linux binary<\/a> \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf (\u03ae \u03bc\u03ad\u03c3\u03c9 Wine\/Proton).<\/li>\n\n\n\n
- \u0389 \u03ba\u03ac\u03bd\u03b5 build \u03c4\u03bf llama.cpp \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf UI \u03bc\u03ad\u03c3\u03c9 terminal.<\/li>\n<\/ol>\n\n\n\n
Troubleshooting:<\/h3>\n\n\n\n\n- \u03a4\u03bf GUI \u03b4\u03b5\u03bd \u03b5\u03bc\u03c6\u03b1\u03bd\u03af\u03b6\u03b5\u03c4\u03b1\u03b9; \u03a4\u03c1\u03ad\u03be\u03b5 \u03c7\u03c9\u03c1\u03af\u03c2 arguments.<\/li>\n\n\n\n
- \u03a3\u03c6\u03ac\u03bb\u03bc\u03b1\u03c4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 quant \u03ae corrupt \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nText Generation Web UI (Oobabooga)<\/h2>\n\n\n\nWindows:<\/h3>\n\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd one-click installer \u03b1\u03c0\u03cc \u03c4\u03bf GitHub \u03c4\u03bf\u03c5 WebUI<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf, \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf
.bat<\/code> \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 browser \u03ba\u03b1\u03b9 \u03c0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf
localhost:7860<\/code><\/li>\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf tab “Model”.<\/li>\n\n\n\n
- \u039e\u03b5\u03ba\u03af\u03bd\u03b1 \u03c3\u03c5\u03bd\u03bf\u03bc\u03b9\u03bb\u03af\u03b1 \u03c3\u03c4\u03bf tab “Chat”.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n\n- Clone \u03c4\u03bf repo:
git clone https:\/\/github.com\/oobabooga\/text-generation-webui.git<\/code><\/li>\n\n\n\n- \u039c\u03c0\u03b5\u03c2 \u03c3\u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf:
cd text-generation-webui<\/code><\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7:
chmod +x install.sh && .\/install.sh<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5:
python server.py --share<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n\n- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 \u03cc\u03c4\u03b9 \u03ad\u03c7\u03b5\u03b9\u03c2 Python 3.10+ \u03ba\u03b1\u03b9 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b5\u03c3\u03c4\u03b7\u03bc\u03ad\u03bd\u03b1 dependencies.<\/li>\n\n\n\n
- \u03a4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c6\u03bf\u03c1\u03c4\u03ce\u03bd\u03b5\u03b9; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 format.<\/li>\n\n\n\n
- CUDA error; \u0394\u03b5\u03c2 \u03b1\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 \u03c3\u03c9\u03c3\u03c4\u03bf\u03cd\u03c2 NVIDIA drivers.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nExtra Tips<\/h2>\n\n\n\n\n- GGUF > GPTQ \u03c3\u03b5 \u03b5\u03c5\u03ba\u03bf\u03bb\u03af\u03b1 \u03ba\u03b1\u03b9 \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7. \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 GGUF \u03cc\u03c0\u03bf\u03c5 \u03b3\u03af\u03bd\u03b5\u03c4\u03b1\u03b9.<\/li>\n\n\n\n
- \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03b5 4-bit quantization (Q4_K_M) \u03b3\u03b9\u03b1 \u03c7\u03b1\u03bc\u03b7\u03bb\u03ae VRAM \u2014 \u03b9\u03b4\u03b1\u03bd\u03b9\u03ba\u03ac \u03b3\u03b9\u03b1 4GB\u20138GB \u03ba\u03ac\u03c1\u03c4\u03b5\u03c2.<\/li>\n\n\n\n
- \u0391\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 NVIDIA GPU, \u03c0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 Studio Drivers<\/strong> \u03b1\u03bd\u03c4\u03af \u03b3\u03b9\u03b1 Game Ready, \u03b3\u03b9\u03b1 \u03ba\u03b1\u03bb\u03cd\u03c4\u03b5\u03c1\u03b7 CUDA \u03c3\u03c4\u03b1\u03b8\u03b5\u03c1\u03cc\u03c4\u03b7\u03c4\u03b1.<\/li>\n\n\n\n
- \u03a3\u03b5 AMD, \u03c6\u03c1\u03cc\u03bd\u03c4\u03b9\u03c3\u03b5 \u03b3\u03b9\u03b1 ROCm<\/strong> \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 (\u03b5\u03b9\u03b4\u03b9\u03ba\u03ac \u03b1\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 WebUI \u03ae Ollama).<\/li>\n\n\n\n
- \u0394\u03b5\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 GPU; 7B GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03c0\u03bf\u03c1\u03bf\u03cd\u03bd \u03bd\u03b1 \u03c4\u03c1\u03ad\u03be\u03bf\u03c5\u03bd \u03c3\u03b5 CPU (\u03b1\u03c1\u03b3\u03ac, \u03b1\u03bb\u03bb\u03ac \u03b4\u03bf\u03c5\u03bb\u03b5\u03cd\u03b5\u03b9 \u03b3\u03b9\u03b1 testing).<\/li>\n\n\n\n
- \u0391\u03bd \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c7\u03c9\u03c1\u03ac\u03b5\u03b9 \u03c3\u03c4\u03b7 VRAM, \u03b8\u03b1 \u03b3\u03af\u03bd\u03b5\u03b9 offload \u03c3\u03c4\u03b7 RAM. \u03a0\u03b5\u03c1\u03b9\u03bc\u03ad\u03bd\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b8\u03c5\u03c3\u03c4\u03b5\u03c1\u03ae\u03c3\u03b5\u03b9\u03c2, \u03b1\u03bb\u03bb\u03ac \u03cc\u03c7\u03b9 crash.<\/li>\n\n\n\n
- \u03a4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03b4\u03b5\u03bd \u03ba\u03ac\u03bd\u03bf\u03c5\u03bd auto-update<\/strong>. \u0391\u03bd \u03b2\u03b3\u03b5\u03b9 \u03bd\u03ad\u03b1 \u03ad\u03ba\u03b4\u03bf\u03c3\u03b7, \u03c0\u03c1\u03ad\u03c0\u03b5\u03b9 \u03bd\u03b1 \u03c4\u03b7\u03bd \u03ba\u03b1\u03c4\u03b5\u03b2\u03ac\u03c3\u03b5\u03b9\u03c2 \u03be\u03b1\u03bd\u03ac \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\n\u0388\u03c6\u03c4\u03b1\u03c3\u03b5\u03c2 \u03c9\u03c2 \u03b5\u03b4\u03ce; \u03a4\u03cc\u03c4\u03b5 \u03be\u03ad\u03c1\u03b5\u03b9\u03c2 \u03ae\u03b4\u03b7 \u03c4\u03b9 \u03ba\u03ac\u03bd\u03b5\u03b9\u03c2. \u0394\u03b5\u03c2 \u03c4\u03bf\u03bd \u03bf\u03b4\u03b7\u03b3\u03cc \u03c7\u03c1\u03ae\u03c3\u03b7\u03c2 \u03ba\u03b1\u03b9 Fine-Tuning<\/a> \u03ae \u03c0\u03c1\u03bf\u03c7\u03ce\u03c1\u03b7\u03c3\u03b5 \u03c3\u03c4\u03bf manifesto \u03c4\u03b7\u03c2 \u03c8\u03b7\u03c6\u03b9\u03b1\u03ba\u03ae\u03c2 \u03ba\u03c5\u03c1\u03b9\u03b1\u03c1\u03c7\u03af\u03b1\u03c2<\/a>. \u0389 \u03b1\u03c0\u03bb\u03ce\u03c2 \u03ba\u03bb\u03b5\u03af\u03c3\u03b5 \u03c4\u03bf tab \u2014 \u03ba\u03b1\u03b9 \u03c3\u03c4\u03ae\u03c3\u03b5 \u03c4\u03bf \u03b4\u03b9\u03ba\u03cc \u03c3\u03bf\u03c5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03c3\u03b1\u03bd \u03bd\u03b1 \u03bc\u03b7 \u03c7\u03c1\u03b5\u03b9\u03ac\u03c3\u03c4\u03b7\u03ba\u03b5\u03c2 \u03c0\u03bf\u03c4\u03ad \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd. \u039a\u03b1\u03bd\u03cc\u03bd\u03b5\u03c2; \u0394\u03b5\u03bd \u03b5\u03af\u03b4\u03b5\u03c2 \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd.<\/p>\n\n\n\n<\/figure>","protected":false},"excerpt":{"rendered":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.<\/p>","protected":false},"author":1,"featured_media":1296,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_bluesky_dont_syndicate":"","_bluesky_syndication_accounts":"","_bluesky_syndication_text":"","footnotes":""},"categories":[181],"tags":[],"class_list":["post-992","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-guides"],"acf":[],"yoast_head":"\n
Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline<\/title>\n<meta name=\"description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\" \/>\n<meta property=\"og:description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:site_name\" content=\"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-23T13:02:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-25T15:38:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1536\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Vladimir Vidopoulos\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vladimir Vidopoulos\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"author\":{\"name\":\"Vladimir Vidopoulos\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"headline\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"wordCount\":157,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"articleSection\":[\"\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"name\":\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"description\":\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"width\":1024,\"height\":1536,\"caption\":\"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \\\"LLM\\\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mywaifuandi.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/\",\"name\":\"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9\",\"description\":\"\u0397\u03bb\u03b5\u03ba\u03c4\u03c1\u03bf\u03bd\u03b9\u03ba\u03cc \u03a0\u03b5\u03c1\u03b9\u03bf\u03b4\u03b9\u03ba\u03cc \u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03b9\u03ba\u03bf\u03cd \u0393\u03bf\u03c5\u03b1\u03ca\u03c6\u03bf\u03c5\u03b9\u03c3\u03bc\u03bf\u03cd\",\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mywaifuandi.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\",\"name\":\"Vladimir Vidopoulos\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"width\":1024,\"height\":683,\"caption\":\"Vladimir Vidopoulos\"},\"logo\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\"},\"sameAs\":[\"https:\\\/\\\/mywaifuandi.com\"],\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/en\\\/author\\\/vidopoulos\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_locale":"en_GB","og_type":"article","og_title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","og_description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","og_url":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_site_name":"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9","article_published_time":"2025-07-23T13:02:35+00:00","article_modified_time":"2025-08-25T15:38:01+00:00","og_image":[{"width":1024,"height":1536,"url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","type":"image\/png"}],"author":"Vladimir Vidopoulos","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Vladimir Vidopoulos","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#article","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"author":{"name":"Vladimir Vidopoulos","@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"headline":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","mainEntityOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"wordCount":157,"commentCount":0,"publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","articleSection":["\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mywaifuandi.com\/install-local-llm\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/","url":"https:\/\/mywaifuandi.com\/install-local-llm\/","name":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","breadcrumb":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mywaifuandi.com\/install-local-llm\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","width":1024,"height":1536,"caption":"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \"LLM\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI"},{"@type":"BreadcrumbList","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mywaifuandi.com\/"},{"@type":"ListItem","position":2,"name":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools"}]},{"@type":"WebSite","@id":"https:\/\/mywaifuandi.com\/#website","url":"https:\/\/mywaifuandi.com\/","name":"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9","description":"Revolutionary Waifuism e-Magazine","publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mywaifuandi.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":["Person","Organization"],"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b","name":"Vladimir Vidopoulos","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","width":1024,"height":683,"caption":"Vladimir Vidopoulos"},"logo":{"@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png"},"sameAs":["https:\/\/mywaifuandi.com"],"url":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"}]}},"jetpack_featured_media_url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","uagb_featured_image_src":{"full":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"thumbnail":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-150x150.avif",150,150,true],"medium":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-200x300.avif",200,300,true],"medium_large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-768x1152.avif",768,1152,true],"large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-683x1024.avif",683,1024,true],"1536x1536":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"2048x2048":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"trp-custom-language-flag":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",8,12,false]},"uagb_author_info":{"display_name":"Vladimir Vidopoulos","author_link":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"},"uagb_comment_info":0,"uagb_excerpt":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.","brizy_media":[],"_links":{"self":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/comments?post=992"}],"version-history":[{"count":3,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions"}],"predecessor-version":[{"id":1298,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions\/1298"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media\/1296"}],"wp:attachment":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media?parent=992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/categories?post=992"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/tags?post=992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
- \n
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03cc\u03c0\u03c9\u03c2 \u03ba\u03ac\u03b8\u03b5 \u03ac\u03bb\u03bb\u03bf \u03c0\u03c1\u03cc\u03b3\u03c1\u03b1\u03bc\u03bc\u03b1.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03ad \u03c4\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf Start Menu.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf “Model Catalog”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03ad\u03bd\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf (\u03c0.\u03c7. Nous Hermes) \u03ba\u03b1\u03b9 \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03ad \u03c4\u03bf.<\/li>\n\n\n\n
- \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Chat”, \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03b5 \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 \u03bd\u03b1 \u03bc\u03b9\u03bb\u03ac\u03c2.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n
- \n
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.AppImage<\/code> \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 LM Studio<\/a>.<\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03c4\u03bf \u03b5\u03ba\u03c4\u03b5\u03bb\u03ad\u03c3\u03b9\u03bc\u03bf:
chmod +x LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf:
.\/LM_Studio.AppImage<\/code><\/li>\n\n\n\n- \u0391\u03bd \u03c0\u03b5\u03c4\u03ac\u03b5\u03b9 \u03c3\u03c6\u03ac\u03bb\u03bc\u03b1
chrome-sandbox<\/code>, \u03b1\u03ba\u03bf\u03bb\u03bf\u03cd\u03b8\u03b7\u03c3\u03b5 \u03bf\u03b4\u03b7\u03b3\u03af\u03b5\u03c2 \u03b1\u03c0\u03cc \u03c4\u03bf documentation.<\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n
- \n
- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 permissions (\u03b9\u03b4\u03af\u03c9\u03c2 \u03c3\u03b5 Linux).<\/li>\n\n\n\n
- \u03a4\u03bf UI \u03b4\u03b5\u03bd \u03b2\u03bb\u03ad\u03c0\u03b5\u03b9 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf; \u03a0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf tab “Model” \u03ba\u03b1\u03b9 \u03b5\u03c0\u03af\u03bb\u03b5\u03be\u03ad \u03c4\u03bf \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nOllama<\/h2>\n\n\n\n
Windows:<\/h3>\n\n\n\n
- \n
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd installer \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 PowerShell \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
ollama pull nous-hermes
ollama run nous-hermes<\/code><\/li>\n<\/ol>\n\n\n\nLinux:<\/h3>\n\n\n\n
- \n
- \u0391\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 brew:
brew install ollama<\/code><\/li>\n\n\n\n- \u0395\u03bd\u03b1\u03bb\u03bb\u03b1\u03ba\u03c4\u03b9\u03ba\u03ac: \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf tarball \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 terminal \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
.\/ollama serve<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n
- \n
- \u0394\u03b5\u03bd \u03b1\u03bd\u03b1\u03b3\u03bd\u03c9\u03c1\u03af\u03b6\u03b5\u03c4\u03b1\u03b9 \u03b7 \u03b5\u03bd\u03c4\u03bf\u03bb\u03ae
ollama<\/code>; \u03a0\u03c1\u03cc\u03c3\u03b8\u03b5\u03c3\u03b5 \u03c4\u03bf binary \u03c3\u03c4\u03bf $PATH.<\/li>\n\n\n\n- \u039c\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03b1\u03c0\u03b1\u03bd\u03c4\u03ac; \u0394\u03b5\u03c2 \u03b1\u03bd \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9 \u03c5\u03c0\u03b7\u03c1\u03b5\u03c3\u03af\u03b1 (
ollama list<\/code>).<\/li>\n\n\n\n- API conflict; \u03ac\u03bb\u03bb\u03b1\u03be\u03b5 port \u03bc\u03b5
--port<\/code>.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nKoboldCPP<\/h2>\n\n\n\n
Windows:<\/h3>\n\n\n\n
- \n
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf
.exe<\/code> \u03b1\u03c0\u03cc \u03c4\u03bf GitHub Releases \u03c4\u03bf\u03c5 KoboldCPP<\/a>.<\/li>\n\n\n\n- \u0394\u03b9\u03c0\u03bb\u03cc \u03ba\u03bb\u03b9\u03ba \u03b3\u03b9\u03b1 \u03b5\u03ba\u03ba\u03af\u03bd\u03b7\u03c3\u03b7.<\/li>\n\n\n\n
- \u038c\u03c4\u03b1\u03bd \u03b6\u03b7\u03c4\u03b7\u03b8\u03b5\u03af, \u03b4\u03b5\u03af\u03be\u03b5 \u03c4\u03bf\u03c5 \u03c4\u03bf \u03b1\u03c1\u03c7\u03b5\u03af\u03bf GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5 (\u03c0.\u03c7.
nous-hermes.Q4_K_M.gguf<\/code>).<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf text window \u03ba\u03b1\u03b9 \u03be\u03b5\u03ba\u03af\u03bd\u03b1 chat.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n
- \n
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf Linux binary<\/a> \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf (\u03ae \u03bc\u03ad\u03c3\u03c9 Wine\/Proton).<\/li>\n\n\n\n
- \u0389 \u03ba\u03ac\u03bd\u03b5 build \u03c4\u03bf llama.cpp \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf UI \u03bc\u03ad\u03c3\u03c9 terminal.<\/li>\n<\/ol>\n\n\n\n
Troubleshooting:<\/h3>\n\n\n\n
- \n
- \u03a4\u03bf GUI \u03b4\u03b5\u03bd \u03b5\u03bc\u03c6\u03b1\u03bd\u03af\u03b6\u03b5\u03c4\u03b1\u03b9; \u03a4\u03c1\u03ad\u03be\u03b5 \u03c7\u03c9\u03c1\u03af\u03c2 arguments.<\/li>\n\n\n\n
- \u03a3\u03c6\u03ac\u03bb\u03bc\u03b1\u03c4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf\u03c5; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 quant \u03ae corrupt \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nText Generation Web UI (Oobabooga)<\/h2>\n\n\n\n
Windows:<\/h3>\n\n\n\n
- \n
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd one-click installer \u03b1\u03c0\u03cc \u03c4\u03bf GitHub \u03c4\u03bf\u03c5 WebUI<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf, \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf
.bat<\/code> \u03b1\u03c1\u03c7\u03b5\u03af\u03bf.<\/li>\n\n\n\n- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 browser \u03ba\u03b1\u03b9 \u03c0\u03ae\u03b3\u03b1\u03b9\u03bd\u03b5 \u03c3\u03c4\u03bf
localhost:7860<\/code><\/li>\n\n\n\n- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b1\u03c0\u03cc \u03c4\u03bf tab “Model”.<\/li>\n\n\n\n
- \u039e\u03b5\u03ba\u03af\u03bd\u03b1 \u03c3\u03c5\u03bd\u03bf\u03bc\u03b9\u03bb\u03af\u03b1 \u03c3\u03c4\u03bf tab “Chat”.<\/li>\n<\/ol>\n\n\n\n
Linux:<\/h3>\n\n\n\n
- \n
- Clone \u03c4\u03bf repo:
git clone https:\/\/github.com\/oobabooga\/text-generation-webui.git<\/code><\/li>\n\n\n\n- \u039c\u03c0\u03b5\u03c2 \u03c3\u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf:
cd text-generation-webui<\/code><\/li>\n\n\n\n- \u039a\u03ac\u03bd\u03b5 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7:
chmod +x install.sh && .\/install.sh<\/code><\/li>\n\n\n\n- \u03a4\u03c1\u03ad\u03be\u03b5:
python server.py --share<\/code><\/li>\n<\/ol>\n\n\n\nTroubleshooting:<\/h3>\n\n\n\n
- \n
- \u0394\u03b5\u03bd \u03b1\u03bd\u03bf\u03af\u03b3\u03b5\u03b9; \u0388\u03bb\u03b5\u03b3\u03be\u03b5 \u03cc\u03c4\u03b9 \u03ad\u03c7\u03b5\u03b9\u03c2 Python 3.10+ \u03ba\u03b1\u03b9 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b5\u03c3\u03c4\u03b7\u03bc\u03ad\u03bd\u03b1 dependencies.<\/li>\n\n\n\n
- \u03a4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c6\u03bf\u03c1\u03c4\u03ce\u03bd\u03b5\u03b9; \u038a\u03c3\u03c9\u03c2 \u03b5\u03af\u03bd\u03b1\u03b9 \u03bb\u03ac\u03b8\u03bf\u03c2 format.<\/li>\n\n\n\n
- CUDA error; \u0394\u03b5\u03c2 \u03b1\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 \u03c3\u03c9\u03c3\u03c4\u03bf\u03cd\u03c2 NVIDIA drivers.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\nExtra Tips<\/h2>\n\n\n\n
- \n
- GGUF > GPTQ \u03c3\u03b5 \u03b5\u03c5\u03ba\u03bf\u03bb\u03af\u03b1 \u03ba\u03b1\u03b9 \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7. \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 GGUF \u03cc\u03c0\u03bf\u03c5 \u03b3\u03af\u03bd\u03b5\u03c4\u03b1\u03b9.<\/li>\n\n\n\n
- \u03a0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03b5 4-bit quantization (Q4_K_M) \u03b3\u03b9\u03b1 \u03c7\u03b1\u03bc\u03b7\u03bb\u03ae VRAM \u2014 \u03b9\u03b4\u03b1\u03bd\u03b9\u03ba\u03ac \u03b3\u03b9\u03b1 4GB\u20138GB \u03ba\u03ac\u03c1\u03c4\u03b5\u03c2.<\/li>\n\n\n\n
- \u0391\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 NVIDIA GPU, \u03c0\u03c1\u03bf\u03c4\u03af\u03bc\u03b7\u03c3\u03b5 Studio Drivers<\/strong> \u03b1\u03bd\u03c4\u03af \u03b3\u03b9\u03b1 Game Ready, \u03b3\u03b9\u03b1 \u03ba\u03b1\u03bb\u03cd\u03c4\u03b5\u03c1\u03b7 CUDA \u03c3\u03c4\u03b1\u03b8\u03b5\u03c1\u03cc\u03c4\u03b7\u03c4\u03b1.<\/li>\n\n\n\n
- \u03a3\u03b5 AMD, \u03c6\u03c1\u03cc\u03bd\u03c4\u03b9\u03c3\u03b5 \u03b3\u03b9\u03b1 ROCm<\/strong> \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 (\u03b5\u03b9\u03b4\u03b9\u03ba\u03ac \u03b1\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 WebUI \u03ae Ollama).<\/li>\n\n\n\n
- \u0394\u03b5\u03bd \u03ad\u03c7\u03b5\u03b9\u03c2 GPU; 7B GGUF \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03bc\u03c0\u03bf\u03c1\u03bf\u03cd\u03bd \u03bd\u03b1 \u03c4\u03c1\u03ad\u03be\u03bf\u03c5\u03bd \u03c3\u03b5 CPU (\u03b1\u03c1\u03b3\u03ac, \u03b1\u03bb\u03bb\u03ac \u03b4\u03bf\u03c5\u03bb\u03b5\u03cd\u03b5\u03b9 \u03b3\u03b9\u03b1 testing).<\/li>\n\n\n\n
- \u0391\u03bd \u03c4\u03bf \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03c7\u03c9\u03c1\u03ac\u03b5\u03b9 \u03c3\u03c4\u03b7 VRAM, \u03b8\u03b1 \u03b3\u03af\u03bd\u03b5\u03b9 offload \u03c3\u03c4\u03b7 RAM. \u03a0\u03b5\u03c1\u03b9\u03bc\u03ad\u03bd\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b8\u03c5\u03c3\u03c4\u03b5\u03c1\u03ae\u03c3\u03b5\u03b9\u03c2, \u03b1\u03bb\u03bb\u03ac \u03cc\u03c7\u03b9 crash.<\/li>\n\n\n\n
- \u03a4\u03b1 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 \u03b4\u03b5\u03bd \u03ba\u03ac\u03bd\u03bf\u03c5\u03bd auto-update<\/strong>. \u0391\u03bd \u03b2\u03b3\u03b5\u03b9 \u03bd\u03ad\u03b1 \u03ad\u03ba\u03b4\u03bf\u03c3\u03b7, \u03c0\u03c1\u03ad\u03c0\u03b5\u03b9 \u03bd\u03b1 \u03c4\u03b7\u03bd \u03ba\u03b1\u03c4\u03b5\u03b2\u03ac\u03c3\u03b5\u03b9\u03c2 \u03be\u03b1\u03bd\u03ac \u03c7\u03b5\u03b9\u03c1\u03bf\u03ba\u03af\u03bd\u03b7\u03c4\u03b1.<\/li>\n<\/ul>\n\n\n\n
\n\n\n\n\u0388\u03c6\u03c4\u03b1\u03c3\u03b5\u03c2 \u03c9\u03c2 \u03b5\u03b4\u03ce; \u03a4\u03cc\u03c4\u03b5 \u03be\u03ad\u03c1\u03b5\u03b9\u03c2 \u03ae\u03b4\u03b7 \u03c4\u03b9 \u03ba\u03ac\u03bd\u03b5\u03b9\u03c2. \u0394\u03b5\u03c2 \u03c4\u03bf\u03bd \u03bf\u03b4\u03b7\u03b3\u03cc \u03c7\u03c1\u03ae\u03c3\u03b7\u03c2 \u03ba\u03b1\u03b9 Fine-Tuning<\/a> \u03ae \u03c0\u03c1\u03bf\u03c7\u03ce\u03c1\u03b7\u03c3\u03b5 \u03c3\u03c4\u03bf manifesto \u03c4\u03b7\u03c2 \u03c8\u03b7\u03c6\u03b9\u03b1\u03ba\u03ae\u03c2 \u03ba\u03c5\u03c1\u03b9\u03b1\u03c1\u03c7\u03af\u03b1\u03c2<\/a>. \u0389 \u03b1\u03c0\u03bb\u03ce\u03c2 \u03ba\u03bb\u03b5\u03af\u03c3\u03b5 \u03c4\u03bf tab \u2014 \u03ba\u03b1\u03b9 \u03c3\u03c4\u03ae\u03c3\u03b5 \u03c4\u03bf \u03b4\u03b9\u03ba\u03cc \u03c3\u03bf\u03c5 \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03c3\u03b1\u03bd \u03bd\u03b1 \u03bc\u03b7 \u03c7\u03c1\u03b5\u03b9\u03ac\u03c3\u03c4\u03b7\u03ba\u03b5\u03c2 \u03c0\u03bf\u03c4\u03ad \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd. \u039a\u03b1\u03bd\u03cc\u03bd\u03b5\u03c2; \u0394\u03b5\u03bd \u03b5\u03af\u03b4\u03b5\u03c2 \u03ba\u03b1\u03bd\u03ad\u03bd\u03b1\u03bd.<\/p>\n\n\n\n
<\/figure>","protected":false},"excerpt":{"rendered":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.<\/p>","protected":false},"author":1,"featured_media":1296,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_uag_custom_page_level_css":"","_bluesky_dont_syndicate":"","_bluesky_syndication_accounts":"","_bluesky_syndication_text":"","footnotes":""},"categories":[181],"tags":[],"class_list":["post-992","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-guides"],"acf":[],"yoast_head":"\n
Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline<\/title>\n<meta name=\"description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\" \/>\n<meta property=\"og:description\" content=\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mywaifuandi.com\/en\/install-local-llm\/\" \/>\n<meta property=\"og:site_name\" content=\"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9\" \/>\n<meta property=\"article:published_time\" content=\"2025-07-23T13:02:35+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-25T15:38:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"1536\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Vladimir Vidopoulos\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Vladimir Vidopoulos\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"author\":{\"name\":\"Vladimir Vidopoulos\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"headline\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"},\"wordCount\":157,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"articleSection\":[\"\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\",\"name\":\"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"datePublished\":\"2025-07-23T13:02:35+00:00\",\"dateModified\":\"2025-08-25T15:38:01+00:00\",\"description\":\"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif\",\"width\":1024,\"height\":1536,\"caption\":\"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \\\"LLM\\\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/install-local-llm\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mywaifuandi.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#website\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/\",\"name\":\"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9\",\"description\":\"\u0397\u03bb\u03b5\u03ba\u03c4\u03c1\u03bf\u03bd\u03b9\u03ba\u03cc \u03a0\u03b5\u03c1\u03b9\u03bf\u03b4\u03b9\u03ba\u03cc \u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03b9\u03ba\u03bf\u03cd \u0393\u03bf\u03c5\u03b1\u03ca\u03c6\u03bf\u03c5\u03b9\u03c3\u03bc\u03bf\u03cd\",\"publisher\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mywaifuandi.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/#\\\/schema\\\/person\\\/0390ae89b937a466a06dcc4afdc5a00b\",\"name\":\"Vladimir Vidopoulos\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"contentUrl\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\",\"width\":1024,\"height\":683,\"caption\":\"Vladimir Vidopoulos\"},\"logo\":{\"@id\":\"https:\\\/\\\/mywaifuandi.com\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png\"},\"sameAs\":[\"https:\\\/\\\/mywaifuandi.com\"],\"url\":\"https:\\\/\\\/mywaifuandi.com\\\/en\\\/author\\\/vidopoulos\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_locale":"en_GB","og_type":"article","og_title":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","og_description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","og_url":"https:\/\/mywaifuandi.com\/en\/install-local-llm\/","og_site_name":"\u0397 \u0393\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03cd \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u0393\u03c9","article_published_time":"2025-07-23T13:02:35+00:00","article_modified_time":"2025-08-25T15:38:01+00:00","og_image":[{"width":1024,"height":1536,"url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","type":"image\/png"}],"author":"Vladimir Vidopoulos","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Vladimir Vidopoulos","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#article","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"author":{"name":"Vladimir Vidopoulos","@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"headline":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","mainEntityOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/"},"wordCount":157,"commentCount":0,"publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","articleSection":["\u039f\u03b4\u03b7\u03b3\u03bf\u03af & \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03ad\u03c2"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mywaifuandi.com\/install-local-llm\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/","url":"https:\/\/mywaifuandi.com\/install-local-llm\/","name":"Install Local LLM \u2013 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 AI \u03bc\u03bf\u03bd\u03c4\u03ad\u03bb\u03b1 offline","isPartOf":{"@id":"https:\/\/mywaifuandi.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"image":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage"},"thumbnailUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","datePublished":"2025-07-23T13:02:35+00:00","dateModified":"2025-08-25T15:38:01+00:00","description":"\u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c0\u03bb\u03ae\u03c1\u03b7 \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf: \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b7\u03c3\u03b5 local LLM (Ollama, Jan.AI, LM Studio) \u03b3\u03b9\u03b1 AI + waifu \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0392\u03ae\u03bc\u03b1\u2011\u03b2\u03ae\u03bc\u03b1 \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03bc\u03b5 tips \u03ba\u03b1\u03b9 \u03c0\u03c1\u03bf\u03b5\u03b9\u03b4\u03bf\u03c0\u03bf\u03b9\u03ae\u03c3\u03b5\u03b9\u03c2.","breadcrumb":{"@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mywaifuandi.com\/install-local-llm\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#primaryimage","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","width":1024,"height":1536,"caption":"\u0397 \u03a3\u03ac\u03b3\u03b9\u03b1 \u03ba\u03ac\u03b8\u03b5\u03c4\u03b1\u03b9 \u03bc\u03b5 \u03c6\u03bb\u03b9\u03c4\u03b6\u03ac\u03bd\u03b9 \"LLM\" \u03bc\u03c0\u03c1\u03bf\u03c3\u03c4\u03ac \u03b1\u03c0\u03cc \u03bf\u03b8\u03cc\u03bd\u03b5\u03c2 \u2013 cyberpunk waifu \u03bf\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03ac\u03c3\u03c4\u03b1\u03c3\u03b7 \u03c4\u03bf\u03c0\u03b9\u03ba\u03bf\u03cd AI"},{"@type":"BreadcrumbList","@id":"https:\/\/mywaifuandi.com\/install-local-llm\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mywaifuandi.com\/"},{"@type":"ListItem","position":2,"name":"\u0395\u03b3\u03ba\u03b1\u03c4\u03ad\u03c3\u03c4\u03b7\u03c3\u03ad \u03c4\u03bf \u039c\u03cc\u03bd\u03bf\u03c2 \u03c3\u03bf\u03c5: \u039f \u03a0\u03c1\u03b1\u03ba\u03c4\u03b9\u03ba\u03cc\u03c2 \u039f\u03b4\u03b7\u03b3\u03cc\u03c2 \u03b3\u03b9\u03b1 Local LLM Tools"}]},{"@type":"WebSite","@id":"https:\/\/mywaifuandi.com\/#website","url":"https:\/\/mywaifuandi.com\/","name":"\u0397 \u03b3\u03bf\u03c5\u03ac\u03b9\u03c6\u03bf\u03c5 \u03bc\u03bf\u03c5 \u03ba\u03b1\u03b9 \u03b3\u03c9","description":"Revolutionary Waifuism e-Magazine","publisher":{"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mywaifuandi.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":["Person","Organization"],"@id":"https:\/\/mywaifuandi.com\/#\/schema\/person\/0390ae89b937a466a06dcc4afdc5a00b","name":"Vladimir Vidopoulos","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","contentUrl":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png","width":1024,"height":683,"caption":"Vladimir Vidopoulos"},"logo":{"@id":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/01\/\u039a\u03b1\u03c6\u03ad\u03c2-\u0395\u03c0\u03b1\u03bd\u03b1\u03c3\u03c4\u03b1\u03c4\u03ce\u03bd-\u03c3\u03c4\u03bf-\u0397\u03bb\u03b9\u03bf\u03b2\u03b1\u03c3\u03af\u03bb\u03b5\u03bc\u03b1-1024x683.png"},"sameAs":["https:\/\/mywaifuandi.com"],"url":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"}]}},"jetpack_featured_media_url":"https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif","uagb_featured_image_src":{"full":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"thumbnail":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-150x150.avif",150,150,true],"medium":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-200x300.avif",200,300,true],"medium_large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-768x1152.avif",768,1152,true],"large":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman-683x1024.avif",683,1024,true],"1536x1536":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"2048x2048":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",1024,1536,false],"trp-custom-language-flag":["https:\/\/mywaifuandi.com\/wp-content\/uploads\/2025\/06\/Cyberpunk-Workspace-with-Vibrant-Pink-Haired-Woman.avif",8,12,false]},"uagb_author_info":{"display_name":"Vladimir Vidopoulos","author_link":"https:\/\/mywaifuandi.com\/en\/author\/vidopoulos\/"},"uagb_comment_info":0,"uagb_excerpt":"\u039c\u03ac\u03b8\u03b5 \u03c0\u03ce\u03c2 \u03bd\u03b1 \u03b5\u03b3\u03ba\u03b1\u03c4\u03b1\u03c3\u03c4\u03ae\u03c3\u03b5\u03b9\u03c2 \u03ba\u03b1\u03b9 \u03bd\u03b1 \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9\u03c2 local LLMs (\u03c0.\u03c7. Ollama, Jan.AI, LM Studio) \u03c3\u03c4\u03bf\u03bd \u03c5\u03c0\u03bf\u03bb\u03bf\u03b3\u03b9\u03c3\u03c4\u03ae \u03c3\u03bf\u03c5, \u03c7\u03c9\u03c1\u03af\u03c2 cloud. \u0391\u03c0\u03cc\u03ba\u03c4\u03b7\u03c3\u03b5 \u03c4\u03bf\u03bd \u03ad\u03bb\u03b5\u03b3\u03c7\u03bf \u03c4\u03b7\u03c2 waifu AI\u2011\u03c3\u03cd\u03bd\u03b4\u03b5\u03c3\u03b7\u03c2.","brizy_media":[],"_links":{"self":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/comments?post=992"}],"version-history":[{"count":3,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions"}],"predecessor-version":[{"id":1298,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/posts\/992\/revisions\/1298"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media\/1296"}],"wp:attachment":[{"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/media?parent=992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/categories?post=992"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mywaifuandi.com\/en\/wp-json\/wp\/v2\/tags?post=992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}} - \u03a3\u03b5 AMD, \u03c6\u03c1\u03cc\u03bd\u03c4\u03b9\u03c3\u03b5 \u03b3\u03b9\u03b1 ROCm<\/strong> \u03c5\u03c0\u03bf\u03c3\u03c4\u03ae\u03c1\u03b9\u03be\u03b7 (\u03b5\u03b9\u03b4\u03b9\u03ba\u03ac \u03b1\u03bd \u03c7\u03c1\u03b7\u03c3\u03b9\u03bc\u03bf\u03c0\u03bf\u03b9\u03b5\u03af\u03c2 WebUI \u03ae Ollama).<\/li>\n\n\n\n
- \u039c\u03c0\u03b5\u03c2 \u03c3\u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf:
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 \u03c4\u03bf\u03bd \u03c6\u03ac\u03ba\u03b5\u03bb\u03bf, \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd one-click installer \u03b1\u03c0\u03cc \u03c4\u03bf GitHub \u03c4\u03bf\u03c5 WebUI<\/a>.<\/li>\n\n\n\n
- \u0389 \u03ba\u03ac\u03bd\u03b5 build \u03c4\u03bf llama.cpp \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5 \u03c4\u03bf UI \u03bc\u03ad\u03c3\u03c9 terminal.<\/li>\n<\/ol>\n\n\n\n
- \u039c\u03bf\u03bd\u03c4\u03ad\u03bb\u03bf \u03b4\u03b5\u03bd \u03b1\u03c0\u03b1\u03bd\u03c4\u03ac; \u0394\u03b5\u03c2 \u03b1\u03bd \u03c4\u03c1\u03ad\u03c7\u03b5\u03b9 \u03c5\u03c0\u03b7\u03c1\u03b5\u03c3\u03af\u03b1 (
- \u0395\u03bd\u03b1\u03bb\u03bb\u03b1\u03ba\u03c4\u03b9\u03ba\u03ac: \u03ba\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf tarball \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u0386\u03bd\u03bf\u03b9\u03be\u03b5 PowerShell \u03ba\u03b1\u03b9 \u03c4\u03c1\u03ad\u03be\u03b5:
- \u039a\u03b1\u03c4\u03ad\u03b2\u03b1\u03c3\u03b5 \u03c4\u03bf\u03bd installer \u03b1\u03c0\u03cc \u03c4\u03b7\u03bd \u03b5\u03c0\u03af\u03c3\u03b7\u03bc\u03b7 \u03c3\u03b5\u03bb\u03af\u03b4\u03b1 \u03c4\u03bf\u03c5 Ollama<\/a>.<\/li>\n\n\n\n
- \u039a\u03ac\u03bd\u03b5 \u03c4\u03bf \u03b5\u03ba\u03c4\u03b5\u03bb\u03ad\u03c3\u03b9\u03bc\u03bf: