Local LLM Setup on Windows: Complete Step-by-Step Guide (Ollama, LM Studio, GPT4All) 2026

You use Windows and want to run local AI models. Which tool to choose? How to configure GPU? What about storage?

💡 What You Will Learn

You use Windows and want to run local AI models. Which tool to choose? How to configure GPU? What about storage?

📜 Table of Contents

• InstallationOllama
• Summary

1. Visit ollama.com/download, click Windows download
2. Double-click OllamaSetup.exe, follow prompts
3. After install, run in terminal: ollama --version 

# CMDPowerShell
ollama pull qwen2.5:7b
ollama run qwen2.5:7b

①  lmstudio.ai → Download for Windows
② 200MB
③ GPUNVIDIA CUDA / AMD ROCm

① "Search" →  qwen2.5
② GGUF → Download
③  →  → "Load Model"
④ Conversation

①  gpt4all.io → Windows
② Installation/Setup → Auto/Automatic
③ Conversation

Windows
├─  / API → Ollama ✅
├─  /  → LM Studio ✅
├─  /  → GPT4All ✅
└─  → Ollama + VS Code Continue ✅

InstallationOllama

ollama --version
# ollama version 0.30.5

# 

# 8GB → 
ollama pull qwen2.5:7b
# 4.5GB | 

# 16GB → 
ollama pull qwen2.5:14b
# 9GB | 

# 32GB → 
ollama pull llama3.1:8b
ollama pull qwen2.5:32b
# 18GB | 

ollama run qwen2.5:7b

# GPU
ollama run qwen2.5:7b
# ConversationGPU
# OllamaGPU

# ollamaLogging
# Windows: %LOCALAPPDATA%\ollama\server.log

|:---:|:------:|:-------:| | RTX 3060 12GB | 25-35 tok/s | 15-20 tok/s | | RTX 4060 8GB | 20-30 tok/s | 12-18 tok/s | | RTX 4090 24GB | 50-70 tok/s | 30-45 tok/s | || 5-8 tok/s | 3-5 tok/s |

① Ollama ROCmollama.comROCm
② AMD ROCmrocm.docs.amd.com
③ OllamaROCm

# CPUConfigurationOllamaAuto/AutomaticCPU
ollama run qwen2.5:7b

# 
setx OLLAMA_MODELS D:\ollama\models

# CMD
# 
ollama pull qwen2.5:7b

# 
sc query ollama

# Start
net start ollama

# 
net stop ollama

# Ollama
setx OLLAMA_HOST 0.0.0.0

① VS Code →  → "Continue"
② Continue
③ Ollama

{
  "models": [
    {
      "title": "Ollama Local",
      "provider": "ollama",
      "model": "qwen2.5-coder:7b"
    }
  ],
  "tabAutocompleteModel": {
    "title": "Qwen Coder 7B",
    "provider": "ollama",
    "model": "qwen2.5-coder:7b"
  }
}

□  Ollama / LM Studio
□ 8GB→7B, 16GB→14B, 32GB+→32B
□  ollama run qwen2.5:7b
□ COLLAMA_MODELS
□ →VS Code + Continue
□ →Open WebUIDocker

Summary

Ollama / LM Studio / GPT4All
Qwen2.5:7b8GB / Qwen2.5:14b16GB
NVIDIA CUDA / AMD ROCm / CPU
VS Code + Continue / API / Open WebUI
 +