Local AI Homelab
Windows-native ROG Ally edge AI node. Browser talks to local Ollama through an SSH tunnel over Tailscale.
Run order
- On the ROG Ally, open PowerShell as Administrator.
- Scaffold the 4TB vault:
./scripts/scaffold-vault.ps1 -Path D:\ai-vault - Install/configure Ollama and pull qwen:
./scripts/setup-ollama.ps1 - On the main laptop, open the tunnel:
./scripts/start-tunnel.ps1 -RogHost <ROG_TAILSCALE_IP> -User <ROG_WINDOWS_USER> - Start the UI:
cd web-uidocker compose up -d - Open
http://localhost:3000orhttps://homelab.himanshulade.com.
Chain
browser -> localhost:11434 -> SSH tunnel -> Tailscale -> ROG Ally -> Ollama
Notes
- ROG Ally stays Windows-only. No WSL dependency.
- Ollama models are stored under
D:\ai-vault\models\ollama. - Allow inbound TCP
11434in Windows Firewall on the ROG Ally. - nginx config expects Cloudflare proxy with Full (strict) TLS.