Local AI

Local AI

What Changed in Strata Updates: Should 12GB and 16GB GeForce Users Upgrade?

Strata changes up to 0.2.10 for 12GB/16GB GeForce on Windows: upgrading, changed defaults and how to revert, and 0.1.41 vs 0.1.45 speed on RTX 5080/5060 Ti.
2026.11.06 AI Hardware Zukan
Local AILocal LLMs
Local AI

Using a Second GPU in Strata: Layer Split vs. Helper Cache on RTX 5080 + 5060 Ti

Layer split vs. helper cache in Strata 0.1.39–0.1.41 on an RTX 5080 with an OCuLink RTX 5060 Ti. Every setup tried had slower prompt processing than one card.
2026.11.06 AI Hardware Zukan
Local AILocal LLMs
GPUs & Graphics Cards

Why Oculink GPU Fails in Ollama: Dual Setup & Scheduling

Fix RTX 5060 Ti recognition in Ollama via Oculink. Step-by-step guide using CUDA_VISIBLE_DEVICES and OLLAMA_SCHED_SPREAD for RTX 5080 + RTX 5060 Ti dual-GPU setups.
2026.06.15 AI Hardware Zukan
GPUs & Graphics CardsLocal AIMini PCs & Small Form Factor PCs
Local AI

Qwen3.6-35B-A3B: Local MoE Multimodal LLM Guide

Run Qwen3.6-35B-A3B locally on RTX 5090. Explore specs, FP8 model size, and multimodal capabilities of this efficient MoE LLM.
2026.06.13 AI Hardware Zukan
Local AI
GPUs & Graphics Cards

Why RAM Exhausts When Running Gemma 4 with llama.cpp

Loaded a model on a GPU with 32GB VRAM, yet the process crashed after just a few prompts. The culprit wasn't low VRAM but system RAM exhaustion.
2026.05.28 AI Hardware Zukan
GPUs & Graphics CardsLocal AILocal LLMs