Local LLMs

Local LLMs

Strata Models and Memory Requirements: Which to Pick on a 12GB or 16GB VRAM GPU

Choose Qwen3.8-Flash-Next, Gyro, Coder or DeepSeek V4.1-Flash on Strata by system RAM and 12GB/16GB VRAM. Includes DeepSeek's memory and disk needs and second-GPU results.
2026.11.06 AI Hardware Zukan
Local LLMs
Local AI

What Changed in Strata Updates: Should 12GB and 16GB GeForce Users Upgrade?

Strata changes up to 0.2.10 for 12GB/16GB GeForce on Windows: upgrading, changed defaults and how to revert, and 0.1.41 vs 0.1.45 speed on RTX 5080/5060 Ti.
2026.11.06 AI Hardware Zukan
Local AILocal LLMs
Local AI

Using a Second GPU in Strata: Layer Split vs. Helper Cache on RTX 5080 + 5060 Ti

Layer split vs. helper cache in Strata 0.1.39–0.1.41 on an RTX 5080 with an OCuLink RTX 5060 Ti. Every setup tried had slower prompt processing than one card.
2026.11.06 AI Hardware Zukan
Local AILocal LLMs
GPUs & Graphics Cards

Why RAM Exhausts When Running Gemma 4 with llama.cpp

Loaded a model on a GPU with 32GB VRAM, yet the process crashed after just a few prompts. The culprit wasn't low VRAM but system RAM exhaustion.
2026.05.28 AI Hardware Zukan
GPUs & Graphics CardsLocal AILocal LLMs