Kolibri‑1 now runs in llama.cpp: unlock 78 B‑parameter, bilingual MoE reasoning with 3.46 B active params, up to 1M‑token context – ready for local inference.
New open‑source LLM frontend Otaku lets writers create long‑form stories with a web or terminal UI, character library, multimodal support, and context‑summary tech.
DeepSeek V4.1 Flash benchmarks revealed real‑world performance gaps and memory limits on NVIDIA DGX Spark, showing how tuning and NVMe streaming can unlock faster, more stable inference.
Discover how llama.cpp’s new tensor split & MTP upgrades push local LLMs like Gemma 4 and Qwen 3.8 to 60–70 tokens/sec, unlock multimodal vision‑language and 200k‑token context, and shift AI from cloud to consumer hardware.
Explore how Alibaba’s Qwen 3.6 27B model powers custom autonomous agents, sub‑agents, and MCP tools, revealing the rise of Chinese LLMs in open‑source AI development.