Unsloth has announced the release of Unsloth Desktop, an open-source application designed to allow users to run and train large language models (LLMs) locally. According to a post on the Reddit community r/LocalLlama, the software is compatible with macOS, Windows, and Linux, and supports various formats including MLX, GGUF, and diffusion-based image and video models.
Technical Specifications and Performance Claims
The developers claim that the application enables model training that is 2× faster while utilizing 70% less Video Random Access Memory (VRAM) compared to previous methods. The software is designed to support multi-GPU setups across hardware from NVIDIA, AMD, Intel, and Apple.
Unsloth Desktop includes several integrated features, such as private web search, deep research capabilities, Retrieval-Augmented Generation (RAG), and Model Context Protocol (MCP) support. It also allows for model exports in NVFP4 and GGUF formats. Users can connect the application to Claude Code and Codex to interact with local LLMs; the developers state this configuration can be 50% more accurate due to the implementation of sandboxed code execution and self-healing tool calls.
The application provides an OpenAI-compatible API, allowing users to interface Unsloth with cloud-based models from OpenAI and Anthropic. For remote deployment, the developers noted that users can securely access LLMs via Cloudflare HTTPS. Unsloth has stated that the application does not collect telemetry or user data.
Ecosystem and Integration
The release arrives as the local AI landscape sees increased interest in decentralized infrastructure. In a separate development shared on Reddit, an independent developer introduced “Redstart,” an experimental local AI server project built around llama.cpp. While Unsloth focuses on a consumer-facing desktop application, the Redstart project aims to bundle enterprise-scale tools—such as model management, client discovery, and tool permission enforcement—into a single machine. The Redstart server is currently in an alpha stage and is limited to Windows.
Unsloth Desktop is currently available for download via the company’s website and GitHub. While the software is functional, developers on Reddit noted that the desktop mode is still in a beta phase.