New Tool for LLM Token Visualization and Control Released
A new interactive tool designed for the granular inspection and manipulation of Large Language Model (LLM) outputs has been released. The tool, titled “onPanda” (On-Policy Alignment Data Annotator), allows users to interact with models at the token level, providing a mechanism for engineers and power users to steer model behavior and perform data annotation.
According to developer documentation shared on Reddit, the tool’s core functionality revolves around a “hover and edit” loop. Users can hover over specific tokens to view alternatives or edit the model’s output directly, including reasoning steps and tool calls. The interface utilizes a tree structure to record branching histories, allowing for comparative prompt engineering and model inspection.
Technical Capabilities and Integration
The onPanda tool supports multi-modal inputs, including audio, video, and images. It is designed to connect with Model Context Protocol (MCP) servers to execute tasks in real-world environments and can integrate with existing harnesses such as Claude Code, Codex, and OpenCode to compare system prompts, memory mechanisms, and tool sets.
A notable feature of the release is “browser-agent,” an agentic component that operates within a user’s browser without requiring local installation. This agent utilizes the browser as a harness to provide JavaScript execution, local file access, and multimedia I/O.
The developer, who has been building the project since September 2024, has made the source code available for self-hosting via GitHub. While the tool is positioned as a resource for the r/LocalLLaMA community, independent verification of its performance benchmarks or efficiency compared to established industry standards has not yet been established.
Community Reception and Technical Context
Initial feedback from the developer community on Reddit has been mixed regarding the tool’s novelty. Some users compared the interface to “J-space,” a concept previously discussed by Anthropic, while others noted that similar functionality exists in tools like SillyTavern, though they pointed out that accessing logprobs remains a challenge with many high-end models.
Technical discussions on the platform highlighted that the tool functions through manual sampling. Commenters noted that because LLMs output probabilities for subsequent tokens, the tool’s ability to “branch” is a matter of human-driven selection and rollback rather than a fundamental change to the underlying model architecture.
The release comes amid a broader landscape of rapid AI development and competition. While onPanda focuses on the developer experience and model alignment, the wider industry continues to see significant movement, including recent reports of Chinese AI models, such as those from Alibaba and DeepSeek, competing closely with Western counterparts in terms of token throughput and training efficiency.