General Chat🔧 Supports Agent Tools

Qwen 2.5 (0.5B)

onnx-community/Qwen2.5-0.5B-Instruct

Overview

A highly capable, extremely lightweight model. An excellent balance of size and intelligence for fast browser inference.

Parameters

0.5B

Quantization

q4

Footprint

~350 MB

Context Window

128K tokens

Browser Requirements & Caching

When you initiate a chat session using this model, your browser will download the model files directly from Hugging Face. The model will then be cached locally in your browser's Cache Storage API so subsequent loads are instant and run directly in the browser.

Tip: Ensure you have at least 525 MB of free disk space for smooth initialization.