TurboQuant: Diagram Generation with Excalidraw

TurboQuant offers a unique solution for generating diagrams directly in your browser using Excalidraw. By leveraging the Gemma 4 E2B model, diagrams can be described and generated efficiently, but this functionality is currently limited to Desktop Chrome 134+ due to its reliance on WebGPU subgroups and significant RAM requirements. The TurboQuant algorithm, which combines polar and QJL methods, is designed to compress the KV cache by approximately 2.4 times, allowing for longer conversations to fit into GPU memory. This demo showcases the implementation of TurboQuant in WGSL compute shaders, enabling GPU execution at speeds of over 30 tokens per second. Additionally, the turboquant-wasm npm package provides a CPU-side solution using WASM+SIMD for vector searches.