https://xylight.dev/

Developer of Photon

Main account @[email protected]

  • 4 Posts
  • 13 Comments
Joined 1 year ago
cake
Cake day: June 9th, 2025

help-circle





  • Xylight@feddit.onlinetoLemmy Shitpost@lemmy.world•u WoT m8
    link
    fedilink
    English
    arrow-up
    6
    ·
    10 months ago

    Qwen3 30b a3b, for example, is brilliant for its size and i can run it on my 8 GB VRAM + 32 GB RAM system at like 20 tokens per second. For lower powered systems, Qwen3 4b + a search tool is also insanely great for its size and can fit in less than 3 GB of RAM or VRAM at Q5 quantization