Skip to main content

in reply to ☆ Yσɠƚԋσʂ ☆

Sorry but what kind of specs are needed to run something like this? Is it more or less demanding than a 8B moderately quantised LLM?
in reply to loathsome dongeater

yeah the models are tiny, just 2b huggingface.co/collections/Qwe…