• BananaOnionJuice@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    5
    ·
    11 months ago

    I finally found some offline ones jan.ai and koboldcpp you download the GGUF model and run everything from your own pc, it just takes a lot of CPU and GPU for it to work acceptable, my setup can’t really manage much more than a model with 7B.