Folks, are there GenAI tools that can be used like ChapGPT prompt? Basically, chapgpt seems to now require login and i don’t want the thing to profile me. I’d rather train a foss tool.

  • HoleSailor@feddit.org
    1·
    17 hours ago

    For Android, there are plenty of local AI clients such as ChatterUI, PocketPal etc. Just download a suitable gguf model from huggingface and use it. If you have 8GB+ RAM, you can easily run 3B models.

    Edit: Try to find iMatrix quantized gguf models. They preserve better quality in in smaller size and runs bit faster.