Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If anyone is looking for a cloud option (e.g. don't have the hardware, just want to pay someone else to handle the compute while still writing about generally uncensored things like a violent RPG adventure or something explicit in the adult sense), then I guess NovelAI could fit the bill: https://novelai.net/

I guess most people focus on their image generation which is pretty cool for anime characters and things like placeholder art (say, in gamedev), but their text generation options are also pretty nice and can be used either through their web UI, or something like SillyTavern: https://github.com/SillyTavern/SillyTavern

If you do want to run something locally and have the hardware, I think people discuss models in a variety of places, like https://old.reddit.com/r/LocalLLaMA/comments/16425mk/best_ns... (quick search, was curious, NSFW discussion) and it seems like there's plenty of models on HuggingFace, though I haven't particularly looked into them.

I will absolutely say that even when I was trying to run a general purpose chatbot LLM, it was kind of impressive how quickly things are moving ahead in regards to LLMs: all of these GGML, GGUF and other formats, being able to use even consumer GPUs (though I couldn't get ROCm working with my RX580) and experimental attempts like using Vulkan.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: