-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changing character sprite based on emotion of reply #2
Comments
I have personally tested this model: https://huggingface.co/michellejieli/emotion_text_classifier that was doing pretty good. The thing is that to do that, it would need people to add a lot of sprites themselves which can be a little problematic for people without designing abilities. Maybe with a diffusion model generating the sprites itself but it would take some time to add and I don't plan on maintaining it for a long time. |
If it's not too difficult, could you implement it in a new release? I think you can make it optional, people who can't insert sprites can just use one default picture. Actually this guy https://github.com/kwaroran/RisuAI made it possible to change expressions, but the chatbot either repeats itself a lot or says nothing in my case, so I can't use it. Maybe you can join force? He's the only dev ower there. |
This could be implemented by using models such as https://huggingface.co/datasets/dair-ai/emotion
The output of chatbot is used as input of the emotion model. Based on string output of emotion model, the corresponding character sprite is used (e.g. anger -> anger.png)
The text was updated successfully, but these errors were encountered: