Getting Started with Pygmalion
I recommend using the Kobold Colab.
I also recommend using TavernAI for a better UI.
Here is a guide for using the two together: TavernAI + Kobold Guide
Guide below was made for the old Colab which is now no longer supported, but the same concepts apply to the Kobold version.
Getting Good Results
With the current state of Pygmalion (6B), it can take a bit of fiddling to get the best results from the model. There are a few things you can do to ensure you have the best experience possible:
- You get out what you put in: One of the most common complaints I see about Pygmalion is it giving short, uninteresting messages. You can all but eliminate this issue by “putting in the work” early in the chat. The first several messages are crucial for setting the tone, response style, etc. of the character. Any AI language model will tend to “mirror” the user’s writing style early on in the conversation (when there is less “data” for it to go on). What this means is if you want long responses with detailed narration, you need to show it this in your initial messages. After a dozen or so messages, you don’t need to try as hard, as the AI will pick up on the pattern, but you DO need to put in the effort early.
- Generation settings: Your mileage may very, but with the “standard” (non-experimental) version of Pygmalion 6B, I find the best temperature setting to be in the 0.5 – 0.6 range. For repetition penalty, the default setting seems to be fine, but anything 1.01 – 1.1 seems to work. According to the developers, repetition penalty over 1.2 should be avoided.
- Your name is “You”: It has been suggested that, for best results, your name in the Pygmalion chat client should be set as “You.” I have indeed found this to be the case. It may be because “you” are often referenced in character personas (i.e. “Bob is friends with you.”) Whatever the reason is, I do recommend setting your name to “You.”
For more, check out this page: https://rentry.org/PygTips