Stheno 8B 32K is a creative writing/roleplay model from Sao10k. It was trained at 8K context, then expanded to 32K context.

Compared to older Stheno version, this model is trained on:

• 2x the amount of creative writing samples
• Cleaned up roleplaying samples
• Fewer low quality samples