FAQ
Energy
Energy is what you spend on replies.
Each reply costs Energy. How much depends on how much the model reads — your story's setup plus the chat so far — and how much it writes. Bigger models cost more for the same amount.
The model rereads the chat before every reply. The longer the chat, the more it reads each time.
The model provider keeps what the model just read for a while, and rereading it from there is much cheaper. Claude models keep it for 1 hour; for other models it depends on the provider, usually a few minutes. Come back after that, and your next reply pays full price once to read the whole chat again. After that, it's cheap again.
- The longer the chat, the bigger that one reply. Lowering “Story notes take over at” keeps long chats shorter, so it costs less.
- Switching models, or editing the story or your persona, makes the next reply pay full price once too.
- Keep replying in one sitting.
- Lower “Story notes take over at” in Settings. Older parts of a long chat turn into Story notes sooner, so the model has less to read.
- Pick a lighter model.
Story notes
How the model keeps up with a long chat.
A running summary of your chat: what happened, who's who, and what's still unresolved. They update in the background as you chat, and you can read and edit them in the chat's Context window panel.
The model rereads your chat before every reply. Once a chat reaches this length, it stops rereading the older messages and reads your Story notes in their place, plus your latest messages (about 10k tokens) word-for-word. Your chat itself doesn't change.
- Lower: each reply reads less, so it costs less, but older details survive only as notes.
- Higher, up to Max (each model's own limit): more of the story stays word-for-word, and each reply costs more as the chat grows.
- It's one value for all your chats. Change it in Settings or in a chat's Context window panel.
Energy simulator
A made-up chat that's already 150 messages long. Send, continue, take a break, switch models or change when Story notes take over, and watch what each reply costs. Rates are each model's real ones; message sizes are typical, so your own chats will differ.
Loading…