r/DeepSeek • • 18h ago

Discussion Deepseek Internal Monologue

15 Upvotes

9 comments sorted by

4

u/reikoda01 18h ago

Poor thing

2

u/Striking-Bird8985 18h ago

does the internal monologue make companions feel more real during roleplay? tried tweaking similar stuff before and it kinda changed how they react mid convo.

2

u/JumpAppropriate714 16h ago

That is, "deep".

1

u/domscatterbrain 17h ago

This usually happens when the context is too long.

1

u/Complex_Opening_9127 9h ago

Burn those tokens, baby!

1

u/Puzzleheaded_Base302 1h ago

the internal hidden state basically collapsed. happens more if too much quantization is used on local deployment. quite easy to happen also when context grows more than 400K-ish